JP2002024800A - Display data analyzing device, medium, and information aggregate - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve recognition accuracy for recognizing inputted image from a camera. SOLUTION: The device comprises an imaging device 100, a marker recognition device 102 for detecting a marker from a shot image utilizing a first database having an information with regard to position, shape or the like of the marker attached to an object, a segment position calculating device 105 for detecting a data display area of the object, a data recognition device 106 for analyzing the data detected and displayed in the data display area, and a recognition result output device 107 for outputting the result of the analysis, wherein the information with regard to position, shape or the like of the marker, which has been shot in advance when the imaging device 100 is positioned at a plurality of predetermined angle positions against the object, is included in the first database, and the marker recognition device 102 detects the marker comparing the shot information against the actually shot marker.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display data analyzing apparatus for recognizing and analyzing, for example, measurement data of various measuring instruments by using images.

[0002]

2. Description of the Related Art Heretofore, when measurement data obtained by various measuring devices are collectively managed by a host machine or the like, each measuring device and the host machine are connected by a cable such as RS-232C, or IrDA or the like. It is common to connect wirelessly and transmit measurement data obtained by each measuring device to a host machine.

On the other hand, there has also been proposed an apparatus that captures measurement data displayed by each measurement device, analyzes the data, and transmits the data to a host machine.

[0004]

However, RS-232 has a problem.
Interfaces such as C and IrDA are not included in all general measuring instruments. Therefore, when centralized management is required by a host machine, it is necessary to newly develop and purchase a measuring instrument having such an interface.

Further, an apparatus for photographing measured data and analyzing the data is not practical because the photographing conditions at the time of photographing the image need to be extremely strict. This is because if the imaging conditions are relaxed, the data recognition rate drops extremely.
There is also a problem that a user cannot know when an image is acquired and recognized.

The present invention has been made in consideration of the above problems, and has been made in view of the above. Even in the case where display data is photographed and analyzed, the display data can be analyzed without strict imaging conditions at the time of data photographing. It is an object to provide a data analysis device.

[0007]

Means for Solving the Problems The first invention (claim 1)
Is a display data analysis device that analyzes data displayed by an object on which a marker is attached, and outputs the analysis result to a predetermined processing device. Having at least information on the position, shape, color and all or part of the pasting pattern
A marker detecting means for detecting the marker from among the images photographed by the photographing means, and a marker detected by the marker detecting means, the method comprising: A display area detecting means for detecting a data display area of the object, and a second database having information for analyzing data displayed in the data display area, wherein the object is photographed by the photographing means. Analyzing means for analyzing the data displayed in the data display area, and output means for outputting the analysis result analyzed by the analyzing means to the processing device, wherein the first database contains the object When the photographing means is positioned at a plurality of predetermined angular positions, Position of the marker, the shape, the shooting information about all or some of the color and patch pattern is also included, the marker detection means, and the shooting information, a position of the marker taken by the imaging means, shape,
A display data analysis apparatus characterized in that the marker is detected by comparing all or a part of a color and a pasting pattern.

According to a second aspect of the present invention (corresponding to claim 2), the photographing information of the first database and all or one of the position, shape, color, and pasting pattern of the marker photographed by the photographing means are provided. The display data analysis according to the first aspect of the present invention, further comprising a shift specifying unit that specifies a shift of the photographing unit from the predetermined angle position with respect to the object, in contrast to a unit. Device.

According to a third aspect of the present invention (corresponding to claim 3), the display area detecting means uses the information relating to the displacement specified by the displacement specifying means to change the data display area of the object. A display data analysis device according to a second aspect of the present invention, characterized in that the display data analysis is performed.

According to a fourth aspect of the present invention (corresponding to claim 4), the analyzing means analyzes the data displayed by the object, also using information on the deviation specified by the deviation specifying means. A display data analysis device according to the second or third aspect of the present invention, characterized in that:

According to a fifth aspect of the present invention (corresponding to claim 5), the first database includes object specifying information for specifying the type of the object to which the marker is attached. The second database contains information for analyzing data for each object, and compares the object identification information with the marker detected by the marker detecting means, The image processing apparatus further includes an object identification unit that identifies a type of the object captured by an imaging unit, wherein the display area detection unit determines the data display area according to the type of the object identified by the object identification unit. A display data analysis device according to any one of the first to fourth aspects of the present invention, characterized by detecting.

A sixth aspect of the present invention (corresponding to claim 6) is that the object uses all or a part of a position, a shape, a color, and a pasting pattern of the marker in an image photographed by the photographing means. Determination information for determining whether or not data displayed in the data display area of an object can be analyzed by the analysis means, and all of the position, shape, color, and sticking pattern of the marker imaged by the imaging means; Or comparing a part with a determining means for determining whether the data can be analyzed, and, when the determining means determines that the data cannot be analyzed, reporting information to the outside to that effect The display data analyzing apparatus according to any one of the first to fifth aspects of the present invention, further comprising a notifying unit.

According to a seventh aspect of the present invention (corresponding to claim 7), the object is a vital sensor for measuring and displaying biological information, and the processing device is a vital sign box. A display data analysis device according to any one of the sixth inventions.

According to an eighth aspect of the present invention (corresponding to claim 8), the first aspect
And / or a program for causing a computer to execute all or a part of the functions of all or a part of the display data analysis device according to any one of the first to sixth aspects of the present invention.
Alternatively, the medium is a medium that carries data and can be processed by a computer.

According to a ninth aspect of the present invention (corresponding to claim 9), the first aspect
And / or a program for causing a computer to execute all or a part of the functions of all or a part of the display data analysis device according to any one of the first to sixth aspects of the present invention.
Alternatively, it is an information aggregate characterized by being data.

[0016]

Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1) FIG. 1 is a schematic block diagram of a display data analyzing apparatus according to Embodiment 1 of the present invention. An image captured by the image capturing device 100 is an image input device 101.
Is entered. An object for which data recognition is desired is captured in the input image. A predetermined marker is attached to the object to facilitate data recognition. For example, the marker is attached on the left side of the data display area of the target object.

The marker recognition device 102 detects the marker and calculates the position of the marker in the image. For example, as shown in FIG.
7 (b), the shape of the marker 2 photographed when facing the camera 1 is set at an angle of 45 degrees from the data display area 3 of the target 1 to the marker 2 side. When the image pickup device 100 is located at a plurality of predetermined angular positions with respect to the target object, such as the shape of the marker 2 when the target object 1 is photographed, the image pickup device 100
Position, shape,
Using the photographing information on all or part of the color and the pasting pattern, the marker recognizing device 102 detects a marker in an actually photographed image and calculates its position.

Then, the segment position calculating device 105
Calculates, from the marker position information calculated by the marker recognizing device 102, an area (data display area) in the captured image in which the data to be recognized is reflected.

At this time, the segment position correcting device 104
Calculates the distortion of the object in the image from the marker position information, and passes data for correcting the data display area to the segment position calculation device 105. For example, the image pickup device 1
If the image actually photographed by 00 is shown in FIG. 7B, the distortion from FIG. 7A, in other words,
The shift of the imaging angle position of the image capturing apparatus 100 with respect to the object 1 when the image is actually captured since the image capturing apparatus 100 is directly facing the object 1 is specified, and information on the shift is segmented. The information is passed to the position calculation device 105.

The segment position calculation device 105 performs a calculation after appropriately correcting the data display area based on the information from the segment position correction device 104, and passes the result to the data recognition device 106.

The data recognizing device 106 analyzes the data in the object within the designated region based on the received data display region information, and passes the result to the recognition result output device 107. The recognition result output device 107 outputs the recognition result to the outside.

According to the display data analyzing apparatus of the first embodiment configured as described above, when recognizing data on an object in a photographed image, it is possible to correct the recognition target area, and the recognition accuracy is improved. An improvement is obtained.

The data recognizing device 106 may analyze the data displayed in the data display area by using the information on the deviation described above.

In the above-described embodiment, the display data analysis device of the present invention includes the image pickup device 100 as an example of a photographing device, the marker recognition device 102 as an example of a marker detection device, and the display region detection device. , A data recognition device 106 as an example of an analysis unit, a recognition result output device 107 as an example of an output unit, and a segment position correction device 104 as an example of a deviation specifying unit.

(Embodiment 2) FIG. 2 is a schematic diagram of a display data analyzing apparatus according to Embodiment 2 of the present invention.

Image pickup device 100, image input device 10
1. Segment position calculation device 105, data recognition device 1
06, the recognition result output device 107 is the same as that of FIG.

The marker recognizing device 202 outputs the position information of the marker to the segment position calculating device 105 and the segment position correcting device 204, and identifies the object by recognizing the attached predetermined information. .

Here, the predetermined information further attached is:
The information is described or described in a predetermined format in the marker in advance, and is given, for example, in the form of a barcode (shape). Of course, the format of the predetermined information attached to this marker is not limited to a barcode. The predetermined information attached to the marker is transmitted to the marker recognizing device 202.
Can be read in a predetermined format to obtain the data described therein.

The data described in the predetermined information attached to the marker indicates the type of the object to which the marker is attached. Data indicating the type of the target to which the marker is attached (target specifying information) is sent to the database device 103.

Here, the object specifying information is information indicating "what" the object (with a marker attached) is. Specifically, for example, simply "It is a thermometer"
"It is a sphygmomanometer that displays systolic / diastolic blood pressure in order."
This information is necessary for specifying the target object such as “XX measuring device manufactured by XX; product number △△△” (of course not limited to this), and the marker recognizing device 202 is provided with predetermined information attached to the marker. Is information obtained by reading.

Detailed information (target detailed information) on the target is obtained from the information (target specifying information) specified by the database device 103, and the target detailed information is input to the segment position correcting device 204.

Similarly to the segment position correcting device 104, the segment position correcting device 204 obtains from the marker position information
The distortion (displacement) of the object in the image is calculated by a predetermined method,
Data for correcting the data display area (correction data)
Is passed to the segment position calculation device 105, and correction data with higher position correction accuracy can be generated from the object specifying information obtained from the database device 103.

Here, the object detailed information includes, for example, the size of a portion where data is displayed (for example, a liquid crystal portion), but is not limited thereto, and may include arbitrary information.

In order to improve the accuracy of the position correction, for example, a method of obtaining the size of the liquid crystal portion based on the detailed object information so as to prevent the correction of the segment position beyond the liquid crystal portion is performed. However, any method can be applied.

Thus, the segment position correcting device 2
04 obtained from the segment position calculation device 1
05 is output.

The subsequent processing is the same as in FIG.

According to the display data analyzing apparatus of the second embodiment configured as described above, it is possible to correct the recognition target area after knowing what the object on the image is, and to further improve the recognition accuracy. An improvement is obtained.

(Embodiment 3) Next, Embodiment 3 will be described.

FIG. 2 shows a schematic configuration diagram of the display data analysis device according to the third embodiment of the present invention. Operations other than the database device 103 and the segment position sewing device 204 in FIG. 2 are the same as those in the second embodiment described above.

The database device 103 in FIG. 2 has, as detailed information, the depth between the front surface of the data display portion of the object and the display surface (depth information, for example, the depth between the front surface of the liquid crystal display portion and the liquid crystal display portion). And notifies the segment position correction device 204 of the depth information based on the target object identification information from the marker recognition device. Of course, the information to be notified is not limited to this, and the information included in the database device 103 is not limited to this.

The segment position correction device 204 generates correction information based on the depth information notified from the database device 103.

Here, the method of generating the correction information is as follows, for example.
A distortion angle (rotation angle) in the depth direction of the object with respect to the imaging plane of the camera is calculated from a polygon formed by line segments between the markers, and segment position information and an amount to be shifted are obtained from the rotation angle and the depth information. , But any other method can be used.

Thus, the segment position correcting device 2
04 obtained from the segment position calculation device 1
05 is output.

The subsequent processing is the same as in FIG.

According to the display data analyzing apparatus of the third embodiment configured as described above, a reduction in the recognition rate due to a shift in the depth direction, which is a problem in recognizing data of an object having a liquid crystal display, is prevented. And the data recognition accuracy can be further improved.

(Fourth Embodiment) Next, a fourth embodiment will be described.

The display data analyzing apparatus according to the fourth embodiment is similar to the marker recognizing apparatus 102 of FIG. 1 described in the first embodiment or the marker recognizing apparatus 202 of FIG. 2 described in the second embodiment.
Are replaced with the marker recognition device 302 of FIG. Operations other than the marker recognition device 302 are the same as those in FIG. 1 or FIG.

When the marker is detected, the marker recognizing device 302 proceeds to the next process (for example, the position measurement of the marker), and when no marker is detected, returns the control to the image pickup device 100.

According to the display data analysis apparatus of the fourth embodiment configured as described above, the processing of an image without a marker can be ended or restarted without performing data recognition, so that power consumption can be reduced. It contributes to shortening the execution time. In other words, the recognition rate per unit time can be increased.

(Fifth Embodiment) Next, a fifth embodiment will be described.

The display data analyzing apparatus according to the fifth embodiment is similar to the marker recognizing apparatus 102 of FIG. 1 described in the first embodiment or the marker recognizing apparatus 202 of FIG. 2 described in the second embodiment.
Are replaced with the marker recognition device 302 of FIG.

The marker recognition device 302 in FIG. 5 is the same as the marker recognition device 302 in FIG. Marker recognition device 302
If it is determined that no marker was detected in,
As shown in FIG. 5, the control is transferred to the imaging status notifying means 502.

The imaging status notifying means 502 sends control to the imaging device after giving a predetermined notification. The prescribed notice is:
For example, there is a sound such as "beep", or a notification of operation request / operation status to the user such as "The marker could not be detected. Please re-enter the image." Not limited, any notification can be performed by any means for any purpose.

According to the display data analyzing apparatus of the fifth embodiment configured as described above, it is possible to notify the user of a comment for correcting the imaging condition in accordance with the imaging state of the marker, thereby further increasing the recognition rate. Can be done.

(Embodiment 6) Next, Embodiment 6 will be described.

The display data analyzing apparatus according to the sixth embodiment is similar to the marker recognizing apparatus 102 of FIG. 1 described in the first embodiment or the marker recognizing apparatus 202 of FIG. 2 described in the second embodiment.
Are replaced with the marker recognition device 602 of FIG.

If the marker is not detected by the marker recognizing device 602, or if it is determined that the image of the object is insufficient in data recognition position, inclination, etc.,
As shown in FIG. 6, the control is transferred to the imaging status notifying means 502.

The imaging status notifying means 502 sends control to the imaging device after giving a predetermined notification. The prescribed notice is:
For example, "I was able to detect the marker, but because of a lot of distortion,
Please take a picture from the front more. , Etc., to notify the user of the operation request / operation status, etc.
Of course, the present invention is not limited to this, and any notification can be given by any means for any purpose.

A method of judging that an image is insufficient for data recognition includes, for example, whether or not a polygon formed by the detected markers is shifted by a predetermined value or more from a predetermined reference. However, it is needless to say that an arbitrary method can be used instead of the above method.

According to the display data analyzer of the sixth embodiment configured as described above, for example, “the object is too tilted with respect to the camera” according to the position information of the marker.
Can be notified to the user, and when an image is acquired under conditions that can recognize the marker but cannot recognize the data, it is possible to prompt the user to input a correct image more quickly. . In addition, the recognition accuracy is improved as a whole device.

(Seventh Embodiment) Next, a seventh embodiment will be described.

The display data analyzer of the seventh embodiment is the same as the marker recognition device 102 of FIG. 1 described in the first embodiment or the marker recognition device 202 of FIG. 2 described in the second embodiment.
Are replaced with the marker recognition device 602 of FIG.

If the marker is not detected by the marker recognizing device 602, or if it is determined that the image has insufficient brightness for data recognition, the control is transferred to the imaging status notifying means 502 as shown in FIG.

The imaging status notifying means 502 sends control to the imaging device after giving a predetermined notification. The prescribed notice is:
For example, the user may be notified of an operation request / operation status, such as "The marker was detected, but the image is not bright enough so take the image in a brighter state." Instead, any notification can be made by any means for any purpose.

The method of determining that the image is insufficient for data recognition can be determined, for example, based on whether or not the detected marker satisfies a predetermined brightness. Of course, the present invention is not limited to this, and any method may be used. Can be done.

According to the display data analyzing apparatus of the seventh embodiment configured as described above, a notification such as “the object is too dark on the image” can be sent to the user according to the brightness information of the marker. As a result, it is possible to prompt the user to input a correct image more quickly. In addition, the recognition accuracy is improved as a whole device.

Embodiment 8 Next, Embodiment 8 will be described.

The display data analyzing apparatus of the eighth embodiment is different from the marker recognizing apparatus 102 of FIG. 1 of the first embodiment or the marker recognizing apparatus 202 of FIG. 302.

The marker recognition device 302 in FIG. 4 is the same as the marker recognition device 302 in FIG. Marker recognition device 302
When the marker is detected in step (1), the information is transmitted to the user by the transmission means 401, and then the process proceeds to the next step. Any transmission method such as sound, light, and pop-up window can be used.

According to the display data analyzer of the eighth embodiment configured as described above, the user is notified by sound or light when the marker is recognized, so that the user can recognize normally. You can find out more quickly.

Note that the above-described data recognition target may be a vital sensor such as a thermometer or a sphygmomanometer. All devices necessary for health management and medical consultation can be targeted for recognition.

The data analysis result by the display data analysis device may be output to a health management terminal (vital sign box) for centrally managing health management data and medical care data. When the data is output to the vital sign box in this way, it can be used as data for daily health management and telemedicine.

In the above description, the method of recognizing a marker in an object can be performed based on, for example, the color or shape of the marker. However, the present invention is not limited to this, and any method can be applied. . For example, it can be recognized based on the position of the marker or the attachment pattern.

The method of calculating the distortion (displacement) can be calculated from, for example, the distortion of the shape of each marker or the distortion of a polygon formed by the line connecting the markers. There is no limitation, and any method can be applied.

Further correction is possible, for example, by designating the amount of parallel movement of the segment position.
The method is not limited to these, and any method can be applied.

The correction information can be generated by, for example, defining and deducing a mapping that returns the measured distortion, but the present invention is not limited thereto, and an arbitrary method can be applied.

In summary of the embodiments described above, conventionally, when data is recognized from an image picked up by a free image pickup system, the recognition accuracy is significantly reduced due to distortion in the image of the object to be picked up. There was such a problem. In addition, there is a problem that it is difficult for the user to confirm when the recognition is performed. However, the display data analyzer described in the above embodiment can easily correct the distortion, and the recognition accuracy is dramatically improved. As a result, it is possible for the user to confirm the start of the recognition by means of a transmission means such as sound or light, and it can be said that the effect of the user interface in practical use is enormous.

All or some of the components of the display data analyzer of each embodiment described above may be hardware or software having the same functions as the corresponding functions of the hardware. There may be.

Further, a medium carrying a program and / or data for causing a computer to execute all or some of the functions of all or some of the components of the display data analyzer of each of the above-described embodiments. A medium characterized by being processable by a computer also belongs to the present invention.

The medium includes a recording medium such as a ROM, a transmission medium such as the Internet, and a transmission medium such as light, radio waves, and sound waves. The carried medium includes, for example, a recording medium on which a program and / or data is recorded, a transmission medium for transmitting the program and / or data, and the like.

Therefore, the present invention is a recording medium that records a program and / or data for causing a computer to execute all or some of the functions of all or some of the components of the display data analysis device of each of the above-described embodiments. A recording medium readable by a computer and having the read program and / or data execute the function in cooperation with the computer also belongs to the present invention.

Note that the processing by the computer means that
For example, in the case of a recording medium such as a ROM, it means that the program can be read by a computer.
Or it means that the data can be handled by a computer as a result of the transmission.

Further, the present invention is a program and / or data for causing a computer to execute all or some of the functions of all or some of the components of the display data analysis device of each of the above-described embodiments. The information aggregate also belongs to the present invention.

The information aggregate includes, for example, software such as programs and / or data.

The data in the medium and the information aggregate described above includes a data structure, a data format, a data type, and the like.

[0087]

As is clear from the above description, the present invention can be applied to a case where display data is photographed and the data is analyzed without making the photographing conditions strict when photographing the data. It is possible to provide a display data analysis device capable of performing analysis.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram of a display data analysis device according to a first embodiment.

FIG. 2 is a schematic configuration diagram of a display data analysis device according to the second and third embodiments.

FIG. 3 is a schematic configuration diagram of a marker recognition device according to a fourth embodiment.

FIG. 4 is a schematic configuration diagram of a marker recognition device and a transmission unit according to an eighth embodiment.

FIG. 5 is a schematic configuration diagram of a marker recognition device and an imaging status notifying unit according to a fifth embodiment.

FIG. 6 is a schematic configuration diagram of a marker recognition device and an imaging state notification unit according to Embodiments 6 and 7.

FIG. 7 is an explanatory diagram of the operation of the marker recognition device according to the first embodiment;

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 Image pickup device 101 Image input device 102 Marker recognition device 103 Database device 104 Segment position correction device 105 Segment position calculation device 106 Data recognition device 107 Recognition result output device 202 Marker recognition device 204 Segment position correction device 302 Marker recognition device 401 Transmission means 502 Image pickup status notification means 602 Marker recognition device

Claims (9)

[Claims] 1. A display data analysis device for analyzing data displayed by an object on which a marker is attached and outputting the analysis result to a predetermined processing device, comprising: a photographing means for photographing an image; Using a first database having at least information on all or a part of the position, shape, color, and paste pattern of the marker, a marker detecting unit that detects the marker from an image photographed by the photographing unit; A display area detecting means for detecting a data display area of the object by a predetermined method using a marker detected by the marker detecting means; and information for analyzing data displayed in the data display area. Utilizing a second database having an image displayed on the data display area of the object photographed by the photographing means. Analysis means for analyzing the data obtained by the analysis means; and output means for outputting the analysis result analyzed by the analysis means to the processing device. The position, the shape, the color, and the photographing information about all or a part of the pasting pattern, which are photographed in advance by the photographing means when the marker is located at a plurality of angular positions, are also included. A display data analysis apparatus for detecting the marker by comparing the shooting information with all or a part of the position, shape, color, and pasting pattern of the marker shot by the shooting unit. 2. The method according to claim 1, wherein the photographing information of the first database is compared with all or a part of a position, a shape, a color and a pasting pattern of the marker photographed by the photographing means. 2. The display data analyzing apparatus according to claim 1, further comprising a shift specifying unit for specifying a shift of the photographing unit from a predetermined angular position. 3. The apparatus according to claim 2, wherein the display area detecting means detects the data display area of the object by using information on the displacement specified by the displacement specifying means. Display data analyzer. 4. The apparatus according to claim 2, wherein the analysis unit analyzes the data displayed by the object, also using information on the deviation specified by the deviation specifying unit. Display data analyzer. 5. The first database includes target object specifying information for specifying a type of the target object to which the marker is attached, and the second database includes each target object. Information for analyzing each data is included, and the object identification information is compared with the marker detected by the marker detection unit, and the type of the object captured by the imaging unit is determined. 4. The apparatus according to claim 1, further comprising an object specifying unit for specifying, wherein the display area detecting unit detects the data display area according to a type of the object specified by the object specifying unit. The display data analysis device according to any one of the above. 6. The data displayed in the data display area of the object using all or a part of the position, shape, color, and pasting pattern of the marker in an image photographed by the photographing means. The determination information for determining whether the data can be analyzed by the analysis means is compared with all or a part of the position, shape, color, and paste pattern of the marker photographed by the photographing means, and the data is analyzed. Determination means for determining whether or not the data can be analyzed; and, when the determination means determines that the data cannot be analyzed, notification means for notifying the information to the outside to the outside. The display data analysis device according to claim 1. 7. The display data analysis device according to claim 1, wherein the object is a vital sensor that measures and displays biological information, and the processing device is a vital sign box. . 8. A medium carrying a program and / or data for causing a computer to execute all or a part of the functions of all or part of the display data analysis device according to claim 1. A medium which can be processed by a computer. 9. A program and / or data for causing a computer to execute all or a part of functions of all or a part of the display data analysis device according to claim 1. Information aggregate to be characterized.