JP2023055782A - Information processing device and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device and a computer program which can reduce a work load in meter reading work for reading an analog meter.

SOLUTION: A computer program according to an embodiment causes a computer to function as: a measurement value detection unit which detects a measurement value indicated by a pointer on the basis of positions of the pointer, a first number located on one side surface of the pointer and a second number located on the other side surface of the pointer and values of the first number and the second number on the basis of image data obtained by imaging an analog meter; an image data generation unit which generates the image data obtained by trimming a region including the first number, the second number and the pointer in an image based on the image data; a document creation unit which stores in a storage unit document data by totalizing the measurement value detected by the measurement value detection unit and the image data generated by the image data generation unit at least in association with each other; and a communication control unit which uploads the newly created document data to a server.

SELECTED DRAWING: Figure 3

COPYRIGHT: (C)2023,JPO&INPIT

Description

The embodiments of the present invention relate to information processing apparatuses and computer programs.

Recently, services have been provided to support meter reading work. This service utilizes AI (Artificial Intelligence) to read meter values displayed in Arabic numerals with a device. Due to the variety of shapes and scale display methods, settings are required for each individual meter display type, which complicates the initial settings and creates a workload.

Japanese Patent Application Laid-Open No. 2007-114828 JP 2016-212044 A JP 2018-45655 A

A problem to be solved by the present invention is to provide an information processing device and a computer program capable of reducing the work load in meter reading work for reading an analog meter.

The computer program of the embodiment causes the computer to display the pointer and the position on one side of the pointer based on image data captured by an analog meter that indicates the measured value in the positional relationship between the numbers written on the display panel and the pointer. and the position of each of the second digits located on the other side of the pointer, and the values of each of the first and second digits. and an image data generator for generating image data by trimming an area including the first number, the second number, and the pointer in an image based on the image data. a form creation unit for storing, in a storage unit, form data obtained by associating at least the measurement values detected by the measurement value detection unit and the image data generated by the image data generation unit with each other; It functions as a communication control unit that uploads the form data to the server.

1 is a diagram showing a configuration example of an information processing system including an information processing apparatus according to the present invention; FIG. FIG. 2 is a circuit block diagram showing the configuration of the portable terminal device shown in FIG. 1; 4 is a flowchart for explaining the operation of the portable terminal device shown in FIG. 1; FIG. 4 is a view exemplifying a display image when an analog meter is displayed on the portable terminal device by the operation shown in FIG. 3; The figure which illustrated the display image at the time of detecting a meter reading value from an analog meter by the operation|movement shown in FIG. The figure which illustrated the display image at the time of detecting a meter reading value from an analog meter by the operation|movement shown in FIG. The figure which illustrated the display image at the time of detecting a meter reading value from an analog meter by the operation|movement shown in FIG. The figure which illustrated the display image at the time of detecting a meter reading value from an analog meter by the operation|movement shown in FIG. The figure which illustrated the display image at the time of detecting a meter reading value from an analog meter by the operation|movement shown in FIG. The figure which illustrated the display image at the time of detecting a meter reading value from an analog meter by the operation|movement shown in FIG. FIG. 4 is a view exemplifying a display image when the form data created by the operation shown in FIG. 3 is displayed on the portable terminal device; FIG. 4 is a diagram showing an example of an analog meter that is the target of the operation shown in FIG. 3; FIG. 4 is a diagram showing an example of an analog meter that is the target of the operation shown in FIG. 3;

An embodiment will be described below with reference to the drawings.
FIG. 1 shows the configuration of an information processing system including an information processing device and a computer program according to one embodiment. In the following description, the information processing apparatus and the computer program are described by taking as an example a case where the information processing apparatus and the computer program are applied to meter reading work of various meters used in facilities of factories and business establishments, various measuring instruments, and the like.

(composition)
This information processing system is, as shown in FIG. and information obtained from the meters MT1 to MTn of the measuring instrument.

Note that the meters MT1 to MTn are assumed to display measured values such as current, voltage, pressure and flow rate of gases and liquids, and values indicating the operating status of facilities and equipment, for example. It may be something that shows a numerical value of.

The meters MT1 to MTn are of two types, numerical meters and analog meters, and both types can be mixed.

A numeric meter is an instrument that indicates a measured value or the like in either rotary or digital form. In the case of a digital type, for example, it is conceivable to use a plurality of 7-segment displays that display numbers from 0 to 9 to indicate numerical values. In the case of a rotary type, for example, it is a mechanical type in which a number of number wheels with digits from 0 to 9 are arranged in a row. configuration is conceivable.

An analog meter is a measuring instrument in which a pointer moves on a display panel on which Arabic numerals and scales are marked as readings of the meter, and the measured values are indicated by the positional relationship between the numbers and scales and the pointer.

The portable terminal device 100 is a terminal device carried by a meter reader who reads the meters. It is an information processing device for Details will be described later.

The radio base station 200 wirelessly communicates with the mobile terminal device 100 and connects the mobile terminal device 100 to the network 500 . For example, if the network 500 is a LAN built in an office, it is an access point that employs a wireless LAN (IEEE802.11 series) as a communication method. When the network 500 is a mobile communication network of a communication carrier, it is a base station device that performs wireless communication compatible with standards such as 3G, 3.9G (LTE (registered trademark), etc.), 4G, 5G, and the like.

That is, the wireless LAN and the mobile phone network are only examples, and the mobile terminal device 100 is not limited to these methods as long as it can connect to the network 500 by wireless communication, and Bluetooth (registered trademark) can be used. Any communication method including the above is applicable. Also, the network 500 is not limited to one network, and may be a network in which a plurality of networks (for example, a local LAN and a mobile communication network) are interconnected.

The client terminal 300 is installed in a management department of users of the meter reading service provided by the system, and is a terminal used by an operator of the department. is.

The client terminal 300 has functions of downloading data files uploaded to the server 400 by the portable terminal device 100, and performing reference/browsing, editing/aggregation, data conversion/file creation, and issuing of forms.

Also, the client terminal 300 may have all or part of the data processing functions of the mobile terminal device 100 and execute the same processing as the mobile terminal device 100 . In other words, the client terminal 300 may have similar functions to perform data processing that can be executed on the portable terminal device 100 instead of photographing at the meter reading site.

The server 400 forms the core of the cloud computing provided by the system, stores and manages information uploaded from the portable terminal device 100 and the client terminal 300, and performs predetermined data processing on the information. Alternatively, the stored information or data-processed information is provided (downloaded) to the portable terminal device 100 or the client terminal 300 to realize data sharing between system users.

In addition, the server 400 performs part or all of the data processing performed by the portable terminal device 100 and the client terminal 300 on behalf of each device, thereby making it possible to save the computer resources of each device. The server 400 also provides the OS (Operating System) and application software used by the portable terminal device 100 and the client terminal 300 to each device, updates them with the latest information, and realizes services.

In this way, the database of the server 400 stores the meter reading data uploaded from the mobile terminal device 100 and also stores various programs of the mobile terminal device 100 and the client terminal 300 .

The service provided by the server 400 may be provided on a subscription basis to the portable terminal device 100 or the client terminal 300 owned (or lent) by the client receiving the service.

Next, the mobile terminal device 100 will be described with reference to FIG.
As described above, the portable terminal device 100 is a terminal that is carried by a meter reader who reads a meter at a meter reading site and is used as an operator. information processing device.

As shown in FIG. 2, the portable terminal device 100 has the same hardware configuration as a general computer, and includes at least a communication unit 101, an input unit 102, a display unit 103, and a camera 104 connected by a bus. , a GNSS (Global Navigation Satellite System) receiving unit 105 , a storage unit 106 , and a control unit 110 .

The communication unit 101 is a wireless communication interface that establishes a wireless communication link with the wireless base station 200 for communication, and communicates with the server 400 via the wireless base station 200 and the network 500 . Wireless communication corresponds to a communication method that conforms to the specifications of the wireless base station 200 . Examples of this communication method include wireless LAN (IEEE802.11 series), 3G, 3.9G (LTE (registered trademark), etc.), 4G, 5G, Bluetooth (registered trademark), and various other standards. Any of them may be used, and they are not limited to these.

The input unit 102 includes an input device such as a touch panel placed on the display unit 103 (to be described later) and a key switch provided on the housing of the portable terminal device. to detect The above touch panel allows input using a stylus or a finger, and various methods such as an electrostatic capacity method, a resistive film method, and a projected infrared method can be applied.

The display unit 103 visually provides information to the meter reader, and displays, for example, information entry fields, software keys, and various images (photographs, CG (computer graphics) images).

The information input fields and software keys are displayed so as to correspond to the operations on the input unit 102 described above under the control of the control unit 110, which will be described later. Various display devices such as liquid crystal panels, organic EL (Electro Luminescence) panels, and electronic paper can be applied as devices used for display.

The camera 104 includes an optical system including a plurality of lenses and a zoom mechanism for varying the distance between these lenses, an imaging unit including an image sensor such as a CMOS (Complementary MOS), and an imaging unit. and a signal processing unit that generates image data in a predetermined format (for example, JPEG (Joint Photographic Experts Group)) from captured image signals.

Note that the image data obtained by the camera 104 includes additional information (for example, Exif (Exchangeable image file format)) indicating the date and time and place of shooting, shooting conditions (shutter speed, aperture value, angle of view, latitude and longitude, etc.). data) is added by the control unit 110 and recorded.

The GNSS receiving unit 105 performs position measurement (positioning) using signals emitted from a plurality of GNSS satellites, ground reference stations, and the like, and receives the current time.

The storage unit 106 stores the OS and application software of the control unit 110 to be described later, data generated along with the operation of the application software, various parameters, data input by a meter reader, image data captured by the camera 104 (meter MT1 ~ MTn measurement values, etc.), data acquired (downloaded) from the server 400, and other temporary data for information processing. RAM (Random Access Memory) and ROM ( Read Only Memory), flash memory such as SSD (Solid State Drive), and recording device such as HDD (Hard Disk Drive) are provided in combination according to the characteristics of the data.
The storage unit 106 also stores various data such as form data 106a, setting information data 106b, meter image data 106c.

The form data 106a is data created for totalizing the meter reading values of each meter for each predetermined meter reading period, and is uploaded to the server 400 when new data is created. Specifically, the form data 106a is data created for each meter reading site. Information such as "meter information", "meter image", "current meter reading value", "previous difference", "previous meter reading value", and "previous difference obtained" are associated with the form data 106a. This data includes the above information for each meter when a plurality of meters are installed at the meter reading site.

Here, "meter information" is the master code for identifying the meter, identification information indicating the object to be measured by the meter (e.g., tenant, parking lot, shared space, etc.), type (e.g., gas, electricity, water, etc.) )including. A “meter image” is an image that serves as the basis for the meter reading, that is, an image taken during meter reading.

The "current meter reading value" is the value read in the current meter reading. "Difference from last time" is the difference between the current meter reading value and the previous meter reading value. The "previous meter reading value" is the value read in the last meter reading. The "difference obtained last time" is the difference between the previous meter reading value and the meter reading value before last.

The setting information data 106b is setting information necessary for totalizing meter reading values of each meter. Specifically, like the form data 106a, it is created for each meter at each meter reading site.

The meter image data 106c is image data of the meter reading value captured by the camera 104 for meter reading. It is recorded as an image in the form data 106a.

The control unit 110 includes processors such as a CPU (Central Processing Unit) and GPU (Graphics Processing Unit), a chipset, RAM, ROM, and the like, and controls each unit of the mobile terminal device 100 in an integrated manner.

The ROM stores firmware and setting values (various parameters). The CPU reads the OS and application software from the storage unit 106 into RAM according to the above firmware, executes the OS and application software, and uses RAM as a work area to realize various control functions. do.

The control unit 110 implements at least the following control functions by executing the OS and application software. That is, the control unit 110 executes the software (program) as a processor to control the communication control unit 111, the input control unit 112, the display control unit 113, the image processing unit 114, the position information processing unit 115, and the meter reading data aggregation processing unit 116. and these functions can work in conjunction with each other.

It should be noted that part or all of each of these functions can be integrated with other functions, or each function of 111 to 116 can be divided into a plurality of functional blocks from a different point of view and explained using different expressions. .

The communication control unit 111 controls the communication unit 101, establishes a wireless communication link with the wireless base station 200 according to a predetermined communication protocol, and communicates with the server 400 through the network 500. data download and data upload to the server 400.

The input control unit 112 controls the input unit 102, and interprets the request of the meter reader from the operation of the meter reader on the input unit 102 based on the result detected by the input unit 102, inputs information (character strings, etc.), data and accepts changes in linkage, and captures image data captured by the camera 104 .

The display control unit 113 controls the display unit 103 to display various information including characters and images, and a graphical user interface (hereinafter referred to as GUI (Graphical User Interface)). Examples of the GUI are the above-described information input fields and software keys, and their display corresponds to input through the touch panel of the input unit 102 . In addition, a guide display is performed to indicate the image capture position.

The image processing unit 114 performs image processing on image data captured by the camera 104, and has, for example, a function as a recognition engine and a function as an analysis engine.

The recognition engine performs processing for recognizing various types of information from an image based on image data obtained by the camera 104, for example, by pattern recognition using AI (Artificial Intelligence).
Specifically, the recognition engine detects, for example, a QR code (registered trademark), distinguishes (determines) whether the type of meter in the image is a numerical meter or an analog meter, Detects the meter part that displays the measured value, and objects in the meter part (number string of the measured value of the numerical meter, needle of the analog meter, numbers written on the display panel, etc.) and their arrangement (coordinates) It has a function to detect.

On the other hand, the analysis engine performs processing for analyzing information detected by the recognition engine.
Specifically, the analysis engine analyzes the image of the meter part, converts the measurement value of the numerical meter into text by decoding the QR code, character recognition processing such as optical character recognition (OCR (Optical Character Recognition)), and analog The value indicated by the pointer is detected from the positional relationship of the objects marked on the meter part of the meter.

Multiple types of analysis engines are prepared for character recognition processing. Each analysis engine corresponds to each type of meter, and converts the displayed measurement value into text using an analysis algorithm suitable for the display (number string) of the measurement value of the corresponding meter.

Specifically, the typeface of Arabic numerals and the combination of numbers and background colors differ depending on the meter, so an analysis engine having an analysis algorithm suitable for the display of each meter is prepared.

The position information processing unit 115 includes an acceleration sensor, a gyro sensor, etc. Based on the detection results of these, the positioning result of the GNSS receiving unit 105, and/or the positioning information obtained from the radio base station 200 by the communication control unit 111 , the position of the mobile terminal device 100 is measured.

The meter reading data aggregation processing unit 116 controls various processes related to meter reading data aggregation, and includes a numerical meter reading unit 116a, an analog meter reading unit 116b, a form creation unit 116c, and a correction processing unit 116d. Prepare.

The numerical meter reading unit 116a uses the image processing unit 114 as necessary, and performs a process of reading the numeric string of the measured value displayed on the numerical meter as the meter reading value.

The analog meter reading unit 116b uses the image processing unit 114 as necessary to read the value indicated by the pointer on the analog meter as the meter reading. It is an example of a detection unit, a straight line creation unit, a number detection unit, an arc creation unit, an intersection detection unit, an image data generation unit, and a recording unit.

The form creation unit 116c performs processing for creating form data based on the meter readings read by the numerical meter reading unit 116a and the analog meter reading unit 116b.

The correction processing unit 116d receives an instruction to correct the meter reading according to an instruction from the meter reader, and corrects the meter reading read by the numerical meter reading unit 116a or the analog meter reading unit 116b.

(motion)
Next, the operation of the information processing system configured as described above will be described. In the following description, among the processes in the portable terminal device 100, a meter-reading data tallying process (hereinafter referred to as a meter-reading data tallying process) will be described in particular.

This meter reading data aggregation processing is performed by the meter reading data aggregation processing unit 116 to support the meter reading work for the meters MT1 to MTn by the meter reader, read the measured values displayed on the meters MT1 to MTn, and aggregate them into form data. 106a.

Moreover, this meter reading data totalization processing is realized by the controller 110 executing the application software (program) functioning as the meter reading data totalization processing unit 116 . In the following description, one piece of application software is described, but a plurality of pieces of application software may work together or operate in succession.

When the application software is executed, the form creation unit 116c of the meter reading data aggregation processing unit 116 displays a template of the form data 106a. Specifically, the form creation unit 116 c reads template data of the form data 106 a stored in the storage unit 106 and outputs the read template data to the display control unit 113 . On the other hand, the display control unit 113 displays a form template on the display unit 103 based on the template data.

Subsequently, the meter reading data aggregation processing unit 116 gives an instruction to the display control unit 113 to display on the display unit 103 a request for input of the type of meter to be read. That is, the input control unit 112 receives the meter reader's selection through the input unit 102 by inquiring of the meter reader whether the meter reader is reading a numerical meter or reading an analog meter.

Here, when the meter reader selects the meter reading of the numerical meter, the input control unit 112 detects this input, and in response to this detection result, the meter reading data aggregation processing unit 116 outputs the numerical meter reading unit 116a. to start meter reading. That is, the numerical value displayed on the numerical meter is read by OCR and converted to text, and then the meter reading value converted into text is input to the form data 106a by the form creation unit 116c.

On the other hand, when the meter reader selects the meter reading of the analog meter, the input control unit 112 detects this input, and in response to the detection result, the meter reading data aggregation processing unit 116 converts the analog meter meter reading unit 116b Read the meter. The details will be described below with reference to FIG.

As described above, the meter reader may indicate through the input unit 102 whether the meter is to be read by a numerical meter or by an analog meter. The recognition engine may distinguish (determine) whether the type of meter appearing in the image is a numerical meter or an analog meter.

FIG. 3 is a flowchart for explaining a meter reading data aggregation process for reading an analog meter. As described above, this meter reading data aggregation process is realized by the controller 110 executing the application software (program) functioning as the meter reading data aggregation processing section 116 (analog meter meter reading section 116b).

First, in step S301, the analog meter meter reading unit 116b controls the camera 104, and takes an image of the analog meter MT (for example, any one of the meters MT1 to MTn) with the photographing composition (angle) by the meter reader. The image processing unit 114 is caused to perform image processing on the image data, and the process proceeds to step S302.

Specifically, in step S301, the camera 104 is activated, the image captured by the camera 104 is displayed on the display unit 103, and the meter reader confirms this display and adjusts the photographing composition while adjusting the overall analog meter MT. perform the shutter operation for taking the picture.

As a result, the image of the entire analog meter MT is captured by the portable terminal device 100, and imaged data of the entire analog meter MT is obtained by the processing of the image processing unit 114. For example, as shown in FIG. A display is made at 103 .

FIG. 4 shows how the analog meter MT photographed by the camera 104 is displayed on the portable terminal device 100 . Further, in this display, the display control unit 113 displays a GUI (Graphical User Interface) for meter reading on the display unit 103 according to an instruction from the analog meter reading unit 116b.

In the GUI example of FIG. 4, a shooting guide frame Fq for shooting a meter is displayed, and the image shot by the camera 104 is displayed as it is within the shooting guide frame Fq, and outside the shooting guide frame Fq, For example, by displaying a gray mask with a reduced transmittance, the meter reader is urged to place the analog meter MT within the photographing guide frame Fq. Seeing this, the meter reader moves the camera 104 of the portable terminal device 100 over the analog meter MT by moving it back and forth, left and right, and up and down to change the photographing composition, and inserts the analog meter MT into the photographing guide frame Fq. adjust so that it fits.

In the GUI example of FIG. 4, a zoom key Z and software keys S1 to S4 are displayed. The zoom key Z instructs the image processing unit 114 to enlarge and display the image data captured by the camera 104 .

For example, "1X" means no enlargement processing, "2X" means displaying with the angle of view doubled at the "1X" ratio, "3X" means displaying with the angle of view tripled at the "1X" ratio, "Maximum" corresponds to the processing of displaying the angle of view at the "1X" ratio, which is the maximum in terms of performance. indicate.

In the above description, the digital zoom that changes the angle of view by image processing of the image processing unit 114 is described as an example. Alternatively, digital zooming by the image processing unit 114 and optical angle-of-view change control may be combined.

The "numerical value meter" of the software key S1 shown in FIG. 4 is for switching from the current meter reading data totalization processing for the analog meter to the meter reading data totalization processing for the numerical meter. The "analog meter" of the software key S2 indicates that the meter reading data aggregation process currently being performed is for the analog meter.

The software key S3 "re-capture" is for instructing re-capture of the meter. The software key S4 "meter reading" is for instructing execution of meter reading (reading of measured values) from a photographed image.

In step S302, when the analog meter meter reading unit 116b confirms that the software key S4 has been operated from the detection result of the input control unit 112, using the recognition engine of the image processing unit 114, from the imaging data obtained in step S301 , the object (number) on the display panel of the analog meter MT that appears in the image and its coordinates are detected.

Specifically, the analog meter meter reading unit 116b uses the recognition engine of the image processing unit 114, and assuming that the image obtained in step S301 is as shown in FIG. 5, as shown in FIG. The numbers written on the display panel of the analog meter MT are detected, a virtual XY coordinate plane is set on the image of the display panel, and the coordinates of the numbers are detected. At least two numbers are detected.

Furthermore, the analog meter reading unit 116b instructs the display control unit 113 to display a rectangle surrounding the number in order to indicate that the number has been detected. Here, the analog meter reading unit 116b converts the numbers (objects) into text by OCR using a recognition engine, and detects the value.

Subsequently, the analog meter meter reading unit 116b uses the recognition engine of the image processing unit 114 to detect the center of the rectangle surrounding the detected number and its coordinates, and compare the coordinates with the value of the detected number (object). After linking, the process moves to step S303.

Specifically, the analog meter reading unit 116b uses a recognition engine to detect the coordinates of the center of the square in the virtual XY coordinates set on the image of the display panel, associate them with numbers, The display control unit 113 is instructed to display a pattern for specifying a point, which is similar to "·" or the like at the coordinates, as shown in FIG. 6 .

In step S303, the analog meter reading unit 116b analyzes the image using the analysis engine of the image processing unit 114, and connects the central coordinates of the numbers detected in step S302 with an arc (or a circle is also possible) (overlaps the arc). A curve is created, and the process proceeds to step S304.

Specifically, the analog meter reading unit 116b performs image analysis using the analysis engine, and approximates the approximate curve (Xa)^2+ that connects (overlaps the arc) the center points of the numbers detected in step S302 with an arc. (Y−b)̂2=r̂2 is created (a, b, and r are calculated), and the display control unit 113 is instructed to display a part of this curve as shown in FIG. Note that the coordinates of the rotation center of the pointer to be detected later may be detected and the values thereof may be used as the above (a, b).

In step S304, the analog meter reading unit 116b uses the recognition engine of the image processing unit 114 to detect an object (pointer) on the display panel of the analog meter MT shown in the image and its coordinates from the imaging data obtained in step S301. do.

Specifically, the analog meter meter reading unit 116b uses the recognition engine of the image processing unit 114, and assuming that the image obtained in step S301 is as shown in FIG. 5, as shown in FIG. A pointer of the analog meter MT is detected, a virtual XY coordinate plane is set on the image of the display panel, and the coordinates of both ends (start point and end point) of the pointer are detected.

Then, the analog meter reading unit 116b creates a linear function Y=c*X+d (calculates the values of c and d) connecting both ends of the detected pointer (overlaps on both ends), and further indicates that the pointer has been detected. In order to show the pointer, the display control unit 113 is instructed to display a line segment (straight line) overlapping the pointer in the longitudinal direction based on the coordinates of both ends of the pointer, and the process proceeds to step S305.

Various methods are conceivable for the method of recognizing the pointer by the recognition engine. For example, an object extending outward from the vicinity of the center of the image (that is, the center of the analog meter MT) and having a length greater than a certain proportion of the image size may be recognized as a pointer, or a specific color (red or black) and having an aspect ratio equal to or greater than a predetermined value is recognized as a guideline. In addition, it will be easily understood by those skilled in the art that it can be realized by appropriately using a well-known method.

In step S305, the analog meter reading unit 116b analyzes the image using the analysis engine of the image processing unit 114, and the intersection point P of the approximated curve (arc) created in step S303 and the linear function (guideline) created in step S304 is detected (see FIG. 7), and the process proceeds to step S306. Here, when the circular arc and the needle do not overlap, the analysis engine of the image processing unit 114 extends the range of the linear function and detects the intersection point P. FIG.

In step S306, the analog meter meter reading unit 116b analyzes the image using the analysis engine of the image processing unit 114, and the number M near the left of the needle detected in step S304 (or the intersection point P detected in step S305) and the number M near the right A nearby number N is detected (specified), and the process proceeds to step S307. The values of M and N are the values read by OCR in step S302.

Specifically, based on the linear function created in step S304 (or the intersection point P detected in step S305), the two numbers closest to the straight line (or intersection point P) indicated by this linear function are M, Detect as N. Note that the closest two numbers may be manually set, that is, specified by a meter reader through the touch panel of the input unit 102 .

In step S307, the analog meter reading unit 116b detects a rectangular area Sq including two numbers M and N detected in step S306 as diagonals, as shown in FIG. 8, and proceeds to step S307.

Specifically, the analog meter meter reading unit 116b performs image analysis using the analysis engine, and finds the rectangle surrounding the two numbers M and N detected in step S306. A point away from the linear function Y=c*X+d (or the intersection point P) is detected. The square obtained in this way, with the two most distant points as diagonals, is detected as the square area Sq, and the display control unit 113 is instructed to display this square area Sq (see FIG. 8).

In step S308, based on the image data obtained in step S301, the analog meter reading unit 116b generates image data by cutting out (trimming) the square area Sq detected in step S306, as illustrated in FIG. The process proceeds to step S309.

In step S309, the analog meter reading unit 116b analyzes the image using the analysis engine of the image processing unit 114, and determines the center coordinates of the numbers M and N detected in step S302 and the coordinates of the intersection point P detected in step S305. Based on this, the value indicated by the pointer (measured value) is obtained as the detection value DT, and the process proceeds to step S310.

Specifically, as shown in FIG. 10, the analog meter reading unit 116b obtains the distance x from the center coordinates of one of the two numbers M and N detected in step S306 to the intersection point P. , and the distance y from the center coordinates of the other number N to the intersection point P. After that, the analog meter reading unit 116b calculates the detection value DT by DT=m+(nm)*x/(x+y) (where m is the value of the number M and n is the value of the number N). demand.

In step S310, the analog meter reading unit 116b outputs the detection value DT obtained in step S309 and the image data of the rectangular area Sq cut out in step S308 to the form creating unit 116c, and the process proceeds to step S311. The form creation unit 116c that has received the output aggregates (records) the detection value DT and the image data in the form data 106a.

In step S311, the analog meter reading unit 116b instructs the display control unit 113 to display the form data 106a aggregated in step S310 on the display unit 103, and the process proceeds to step S312. The display control unit 113 having received this instruction performs display based on the form data 106a as shown in FIG. 11, for example.

In step S312, the analog meter reading unit 116b instructs the display control unit 113 to display a display requesting the meter reader to confirm the form data and a software key. It waits to be transmitted from 112 .

In response to this, the display control unit 113 causes the display unit 103 to display a display requesting confirmation of whether the correct meter reading value is input to the document data being displayed, and the software keys "OK" and "NG". to control.

Eventually, when the meter reader operates the "OK" software key to indicate to the input unit 102 that the detected value DT is correct, the process proceeds to step S314, while indicating that the detected value DT is incorrect. When the "NG" software key is operated at the same time, the process proceeds to step S313.

In step S313, the analog meter reading unit 116b requests the correction processing unit 116d to correct the form data 106a, and when the correction is completed, the process proceeds to step S314.

Specifically, the correction processing unit 116d that has received the correction request instructs the display control unit 113 to display a GUI for correcting the inspection form data on the display unit 103. The input control unit 112 detects the content input by the meter reader, and corrects the form data 106a according to the detection result.

In step S314, the analog meter reading unit 116b notifies the form creation unit 116c of the completion of the form data 106a, and ends the process. In response, the form creation unit 116c stores the form data 106a in the storage unit 106. FIG.

(summary)
As described above, in the information processing system configured as described above, when the meter reader uses the portable terminal device 100 to read the analog meter, the portable terminal device 100 captures the display panel of the analog meter based on the image data. , the two numbers M and N located on both sides of the pointer are detected, and the position of the intersection of the line connecting the two numbers M and N and the pointer and the values m and n of the two numbers M and N are used to read the meter. I am trying to detect the value.

Therefore, according to the information processing system configured as described above, the meter reader can read the analog meter without performing initial setting according to the display type, thereby reducing the workload. can be done.

In the form data 106a, the meter reading value of the analog meter and the image data from which the meter reading value is detected are stored in association with each other. Therefore, a person who browses the form data 106a later can confirm.

It should be noted that the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying constituent elements without departing from the scope of the present invention at the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. Further, for example, a configuration in which some components are deleted from all the components shown in the embodiments is also conceivable. Furthermore, components described in different embodiments may be combined as appropriate.

For example, in the above embodiment, the line connecting the two numbers M and N sandwiching the pointer is drawn as an arc, but the present invention is not limited to this. You can

Also, as an example of the analog meter, the ammeter having a circular outer shape as shown in FIG. 5 has been exemplified, but the present invention is not limited to this. For example, an ammeter having a rectangular outer shape as shown in FIG. 12 may be used. Fig. 12(a) is a rectangular DC ammeter, Fig. 12(b) is a rectangular ammeter that can display negative values, Fig. 12(c) is an AC ammeter with different scale intervals, Fig. 12(d) ) shows a rectangular ammeter that can display the extended region in addition to the normal region.

Moreover, it is not limited to an ammeter, and may be an analog meter for measuring other physical quantities. For example, a pressure gauge for measuring positive pressure as shown in FIG. 13(a), a compound gauge capable of measuring and displaying both ranges of positive pressure and negative pressure as shown in FIG. It may be a vacuum gauge or the like for measuring negative pressure as shown in c).

Further, in the above-described embodiment, the case where the mobile terminal device 100 performs the photographing of the analog meter, the detection of the measured value of the analog meter, and the creation of the form data 106a recording the detected value has been described as an example. , but not limited to.

That is, only the photographing of the analog meter is performed by the portable terminal device 100, and the detection of the measured value of the analog meter and the creation of the report data 106a recording the detected value are realized by information processing in the client terminal 300 and the server 400. You may make it In this case, the hardware and software described in the above embodiments are provided in the client terminal 300 and server 400 .
In addition, it goes without saying that various modifications can be made in the same way without departing from the scope of the present invention.

[Appendix 1]
the computer,
a pointer detection unit that detects the pointer based on image data captured by an analog meter that indicates a measurement value based on the positional relationship between the number and the pointer written on the display panel;
a number detection unit that detects a first number positioned on one side of the pointer and a second number positioned on the other side of the pointer based on the image data;
A measurement value indicated by the pointer is detected based on the position of the first digit, the position of the second digit, the position of the pointer, and the respective values of the first digit and the second digit. A program for functioning as a measurement value detection unit.
[Appendix 2]
The measured value detection unit detects a ratio of a distance between the position of the first digit and the position of the pointer to a distance between the position of the second digit and the position of the pointer, and the first The program according to [Supplementary Note 1], wherein the measured value indicated by the pointer is detected based on both the number of 1 and the second number.
[Appendix 3]
the computer,
a pointer detection unit that detects the pointer based on image data captured by an analog meter that indicates a measurement value based on the positional relationship between the number and the pointer written on the display panel;
a straight line creation unit that creates a straight line that overlaps the pointer in the longitudinal direction;
a number detection unit that detects at least two numbers written on the display panel based on the image data;
an arc creation unit that creates an arc that overlaps the at least two numbers detected by the number detection unit;
an intersection detection unit that detects an intersection point where the straight line and the arc intersect;
A program for functioning as a measured value detection unit that detects the measured value indicated by the hands based on the positions of the numbers, the positions of the intersection points, and the values of the numbers.
[Appendix 4]
The measured value detection unit detects a distance between a first number located on one side of the pointer and the intersection point among the numbers detected by the number detection unit, and a distance between the intersection point and a number detected by the number detection unit. [Appendix 3], wherein the measurement value indicated by the pointer is detected based on the ratio of the distance between the number 2 and the intersection point and both the values of the first number and the second number. program.
[Appendix 5]
In addition, computer
an image data generation unit that generates image data by trimming an area including the first number, the second number, and the pointer in an image based on the image data, based on the image data;
The program according to [Appendix 2] or [Appendix 4] for functioning as a recording unit that associates and records the measured value detected by the measured value detection unit and the image data generated by the image data generation unit.
[Appendix 6]
a pointer detection unit that detects the pointer based on image data captured by an analog meter that indicates a measurement value based on the positional relationship between the number and the pointer written on the display panel;
a number detection unit that detects a first number positioned on one side of the pointer and a second number positioned on the other side of the pointer based on the image data;
A measurement value indicated by the pointer is detected based on the position of the first digit, the position of the second digit, the position of the pointer, and the respective values of the first digit and the second digit. An information processing device comprising a measured value detection unit for detecting a measured value.
[Appendix 7]
a pointer detection unit that detects the pointer on the basis of image data captured by an analog meter that indicates a measurement value based on the positional relationship between the numbers written on the display panel and the pointer;
a straight line creation unit that creates a straight line that overlaps the pointer in the longitudinal direction;
a number detection unit that detects at least two numbers written on the display panel based on the image data;
an arc creation unit that creates an arc that overlaps the at least two numbers detected by the number detection unit;
an intersection detection unit that detects an intersection point where the straight line and the arc intersect;
An information processing apparatus comprising: a measured value detection unit that detects a measured value indicated by the pointer based on the position of the number, the position of the intersection point, and the value of the number.

DESCRIPTION OF SYMBOLS 100... Portable terminal device 101... Communication part 102... Input part 103... Display part 104... Camera 106... Storage part 106a... Form data 106b... Setting information data 106c... Meter image data 110... Control unit 111 Communication control unit 112 Input control unit 113 Display control unit 114 Image processing unit 115 Position information processing unit 116 Meter reading data aggregation processing unit 116a Numerical meter reading unit 116b Analog meter reading unit 116c Document creation unit 116d Correction processing unit 200 Wireless base station 300 Client terminal 400 Server 500 Network Fq Shooting guide frame MT1 to MTn Meter P ... intersection, S1 ... software key, S2 ... software key, S3 ... software key, S4 ... software key, Sq ... rectangular area.

Claims (4)

the computer,
The pointer, the first number positioned on one side of the pointer, and the pointer are obtained based on image data obtained by photographing an analog meter that indicates the measured value in terms of the positional relationship between the numbers written on the display panel and the pointer. Measured value detection unit for detecting the measured value indicated by the pointer based on the respective positions of the second digits located on the other side and the respective values of the first digit and the second digit and,
an image data generation unit that generates image data by trimming an area including the first number, the second number, and the pointer in the image based on the image data;
a form creation unit configured to save, in a storage unit, form data obtained by at least associating the measurement values detected by the measurement value detection unit and the image data generated by the image data generation unit with each other;
a communication control unit that uploads the newly created form data to a server;
program to function as In addition, computer
Presenting a display based on the form data, and when an input indicating that a correct measurement value is not entered in the form data is made, the form is detected according to the detection result of detecting the contents input through the input unit. Function as a correction processing unit that corrects data,
2. The program according to claim 1, wherein said form creation unit saves said corrected form data in said storage unit. The form creation unit generates the meter information of the analog meter, the image data generated by the image data generation unit, the current meter reading value, the difference between the previous meter reading value and the current meter reading value, the previous meter reading value, and the previous meter reading value. 2. The program according to claim 1, which creates form data in which the information on the difference obtained in . The pointer, the first number positioned on one side of the pointer, and the pointer are obtained based on image data obtained by photographing an analog meter that indicates the measured value in terms of the positional relationship between the numbers written on the display panel and the pointer. Measured value detection unit for detecting the measured value indicated by the pointer based on the respective positions of the second digits located on the other side and the respective values of the first digit and the second digit and,
an image data generation unit that generates image data by trimming an area including the first number, the second number, and the pointer in the image based on the image data;
a form creation unit configured to save, in a storage unit, form data obtained by at least associating the measurement values detected by the measurement value detection unit and the image data generated by the image data generation unit with each other;
a communication control unit that uploads the newly created form data to a server;
Information processing device with

Images