JP6989643B2 - Information processing equipment and computer programs - Google Patents

Description

Embodiments of the present invention relate to information processing devices and computer programs.

Conventionally, as a meter reading operation for equipment installed in office buildings, factories, public facilities, etc., inspectors read meters indicating the operating status of those equipment and perform maintenance of the equipment.

In recent years, in order to eliminate the need for manual meter reading work, high-performance equipment compatible with a system that sends measurement data indicating the operating status to a server via a network and can store and manage it on this server has been introduced. It's starting.

However, since the equipment and devices compatible with such a system are expensive, they have not become widespread, and there are still many equipment and devices that perform meter reading by inspectors, and the meter reading work by the inspector's visual inspection is still performed. ing. In addition, when it comes to reading gas, electricity, water, etc. in a general house, it is common for a meter reader to go to each house to read the meter.

Recently, a service has been provided to support the meter reading work of the meter. In this service, AI (Artificial Intelligence) is used to read the meter value (value measured by the meter) with a device, but even with a system that applies such technology, at the actual meter reading work site, Human error could occur, requiring a certain level of skill for inspectors and meter readers, and still requiring guidance for inexperienced inspectors and meter readers.

Japanese Patent No. 6514390

An object to be solved by the present invention is to provide an information processing device and a computer program that support efficient and accurate meter reading with a simple operation in a meter reading operation of reading a meter value with an instrument.

The computer program of the embodiment causes the computer to function as a display control unit and a guide display control unit. When the display control unit displays an image including the first meter and the second meter, the guide display control unit mode execution unit identifies the first meter displayed on the first meter on the image. A display showing the correspondence between the information and the measured value is displayed, and a display showing the correspondence between the identification information of the second meter displayed on the second meter and the measured value is displayed.

The figure which shows the example of a meter. The figure which shows the example of a meter. The figure which shows the example of a meter. The figure which shows the structure of the information processing system which concerns on embodiment. The figure which shows the arrangement example of the meter which is the object of meter reading. The figure which shows the appearance of the portable terminal apparatus shown in FIG. The figure which shows the configuration example of the portable terminal apparatus shown in FIG. The flowchart for demonstrating the processing of the portable terminal apparatus shown in FIG. The figure which shows the example of the guide display during the reading operation of meter reading data. The figure which shows the display example during reading operation of meter reading data. The figure which shows the example of the guide display during the reading operation of meter reading data. The figure which shows the example of the guide display during the reading operation of meter reading data. The figure which shows the example of the guide display during the reading operation of meter reading data. The figure which shows the example of the guide display during the reading operation of meter reading data. The figure which shows the example of the guide display during the reading operation of meter reading data. The figure which shows the display example during reading operation of meter reading data. The figure which shows the display example during reading operation of meter reading data. The figure which shows the display example during reading operation of meter reading data. The figure for demonstrating the procedure of continuous shooting. The figure which shows the display example of the meter reading data. The figure which shows the display example of the meter reading data. The figure which shows the display example during reading operation of meter reading data. The figure which shows the display example at the time of continuous shooting. The figure which shows the display example during reading operation of meter reading data. The figure which shows the display example of the meter reading data. The figure which shows the display example during reading operation of meter reading data. The figure which shows the display example of the meter reading data. The figure which shows an example of meter reading data.

Hereinafter, one embodiment will be described with reference to the drawings.
The information processing system including the information processing apparatus and the computer program according to this embodiment is for meter reading to read the value indicated by the meter. As shown in FIG. 1, the meter is, for example, an electronic watt-hour meter equipped with a display unit such as an analog inductive watt-hour meter (FIG. 1 (a)) or an LCD (Liquid Crystal Display), which has been widely used in the past. , So-called smart meters (FIG. 1 (b)), water meters (FIG. 1 (c), (d)), digital nogis (FIG. 1 (e)), digital multimeters (FIG. 1 (f)) and the like.

In addition, speed meters (Fig. 2 (a)), clamp-type ammeters (Fig. 2 (b)), and decibel display meters (Fig. 2) are types of meters that do not directly display numbers but can be read from a pointer. (C)), voltmeters (FIG. 2 (d)), pressure gauges (FIG. 2 (e)), micrometer (FIG. 2 (f)), and various other instruments are in widespread use.

In addition, when the facility or device to which the electric meter, water meter, voltmeter, etc. are applied is large, as shown in FIGS. 3 (a) to 3 (c), a plurality of units are planar or linear and regular. It is often installed in an array.

FIG. 4 shows a configuration of an information processing system including an information processing device and a computer program according to an embodiment. In the following description, the case where the information processing apparatus and the computer program are applied to meter reading work for gas, electricity, water, etc. in a general house will be described as an example.

In this example, a case where a meter reader (or an inspector) visits individual houses, buildings, facilities, etc. and reads the electric meters installed in or near them will be described as an example. Hereinafter, the place where the meter is installed is referred to as a meter reading site.

This information processing system provides a meter reading service for an electric meter, and as shown in FIG. 4, a cloud including a portable terminal device 100, a radio base station 200, a client terminal 300, a server 400, and a network 500. Realize computing. This system processes the information obtained from the meters MT1 to MTn installed at the meter reading site, and creates a form related to, for example, billing of the usage amount.

The portable terminal device 100 is an information processing device for a meter reader to carry and input reading values of meters MT1 to MTn installed at a meter reading site and transmit them to a server 400. Details will be described later.

The reading value is a value measured by each of the meters MT1 to MTn. Further, a value read, recorded or reported by a meter reader visually or by a device is referred to as a meter reading value. The reading value and the meter reading value are substantially the same. That is, the meter reading value and the value measured by each of the meters MT1 to MTn are substantially the same value.

The wireless base station 200 wirelessly communicates with the portable terminal device 100 and connects the portable terminal device 100 to the network 500. For example, when the network 500 is a LAN constructed in a business establishment, it is an access point that adopts a wireless LAN (IEEE802.11 series) as a communication method. When the network 500 is a mobile phone network of a telecommunications carrier, it is a base station device that performs wireless communication corresponding to standards such as 3G, 3.9G (LTE (registered trademark), etc.), 4G, 5G, and the like.

That is, the wireless LAN and the mobile phone network are merely examples, and as long as the portable terminal device 100 can be connected to the network 500 by wireless communication, the method is not limited to these methods, and Bluetooth (registered trademark) is used. It can be applied to any communication method including.

The client terminal 300 is a terminal installed in a meter reading service management department and used by an operator in that department, and is, for example, an information processing device such as a desktop type or laptop type personal computer.

Then, the client terminal 300 has a function of downloading a data file uploaded to the server 400 by the portable terminal device 100, and performing reference / viewing, editing / aggregation, data conversion / file creation, issuance of a form, and the like.

Further, the client terminal 300 may have all the functions of the portable terminal device 100 or a part of the data processing functions, and may execute the same processing as the portable terminal device 100. That is, the client terminal 300 may have the same function so as to perform data processing on the portable terminal device 100 instead, except for taking a picture at the meter reading site.

The server 400 is the center of cloud computing provided by the system, and stores and manages information uploaded from the portable terminal device 100 and the client terminal 300, and performs predetermined data processing on the above information. Alternatively, the stored information and data processed information are provided (downloaded) to the portable terminal device 100 and the client terminal 300 to realize data sharing among system users.

Further, the server 400 can save the computer resources of each device by taking part or all of the data processing by the portable terminal device 100 and the client terminal 300 on behalf of each device. Further, the server 400 provides the OS and application software used by the portable terminal device 100 and the client terminal 300 to each device, and updates the latest information to realize the service.

Therefore, in the database of the server 400, the meter reading data uploaded from the portable terminal device 100 is stored as the meter reading data 400a, and the ID of the device targeted for the meter reading service, its position information, and the map information around it are stored. The map data 400b associated with the above is saved. In addition, various programs of the portable terminal device 100 and the client terminal 300 are stored in the database.

The service provided by the server 400 may be provided by a subscription method to the portable terminal device 100 or the client terminal 300 owned (or rented) by the client receiving the service.

The portable terminal device 100 may be carried by a meter reader and operated directly as an operator, or may be remotely controlled via a network 500. For example, it may be installed in a remote control device such as a drone or a robot. In this case, the attitude control of the drone and the operation of the robot may be performed by remote control through the camera image of the portable terminal device 100.

Further, the portable terminal device 100 operates a remote control device such as a drone or a robot, and the process described below is performed on the camera image mounted on the remote control device in place of the camera included in the portable terminal device 100. May be applied.

The meters MT1 to MTn are, for example, watt-hour meters for measuring the amount of electricity used, and display the numerical values obtained by the measurement. Further, each meter is provided with a display unit D and an ID plate P on the housing, for example, as shown in FIG. 5A.

The display unit D indicates the measured amount of electricity used as a rotary (analog type) or digital Arabic numeral. In the case of the digital type, for example, it is a digital display device that constitutes a plurality of digits by using a plurality of 7-segment displays displaying numbers from 0 to 9, and is used in the above-mentioned amount of electricity and equipment and equipment. The numerical value (meter reading value) according to the operating state is shown.

In the case of the rotary type, for example, it is a mechanical direct-reading display device that constitutes a plurality of digits by using a plurality of number wheels on which numbers from 0 to 9 are described, and the amount of electricity used as described above. The numerical value (meter reading value) according to the operating condition of the equipment and equipment is shown.

The ID plate P is provided on the same surface as the display unit D, and has an identification number and attributes (electricity, gas, water, supply entity, installation location, manufacturing date and time) uniquely assigned to the provided meters (MT1 to MTn). , Installation date and time, specifications indicating performance, etc.), and input specification information that specifies the input field for meter reading values corresponding to the application software that aggregates meter reading values. Various methods such as printing and engraving can be considered for the description, and the description may be a sticker or the like.

Further, the ID plate P may present the identification information and the input designation information by a two-dimensional bar code (two-dimensional data code) instead of the above-mentioned plate or seal. The two-dimensional bar code is decoded by a predetermined algorithm, and the above information (identification information and input designation information) is obtained.

Further, a part of the above information may be indicated by the above-mentioned plate or seal, and the remaining information may be indicated by the above-mentioned two-dimensional bar code, or all the information may be indicated by the above-mentioned plate or seal and the two-dimensional bar. It may be displayed in duplicate in the code.

Further, in addition to the case where the meters MT1 to MTn are installed alone as shown in FIG. 5A, for example, four meters MT2 to MT5 are installed as a group as shown in FIG. 5B. Or, as shown in FIG. 5C, when six meters MT6 to MT11 are installed as a group, a larger number of meters may be installed as a group.

In addition, it is conceivable that the arrangement is linear instead of the rectangular arrangement as shown in FIGS. 5 (b) and 5 (c), or that the arrangement is regularly / irregularly arranged other than these. In the following description, when a plurality of meters are installed together, a group composed of these meters is referred to as a meter group. The meters that make up the meter group may measure and display information on different lifelines and infrastructure.

Next, the portable terminal device 100 will be described.
The portable terminal device 100 is a terminal used by a meter reader of meters MT1 to MTn as an operator, for example, a tablet computer as shown in FIG. 6, a portable laptop personal computer, or the like. It is an information processing device.

Further, as shown in FIG. 7, the portable terminal device 100 has a hardware configuration similar to that of a general computer, and has at least a communication unit 101, an input unit 102, a display unit 103, and a camera 104 connected by a bus. It includes a GNSS (Global Navigation Satellite System) receiving unit 105, a storage unit 106, and a control unit 110.

The communication unit 101 is a wireless communication interface that establishes a wireless communication link with the wireless base station 200 and communicates with the server 400 via the wireless base station 200 and the network 500. The wireless communication corresponds to a communication method according to the specifications of the wireless base station 200.

As an example of this communication method, various standards such as wireless LAN (IEEE802.11 series), 3G, 3.9G (LTE (registered trademark), etc.), 4G, 5G, Bluetooth, etc. can be considered, but any of them may be used. , Not limited to these.

The input unit 102 is an input device such as a touch panel mounted on the display unit 103, which will be described later, or a key switch provided on the housing of the portable terminal device, and can input various information from a meter reader. Accept instructions. The touch panel can be input using a stylus or a finger, and various methods such as a capacitance method, a resistance film method, and a projection type infrared method can be applied.

The display unit 103 visually provides information to the meter reader, and displays, for example, an information input field, a software key, and various images (photographs, CG (computer graphics) images).

The information input field and the software key are displayed so as to correspond to the operation on the touch panel of the input unit 102 described above by the control of the control unit 110 described later. As the device to be used, various display devices such as a liquid crystal panel, an organic EL (Electro Luminescence) panel, and electronic paper can be applied.

The camera 104 has a predetermined format (for example, JPEG (Joint Photographic Experts Group)) from an optical system such as a lens, an image pickup unit equipped with an image sensor such as CMOS (Complementary MOS), and an image pickup signal obtained by the image pickup unit. ) Is a digital camera equipped with a signal processing unit that generates image data.

The control unit 110 measures the time, and the image data obtained by the camera 104 includes additional information (for example, Exif (Exchangeable image file format)) indicating the date and time when the time was taken and the position information described later. ) Data) is added and recorded.

The GNSS receiving unit 105 performs position measurement (positioning), time reception, and the like using signals emitted from artificial satellites.

The storage unit 106 includes the OS (Operating System) of the control unit 110, which will be described later, application software, data generated by the operation of the application software, various parameters, data input from the meter reader, and an image captured by the camera 104. It stores data (such as a photograph of the display surface of the meter reading values of meters MT1 to MTn), data acquired (downloaded) from the server 400, and other temporary data for information processing, and is used for RAM (RAM). Random Access Memory), ROM (Read Only Memory), flash memory such as SSD (Solid State Drive), and recording devices such as HDD (Hard Disk Drive) are provided in combination according to the characteristics of the data.

Further, the storage unit 106 stores the photographing support data 106a, the base image data 106b, the recognition data 106c, and the meter reading data 106d.
The shooting support data 106a is support information for supporting the shooting of an image that is the basis of meter reading (the image data is hereinafter referred to as base image data), and is shooting status (meter reading location, date, time, and time). , The identification information of the meter to be meter-readed, the product model number), and is appropriately updated using the past meter-reading data and the information (map information and template) stored in the server 400.

Specifically, the photographing support data 106a includes the meter reading value and its related information. Related information includes, for example, the date and time when the meter was read, the position information (geographical coordinates) indicating the location where the meter was read, the name of the meter (meter name) which was the target of the meter reading, and the meter or meter group. Uniquely given identification information or model number, also called meter number (hereinafter referred to as meter ID), ID coordinate data P-ID of the part where the meter ID is reflected on the base image (the base of the part where the meter ID is read) From the start of meter reading (coordinates on the image), meter coordinate data P-MR (coordinates on the base image of the part where the meter reading is read) where the meter reading (meter reading) is reflected. Video data taken by the camera 104 until the end (hereinafter referred to as support moving image data), camera settings at the time of shooting (exposure and shutter speed), incidental information arbitrarily input by the meter reader (character string, etc.) And so on.

The basic image data 106b is image data obtained by the camera 104, and is, for example, basic image data or image data showing the meters MT1 to MTn and its vicinity, and is a reading displayed on the meters MT1 to MTn. It is used for reading values and meter IDs, specifying meter reading locations, and so on.

The recognition data 106c is data generated by the image processing unit 114, which will be described later, based on the basic image data 106b. Specifically, it is information (meter ID and meter reading value) obtained by subjecting the basic image data to character recognition processing such as optical character recognition (OCR) described later and decoding of a two-dimensional bar code. ..

The meter reading data 106d is data in which the data which is the meter reading result is associated with the accompanying information accompanying this data among the recognition data 106c. Since the accompanying information is later used as related information of the imaging support data 106a, for example, the date and time when the meter reading was performed, the position information (geographical coordinates) indicating the location where the meter reading was performed, and the meter which was the target of the meter reading. Name (meter name), meter ID unique to the meter or meter group, ID coordinate data P-ID, meter coordinate data P-MR, support moving image data, camera setting data, incidental information, and the like.

The control unit 110 includes a processor such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit), a chipset, RAM, ROM, and the like, and controls each unit of the portable terminal device 100 in an integrated manner.

ROM stores firmware and setting values (various parameters). The CPU realizes various control functions by reading the OS and application software from the storage unit 106 into the RAM according to the above firmware, executing the OS and application software, and using the RAM as a work area (work area). do.

The control unit 110 realizes at least the following control functions by executing the OS and application software. That is, the control unit 110 functions as a communication control unit 111, an input control unit 112, a display control unit 113, an image processing unit 114, a position information processing unit 115, and a meter reading data aggregation processing unit 116 by executing software. These functions can work in tandem with each other. It is also possible to integrate a part or all of each of these functions with other functions, or to divide each function of 111 to 116 into a plurality of functional blocks from different viewpoints and explain them in different expressions. ..

The communication control unit 111 controls the communication unit 101 to establish a wireless communication link with the wireless base station 200 according to a predetermined communication protocol, and further communicates with the server 400 through the network 500. For example, from the server 400. Data is downloaded and data is uploaded to the server 400.

The input control unit 112 controls the input unit 102 to interpret the meter reader's request from the meter reader's operation on the input unit 102, input information (character string, etc.), capture data, and change the association. It accepts, captures image data captured by the camera 104, and so on.

The display control unit 113 controls the display unit 103 to display various information including characters and images and a graphical user interface (hereinafter, GUI (Graphical User Interface)). Examples of the GUI are the above-mentioned information input field and software key, and these displays correspond to the input through the touch panel of the input unit 102. In addition, the image capture position is indicated by a frame line or the like, and the guide display is performed by indicating the movement direction of the composition by an arrow or the like.

The image processing unit 114 has a function as a character recognition engine and a function as an analysis engine. The character recognition engine performs character recognition processing such as optical character recognition on the image data obtained by the camera 104, recognizes the characters contained in the image, and outputs text data (that is,). Conversion of image data to text data). The analysis engine decodes the two-dimensional bar code contained in the image to obtain information (for example, meter identification information or information obtained by reading an analog pointer value and converting it into a digital value).

The position information processing unit 115 includes an acceleration sensor, a gyro sensor, and the like, and is based on the detection results, the positioning result by the GNSS receiving unit 105, and / or the positioning information obtained from the radio base station 200 by the communication control unit 111. Positioning of the portable terminal device 100 is performed.

The meter reading data aggregation processing unit 116 controls various processes related to the creation of meter reading data in an integrated manner, and includes a shooting support data acquisition unit 116a, a shooting support data specifying unit 116b, a guide display control unit 116c, and a meter reading data. The creation unit 116d is provided.

The shooting support data acquisition unit 116a may download past meter reading data satisfying the conditions from the server 400 based on the current position and time, and / or the geographical position and time specified by the meter reader, or The meter reading data 106d remaining in the storage unit 106 is detected, and these meter reading data are stored in the storage unit 106 as imaging support data 106a.

The shooting support data specifying unit 116b identifies data related to a device that matches or is similar to the device captured in the image captured by the camera 104 among the shooting support data 106a stored in the storage unit 106.

The guide display control unit 116c performs guide display based on the past meter reading work based on the shooting support data 106a specified by the shooting support data specifying unit 116b. According to this guide display, the meter reader takes a picture of a meter or the like.
The meter reading data creation unit 116d creates meter reading data 106d based on the basic image data.

Next, the operation of the information processing system having the above configuration will be described. In the following description, among the processes in the portable terminal device 100, the meter reading data aggregation process (hereinafter referred to as meter reading data aggregation process) will be described in particular.

This meter reading data aggregation processing is performed by the meter reading data aggregation processing unit 116, assists the meter reading work on the meters MT1 to MTn by the meter reader, acquires information such as the meter reading value displayed on the meters MT1 to MTn, and obtains the meter reading data 106d. It is summarized (aggregated) and uploaded to the server 400.

FIG. 8 is a flowchart for explaining the meter reading data aggregation process. Hereinafter, it will be described with reference to FIG.
The meter reading data aggregation process shown in this figure is realized by the control unit 110 that executes the application software functions as the meter reading data aggregation processing unit 116.

In the following description, it is assumed that the process shown in FIG. 8 can be realized by executing one application software, but the present invention is not limited to this, and one main application software is used as another application software. It is also possible to realize it in the form of incorporating the above or in the form of operating multiple application software in parallel.

In step 801 the meter reading data aggregation processing unit 116 acquires the current position information (hereinafter referred to as the current position information) from the position information processing unit 115, and the meter reading data 400a and the map corresponding to the current position information from the server 400. The data 400b is acquired, and the process proceeds to step 802.

Specifically, the shooting support data acquisition unit 116a requests the position information processing unit 115 to provide the current position information. On the other hand, the position information processing unit 115 provides the latest current position information to the photographing support data acquisition unit 116a.

Here, the position information processing unit 115 may start positioning in response to a request from the shooting support data acquisition unit 116a and provide position information as a result, or may periodically perform positioning in advance. And, in response to the above request, the latest positioning result may be provided as the current position information.

In addition, the information on the current position may be estimated from the immediately preceding meter reading position. For example, the database of the storage unit 106 or the server 400 stores meter reading order information in which past meter reading points and times are associated in chronological order according to the meter reading order.

Then, the photographing support data acquisition unit 116a obtains the elapsed time from the time of the last meter reading and the current time, and refers to the meter reading order information based on this elapsed time and the previous meter reading location, and refers to the next meter reading location. May be estimated.

Further, in the meter reading order information, the weather and illuminance at the time of the examination may be stored for each meter reading location and used for estimating the meter reading location by collating with the current weather and illuminance.
Further, the meter reader may input the current position information through the input unit 102 or select the current position from the list of position information stored in the storage unit 106 in advance.

In step 802, the meter reading data aggregation processing unit 116 acquires shooting support data based on the current position information acquired in step 802.
Specifically, the shooting support data acquisition unit 116a requests the communication control unit 111 to access the server 400 and download the meter reading data 400a and the map data 400b corresponding to the current position information.

On the other hand, the communication control unit 111 controls the communication unit 101 to transmit the current position information to the server 400, and requests that the meter reading data 400a and the map data 400b associated with the current position information be provided. ..

On the other hand, the server 400 detects the meter reading data 400a and the map data 400b corresponding to the current position information from its own database and transmits them to the portable terminal device 100.

The meter reading data 400a and the map data 400b each include position information. Therefore, in response to the request from the portable terminal device 100, the server 400 has a predetermined range from the meter reading data 400a and the map data 400b including the position information matching the current position information, and / or the position indicated by the current position information. The meter reading data 400a and the map data 400b including the position information in (or preliminarily associated with) are detected and transmitted to the portable terminal device 100.

When the shooting support data acquisition unit 116a receives the meter reading data 400a and the map data 400b from the server 400, the shooting support data acquisition unit 116a stores these received information in the storage unit 106 as the shooting support data 106a.

The map data 400b included in the photographing support data 106a can be used, for example, for navigation of a meter reading location. For navigation, the control unit 110 uses the display control unit 113 to display a map based on the map data 400b on the display unit 103, and displays the current position positioned by the position information processing unit 115 on the map.

Further, here, the meter reading data 400a and the map data 400b have been described as being downloaded from the server 400, but a tablet computer, which is relatively large compared to a smart phone or the like, has a large storage capacity of the storage unit 106, so that the meter reading staff The meter reading data 400a and the map data 400b can be stored only in the range in which the meter reading is in charge.

Therefore, before the meter reading staff heads to the meter reading site, the meter reading data aggregation processing unit 116 sets the meter reading data 400a and map data of the area to be the next meter reading at a predetermined time (outside the meter reading work time). The 400b may be downloaded from the server 400 in advance. By such automatic information update processing, the work can proceed even in a situation where communication with the server 400 is not possible.

In step 803, the meter reading data aggregation processing unit 116 displays a message prompting the meter reader to point the camera 104 at the meters (MT1 to MTn) to be meter-read, and then activates the camera 104. Then, the meter reading data aggregation processing unit 116 reads the meter ID captured by the camera 104, detects the shooting support data 106a including the meter ID, and proceeds to step 804.

Specifically, the shooting support data specifying unit 116b causes the display control unit 113 to display a display prompting the meter reader to point the camera 104 at the meters (MT1 to MTn) to be meter-read, and the camera 104. To start.

As a result, the display control unit 113 displays a display prompting the meter to point the camera 104 at the display unit 103, and displays an image taken by the activated camera 104 on the display unit 103. The meter reader who follows the prompting display moves the portable terminal device 100 so that the meter is included in the composition of the shooting while checking the captured image of the camera 104 displayed on the display unit 103.

Subsequently, the shooting support data specifying unit 116b causes the image processing unit 114 to perform OCR (Optical Character Recognition) processing and read the meter ID (text conversion). On the other hand, the image processing unit 114 performs OCR processing on the image captured by the camera 104 every moment, and when the meter ID is detected, the meter ID is notified to the imaging support data specifying unit 116b.

Here, when a two-dimensional bar code is assigned as the meter ID, the image processing unit 114 decodes the two-dimensional bar code for the image taken by the camera 104 every moment, and as a result of the decoding, the meter ID Is detected, this meter ID is notified to the photographing support data specifying unit 116b.

Upon receiving the notification of the meter ID, the shooting support data specifying unit 116b detects the shooting support data 106a including the notified meter ID from the storage unit 106, and proceeds to step 804. As a result, the photographing support data specifying unit 116b identifies one of the numerous photographing support data 106a as the information necessary for the guide display for reading and photographing the meter reading value.

If the photographing support data 106a including the notified meter ID cannot be detected from the storage unit 106, the process proceeds to step 804. Alternatively, if it cannot be detected, some error may be considered in the process up to this point, so the process may proceed to step 801 and the process may be restarted from positioning.

In step 804, the meter reading data aggregation processing unit 116 performs a guide display for photographing the meter reading value displayed on the meters (MT1 to MTn) based on the photographing support data 106a detected in step 803, and in step 805. Transition. Further, in step 804 and subsequent steps, shooting is performed based on the camera settings (exposure and shutter speed) included in the shooting support data 106a detected in step 803.

Specifically, the guide display control unit 116c displays the image captured by the camera 104 on the display unit 103 with respect to the display control unit 113, for example, as shown in FIG. 9, and the photographing detected in step 803 is performed. The guide is displayed based on the support data 106a.

In the example of FIG. 9, the guide display shows the guide frame F, software keys SK1 to SK3 for designating the type and position of the reading position, and an OK key OK for the meter reader to instruct confirmation.

The guide frame F has a size designed to guarantee that the numerical value and the two-dimensional bar code displayed on the guide frame F can be read when the object to be inspected such as a meter is fully photographed in the frame. ..

Further, as illustrated in FIG. 5B, the portable terminal device 100 captures a meter group consisting of four meters MT2 to MT5 at one time as shown in FIG. 10, and four meters MT2 to MT5. It is possible to perform meter reading at once.

In this case, the guide display control unit 116c includes the ID coordinate data P-ID (coordinates on the base image of the portion where the meter ID is read) and the meter coordinate data P-MR included in the shooting support data 106a detected in step 803. Based on the relative positional relationship between (coordinates on the base image of the part where the reading value of the meter is read) and the coordinates displaying the guide frame F in the display area of the display unit 103, the shooting position guide SP1 and The display coordinates of the shooting position guide SP2 are calculated.

The shooting position guide SP1 is a guide display for shooting the display unit D shown in FIG. 5, while the shooting position guide SP2 is a guide display for shooting the ID plate P shown in FIG. ..

In the above calculation of the display coordinates, when the four meters MT2 to MT5 are copied as much as possible in the guide frame F, the meter ID (ID plate P) of each meter and the reading value (display unit D) of each meter are used. It estimates the existing coordinates.

That is, in this calculation, the coordinates that the meter ID and the reading value of the meter may exist on the image are estimated from the information included in the shooting support data 106a when the shooting was performed in the past.

Then, based on this calculation result, a display for guiding the shooting is performed. From the model number of the meter, information about its size may be included in the photographing support data 106a and used in the above calculation.

In this way, the guide display control unit 116c that determines the coordinates of the shooting position guide SP1 and the shooting position guide SP2 displays the shooting position guide SP1 as a guide display for the display control unit 113, for example, as shown in FIG. And the shooting position guide SP2 is displayed on the display unit 103.

Further, the guide display control unit 116c performs the balloon display PU1 and PU2 in association with the shooting position guide SP1 and the shooting position guide SP2, respectively. The balloon display PU1 and PU2 of the same meter are displayed side by side at positions closer to the balloon displays PU1 and PU2 of the meters of other meters, thereby indicating the correspondence relationship. In FIG. 11, the meters MT2 to MT5 are not shown for the sake of brevity.

The balloon displays PU1 and PU2 display serial numbers (Meter1-1, Meter2-1, ...) given to the meters reflected in the guide frame F, and as will be described later, in the shooting position guide SP1 and in the shooting position guide. The information read from the image in SP2 is associated and displayed.

The correspondence is shown by connecting with an arrow line or a leader line as shown in FIG. 11, for example. Since the same serial number is assigned to the meter ID of the same meter and the reading value of the meter, the meter reader who sees the balloon displays PU1 and PU2 can confirm whether or not the appropriate correspondence is made.

In response to the guide display made in this way, the meter reader makes the housing of the portable terminal device 100 face the four meters MT2 to MT5 so that the four meters MT2 to MT5 are reflected in the guide frame F as much as possible. , Up / down, left / right, or back and forth, and further, as shown in FIG. 12, for example, the reading value (display unit D) of the meter of each meter fits in the shooting position guide SP1 and the meter ID (ID plate P). Is moved so that it fits within the shooting position guide SP2.

In the example of FIG. 10, the case where a plate or a seal is attached to each of the meters MT2 to MT5 as the meter ID has been described, but instead, for example, as shown in FIG. 13, each meter MT2 to MT5 has been described. It is also conceivable that a two-dimensional bar code is given to.

This is suitable when the print on the ID plate P (or sticker) is small and difficult to read by imaging, or when the plate or sticker cannot be photographed together with the reading value of the meter. In addition, it is conceivable to indicate the ID and installation location of the meters MT2 to MT5 with one two-dimensional bar code.

Further, in step 804, the guide display control unit 116c reproduces the support moving image data included in the photographing support data 106a detected in step 803 in response to the request of the meter reader, and displays the past meter reading to the meter reader. To project.

Specifically, when a reproduction request is received from the meter reader through the input unit 102, the input control unit 112 detects this request and notifies the guide display control unit 116c. The guide display control unit 116c reads the support video data from the shooting support data 106a and instructs the display control unit 113 to reproduce the support video data. The reproduction is performed on the display unit 103. As a result, the meter reader can confirm the state of past meter reading at the meter reading site, and can perform appropriate meter reading.

If the shooting support data 106a cannot be detected in step 803 (when there is no corresponding data), the guide display control unit 116c displays only the guide frame F in step 804 to provide appropriate shooting support data. Indicates that 106a does not exist. Alternatively, the guide display control unit 116c displays a predetermined number of guides at preset positions, or performs guide display using the photographing support data 106a having a similar meter arrangement.

In a similar determination, the shape of the meter is recognized from the image captured by the camera 104, the number and arrangement of the meters are obtained, and the shooting support data 106a corresponding to the obtained number and arrangement of the meters is detected and used for the guide display. ..

As another method, the meter reader operates the software keys SK1 to SK3 on the image captured by the camera 104 to arbitrarily specify the reading position, and the guide display control unit 116c detects the specified position. It may be recognized as a reading position.

That is, the meter ID reading position is specified by the meter reader by dragging the software key SK1 to the reading position on the touch panel (input unit 102). Similarly, the reading position of the reading value of the meter is also specified by dragging the software key SK2 to the reading position.

In addition, the guide display control unit 116c recognizes the shape (outer shape) of the meter from the image captured by the camera 104, refers to the shooting support data 106a, and calculates the shooting position of the meter ID and the shooting position of the reading value of the meter. , A guide display may be displayed at that position.

In step 805, the meter reading data aggregation processing unit 116 performs OCR processing on the image captured by the camera 104, obtains the meter ID and the meter reading value converted into text from the image, and proceeds to step 806.

Specifically, the guide display control unit 116c first instructs the display control unit 113 to magnify and display the image located in the shooting position guide SP1 on the same position as shown in FIG. 14, and read the meter. Make it easier for personnel to recognize the reading of the meter. By enlarging and redisplaying the captured image at the same position in this way, the meter reader can determine whether or not the image that is the basis of the meter reading is blurred, and whether or not the imaging area is appropriate.

Next, the guide display control unit 116c causes the image processing unit 114 to perform OCR processing on the image located in the shooting position guide SP1 to obtain a meter reading value (reading value) converted into text from the image. At the same time, as shown in FIG. 14, the obtained meter reading value (reading value) is displayed on the balloon display PU1 associated with the shooting position.

Similarly, the guide display control unit 116c subsequently causes the image processing unit 114 to perform OCR processing on the image located in the shooting position guide SP2 to obtain a text meter ID from the image. As shown in FIG. 14, the obtained meter ID is displayed by the balloon display PU2 associated with the shooting position.

As a result, the meter reader can easily recognize which meter the meter reading value or meter ID is for. Here, the guide display control unit 116c may display the recognition accuracy of the OCR process for each meter reading value or meter ID in% display to alert the meter reader. Further, only when the accuracy is low, the color may be changed, or a caution display or a% display of the recognition accuracy may be performed to call attention.

In step 805, when the meter reading value and the meter ID cannot be read normally, the guide display control unit 116c performs a guide display prompting the photographer to change the composition of photography, as shown in FIG. In the example of FIG. 15, as a guide display, the direction in which the composition should be moved is indicated by an arrow.

Here, the determination of whether or not the meter reading value or the meter ID is normally read is performed based on, for example, the imaging support data 106a detected in step 803. Specifically, regarding the meter ID, if the ID of the same character string as the meter ID recognized by the guide display control unit 116c exists in the shooting support data 106a, it is determined that the data has been read normally, and if it does not exist, it is determined that the data has been read normally. If there is an excess or deficiency in the number of character strings, it is judged that the data has not been read normally.

Regarding the meter reading value, the meter reading value recognized by the guide display control unit 116c is compared with the meter reading value associated with the same meter ID in the imaging support data 106a, and the difference is within the threshold range (or above the threshold value). In the case of, it is determined that the reading is normal, and if it exceeds a predetermined range (less than the threshold value) (or the read meter reading value is small), it is determined that the reading is not normal.

Further, the guide display control unit 116c determines the direction in which the composition should be moved based on the deviation of the center position of the meter reflected in the guide frame F or, in the case of a plurality of meters, the deviation of the center position of the group. , The direction in which the center of the meter or the array approaches the center in the guide frame F is indicated by an arrow.

When the meter reader changes the composition according to the display of the arrow, the guide display control unit 116c turns off the arrow display as shown in FIG. 16, for example, and then the meter obtained by the OCR process as shown in FIG. Display ID and meter reading value. As a result, the meter reader can confirm that the portable terminal device 100 is properly recognizing. In FIG. 16, the balloon displays PU1 and PU2 are omitted for the sake of brevity.

Further, as a case where the meter reading value and the meter ID cannot be read normally, it is conceivable that many meters are tried to be read at once. In this case, the guide display control unit 116c instructs the display control unit 113 to display a balloon (error display) indicating a portion that cannot be read, such as “difficult to read”, as shown in FIG. 17, and meter reading. Ask the members to change the composition. The reason why the error display appears is that the meter ID or meter reading value converted into text from the image cannot be obtained because the characters on the image are small.

In addition, as illustrated in FIG. 13, when the meter ID or the like is displayed with a two-dimensional bar code, the guide display control unit 116c is an area where the two-dimensional bar code exists, for example, as shown in FIG. And the blowout display PU2 of the meter ID obtained by decoding this two-dimensional bar code are connected by a leader line or the like to show the correspondence.

In step 806, the meter reading data aggregation processing unit 116 asks the meter reading staff whether or not to take a picture.
Specifically, the guide display control unit 116c causes the display control unit 113 to display a confirmation including a guidance such as "Do you want to take a picture?" On the display unit 103.

Here, when the meter reader operates the "OK" button, the input control unit 112 detects this operation and notifies the guide display control unit 116c, and the guide display control unit 116c proceeds to step 807.

On the other hand, when the meter reader operates the "Cancel" button, the input control unit 112 detects this operation and notifies the guide display control unit 116c, and the guide display control unit 116c proceeds to step 801 and steps. The processes of 801 to step 805 are executed again.

As an intention display equivalent to the operation of the "Cancel" button, the meter reader may display the intention by not operating anything for a predetermined time. That is, when the input control unit 112 does not detect any operation within a certain period of time, the guide display control unit 116c determines that the meter reader has no intention of meter reading, and proceeds to step 801.

Further, it is conceivable that the above confirmation display displays only the "OK" button and the "Cancel" button, and does not display the wording of the guidance. This is because a meter reader who is accustomed to the operation can recognize that the process of processing is in the step of shifting to step 807 by displaying the "OK" button and the "Cancel" button.

In step 807, the meter reading data aggregation processing unit 116 asks the meter reader whether to perform single shooting or continuous shooting.
Here, as a shooting procedure, when six meters MT6 to MT11 are included as in the meter group as illustrated in FIG. 5 (c), as shown in FIG. 19, all of (A) are performed. There are two ways to think about: "single shooting", which is a method of taking pictures of meters all at once and reading them, and (B) a method of taking pictures of some meters and reading them, and (C) taking pictures of the remaining meters and reading them. Will be.

Specifically, the guide display control unit 116c causes the display control unit 113 to display a confirmation such as "Do you want to perform continuous shooting?" To the display unit 103, and also displays an intention to perform continuous shooting. The "continuous shooting" button for accepting and the "single shooting" button for accepting the intention to perform single shooting are displayed.

Here, for example, as described above with reference to FIG. 17, when an error is displayed when trying to read the six meters MT6 to MT11 at once in step 805, the meter reader who is aware of the error Select "Continuous shooting" and consider shooting in multiple meter groups.

In step 807, the meter reader has already recognized in advance that the meter reading cannot be performed in a batch in step 805, and therefore avoids the batch meter reading in pursuit of work efficiency recklessly. As a result, it is possible to prevent a decrease in efficiency such as re-shooting.

Here, when the meter reader operates the "continuous shooting" button, the input control unit 112 detects this operation and notifies the guide display control unit 116c, and the guide display control unit 116c shifts to step 810. ..

On the other hand, when the meter reader operates the "single shooting" button, the input control unit 112 detects this operation and notifies the guide display control unit 116c, and the guide display control unit 116c shifts to step 808.

In step 808, the meter reading data aggregation processing unit 116 acquires the meter ID and the meter reading value from the image obtained by the camera 104, and proceeds to step 809.
Specifically, the guide display control unit 116c executes the same processing as in steps 804 and 805.

That is, the guide display control unit 116c performs a guide display based on the shooting support data 106a detected in step 803, and guides the meter reader to the composition of shooting, as in the process of step 804. In the following shooting, shooting is performed based on the camera settings included in the shooting support data 106a detected in step 803.

Then, as in the process of step 805, the guide display control unit 116c magnifies and displays the image located in the shooting position guide SP1 on the same position as shown in FIG. 14, for example, and the image captured by the camera 104. Of these, OCR processing is performed on the images in the shooting position guides SP1 and SP2, and the meter reading value and the meter ID converted into text are obtained from the images. The meter reading value and the meter ID obtained in this way are displayed as balloon displays PU1 and PU2, respectively.

The meter reader confirms whether the balloon display PU1 and PU2 displayed on the display unit 103 are correctly associated with each other, and whether the OCR process is performed correctly. That is, it can be confirmed whether the balloon display PU1 of the meter reading value of a certain meter is erroneously associated with the balloon display PU2 of the meter ID of a different meter.

Here, if the meter reading value and the meter ID are erroneously associated with each other, the meter reader drags the balloon display PU1 or PU2 through the touch panel (input unit 102) to indicate the correct combination, and accordingly. The guide display control unit 116c changes the correspondence and changes the display position of the balloon display PU1 or PU2 to the position corresponding to the correspondence.

Specifically, the guide display control unit 116c recognizes the operation of the meter reader through the input control unit 112, and for example, the balloon display PU1 (or PU2) is dragged and superposed on the other balloon display PU2 (or PU1). When the operation is performed, it is recognized that the superimposed balloon display PU1 and PU2 are related to the same meter, the meter reading value and the meter ID are handled in association with each other, and the display is performed side by side.

Eventually, when the input control unit 112 detects that the meter reader has operated the software key "shooting" displayed on the display unit 103, the guide display control unit 116c uses the entire OCR process in step 808. The image is stored in the storage unit 106 as the base image data 106b, and the meter reading value and the meter ID obtained by the OCR process are stored in the storage unit 106 as the recognition data 106c.

The basic image data 106b and the recognition data 106c saved here are associated with each other by the guide display control unit 116c. Further, when the operation is performed on the software key "shooting", the base image data 106b is displayed and the display based on the recognition data 106c is performed on the image. As a result, for example, an image as shown in FIG. 14 is displayed as a still image on the display unit 103, and the meter reader can confirm the image that is the basis of reading and the reading result.

Here, at the timing when the operation for the software key "shooting" is performed, the shooting by the camera 104 may be executed again, the OCR process may be executed again, and the meter ID and the meter reading value may be acquired. .. Then, at that time, the focal length and exposure of the camera 104 may be adjusted, or a flash may be emitted as needed.

In step 809, the meter reading data aggregation processing unit 116 creates meter reading data 106d based on the information recorded in the storage unit 106 in step 808.
Specifically, the meter reading data creation unit 116d creates meter reading data 106d in which these information are aggregated in a tabular format based on the basic image data 106b and the recognition data 106c acquired in step 808, and displays and controls this data. The display unit 103 displays the unit 113.

In the meter reading data 106d, for example, as shown in FIG. 20, a row is assigned to each meter, and for each meter, (a) meter name (serial number at the time of shooting), (b) meter ID read in step 808, ( c) The image of the portion of the basic image data 106b from which the meter ID was read, (d) the meter reading value read in step 808, (e) the image of the portion of the basic image data 106b from which the meter reading value was read, (f). ) Provide a cell for incidental information that the meter reader arbitrarily inputs.

The meter reader visually compares the meter ID read in step 808 with the image of the portion where the meter ID is read, and confirms whether the reading is correct. Similarly, the meter reader visually compares the meter reading value read in step 808 with the image of the portion where the meter reading value is read, and confirms whether the reading is correct.

Then, the meter reading data creation unit 116d monitors the detection result of the operation on the input unit 102 by the input control unit 112, and operates the cells (b), (d), and (f) through the touch panel of the display unit 103. Determine if it was broken. When the operation is performed here, the meter reading data creation unit 116d accepts an editing operation for the information of the operated cell. Specifically, when a character string (for example, a numerical value) is input, it is replaced with the input character string.

After that, the meter reading data creation unit 116d monitors the detection result of the operation of the input control unit 112 on the input unit 102, and receives an instruction to end or save the editing from the meter reader through the touch panel of the display unit 103. Then, the meter reading data creation unit 116d stores the aggregated data edited as necessary in the storage unit 106 as the meter reading data 106d.

That is, the meter reading data 106d includes (a) the meter name (serial number at the time of shooting), (b) the meter ID read in step 808, and (c) the image of the portion of the basic image data 106b in which the meter ID is read. Coordinate data (ID coordinate data P-ID) on the data and the base image data of the part, (d) Meter reading value read in step 808 (e) Image of the part where the meter reading value is read out of the base image data 106b. Data and coordinate data on the base image data of the part (meter coordinate data P-MR), (f) incidental information arbitrarily input by the meter reader, including base image data 106b, and other meter reading work. Moving image data (supporting moving image data) taken by the camera 104, camera settings (exposure, shutter speed, focal distance) at the time of shooting the base image data, coordinate data of the shooting location, meter model number information, meter reading. Includes information such as the date and time of the event. Some of this information can also be obtained from the Exif data included in the base image data.

It should be noted that the meter reading data 106d may be stored in the storage unit 106 without being edited by the meter reader. Further, the work of confirming and editing the meter reading data 106d may be performed later, and in step 809, the tabular meter reading data 106d as shown in FIG. 20 may be immediately saved.

Further, FIG. 20 illustrates the case where the meter ID is read from the character string as shown in FIG. 14, and when the meter ID is read from the two-dimensional bar code as shown in FIG. 18, for example. , As illustrated in FIG. 21, ((c) an image of the two-dimensional bar code may be displayed and saved as an image of the portion where the meter ID is read.

On the other hand, in steps 81 to 812, the meter reading data aggregation processing unit 116 partially reads the meter group formed by a large number of meters by continuous shooting, and creates meter reading data 106d that integrates the results of the plurality of meter readings. Then, the process proceeds to step 813. Steps 810 to 812 are loop processes, and the loop process is performed for each shooting.

Here, the meter group to be read is assumed to be a meter group as illustrated in FIG. 5C, and in particular, it is assumed that each meter cannot be read in one shooting. That is, for example, even when four meters are arranged in a square, the meter ID may not be read from the image.

In such a case, for example, as shown in FIG. 22, one two-dimensional bar code is assigned to the four meters, and the position where the two-dimensional bar code is reflected when the four meters are contained in one image. Place in. The two-dimensional bar code may include each meter ID of the four meters and / or may include a group ID (meter group ID). When each meter ID of the four meters is included, the combination of the meter and the meter ID can be specified by recording the meter ID in the order corresponding to the order of the arrangement of the meters.

Hereinafter, the processing of steps 810 to 812 will be described more specifically.
In step 810, the guide display control unit 116c executes the same processing as in steps 804 and 805.

That is, the guide display control unit 116c performs a guide display based on the shooting support data 106a detected in step 803, and guides the meter reader to the composition of shooting, as in the process of step 804. In the following shooting, shooting is performed based on the camera settings (exposure and shutter speed) included in the shooting support data 106a detected in step 803.

Further, the guide display control unit 116c performs a guide display indicating in what order a large number of meters are to be photographed based on the photographing support data 106a. For example, in the case of six meters as shown in FIG. 19, the guide display control unit 116c so as to take a picture and read a meter in the composition of (C) after taking a picture and read a meter in the composition of (B). Display to guide.

Then, as in the process of step 805, the guide display control unit 116c magnifies and displays the image located in the shooting position guide SP1 on the same position as shown in FIG. 14, for example, and the image captured by the camera 104. Of these, OCR processing is performed on the images in the shooting position guides SP1 and SP2, and the meter reading value and the meter ID converted into text are obtained from the images. The meter reading value and the meter ID obtained in this way are displayed as balloon displays PU1 and PU2, respectively.

Eventually, when the input control unit 112 detects that the meter reader has operated the software key "shooting" displayed on the display unit 103, the guide display control unit 116c uses the entire OCR process in step 810. The image is stored in the storage unit 106 as the base image data 106b, and the meter reading value and the meter ID obtained by the OCR process are stored in the storage unit 106 as the recognition data 106c.

The basic image data 106b and the recognition data 106c saved here are associated with each other by the guide display control unit 116c. Further, when the operation is performed on the software key "shooting", the base image data 106b is displayed and the display based on the recognition data 106c is performed on the image. As a result, for example, an image as shown in FIG. 14 is displayed as a still image on the display unit 103, and the meter reader can confirm the image that is the basis of reading and the reading result.

Here, at the timing when the operation for the software key "shooting" is performed, the shooting by the camera 104 is executed again, the same processing as in step 805 is executed again, and the meter ID and the meter reading value are acquired. You may do it. Then, at that time, the focal length and exposure of the camera 104 may be adjusted, or a flash may be emitted as needed.

In step 811 the meter reading data aggregation processing unit 116 creates meter reading data 106d based on the information recorded in the storage unit 106 in step 810.
Specifically, the meter reading data creation unit 116d creates meter reading data 106d in which these information are aggregated in a tabular format based on the basic image data 106b and the recognition data 106c acquired in step 810, and displays and controls this data. The display unit 103 displays the unit 113.

The creation and editing of the meter reading data 106d will be omitted because it is the same as the description in step 809. Here, if the meter reading data 106d has already been created by the previous loop processing, information (meter ID and meter reading value converted into text from the image, and a partial image thereof as a base thereof) are included in the meter reading data 106d. The meter reading data 106d is updated by adding the basic image data 106b used in this loop.

Here, the loop processing of steps 810 to 812 will be described again. Here, as shown in FIG. 23, a case where the six meters MT6 to MT11 are continuously photographed in two steps will be described.

First, in step 810 of the first round, as shown in FIG. 24, photographs are taken for meter reading on the four meters MT6 to MT9 on the left side of the six, and meter reading data 106d including the meter reading results for these four meters is obtained. create. The meter reading data 106d is displayed on the display unit 103 in step 811 as shown in FIG. 25, and is edited as necessary.

Subsequently, in step 810 of the second round, as shown in FIG. 26, photographs were taken for meter reading on the four meters MT8 to MT11 on the right side so as to overlap the first round and the middle two, and these 4 were taken. The meter reading results for one meter are obtained and added to the meter reading data 106d created in the first round. The meter reading data 106d is displayed on the display unit 103 in step 811 as shown in FIG. 27.

For the meters MT8 and MT9, the data is acquired twice, but one of the data is adopted and aggregated as shown in FIG. 28. The meter reading data creation unit 116d may select the one with the higher recognition accuracy.

Also, here, by obtaining the meter reading data of the same meter in duplicate in different shootings, it can be confirmed that the shooting is performed without omission, so if duplicate data cannot be obtained (data for the same meter is available). If it cannot be obtained), the meter reading data creating unit 116d may call the meter reader to pay attention by displaying a warning or the like.

In step 813, the meter reading data aggregation processing unit 116 saves the meter reading data 106d created in step 809 or step 811 as confirmed data, uploads it to the server 400, and ends the process.

Specifically, the meter reading data creation unit 116d stores the meter reading data 106d created in step 809 or step 811 in the storage unit 106 as the meter reading data 106d, and the meter reading data 106d is stored in the communication control unit 111 as the server 400. Instruct to send to. As a result, the communication control unit 111 controls the communication unit 101 to transmit the meter reading data 106d to the server 400. The server 400 stores the received meter reading data 106d as the meter reading data 400a.

Further, in step 813, the meter reading data aggregation processing unit 116 detects, for example, the creation time of the meter reading data 106d from the shooting time (Exif data) of the base image data 106b included in the meter reading data 106d, and sets this time and the current time. It is determined whether or not the difference has elapsed more than a preset time.

Here, if a preset time or longer has elapsed, the meter reading data cannot be uploaded to the display control unit 113 because "the data was not uploaded within the specified time" to the display unit 103. , Etc. are displayed, the meter reading data 106d is not uploaded, and the process shown in FIG. 8 is restarted from the beginning.

According to this, for example, it is possible to prevent time for falsification of the basic image data 106b and the like, and to prevent fraud such as neglect of diversion of past image data. Needless to say, the meter reading data 106d is uploaded within the elapsed time.

It is also possible that uploading may not be possible due to problems with the communication environment. Therefore, the meter reading data aggregation processing unit 116 monitors the situation in which the communication environment cannot be performed, and records the time zone in the storage unit 106. Then, the meter reading data aggregation processing unit 116 may allow uploading to the server 400 according to the information recorded in the storage unit 106 during the non-communication time zone.

As described above, in the information processing system having the above configuration, in the portable terminal device 100, when the meter reading of each meter is collectively performed from the images taken by a plurality of meters, the meter ID and the meter reading value of each meter are read. The position and its correspondence are shown on the image so that the meter reader can confirm the correspondence, and the meter ID and the meter reading value are associated and saved. Further, if there is an error in the correspondence, the meter reader can arbitrarily correct it by an intuitive operation on the touch panel (input unit 102).

Therefore, according to the information processing system having the above configuration, even when the meter reading of a plurality of meters is performed from one image, the meter ID and the meter reading value can be stored in the correct combination. Therefore, it is possible to efficiently support accurate meter reading with a simple operation, and it is possible to suppress human error.

Further, in the above embodiment, when the meter ID and the meter reading value are read from the captured image in the portable terminal device 100, the reading position is displayed in a guide based on the past meter reading work, so that the composition is appropriate for the meter reader. I try to encourage them to shoot. For this reason, not only is it easy for inexperienced meter readers to adapt to work, but it is also expected that the burden of guidance and education for meter readers will be reduced.

Further, in the above embodiment, in the portable terminal device 100, the correspondence between the meter ID and the meter reading value is shown based on the past meter reading results. Therefore, when the display of the correspondence is not appropriate, it can be seen that the past meter reading has not been performed properly.

It should be noted that the present invention is not limited to the above embodiment as it is, and at the implementation stage, the components can be modified and embodied within a range that does not deviate from the gist thereof. Further, various inventions can be formed by appropriately combining a plurality of components disclosed in the above embodiments. Further, for example, a configuration in which some components are deleted from all the components shown in the embodiment can be considered. Further, the components described in different embodiments may be combined as appropriate.

For example, in the above embodiment, the meters MT1 to MTn to be meter-read are described as being indicated by Arabic numerals, such as rotary type (analog type) or digital type, but are limited to this type of meter. is not it. For example, it can be applied to a meter showing a measured value by an analog pointer as shown in FIG. Various existing methods can be applied to the reading of the measured value, such as using matching of a template prepared in advance or determining the meter reading value based on the result learned by AI (Artificial Intelligence) based on the teacher data.

Further, in the above embodiment, the shooting support data specifying unit 116b in step 803 specifies the shooting support data used for the guide display based on the meter ID read from the image shot in step 803, but the present invention is limited to this. It is not something that will be done.

For example, in step 803, the shooting support data specifying unit 116b compares the image shot in step 803 with the base image data included in the shooting support data, and specifies the shooting support data including the base image data of a similar meter. You may do so.

Further, in the above embodiment, the guide display is used to induce a change in the shooting composition, but in addition to or instead of this, the meter reading data aggregation processing unit 116 analyzes the image taken by the meter reading staff. Then, the positions of the display unit D and the ID plate P may be specified, and OCR processing may be performed on these positions to obtain the meter reading value and the meter ID.

The meter reader who operates the portable terminal device 100 does not necessarily have to be in the field, and may be remotely controlled via the network 500. Further, the meter reader who operates the portable terminal device 100 does not necessarily have to be a human being, and may be a drone or a self-propelled robot. The cameras and CPUs of these drones and robots may be used to replace some of the functions described in the flow so far, such as reading, judgment by machine learning, and storage of imaging data.

Further, in the above embodiment, when the guide display is performed, serial numbers (Meter1-1, Meter2-1, ...) Are given to each meter and displayed, but instead of this, for example, based on shooting support data. , The meter ID of each meter may be specified, and the meter ID, the name of the meter, and incidental information may be displayed. As the incidental information, the past meter reading value may be displayed so that the meter reader can visually confirm the consistency with the current meter reading value.

Further, in the above embodiment, the shooting support data is specified from the current position information, but for example, the preset data may be used as the shooting support data and associated with the icon (software key) displayed on the display unit 103. good.

In this case, when the input control unit 112 detects the operation of the meter reader with respect to the icon, the guide display control unit 116c starts the process of step 804 or less by using the shooting support data 106a previously stored in the storage unit 106. You may do it. According to this, the processes of steps 801 to 803 can be omitted, and the meter reader can perform the meter reading work accompanied by the guide display even in an environment where communication cannot be performed.

In addition, it goes without saying that various modifications can be made in the same manner without departing from the gist of the present invention.

100 ... Portable terminal device, 101 ... Communication unit, 102 ... Input unit, 103 ... Display unit, 104 ... Camera, 105 ... GNSS receiver unit, 106 ... Storage unit, 106a ... Shooting support data, 106b ... Base image data, 106c ... Recognition data, 106d ... Meter reading data, 110 ... Control unit, 111 ... Communication control unit, 112 ... Input control unit, 113 ... Display control unit, 114 ... Image processing unit, 115 ... Position information processing unit, 116 ... Meter reading data aggregation Processing unit, 116a ... Shooting support data acquisition unit, 116b ... Shooting support data specifying unit, 116c ... Guide display control unit, 116d ... Meter reading data creation unit, 200 ... Radio base station, 300 ... Client terminal, 400 ... Server, 400a ... Meter reading data, 400b ... Map data, 500 ... Network, MT1 to MTn ... Meter.

Claims (13)

Computer,
A display control unit that displays an image including the first meter and the second meter,
On the image, a display showing the correspondence between the identification information of the first meter displayed on the first meter and the measured value is displayed, and the second meter displayed on the second meter is displayed. A program characterized by functioning as a guide display control unit that displays the correspondence between the identification information of the meter and the measured value. Computer,
A display control unit that displays an image including the first meter and the second meter,
From the image, the identification information and the measured value of the first meter displayed on the first meter are read, and the identification information and the measured value of the second meter displayed on the second meter are read. Image processing unit that reads
On the image, a display showing the correspondence between the identification information portion of the first meter displayed on the first meter and the measured value portion read by the image processing unit is displayed, and the display is performed. A program characterized in that it functions as a guide display control unit that displays a display showing the correspondence between the identification information part of the second meter and the measured value part displayed on the second meter. Further functioning the computer as an input control unit that accepts operations from the user
The program according to claim 1 or 2, wherein the guide display control unit changes and displays the correspondence according to an operation received by the input control unit. The program according to claim 2, wherein the guide display control unit displays the correspondence based on the results of meter reading of the first meter and the second meter in the past. As a location information processing unit that acquires location information, the computer is further functioned.
The program according to claim 4, wherein the guide display control unit displays the correspondence based on the result of meter reading in the past corresponding to the position information acquired by the position information processing unit. The program according to claim 4, wherein the guide display control unit displays the correspondence based on the result of meter reading in the past corresponding to the identification information read by the image processing unit. A claim characterized by further functioning a computer as a communication control unit capable of transmitting the identification information and the measured value read by the image processing unit to a server on the network within a predetermined time limit. The program described in Item 2. The first meter displays the identification information in a display of the first form and a display of the second form.
The program according to claim 2, wherein the image processing unit reads the identification information from the display of the second format when the identification information cannot be read from the display of the first format. The identification information of the first meter displayed on the first meter read by the image processing unit is associated with the measured value, and further displayed on the second meter read by the image processing unit. 2. The second aspect of the present invention is characterized in that the computer is further functioned as a meter reading data creating unit that associates the identification information of the second meter with the measured value and creates the associated information as meter reading data. The program described. The image processing unit reads the identification information and the measured value of the meter from the plurality of images, respectively, and reads them.
The program according to claim 9, wherein the meter reading data creating unit collects identification information and measured values of a plurality of meters read by the image processing unit into one meter reading data. The plurality of images were taken by the same meter in duplicate, and were taken.
The tenth aspect of the present invention is characterized in that the meter reading data creating unit collects identification information and measured values of a plurality of meters read by the image processing unit into one meter reading data, and merges information about the same meter. The program described. The program according to claim 9, wherein the display control unit displays the meter reading data. A display control unit that displays an image including the first meter and the second meter,
On the image, a display showing the correspondence between the identification information of the first meter displayed on the first meter and the measured value is displayed, and the second meter displayed on the second meter is displayed. An information processing device equipped with a guide display control unit that displays the correspondence between the identification information of the meter and the measured value.

Images