JP6892528B1 - Information processing equipment and computer programs - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device and a computer program capable of adjusting a workload in a meter reading operation of reading a meter value with an apparatus. A computer program of an embodiment causes a computer to function as a first mode execution unit, a second mode execution unit, and a mode selection unit. The first mode execution unit repeatedly acquires image data including the meter reading value of the meter, performs character recognition processing on this image to obtain the meter reading value, and the second mode execution unit obtains the first mode execution unit. The process of inputting the meter reading value into the form is performed, and the mode selection unit selectively executes at least one of the first mode execution unit and the second mode execution unit in response to a request from the user. [Selection diagram] Fig. 3

Description

Embodiments of the present invention relate to information processing devices and computer programs.

Conventionally, as a meter reading operation for equipment installed in office buildings, factories, and public facilities, inspectors read meters indicating the operating status of those equipment and perform maintenance of the equipment. In recent years, in order to eliminate the need for manual meter reading work, high-performance equipment compatible with a system that can send measurement data indicating the operating status to a server via a network and store and manage it on this server has been introduced. It's getting better. However, since the equipment and devices compatible with such a system are expensive, they have not become widespread, and there are still many equipments and devices for meter reading by inspectors, and the meter reading work by the inspectors is still performed. ing. In addition, when it comes to gas, electricity, and water meter reading work in ordinary houses, it is common for meter readers to go individually to read the meter.

Recently, a service has been provided to support the meter reading work of the meter. In this service, AI (Artificial Intelligence) is used to read the meter value with a device, but at the meter reading work site, inspectors and meter readers 1) take a picture of the meter, 2) recognize the image by AI, and 3) image. Confirmation of recognition result 4) It is necessary to input to the form. These work routines may take longer than traditional paper form meter readings. If it takes time, for example, when working outdoors, the physical load on the meter reader may increase depending on the season and the weather.

Japanese Patent No. 6514390

An object of the present invention to be solved is to provide an information processing device and a computer program capable of adjusting a workload in a meter reading operation of reading a meter value with an apparatus.

The computer program of the embodiment causes the computer to function as a first mode execution unit, a second mode execution unit, and a mode selection unit. The first mode execution unit repeatedly acquires image data including the meter reading value of the meter, performs character recognition processing on this image to obtain the meter reading value, and the second mode execution unit obtains the first mode execution unit. The process of inputting the meter reading value into the form is performed, and the mode selection unit selectively executes at least one of the first mode execution unit and the second mode execution unit in response to a request from the user.

The figure which shows the structural example of the information processing system including the information processing apparatus which concerns on this invention. The circuit block diagram which shows the structure of the portable terminal apparatus shown in FIG. The flowchart for demonstrating the mode selection of the portable terminal apparatus shown in FIG. The flowchart for demonstrating the process of the normal mode shown in FIG. The flowchart for demonstrating the process of the collection priority mode shown in FIG. The flowchart for demonstrating the process of the form creation mode shown in FIG.

Hereinafter, one embodiment will be described with reference to the drawings.
FIG. 1 shows a configuration of an information processing system including an information processing device and a computer program according to an embodiment. In the following description, the case where the information processing device and the computer program are applied to the meter reading work of gas, electricity, water, etc. of a general house will be described as an example. In this example, a case where a meter reader visits individual houses and reads a meter installed in each house will be described.

As shown in FIG. 1, this information processing system is a system that realizes cloud computing including a portable terminal device 100, a wireless base station 200, a client terminal 300, a server 400, and a network 500, and is a system that realizes cloud computing in each house or. Information obtained from meters MT1 to MTn provided in the vicinity thereof is processed.

The meters MT1 to MTn are, for example, numerical values related to infrastructure such as numerical values such as electricity usage, water supply usage, drainage to sewerage, gas usage, and numerical values indicating the operating status of equipment using them. Although it is assumed that it is shown, it may be a numerical value other than these.

In addition, each meter is printed or stamped with a two-dimensional bar code on the surface for displaying numerical values. This two-dimensional bar code gives the identification number and attributes (electricity, gas, water, supply entity, installation location, manufacturing date and time, installation date and time, specifications indicating performance, etc.) uniquely assigned to the assigned meter. It includes the identification information to be shown and the input designation information for designating the meter reading value input field corresponding to the application software that aggregates the meter reading values.

Further, the two-dimensional bar code is decoded by a predetermined algorithm to obtain the above information (identification information and input designation information). It should be noted that these information may be shown not as a two-dimensional bar code but as a character string of the information itself so that it can be directly visually recognized by printing or engraving in the vicinity of the above-mentioned display value. Part or all information may be displayed in duplicate.

Further, each meter may indicate a numerical value by either a rotary type or a digital type. In the case of the digital type, for example, a plurality of 7-segment displays displaying numbers from 0 to 9 are used, and a numerical value of at least one digit or more (meter reading) is used depending on the amount of electricity used and the operating state of the equipment. A configuration indicating a value) is conceivable. In the case of the rotary type, for example, it is a mechanical type using a plurality of number wheels on which numbers from 0 to 9 are described, and a multi-digit numerical value (meter reading value) is obtained by rotating the number wheel according to the amount used. A direct-reading configuration indicating is conceivable.

Next, the portable terminal device 100 will be described with reference to FIG.
The portable terminal device 100 is a terminal used by a meter reader as an operator, and is a portable information processing device such as a smartphone, a tablet computer, or a laptop-type personal computer. Further, as shown in FIG. 2, the portable terminal device 100 includes at least a communication unit 101, an input unit 102, a display unit 103, a camera 104, a storage unit 105, and a control unit 110, which are connected by a bus.

The communication unit 101 is a wireless communication interface that establishes a wireless communication link with the wireless base station 200 and communicates with the server 400 via the wireless base station 200 and the network 500. The wireless communication corresponds to a communication method according to the specifications of the wireless base station 200. As an example of this communication method, various standards such as wireless LAN (IEEE802.11 series), 3G, 3.9G (LTE (registered trademark), etc.), 4G, 5G, Bluetooth (registered trademark), etc. can be considered. It does not matter, and is not limited to these.

The input unit 102 includes an input device such as a touch panel mounted on the display unit 103, which will be described later, and a key switch provided on the housing of the portable terminal device, and inputs and instructs various information from a meter reader. Accept. The touch panel can be input using a stylus or a finger, and various methods such as a capacitance method, a resistance film method, and a projected infrared method can be applied.

The display unit 103 visually provides information to the meter reader, and displays, for example, an information input field, a software key, and various images (photographs, CG (computer graphics) images). The information input field and the software key are displayed so as to correspond to the operation for the input unit 102 described above by the control of the control unit 110 described later. As the device used, various display devices such as a liquid crystal panel, an organic EL (Electro Luminescence) panel, and electronic paper can be applied.

The camera 104 has a predetermined format (for example, JPEG (Joint Photographic Experts Group)) from an image pickup unit equipped with an optical system such as a lens, an image sensor such as CMOS (Complementary MOS), and an image pickup signal obtained by the image pickup unit. ) Is a digital camera equipped with a signal processing unit that generates image data. The control unit 110 measures the time, and additional information (for example, Exif (Exchangeable image file format) data) indicating the date and time when the time was taken is added to the image data obtained by the camera 104. Will be recorded.

The storage unit 105 uses the OS (Operating System) of the control unit 110, which will be described later, application software, data generated by the operation of the application software, various parameters, data input from the meter reader, and an image captured by the camera 104. It stores data (such as a photograph of the display surface of the meter reading values of meters MT1 to MTn) and data acquired (downloaded) from the server 400, which will be described later, and stores RAM (Random Access Memory) and ROM (Read Only Memory). ), Flash memory such as SSD (Solid State Drive), and recording device such as HDD (Hard Disk Drive) are provided in combination according to the characteristics of the data.
Further, the storage unit 105 stores the image data 105a, the recognition data 105b, and the meter reading form data 105c.

The image data 105a is image data obtained by the camera 104, and is, for example, a photograph of a two-dimensional bar code or a display surface of meter reading values of MT1 to MTn of the meter, and is displayed on the meters MT1 to MTn. It is used for reading numerical values and reading two-dimensional bar codes.

The recognition data 105b is information obtained by decoding a two-dimensional bar code, or numerical data obtained by performing character recognition processing such as optical character recognition (OCR) on the numerical values displayed on the meters MT1 to MTn. This data is associated with the image data that is the basis of the numerical data. Since this data is generated for each meter (for each shooting) that is the subject of shooting, a large amount of recognition data 105b is stored in the storage unit 105. It will be remembered.

The meter reading form data 105c is a data file of the meter reading form for inputting the meter reading value obtained by the meter reading. There are many input fields in the data file of the meter reading form data 105c, and each input field is given an item name and information for identifying the input field (hereinafter referred to as input field identification information). ing.

The control unit 110 includes a processor such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit), a chipset, RAM, a ROM, and the like, and controls each part of the portable terminal device 100 in an integrated manner. ROM stores firmware and setting values (various parameters). The CPU realizes various control functions by reading the OS and application software from the storage unit 105 into RAM, executing the OS and application software, and using the RAM as a work area (work area) according to the above firmware. ..

The control unit 110 realizes at least the following control functions by executing the OS and application software. That is, the control unit 110 functions as a communication control unit 111, an input control unit 112, a display control unit 113, an image processing unit 114, and a form data creation unit 115 by executing software, and functions in cooperation with each other. Can be done. It is also possible to integrate a part or all of each of these functions with other functions, or to describe the above 111 to 115 by another expression divided into a plurality of different functional blocks.

The communication control unit 111 controls the communication unit 101 to establish a wireless communication link with the wireless base station 200 according to a predetermined communication protocol, and further communicates with the server 400 through the network 500. For example, from the server 400. Data is downloaded and data is uploaded to the server 400.

The input control unit 112 controls the input unit 102 to interpret the meter reader's request from the meter reader's operation on the input unit 102, accept the input of information (character string, etc.), and is imaged by the camera 104. Import image data, etc.

The display control unit 113 controls the display unit 103 to display various information including images and a graphical user interface (hereinafter, GUI (Graphical User Interface)). Examples of the GUI are the above-mentioned information input fields and software keys, and these displays correspond to the input through the input unit 102.

The image processing unit 114 is a character recognition engine that performs character recognition processing such as optical character recognition on the image data 105a obtained by the camera 104, and recognizes characters included in the image to generate text data. In addition to outputting (converting image data to text data), it also has a function as a barcode analysis engine that decodes the two-dimensional barcode contained in the image to obtain information (for example, meter identification information). Have. The decoded information and the text data are associated with each other and recorded in the storage unit 105.

More specifically, the image processing unit 114 reads the numerical values (display values) displayed on the meters MT1 to MTn from the image data 105a by the character recognition engine and outputs them as meter reading values, and also by the analysis engine. Identification information of meters MT1 to MTn by decoding the two-dimensional bar code included in the above image data (item name indicating the name of the meter reading value, attributes such as identification number and installation location, manufacturer, serial number, performance maintenance warranty period Etc.) and the input specification information that specifies the meter reading value input field corresponding to the application software that aggregates the meter reading values. The image processing unit 114 associates this information with the acquisition time (the date and time of shooting) and records it in the storage unit 105 as recognition data 105b.

As the identification numbers and attributes of the meters MT1 to MTn, it is conceivable that a character string indicating the identification number itself or the attribute is printed or engraved in the vicinity of the display value instead of the two-dimensional bar code. In this case, the image processing unit 114 performs character recognition processing on the image data obtained by the camera 104, converts the character string indicating the identification number and the attribute into text data, and uses it as the recognition data 105b. Record.

The form data creation unit 115 controls each part of the portable terminal device 100 in order to execute from shooting the meter to creating the form data and uploading the data, and is the first in the scope of claims. It corresponds to the 1st mode execution unit, the 2nd mode execution unit, the 3rd mode execution unit, and the mode selection unit. The display control unit in the claims corresponds to the display control unit 113 and the form data creation unit 115.

Next, the radio base station 200 will be described.
The wireless base station 200 connects the portable terminal device 100 to the network 500 by wireless communication. For example, when the network 500 is a LAN constructed in a business establishment, it is an access point that adopts a wireless LAN (IEEE802.11 series) as a communication method. When the network 500 is a mobile phone network of a telecommunications carrier, it is a base station device that performs wireless communication corresponding to standards such as 3G, 3.9G (LTE, etc.), 4G, 5G, and the like. That is, any communication method can be applied as long as the portable terminal device 100 can be connected to the network 500 by wireless communication, and the method is not limited to these methods.

Next, the client terminal 300 will be described.
The client terminal 300 is a terminal used by an operator in the management department, and is, for example, an information processing device such as a desktop type or laptop type personal computer. It has a function of downloading a data file uploaded to the server 400 by the portable terminal device 100, and performing reference, editing, data conversion, and the like. Further, the client terminal 300 may have all the functions or some functions of the portable terminal device 100 and execute the same processing. That is, the client terminal 300 can be operated by substituting the portable terminal device 100.

Next, the operation of the information processing system having the above configuration will be described. In the following description, in particular, a form data creation process (hereinafter, referred to as a form data creation process) by the portable terminal device 100 will be described. This form data creation process includes a process of reading meters MT1 to MTn to acquire data and a process of analyzing the acquired data to create a form.

First, the overall picture of the form data creation process will be described with reference to FIG.
This form data creation process is realized by the control unit 110 that executes the application software functioning as the form data creation unit 115. In the following description, the processes shown in FIGS. 3 to 6 will be described as being able to be realized by executing one application software, but the present invention is not limited to this, and one main application software is used. It is also possible to realize it by incorporating the application software of.

When the application software is executed, in step 301, the form data creation unit 115 receives a mode selection from the meter reader who is an operator, and executes a process (any of FIGS. 4 to 6) according to the accepted mode. ..

Specifically, the form data creation unit 115 instructs the display control unit 113 to display the mode selection screen on the display unit 103, and the input control unit 112 receives input from the meter reader. Instruct to detect.

On the other hand, the display control unit 113 causes the display unit 103 to display an image asking the meter reader to select a mode and a GUI including a software key for the meter reader to specify the mode. Further, the input control unit 112 detects the operation of the meter reader with respect to the software key through the input unit 102.

Here, when the input control unit 112 detects an operation on the software key corresponding to the "normal mode (full mode)", the process proceeds to step 302, and the operation on the software key corresponding to the "collection priority mode" is performed. If it is detected, the process proceeds to step 303, and if the operation for the corresponding software key in the "form creation mode" is detected, the process proceeds to step 304.

In step 302, the form data creation unit 115 performs the process of the "normal mode (full mode)" shown in FIG. Further, in step 303, the form data creation unit 115 executes the process of the "collection priority mode" shown in FIG. Then, in step 304, the form data creation unit 115 executes the process of the "form creation mode" shown in FIG. The processing of each mode will be described below.

First, the process of the "normal mode (full mode)" will be described with reference to FIG. This "normal mode (full mode)" is a mode in which a series of operations from meter shooting to form data creation and data upload are performed, and these operations are visited by meter readers for meter reading. It is executed for each house.

In step 401, the form data creation unit 115 receives a setting of whether or not to perform preview display from the meter reader as an initial setting, records the received initial setting information in the storage unit 105, and proceeds to step 402. Specifically, the form data creation unit 115 instructs the display control unit 113 to display the preview display setting screen on the display unit 103, and the meter reader tells the input control unit 112 to display the preview display setting screen. Instructs to detect the input of the preview display setting of.

On the other hand, the display control unit 113 includes a GUI including an image requesting the setting of the preview display and a software key for the meter reader to select “preview display ON” or “preview display OFF”. To display. Further, the input control unit 112 detects the operation of the meter reader with respect to the software key.

Here, the input control unit 112 detects an operation on the software key that selects "preview display ON" or "preview display OFF", and sets information corresponding to the operated software key ("preview display ON" or "preview display ON" or ". “Preview display OFF”) is recorded in the storage unit 105 as the initial setting, and the process proceeds to step 402.

Note that once this setting is made, it is not necessary to make it until a change request is made by the operator. Therefore, for example, when executing "normal mode (full mode)" at the next opportunity (meter reading of another meter). May omit step 401.

In step 402, the form data creation unit 115 takes a picture of the two-dimensional bar code assigned to the meters MT1 to MTn, and proceeds to step 403. Specifically, the form data creation unit 115 gives an instruction to the display control unit 113 to cause the display unit 103 to display an explanation prompting the meter reader to take a picture of the two-dimensional bar code, and the camera 104. To start shooting.

As a result, the display control unit 113 displays an explanation on the display unit 103 to urge the meter reader to take a two-dimensional bar code. Then, the meter reader, who is prompted to take a picture by the explanatory display of the display unit 103, adjusts the imaging composition of the camera 104 to the two-dimensional bar code given to the meters MT1 to MTn. On the other hand, the camera 104 repeats shooting at a predetermined cycle (for example, several tens of milliseconds), and outputs the image data 105a obtained by the shooting.

In step 403, the form data creation unit 115 decodes the two-dimensional bar code of the image data 105a output from the camera 104 in step 402 to obtain various information, and proceeds to step 404. Specifically, the form data creation unit 115 causes the image processing unit 114 to decode the two-dimensional bar code image included in the image data 105a obtained moment by moment by the camera 104 to obtain information.

The information obtained here includes identification information (item name indicating the name of the meter reading value, attributes such as identification number and installation location, manufacturer, serial number, and performance maintenance) of the photographed meter (any of MT1 to MTn). (Warranty period, etc.) and input specification information that specifies the meter reading value input field corresponding to the application software that aggregates the meter reading values.

Here, the image processing unit 114, which receives an instruction from the form data creation unit 115, automatically recognizes the area where the numerical value is displayed on the meter (any of MT1 to MTn) based on the image data 105a, and this Character recognition processing may be performed on the image of the area, and the numerical value (display value) displayed in the area may be read as the meter reading value.

If the image based on the image data 105a obtained by the camera 104 in step 402 is unclear and the two-dimensional bar code cannot be decoded, the form data creation unit 115 may contact the display control unit 113. , The meter reader may be made to display a request to redo the photographing, and the process may proceed to step 402.

In step 404, the form data creation unit 115 photographs the numerical values displayed on the meters MT1 to MTn, and proceeds to step 405. Specifically, the form data creation unit 115 gives an instruction to the display control unit 113 and displays on the display unit 103 to urge the meter reader to take a picture of the numerical values displayed on the meters MT1 to MTn. At the same time, the camera 104 is activated to take a picture.

As a result, the display control unit 113 displays on the display unit 103 an explanatory display prompting the meter reader to take a picture of the numerical value displayed on the meters MT1 to MTn. Then, the meter reader who is prompted to take a picture by the explanatory display of the display unit 103 adjusts the imaging composition of the camera 104 to the numerical values displayed on the meters MT1 to MTn. On the other hand, the camera 104 waits for the input control unit 112 to detect the shutter operation by the meter reader through the input unit 102, and when the input control unit 112 notifies the detection of the shutter operation, the camera 104 waits at the notified timing. The captured image data 105a is output.

In step 405, the form data creation unit 115 performs character recognition processing on the image data 105a obtained by the camera 104 in step 404, and reads the numerical values (display values) displayed on the meters MT1 to MTn. It is read as a value, this meter reading value is recorded in the storage unit 105 as recognition data 105b, and the process proceeds to step 406.

Specifically, the form data creation unit 115 gives instructions to the input control unit 112, the display control unit 113, and the image processing unit 114. Each part that receives the instruction executes the following processing. That is, the display control unit 113 causes the display unit 103 to display an image (hereinafter, referred to as a meter image) including a numerical value displayed on the meter (any of MT1 to MTn) based on the image data 105a. , Have the meter reader display an explanation prompting the meter reader to specify the area where the numerical value to be captured is displayed on the meter image.

The meter reader, who is prompted to specify the area by the explanation display of the display unit 103, performs an operation of designating the area to be captured through the input unit 102 with a rectangular diagonal line. From this operation, the input control unit 112 detects the coordinates of the rectangular area designated by the diagonal line. Subsequently, the display control unit 113 performs a semi-transparent mask display on the area on the meter image corresponding to the coordinates of the rectangular area detected by the input control unit 112. When the mask display is performed, the image processing unit 114 performs character recognition processing on the image corresponding to the masked area (designated rectangular area), and determines the numerical value (display value) displayed in the area. Read as meter reading value. This meter reading value is recorded in the storage unit 105 as recognition data 105b in association with the original image data 105a and the information (input designation information and the like) obtained by decoding in step 403.

Here, if the image based on the image data 105a obtained by the camera 104 in step 404 is unclear and the character recognition process cannot be performed (recognition fails), the form data creation unit 115 may use the display control unit 113. On the other hand, the meter reader may be made to display a request to redo the photographing, and the process may proceed to step 404.
Further, in the above description, the meter reader has been described as designating an area in which the numerical value to be captured is displayed on the meter image, but instead of or in addition to this, the form data creation unit 115 has described the meter image. The area where the above meter reading value is displayed may be automatically recognized, and the numerical value (display value) displayed in that area may be read as the meter reading value.

In step 406, the form data creation unit 115 refers to the initial setting in step 401 and determines whether or not the setting for performing the preview display, that is, the setting of "preview display ON" is made. Here, if "preview display ON" is set, the process proceeds to step 407, while if "preview display ON" is not set, the process proceeds to step 408.

In step 407, the form data creation unit 115 displays the meter reading value obtained in step 405 in the rectangular area as a preview display only for a preset time, and when the display is finished, the process proceeds to step 408.

Specifically, the form data creation unit 115 gives an instruction to the display control unit 113 to execute the following. That is, the display control unit 113 displays the meter reading value as a preview display in the rectangular area based on the recognition data 105b recorded in the storage unit 105 in step 405 according to the instruction of the form data creation unit 115, and sets in advance. The display ends when the time has passed. The meter reader who sees the preview display can confirm whether or not the character recognition process has been performed correctly without any special operation.

In step 408, the form data creation unit 115 reads the meter reading form data 105c from the storage unit 105, and in the input field of the meter reading form data 105c, the input field designated by the input designation information obtained by the decoding in step 403 is entered. , The temporary meter reading form data in which the meter reading value of the recognition data 105b recorded in the storage unit 105 in step 405 is input is displayed, and the process proceeds to step 409.

In step 409, the form data creation unit 115 determines whether or not the meter reader has instructed to end the process of the "normal mode (full mode)". Here, if the end is instructed, the process proceeds to step 410, while if the end is not instructed, the process proceeds to step 402 to take a picture of another meter or input a meter reading value. Routine is started.

Specifically, the form data creation unit 115 gives an instruction to the input control unit 112 and the display control unit 113 to execute the following. That is, the display control unit 113 asks the display unit 103 whether to end the processing of the "normal mode (full mode)" according to the instruction of the form data creation unit 115, and selects a display or whether to end the software key. Display it.

On the other hand, the input control unit 112 monitors the operation on the software key through the input unit 102, and when the operation on the software key is detected, notifies the form data creation unit 115 of the detection result. When the input control unit 112 detects an operation on the software key for instructing the end, the form data creation unit 115 proceeds to step 410, and in other cases, proceeds to step 402. Then, a routine for taking a picture of another meter and inputting a meter reading value is started.

In step 410, the form data creation unit 115 overwrites and saves the meter reading form data 105c stored in the storage unit 105 with the temporary meter reading form data displayed in step 408, and proceeds to step 411.

In step 411, the form data creation unit 115 instructs the communication control unit 111 to upload the meter reading form data 105c stored in the storage unit 105 to the server 400, and ends the process. The communication control unit 111 uploads the meter reading form data 105c stored in the storage unit 105 to the server 400 according to the instruction from the form data creation unit 115.

Next, the process of the “collection priority mode” will be described with reference to FIG. This "collection priority code" is a mode in which the work before the creation of the form data is carried out in a series of operations from the shooting of the meter to the creation of the form data and the upload of the data. The work of "collection priority mode" is performed for each house visited by the meter reader for meter reading, but for example, in the case of high temperature or stormy weather, outdoor work can be done in a short time due to other circumstances. It can be used when you want to finish it.

In step 501, the form data creation unit 115 receives a setting of whether or not to perform preview display from the meter reader as an initial setting, records the information of the accepted setting in the storage unit 105, and proceeds to step 502. Specifically, the form data creation unit 115 instructs the display control unit 113 to display the preview display setting screen on the display unit 103, and the meter reader tells the input control unit 112 to display the preview display setting screen. Instructs to detect the input of the preview display setting of.

On the other hand, the display control unit 113 includes a GUI including an image requesting the setting of the preview display and a software key for the meter reader to select “preview display ON” or “preview display OFF”. To display. Further, the input control unit 112 detects the operation of the meter reader with respect to the software key.

Here, the input control unit 112 detects an operation on the software key that selects "preview display ON" or "preview display OFF", and sets information corresponding to the operated software key ("preview display ON" or "preview display ON" or ". “Preview display OFF”) is recorded in the storage unit 105 as the initial setting, and the process proceeds to step 502.

Note that once this setting is made, it is not necessary to make it until a change request is made by the operator. Therefore, for example, the "collection priority mode" is executed at the next opportunity (when the application software is executed for the second time or later). In that case, step 501 may be omitted.

In step 502, the form data creation unit 115 takes a picture of the two-dimensional bar code assigned to the meters MT1 to MTn, and proceeds to step 503. Specifically, the form data creation unit 115 gives an instruction to the display control unit 113 to cause the display unit 103 to display an explanation prompting the meter reader to take a picture of the two-dimensional bar code, and the camera 104. To start shooting.

As a result, the display control unit 113 displays an explanation on the display unit 103 to urge the meter reader to take a two-dimensional bar code. Then, the meter reader, who is prompted to take a picture by the explanatory display of the display unit 103, adjusts the imaging composition of the camera 104 to the two-dimensional bar code given to the meters MT1 to MTn. On the other hand, the camera 104 repeats shooting at a predetermined cycle (for example, several tens of milliseconds), and outputs the image data 105a obtained by the shooting.

In step 503, the form data creation unit 115 decodes the two-dimensional bar code of the image data 105a output from the camera 104 in step 502 to obtain various information, and proceeds to step 504. Specifically, the form data creation unit 115 causes the image processing unit 114 to decode the two-dimensional bar code image included in the image data 105a obtained moment by moment by the camera 104 to obtain information.

The information obtained here includes identification information (item name indicating the name of the meter reading value, attributes such as identification number and installation location, manufacturer, serial number, and performance maintenance) of the photographed meter (any of MT1 to MTn). (Warranty period, etc.) and input specification information that specifies the meter reading value input field corresponding to the application software that aggregates the meter reading values.

Here, if the image based on the image data 105a obtained by the camera 104 in step 502 is unclear and the two-dimensional bar code cannot be decoded, the form data creation unit 115 may contact the display control unit 113. , The meter reader may be made to display a request to redo the photographing, and the process may proceed to step 502.

In step 504, the form data creation unit 115 photographs the numerical values displayed on the meters MT1 to MTn, and proceeds to step 505. Specifically, the form data creation unit 115 gives an instruction to the display control unit 113 and displays on the display unit 103 to urge the meter reader to take a picture of the numerical values displayed on the meters MT1 to MTn. At the same time, the camera 104 is activated to take a picture.

As a result, the display control unit 113 displays on the display unit 103 an explanatory display prompting the meter reader to take a picture of the numerical value displayed on the meters MT1 to MTn. Then, the meter reader who is prompted to take a picture by the explanatory display of the display unit 103 adjusts the imaging composition of the camera 104 to the numerical values displayed on the meters MT1 to MTn. On the other hand, the camera 104 waits for the input control unit 112 to detect the shutter operation by the meter reader through the input unit 102, and when the input control unit 112 notifies the detection of the shutter operation, the camera 104 waits at the notified timing. The captured image data 105a is output.

In step 505, the form data creation unit 115 performs character recognition processing on the image data 105a obtained by the camera 104 in step 504, and reads the numerical values (display values) displayed on the meters MT1 to MTn. It is read as a value, this meter reading value is recorded in the storage unit 105 as recognition data 105b, and the process proceeds to step 506.

Specifically, the form data creation unit 115 gives an instruction to the image processing unit 114. Upon receiving the instruction, the image processing unit 114 automatically recognizes an area where a numerical value is displayed on the meter (any of MT1 to MTn) based on the image data 105a, and performs character recognition processing on the image in this area. Then, the numerical value (display value) displayed in that area is read as the meter reading value. This meter reading value is recorded in the storage unit 105 as recognition data 105b in association with the original image data 105a and the information (input designation information, etc.) obtained by decoding in step 503.

Here, when the image based on the image data 105a obtained by the camera 104 in step 504 is unclear and the character recognition process cannot be performed (recognition fails), the form data creation unit 115 changes the display control unit 113. On the other hand, the meter reader may be made to display a request to redo the photographing, and the process may proceed to step 504.
Further, in the above description, the form data creation unit 115 automatically recognizes the area where the meter reading value is displayed on the meter image, and reads the numerical value (display value) displayed in that area as the meter reading value. However, as described in step 405, the meter reader may specify an area on the meter image where the numerical value to be captured is displayed and perform the character recognition process.

In step 506, the form data creation unit 115 refers to the initial setting in step 501 and determines whether or not the setting for performing the preview display, that is, the setting of "preview display ON" is made. Here, if "preview display ON" is set, the process proceeds to step 507, while if "preview display ON" is not set, the process proceeds to step 511.

In step 507, the form data creation unit 115 displays the meter reading value obtained in step 505 as a preview display, starts a timer, and proceeds to step 508.
Specifically, the form data creation unit 115 gives an instruction to the display control unit 113 to execute the following. That is, the display control unit 113 displays the meter reading value on the display unit 103 as a preview display based on the recognition data 105b recorded in the storage unit 105 in step 505 according to the instruction of the form data creation unit 115. The meter reader who sees the preview display can confirm whether or not the character recognition process has been performed correctly without any special operation.

In step 508, the form data creation unit 115 determines whether or not the timer started in step 507 has timed a preset time. Here, if the preset time has elapsed, the process proceeds to step 511, while if not, the process proceeds to step 509.

In step 509, the form data creation unit 115 determines whether or not the operation of requesting redo from the meter reader has been performed through the input unit 102. The meter reader looks at the preview display, determines the necessity of redoing, and performs an operation of requesting redoing when the character recognition process is not performed accurately. Here, if the operation for requesting redo is performed, the process proceeds to step 510, while if the above operation is not performed, the process proceeds to step 508.

Specifically, the form data creation unit 115 gives an instruction to the input control unit 112 and the display control unit 113 to execute the following. That is, the display control unit 113 causes the display unit 103 to display a display asking whether to redo the meter shooting or a software key display for receiving the redo instruction according to the instruction of the form data creation unit 115.

On the other hand, the input control unit 112 monitors the operation on the software key through the input unit 102, and when the operation on the software key for receiving the instruction to redo is detected, the detection result is transmitted to the form data creation unit 115. Notice. When the input control unit 112 detects an operation on the software key for receiving an instruction to redo, the form data creation unit 115 proceeds to step 510, and in other cases, proceeds to step 508. To do.

In step 510, the form data creation unit 115 discards the image data 105a obtained in step 504 and the recognition data 105b obtained in step 505 (erases from the storage unit 105), and proceeds to step 504. As a result, the meter is rephotographed and reanalyzed by returning to step 504 and performing reprocessing.

In step 511, the form data creation unit 115 determines whether or not the meter reader has instructed to end the process of the "collection priority mode". Here, when the end is instructed, the process is terminated, while when the end is not instructed, the process proceeds to step 502 and a routine for taking a picture of another meter is started. To.

Specifically, the form data creation unit 115 gives an instruction to the input control unit 112 and the display control unit 113 to execute the following. That is, the display control unit 113 causes the display unit 103 to display a display asking whether to end the processing of the "collection priority mode" or a software key to select whether or not to end, according to the instruction of the form data creation unit 115.

On the other hand, the input control unit 112 monitors the operation on the software key through the input unit 102, and when the operation on the software key is detected, notifies the form data creation unit 115 of the detection result. When the input control unit 112 detects an operation on the software key for instructing the end, the form data creation unit 115 ends the process, and in other cases, proceeds to step 502. Then, a routine for taking a picture of another meter is started.

Next, the process of the "form creation mode" will be described with reference to FIG. This "form creation code" is a mode in which the work after the creation of the form data is performed in a series of operations from the shooting of the meter to the creation of the form data and the upload of the data. That is, the form data is created by using the image data 105a and the recognition data 105b for the meters MT1 to MTn collected by the work of the "collection priority mode". Therefore, it is conceivable that the meter reader visits people's houses and performs the work of the "collection priority mode", and then goes indoors such as an office where the business is performed and executes the "form creation mode".

In step 601 the form data creation unit 115 receives an instruction from the meter reader as to whether or not to download the meter reading form data to be worked from the server 400. Here, if the download instruction is received, the process proceeds to step 603, while in other cases, the process proceeds to step 602.

Specifically, the form data creation unit 115 downloads a data file from the server 400 as the meter reading form data to be worked on by the display control unit 113, or creates new meter reading form data. The display unit 103 is instructed to display a display asking whether to edit the meter reading form data file in the middle of work stored in the storage unit 105, and the input control unit 112 is instructed by the meter reader. Instruct to accept the input of the selection of the meter reading form data to be worked.

On the other hand, the display control unit 113 downloads the data file from the server 400, creates new meter reading form data, or edits the meter reading form data file in the middle of work stored in the storage unit 105. A GUI including a software key for selecting whether to do so is displayed on the display unit 103. Further, the input control unit 112 detects the operation of the meter reader with respect to the software key. Here, when the input control unit 112 detects an operation on the software key for selecting the download, the process proceeds to step 603, and when any other operation is performed, the process proceeds to step 602.

In step 602, the form data creation unit 115 reads the template data of the meter reading form data from the storage unit 105 or reads the meter reading form data 105c in the middle of work stored in the storage unit 105 according to the instruction of the meter reader. Then, the process proceeds to step 604.

In step 603, the form data creation unit 115 downloads the data file from the server 400 and proceeds to step 604. Specifically, the form data creation unit 115 gives the following instructions to the communication control unit 111, the input control unit 112, and the display control unit 113.

That is, the form data creation unit 115 communicates with the server 400 with the communication control unit 111, acquires a list of data files stored in the server 400, and displays the list in the display control unit 113 in the display unit 103. Display it. Then, the form data creation unit 115 accepts the selection of the data file to be worked from the above list through the input control unit 112, and instructs the communication control unit 111 to download the accepted data file. In response to this, the communication control unit 111 controls the communication unit 101 to communicate with the server 400 and download the instructed data file.

In step 604, the form data creation unit 115 opens the data file read in step 602 or the data file downloaded in step 603 with the corresponding application software, and causes the display control unit 113 to display the data file to the display unit 103. Display it.

In step 605, the form data creation unit 115 displays a list of recognition data 105b recorded in the storage unit 105, and the meter reader tells which data in this list is to be input to the data file displayed in step 604. Accept and proceed to step 606. Specifically, the form data creation unit 115 gives an instruction to the input control unit 112 and the display control unit 113, and executes the following processing.

That is, the form data creation unit 115 creates a list of recognition data 105b stored in the storage unit 105, instructs the display control unit 113 to display the list on the display unit 103. Subsequently, the form data creation unit 115 receives the selection of the recognition data 105b to be worked from the meter reader from the above list through the input control unit 112.

In step 606, the form data creation unit 115 reads the recognition data 105b selected in step 605 from the storage unit 105, and the image data included in this data and the meter reading value read (recognized) from this image data. Is displayed as a preview display, and the process proceeds to step 607.

Specifically, the form data creation unit 115 gives an instruction to the display control unit 113 to execute the following. That is, the display control unit 113 causes the display unit 103 to display the image data included in the recognition data 105b selected in step 605 according to the instruction of the form data creation unit 115, and displays the meter reading value included in the same recognition data 105b. It is displayed on the display unit 103. Here, the meter reading value may be displayed by superimposing (or arranging) the value on the meter display of the image data that is the basis obtained by the character recognition process.

In step 607, the form data creation unit 115 previews in the input field specified by the input designation information included in the recognition data 105b selected in step 605 among the input fields of the data file displayed in step 604 in step 606. The temporary meter reading form data in which the displayed meter reading value is input is displayed, and the process proceeds to step 608.

In step 608, the form data creation unit 115 asks the meter reader whether the temporary meter reading form data displayed in step 607 may be saved. Here, when the meter reader gives an input indicating that the meter may be saved, the process proceeds to step 610, while in other cases, the process proceeds to step 609.

Specifically, the form data creation unit 115 gives instructions to the input control unit 112 and the display control unit 113. Upon receiving the instruction, the display control unit 113 causes the display unit 103 to display a display asking whether the temporary meter reading form data displayed in step 607 may be saved or a software key for selecting whether or not to save the temporary meter reading form data.

On the other hand, the input control unit 112 that receives the instruction monitors the operation on the software key through the input unit 102, and when the operation on the software key is detected, notifies the form data creation unit 115 of the detection result. When the input control unit 112 detects an operation on the software key for which the storage is good, the form data creation unit 115 proceeds to step 610, while in other cases, the form data creation unit 115 proceeds to step 609.

In step 609, the form data creation unit 115 receives the correction input of the meter reading value for the temporary meter reading form data displayed in step 607 from the meter reader, and proceeds to step 610. Specifically, the form data creation unit 115 receives the input of the corrected meter reading value (input of a specific numerical value) from the input unit 102 through the input control unit 112, and uses this value instead of the meter reading value of the recognition data 105b. Enter in the temporary meter reading form data input field.

In step 610, the form data creation unit 115 stores the temporary meter reading form data in the storage unit 105 as the meter reading form data 105c, and proceeds to step 611.
In step 611, the form data creation unit 115 determines whether or not the meter reader has instructed to end the process of the "form creation mode". Here, if the end is instructed, the process proceeds to step 612, while if the end is not instructed, the process proceeds to step 605, and another recognition data 105b is input to the meter reading form data. Continue processing.

Specifically, the form data creation unit 115 gives an instruction to the input control unit 112 and the display control unit 113 to execute the following. That is, the display control unit 113 causes the display unit 103 to display a display asking whether to end the processing of the "form creation mode" or a software key to select whether or not to end, according to the instruction of the form data creation unit 115.

On the other hand, the input control unit 112 monitors the operation on the software key through the input unit 102, and when the operation on the software key is detected, notifies the form data creation unit 115 of the detection result. When the input control unit 112 detects an operation on the software key for instructing the end, the form data creation unit 115 proceeds to step 612, and in other cases, proceeds to step 605. ..

In step 612, the form data creation unit 115 instructs the communication control unit 111 to upload the meter reading form data 105c stored in the storage unit 105 to the server 400, and ends the process. The communication control unit 111 uploads the meter reading form data 105c stored in the storage unit 105 to the server 400 according to the instruction from the form data creation unit 115.

As described above, in the information processing system having the above configuration, in addition to the "normal mode (full mode)" in which a series of operations from shooting the meter to creating form data and uploading the data are performed, a series of operations is performed. Among them, it has a "collection priority mode" that performs the work before the creation of the form data and a "collection priority mode" that carries out the work after the creation of the form data, and the meter reader arbitrarily selects these modes. It is made possible to execute.

Therefore, according to the information processing system having the above configuration, for example, when the meter reader wants to shorten the outdoor activity time as much as possible, the meter MT1 to perform the "collection priority mode" outdoors. Limited to the information collection work from MTn, the "collection priority mode" is executed at an arbitrary timing (when returning to the office where the work is done), and the meter reading value for the remaining meter reading form data in the series of work is You can enter. In this way, since the meter reader can adjust the amount of work (activity time) outdoors by selecting the mode, the physical load on the meter reader can be suppressed depending on the season and the weather.

The present invention is not limited to the above-described embodiment as it is, and at the implementation stage, the components can be modified and embodied within a range that does not deviate from the gist thereof. Further, various inventions can be formed by appropriately combining a plurality of components disclosed in the above-described embodiment. Further, for example, a configuration in which some components are deleted from all the components shown in the embodiment is also conceivable. Furthermore, the components described in different embodiments may be combined as appropriate.

As an example, for example, in the above embodiment, the character recognition process is performed in step 505 of the "collection priority mode", but in step 505, the image data 105a and step 503 are decoded without performing the character recognition process. Only recorded in the storage unit 105 as recognition data 105b in association with the information obtained in (input designation information, etc.), and character recognition processing for the image data 105a between steps 605 and 606 of the "form creation mode". May be carried out. In this case, as in step 405, the meter reader may specify an area for which character recognition processing is desired for the image based on the image data 105a.
In addition, it goes without saying that various modifications can be made in the same manner without departing from the gist of the present invention.

100 ... Portable terminal device, 101 ... Communication unit, 102 ... Input unit, 103 ... Display unit, 104 ... Camera, 105 ... Storage unit, 105a ... Image data, 105b ... Recognition data, 105c ... Meter reading form data, 110 ... Control Unit, 111 ... Communication control unit, 112 ... Input control unit, 113 ... Display control unit, 114 ... Image processing unit, 115 ... Form data creation unit, 200 ... Radio base station, 300 ... Client terminal, 400 ... Server, 500 ... Network, MT1-MTn ... Meter.

Claims (6)

Computer,
A first mode execution unit that acquires image data including the meter reading value of the meter, performs character recognition processing on this image, and repeats the process of obtaining the meter reading value.
A second mode execution unit that performs a process of inputting a meter reading value obtained by the first mode execution unit into a form, and a second mode execution unit.
A program characterized in that at least one of the first mode execution unit and the second mode execution unit is made to function as a mode selection unit that selectively executes at least one of the first mode execution unit and the second mode execution unit in response to a request from a user. Computer,
The first mode execution unit that repeats the process of acquiring image data including the meter reading value of the meter, and
A second mode execution unit that performs character recognition processing on the image data acquired by the first mode execution unit to obtain the meter reading value and input it to a form.
A program characterized in that at least one of the first mode execution unit and the second mode execution unit is made to function as a mode selection unit that selectively executes at least one of the first mode execution unit and the second mode execution unit in response to a request from a user. The program according to claim 1 or 2, wherein a computer is further operated as a display control unit for temporarily displaying the meter reading value obtained by the character recognition process. As a third mode execution unit, which acquires image data including the meter reading value of the meter, performs character recognition processing on this image to obtain the meter reading value, and repeatedly inputs the obtained meter reading value to a form, a computer. To work,
Claims 1 to 3 are characterized in that the mode selection unit selectively executes at least one of the first mode execution unit, the second mode execution unit, and the third mode execution unit. The program described in any one of. A first mode execution unit that acquires image data including the meter reading value of the meter, performs character recognition processing on this image, and repeats the process of obtaining the meter reading value.
The second mode execution unit that inputs the meter reading value obtained by the first mode execution unit into the form, and the second mode execution unit.
An information processing device including a mode selection unit that selectively executes at least one of the first mode execution unit and the second mode execution unit in response to a request from a user. The first mode execution unit that repeats the process of acquiring image data including the meter reading value of the meter, and
A second mode execution unit that performs character recognition processing on the image data acquired by the first mode execution unit to obtain the meter reading value and inputs it to a form.
An information processing device including a mode selection unit that selectively executes at least one of the first mode execution unit and the second mode execution unit in response to a request from a user.

Images