JP2008164415A - Portable terminal apparatus for site state recognition - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable terminal apparatus for site state recognition capable of easily obtaining a measuring state. <P>SOLUTION: The portable terminal apparatus 1 for site state recognition comprises a measuring section 4 as a measuring means for measuring the physical quantity (surface temperature and dimension) related to a measuring object, and acquiring the measured value, and an imaging section 5 as an imaging means for imaging the measuring object and acquiring the picked-up image. The portable terminal apparatus 1 for site state recognition has a built-in control section 6 as a composite data generation means for generating a composite image where the measured value is arranged on the picked-up image, and a built-in storage section 7 as a storing means for storing the composite data. A side surface of the portable terminal apparatus 1 is provided with an output section 8 as an outputting means, and the composite image data stored in the storage section 7 can be output to an external device. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a portable terminal device for on-site situation confirmation for obtaining measurement data and image data to be measured.

Conventionally, for example, when grasping the state of a defect occurrence location in a factory or conducting a periodic inspection, the occurrence of the defect has been reported in order to report in detail the state of the defect occurrence location or the location where the periodic inspection is performed. The location and inspection location are imaged by an imaging device such as a camera, and physical quantities such as the surface temperature and distance of the measurement target are measured by a portable terminal device for confirming the on-site situation as shown in Patent Document 1, for example. Done.
JP 2001-165645 A

  However, the operator must know the measurement data measured by the measuring device at which location and which measurement data should be reported in detail. And the measurement status is created as a report. For this reason, it took time and effort to create a report for the worker, and the work burden was heavy.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a portable terminal device for confirming the on-site situation in which the measurement situation can be easily grasped.

  In order to solve the above-described problem, the invention according to claim 1 is a measurement unit that measures a physical quantity related to a measurement target, acquires a measurement value, and generates measurement data; and captures the measurement target and acquires a captured image. Imaging means for generating image data; synthetic data generation means for generating composite image data based on the measurement data and the image data to generate a composite image in which the measurement values are arranged on the captured image; Display means for displaying the composite image based on the composite image data, storage means for storing the composite image data, and output means capable of outputting the composite image data stored in the storage means.

  According to this configuration, the composite image data based on the measurement data and the image data is generated, and a composite image in which the measurement values are arranged on the captured image is generated. The measurement status can be easily grasped based on this.

  The invention described in claim 2 is the portable terminal device for confirming the on-site situation according to claim 1, further comprising comment information input means for inputting arbitrary comment information of the operator, and the synthesized data generating means Generates the composite image data to be the composite image including the comment information.

  According to this configuration, since composite image data that is a composite image including arbitrary comment information of the operator is generated, the operator can input a comment regarding the measurement object on the spot, and the measurement situation Can be grasped more easily.

  According to a third aspect of the present invention, in the portable terminal device for confirming the on-site situation according to the second aspect, there is provided comment display position adjusting means for adjusting a display position of the comment information in the composite image.

  According to this configuration, the comment display position adjusting means allows the operator to adjust the display position of the comment information in the composite image on the spot where it has been measured, thereby making it easier to organize the measurement data. Can do.

  According to a fourth aspect of the present invention, in the portable terminal device for on-site situation confirmation according to any one of the first to third aspects, a measured value display for adjusting a display position of the measured value in the composite image Position adjustment means was provided.

  According to this configuration, the measurement value display position adjustment means allows the operator to adjust the measurement value display position in the composite image on the spot so that the measurement target in the composite image can be easily grasped, for example. Thus, the measurement data can be organized more easily.

  Further, the invention according to claim 5 is the portable terminal device for confirming the on-site situation according to any one of claims 1 to 4, in a state in which the measurement object is displayed on the display means by the imaging means. The measurement value is obtained, and the display means displays a measurement standard on the captured image.

  According to this configuration, since the display unit displays the measurement reference on the captured image, the operator can easily grasp the state of the measurement target while displaying the measurement target on the display unit by the imaging unit. Thus, the physical quantity related to the measurement target can be measured while checking the state of the measurement target.

  According to a sixth aspect of the present invention, in the portable terminal device for confirming an on-site situation according to any one of the first to fifth aspects, the measuring unit measures the measurement from the received light data obtained by the imaging unit. Get the value.

  According to this configuration, since the measurement unit acquires the measurement value from the light reception data obtained by the imaging unit, it is possible to omit the configuration necessary only for measuring the physical quantity related to the measurement target, and It is possible to contribute to reducing the weight and size of the portable terminal device.

  According to a seventh aspect of the present invention, in the portable terminal device for on-site situation confirmation according to the sixth aspect, the storage means stores the received light data of each of the imaging elements of the imaging means, and the display means A teaching mark is displayed in a state in which the captured image captured by the imaging means is displayed, and a designation unit capable of designating the teaching mark at an arbitrary designated location on the captured image is provided. The measurement value is acquired from the received light data of the imaging element corresponding to the designated location designated by the designation means.

  According to this configuration, since the measurement unit obtains the measurement value from the light reception data of the image sensor corresponding to an arbitrary designated position on the captured image designated by the designation unit, the operator can capture the image after the image is taken by the imaging unit. The physical quantity at any specified location in the imaging area of the imaging means can be measured.

  ADVANTAGE OF THE INVENTION According to this invention, the portable terminal device for a field condition confirmation which can grasp | ascertain a measurement condition easily can be provided.

  As shown in FIG. 1, a portable terminal device (hereinafter simply referred to as a portable terminal device) 1 for confirming the on-site situation is formed in a rectangular parallelepiped shape, and a rectangular display as a display means is provided on the front end side of one side surface thereof. The screen 2 is provided with an operation unit 3 on the base end side. In addition, a measurement unit 4 as a measurement unit that measures a physical quantity (surface temperature and dimensions) related to a measurement target (for example, the measurement target W shown in FIG. 2) and acquires the measurement value is provided at the tip of the mobile terminal device 1. The imaging unit 5 is provided as an imaging unit that captures the measurement target W and acquires the captured image G1 (see FIG. 4A). As shown in FIG. 2, the mobile terminal device 1 includes a control unit 6 as a composite data generation unit that generates a composite image G2 (see FIG. 4B) in which measurement values are arranged on the captured image G1. In addition, a storage unit 7 is incorporated as storage means for storing the synthesized data. Further, as shown in FIG. 1, an output unit 8 as an output means such as an output terminal to which a USB cable or the like is connected is provided on the side surface of the mobile terminal device 1 of the present embodiment. 7 can be output to an external device (not shown) such as a personal computer.

  As shown in FIG. 2, the measurement unit 4 includes a temperature sensor such as an infrared sensor, and under the control of the control unit 6, a measurement target region A1 (a cracked portion of the measurement target W) as a physical quantity related to the measurement target W. The surface temperature is measured to obtain a measurement value, and temperature data D1 (see FIG. 4A) as measurement data is generated. The imaging unit 5 includes a light receiving element (imaging device) such as a CCD that receives light from the imaging region A0 where the measurement target W is arranged, and the imaging region A0 (measurement target W) is controlled under the control of the control unit 6. The captured image G1 is acquired by imaging, and image data D2 is generated (see FIG. 4A).

  The measurement unit 4 includes a light projecting element that irradiates light to the measurement target W, and the imaging unit 5 receives light from the measurement target W based on light irradiation from the light projecting element and receives light reception data. Generate. Under the control of the control unit 6, the measurement unit 4 measures the dimension of the measurement target W as a physical quantity related to the measurement target W from the light reception data obtained by the imaging unit 5, acquires the measurement value, and measures the dimension as measurement data. Data D3 (see FIG. 4A) is generated. In this case, the measurement unit 4 may measure dimensions based on light reception data obtained by a part of the imaging unit 5 (for example, one image sensor), and the light reception data obtained by the entire imaging unit 5. The dimensions may be measured based on

  The mobile terminal device 1 according to the present embodiment is configured to acquire a measurement value of the surface temperature and dimensions of the measurement target W in a state where the measurement target W is displayed on the display screen 2 by the imaging unit 5. Based on the image data D2 generated by the imaging unit 5, the control unit 6 displays a measurement image G3 in which the measurement reference M is provided on the captured image G1 (see FIG. 3). Note that a menu button 11 is provided in the upper left portion of the operation unit 3. When the menu button 11 is operated in a state where the measurement image G <b> 3 is displayed, the control unit 6 displays the display screen 2 on the display screen 2. A setting screen for setting the brightness of 2, the resolution of measurement, the response speed, etc. is displayed.

  Further, based on the operation of the operation unit 3 by the operator, the control unit 6 displays a composite image G2 in which measurement values are arranged on the captured image G1 as shown in FIG. The composite image data D5 for displaying the composite image G2 is stored.

  More specifically, a measurement / imaging button 12 is provided at the left center portion of the operation unit 3 in FIG. 1. When the measurement / imaging button 12 is operated, the control unit 6 causes the measurement / imaging button 12 to be Temperature data D1 and dimension data D3 measured by the measurement unit 4 at the operated timing and image data D2 imaged by the imaging unit 5 are acquired. Further, the control unit 6 acquires display coordinate data D4 corresponding to the display position of the surface temperature in the composite image G2 stored in advance in the storage unit 7. The control unit 6 generates composite image data D5 for displaying the composite image G2 based on the temperature data D1, the dimension data D3, the image data D2, and the display coordinate data D4, and generates the composite image data D5. Based on this, the composite image G2 is displayed on the display screen 2. Note that an enlargement button 13 and a reduction button 14 are provided on the right side of the measurement / imaging button 12, and a part of the composite image G2 displayed on the display screen 2 is enlarged and displayed. It is possible to do.

  In addition, a determination button 15 is provided below the measurement / imaging button 12, and when the determination button 15 is operated in a state where the composite image G2 is displayed on the display screen 2, the control unit 6 performs this combination. The composite image data D5 for displaying the image G2 is stored in the storage unit 7. Note that a cancel button 16 is provided on the right side of the determination button 15. When the cancel button 16 is operated in a state where the composite image G2 is displayed on the display screen 2, the control unit 6 displays the composite image G2. The composite image data D5 for display is deleted.

  Further, a cursor button 17 as a measurement value display position adjusting means for adjusting the display position of the measurement value in the composite image G2 is provided on the lower right portion of the operation unit 3. When the menu button 11 is operated in a state where the composite image G2 is displayed on the display screen 2, the control unit 6 blinks the surface temperature that is the target for adjusting the display position. When the cursor button 17 is operated while the surface temperature is blinking, the control unit 6 changes the display position of the surface temperature in the composite image G2 according to the operation of the cursor button 17. When the enter button 15 is operated, the display coordinate data D4 corresponding to this display position is stored in the storage unit 7 as new display coordinate data.

Next, the operational effects of the above embodiment will be described below.
(1) Generate composite image data D5 based on temperature data D1, dimension data D3, and image data D2, and generate composite image G2 in which measured values of the surface temperature and dimensions of measurement object W are arranged on captured image G1. Therefore, the operator can easily grasp the measurement state based on the composite image G2. As a result, for example, it is possible to reduce the work burden for creating a report.

  (2) The cursor button 17 allows the operator to adjust the display position of the surface temperature in the composite image G2 at the measured spot so that, for example, the measurement target W in the composite image G2 can easily grasp the temperature. The data D1 and the dimension data D3 can be easily organized.

  (3) Since the display screen 2 displays the measurement reference on the captured image G1, the operator easily grasps the state of the measurement target W while the measurement target W is displayed on the display screen 2 by the imaging unit 5. It is possible to measure the surface temperature and dimensions of the measuring object W while confirming the state of the measuring object W.

  (4) Since the measurement unit 4 acquires the measurement value from the light reception data obtained by the imaging unit 5, it is possible to omit the configuration necessary only for measuring the dimensions related to the measurement target W, and the mobile terminal device 1 Can contribute to weight reduction and downsizing.

In addition, you may change embodiment of this invention as follows.
In the embodiment described above, for example, as shown in FIG. 5, the comment information input unit 20 such as a keyboard is used to input arbitrary comment information (for example, a character string such as “crack”) of the operator to the operation unit 3 a. It may be provided as comment information input means, and may generate composite image data for displaying the composite image G4 including the input comment information. According to such a configuration, the operator can input a comment (character string or the like) regarding the measurement object on the spot where the measurement is performed, and can easily grasp the measurement state. In this case, the display position of the comment information may be fixed, and the comment information is displayed in the composite image G2 by the cursor button 17 as the comment display position adjusting means, as in the surface temperature in the above embodiment. The position may be adjusted.

In the above embodiment, the display position of the surface temperature in the composite image G2 can be changed, but the display position of the surface temperature may be fixed.
In the above embodiment, the storage unit 7 stores the received light data of each of the imaging elements of the imaging unit 5 and displays the teaching mark in a state where the captured image G1 captured by the imaging unit 5 is displayed on the display screen 2. Then, the display position of the teaching mark in the captured image G1 can be specified at any specified location on the captured image G1 by specifying means such as the cursor button 17, for example, and the measurement unit 4 can specify the specification specified by the specifying means. You may make it acquire the said measured value from the light reception data of the image pick-up element corresponding to a location. In this case, the imaging unit 5 designated by the teaching mark may be one or more than one. With such a configuration, the operator can measure a physical quantity (surface temperature or the like) at any specified location in the imaging area A0 of the imaging unit 5 after imaging by the imaging unit 5.

In the above embodiment, when the measurement value is acquired, the measurement image G3 provided with the measurement reference M is displayed on the captured image G1, but the measurement reference M may be omitted.
In the above embodiment, the composite image data D5 generated based on the temperature data D1, the dimension data D3, the image data D2, and the display coordinate data D4 is stored in the storage unit 7, but for example, the temperature data D1 and the dimension data D3, image data D2, and display coordinate data D4 may be stored separately, and composite image data may be generated when the composite image G2 is displayed.

In the above embodiment, the measurement target region A1 is set and the surface temperature of the cracked portion of the measurement target W is measured, but the surface temperature of the entire measurement target W may be measured.
In the above embodiment, the surface temperature and dimensions are measured as physical quantities related to the measurement target W. However, for example, the distance to the measurement target W, the color of the measurement target W, and the like may be measured.

  In the above embodiment, the output unit 8 such as an output terminal is provided. However, for example, a card slot or the like in which a storage medium such as a memory card can be inserted and removed is provided, and the composite image data D5 is received via this storage medium. The method of outputting the composite image data D5 may be changed as appropriate.

Schematic of the portable terminal device of this Embodiment. The block diagram for demonstrating the electrical structure of the portable terminal device of this Embodiment. Explanatory drawing for demonstrating a measurement screen. (A) (b) Explanatory drawing for demonstrating the process by the portable terminal device of this Embodiment. Schematic of the portable terminal device of another example.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Mobile terminal device for on-site situation confirmation, 2 ... Display screen as display means, 4 ... Measurement part as measurement means, 5 ... Imaging part as imaging means, 6 ... Control part as synthetic data generation means, 7 DESCRIPTION OF SYMBOLS Storage unit as storage unit, 8 ... Output unit as output unit, 17 ... Measurement value display position adjustment unit, comment display position adjustment unit and operation unit as designation unit, 20 ... Comment information input as comment information input unit M, measurement standard, D1 temperature data as measurement data, D2 image data, D3 dimension data as measurement data, D5 composite image data, G1 captured image, G2, G4 composite image, W Measurement object.

Claims (7)

A measuring means for measuring a physical quantity related to a measurement object, obtaining a measurement value, and generating measurement data;
Imaging means for imaging the measurement object, obtaining a captured image, and generating image data;
Synthetic data generation means for generating synthetic image data based on the measurement data and the image data in order to generate a synthetic image in which the measurement values are arranged on the captured image;
Display means for displaying the composite image based on the composite image data;
Storage means for storing the composite image data;
An on-site status confirmation portable terminal device comprising: output means capable of outputting the composite image data stored in the storage means. In the portable terminal device for site situation confirmation according to claim 1,
Provided with comment information input means for inputting arbitrary comment information of the operator,
The mobile terminal device for confirming the on-site situation, wherein the composite data generation means generates the composite image data to be the composite image including the comment information. In the portable terminal device for on-site situation confirmation according to claim 2,
A portable terminal device for confirming the on-site situation, comprising comment display position adjusting means for adjusting a display position of the comment information in the composite image. In the portable terminal device for the field situation confirmation according to any one of claims 1 to 3,
A portable terminal device for confirming the on-site situation, comprising measurement value display position adjusting means for adjusting a display position of the measurement value in the composite image. In the portable terminal device for the field situation confirmation according to any one of claims 1 to 4,
The measurement value is acquired in a state where the measurement object is displayed on the display means by the imaging means,
The display means displays a measurement standard on the captured image, and is a portable terminal device for on-site situation confirmation. In the portable terminal device for the field situation confirmation according to any one of claims 1 to 5,
The measurement means acquires the measurement value from the received light data obtained by the imaging means. In the portable terminal device for on-site situation confirmation according to claim 6,
The storage means stores the received light data of each of the imaging elements of the imaging means,
The teaching means is displayed in a state where the picked-up image picked up by the pick-up means is displayed on the display means, and a specifying means capable of specifying the teaching mark at an arbitrary designated position on the picked-up image is provided,
The mobile terminal device for confirming an on-site situation, wherein the measurement unit acquires the measurement value from the received light data of the image sensor corresponding to the specified location specified by the specifying unit.

Images