CN101581581B - Drawing information management device and comparison checking method thereof - Google Patents

Abstract

The present invention provides a drawing information management device and a comparison checking method thereof. The point checking personnel does not require adjusting a portable terminal, etc. to the appropriate position and orientation. Even the large-size checking object can be executed with comparison checking. The comparison checking can be executed efficiently with a view distance that can reduce the view burden of the point checking personnel. In the comparison checking method of the invention, the drawing information of the checking object is stored in a storing part. A first image which is obtained with an image shooting part and comprises at least one part of the checking object is compared with a second image that comprises at least one part of the checking object and the portable terminal thereby obtaining the position information of the portable terminal on the checking object. The drawing information of a preset area is drawn from the drawing information stored in the storing part according to the obtained position information, and is transmitted to the portable terminal so that the display part of the portable terminal displays the drawing information of the preset area.

Description

Drawing apparatus for management of information and check and inspection method

Technical field

The present invention relates to drawing apparatus for management of information and check and inspection method.

Background technology

In the past, check in the check and inspection of configuration, kind, quantity etc. of mounted component in the objects at cautious computer product, buildings, automobile, aircraft etc., as shown in Figure 1, cautious personnel by visual to figure Noodles such as installation diagram, structural member table, displayed map with check that object hockets to observe and relatively carry out check and inspection.In recent years, require to develop the check and inspection method of the cautious personnel's that alleviate in the check and inspection visual burden (that is, cautious personnel can shorten the viewpoint distance of checking object and drawing).

For example, in the method for patent documentation 1 record, in order to alleviate the visual burden of the cautious personnel in the check and inspection, place the inspection objects such as substrate of computing machine at the back side of transparent display frame, the drawing of checking object is presented in the display frame, make by display frame and to check that object and drawing are overlapping, thereby carry out check and inspection by visual.

Patent documentation 1: Japanese kokai publication sho 62-229052 communique

But, in check and inspection method (patent documentation 1 etc.) in the past, though can alleviate the visual burden of the cautious personnel in the check and inspection, but check that object is limited to the substrate of more small-sized computing machine etc., have under checking that object is for the situation than relatively large substrate, large-scale plant (for example aircraft, automobile) etc., need to prepare the such problem points of large-scale display frame that this checks the actual object size of object.In addition, in check and inspection method in the past, check that in order to make object is overlapping with the drawing in the display frame, cautious personnel inspection object or display frame need be adjusted to appropriate position and towards, so spended time in preparation, existing problems point aspect the efficiency of check and inspection.That is, for example, having need be cautious personnel have shown to check the drawing of object in display frame after, the such problem points of operation that the inspection object at the back side that is positioned over display frame is moved.In addition, have cautious personnel and make under the situation that display frame carries out the position of the inspection object of check and inspection moving to the next one, need select so that the drawing corresponding with the inspection object at the back side that is positioned over display frame is presented at the such problem points of operation in the display frame.

Summary of the invention

The present invention is in view of above-mentioned and finish, its purpose is to provide a kind of drawing apparatus for management of information and check and inspection method, by cautious personnel portable terminal device is lifted on the desired locations on the inspection object of expectation check and inspection, portable terminal device and the position relation of checking object according to cautious personnel, the drawing in the appropriate zone of the inspection object of expecting check and inspection is presented in the display part of portable terminal device in real time, thus, cautious personnel need not with portable terminal device etc. be adjusted to appropriate position and towards, even and also can utilize small-sized device to carry out check and inspection to large-scale inspection object, can carry out check and inspection at short notice efficiently with the viewpoint distance of the visual burden that can alleviate cautious personnel.

In order to reach such purpose, the invention provides a kind of drawing apparatus for management of information, can be connected via network with the portable terminal device that possesses display part at least with communicating, and possesses image photography portion at least, storage part and control part, it is characterized in that: above-mentioned storage part possesses the drawing information memory cell that the figure surface information of object is checked in storage, above-mentioned control part possesses: positional information obtains the unit, by to utilizing first image of at least a portion that comprises above-mentioned inspection object that above-mentioned image photography portion obtains, compare with second image of at least a portion that comprises this inspection object and above-mentioned portable terminal device, obtain the positional information of the above-mentioned portable terminal device on the above-mentioned inspection object; Drawing information extraction unit, according to utilizing above-mentioned positional information to obtain the above-mentioned positional information that the unit is obtained, the above-mentioned figure surface information from be stored in above-mentioned drawing information memory cell extracts the regional figure surface information of regulation; And the drawing information display unit, send the above-mentioned figure surface information that utilizes the afore mentioned rules zone that above-mentioned drawing information extraction unit extracts to above-mentioned portable terminal device, make the above-mentioned display part of this portable terminal device show this figure surface information in this regulation zone.

In addition, the invention provides a kind of drawing apparatus for management of information, can be connected via network with the portable terminal device that possesses display part at least with communicating, and possesses image photography portion at least, storage part and control part, it is characterized in that: above-mentioned storage part possesses the drawing information memory cell that the figure surface information in the positional information that will check the above-mentioned portable terminal device on the object and the regulation zone of above-mentioned inspection object is mapped and stores, above-mentioned control part possesses: positional information obtains the unit, by to utilizing first image of at least a portion that comprises above-mentioned inspection object that above-mentioned image photography portion obtains, compare with second image of at least a portion that comprises this inspection object and above-mentioned portable terminal device, obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object; The drawing information retrieval unit, the above-mentioned figure surface information in the retrieval afore mentioned rules zone corresponding from above-mentioned drawing information memory cell with the above-mentioned positional information of utilizing above-mentioned positional information to obtain to obtain the unit; And the drawing information display unit, send the above-mentioned figure surface information in the afore mentioned rules zone that utilizes above-mentioned drawing information retrieval unit retrieval to above-mentioned portable terminal device, make the above-mentioned display part of this portable terminal device show this figure surface information in this regulation zone.

In addition, drawing apparatus for management of information of the present invention is in the drawing apparatus for management of information of above-mentioned record, it is characterized in that: above-mentioned control part also possesses graphics processing unit, this graphics processing unit is by to utilizing above-mentioned first image that above-mentioned image photography portion obtains and above-mentioned second image to carry out projective transformation to become from the image of frontal photography and carries out image processing, above-mentioned positional information obtain the unit by to utilize above-mentioned graphics processing unit carry out Flame Image Process projective transformation after above-mentioned first image and above-mentioned second image compare, and obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object.

In addition, drawing apparatus for management of information of the present invention is in the drawing apparatus for management of information of above-mentioned record, it is characterized in that: at least a portion of above-mentioned portable terminal device, show distinguishing mark, above-mentioned positional information obtains the unit by to above-mentioned first image of at least a portion of comprising above-mentioned inspection object, compare with above-mentioned second image that comprises at least a portion of this inspection object and demonstrate the above-mentioned portable terminal device of above-mentioned distinguishing mark, according to above-mentioned distinguishing mark, obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object.

In addition, drawing apparatus for management of information of the present invention is in the drawing apparatus for management of information of above-mentioned record, it is characterized in that: above-mentioned control part also possesses the positional information adjustment unit, and this positional information adjustment unit will utilize above-mentioned positional information to obtain the above-mentioned positional information skew predetermined distance of obtaining the unit and adjust.

In addition, the invention provides a kind of check and inspection method of in the drawing apparatus for management of information, carrying out, this drawing apparatus for management of information can be connected via network with the portable terminal device that possesses display part at least with communicating, and possesses image photography portion at least, storage part and control part, it is characterized in that: above-mentioned storage part possesses the drawing information memory cell that the figure surface information of object is checked in storage, this check and inspection method is included in the following steps of carrying out in the above-mentioned control part: positional information obtains step, by to utilizing first image of at least a portion that comprises above-mentioned inspection object that above-mentioned image photography portion obtains, compare with second image of at least a portion that comprises this inspection object and above-mentioned portable terminal device, obtain the positional information of the above-mentioned portable terminal device on the above-mentioned inspection object; Drawing information extraction step, according to obtain the above-mentioned positional information that step obtains by above-mentioned positional information, the above-mentioned figure surface information from be stored in above-mentioned drawing information memory cell extracts the regional figure surface information of regulation; And figure surface information step display, send above-mentioned figure surface information to above-mentioned portable terminal device by the afore mentioned rules zone of above-mentioned drawing information extraction step extraction, make the above-mentioned display part of this portable terminal device show this figure surface information in this regulation zone.

In addition, the invention provides a kind of check and inspection method of in the drawing apparatus for management of information, carrying out, this drawing apparatus for management of information can be connected via network with the portable terminal device that possesses display part at least with communicating, and possesses image photography portion at least, storage part and control part, it is characterized in that: above-mentioned storage part possesses the drawing information memory cell that the figure surface information in the positional information that will check the above-mentioned portable terminal device on the object and the regulation zone of above-mentioned inspection object is mapped and stores, above-mentioned check and inspection method is included in the following steps of carrying out in the above-mentioned control part: positional information obtains step, by to utilizing first image of at least a portion that comprises above-mentioned inspection object that above-mentioned image photography portion obtains, compare with second image of at least a portion that comprises this inspection object and above-mentioned portable terminal device, obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object; Drawing information retrieval step, the above-mentioned figure surface information in the retrieval afore mentioned rules zone corresponding from above-mentioned drawing information memory cell with obtain above-mentioned positional information that step obtains by above-mentioned positional information; And figure surface information step display, send the above-mentioned figure surface information in the afore mentioned rules zone of retrieving by above-mentioned drawing information retrieval step to above-mentioned portable terminal device, make the above-mentioned display part of this portable terminal device show this figure surface information in this regulation zone.

In addition, check and inspection method of the present invention is in the check and inspection method of above-mentioned record, it is characterized in that: also possess the image processing step of in above-mentioned control part, carrying out, in this image processing step by to utilizing above-mentioned first image that above-mentioned image photography portion obtains and above-mentioned second image to carry out projective transformation to become and carries out image processing from the image of frontal photography, obtain in the step in above-mentioned positional information, to carry out Flame Image Process by above-mentioned image processing step projective transformation after above-mentioned first image and above-mentioned second image compare, thereby obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object.

In addition, check and inspection method of the present invention is in the check and inspection method of above-mentioned record, it is characterized in that: at least a portion of above-mentioned portable terminal device, show distinguishing mark, obtain in the step in above-mentioned positional information, by to above-mentioned first image of at least a portion of comprising above-mentioned inspection object, compare with above-mentioned second image that comprises at least a portion of this inspection object and demonstrate the above-mentioned portable terminal device of above-mentioned distinguishing mark, according to above-mentioned distinguishing mark, obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object.

In addition, check and inspection method of the present invention is in the check and inspection method of above-mentioned record, it is characterized in that: also possess the positional information set-up procedure of in above-mentioned control part, carrying out, in this positional information set-up procedure, will obtain the above-mentioned positional information skew predetermined distance that step obtains by above-mentioned positional information and adjust.

According to the present invention, because the drawing information stores that will check object is in storage part, to first image that comprises at least a portion of checking object that utilizes image photography portion to obtain, compare with second image of at least a portion that comprises this inspection object and portable terminal device, thereby obtain the positional information of checking the portable terminal device on the object, according to obtained positional information, figure surface information from be stored in storage part, extract the figure surface information in regulation zone, send the figure surface information in the regulation zone of being extracted to portable terminal device, this figure surface information in this regulation zone is presented in the display part of this portable terminal device, so play following effect: can portable terminal device be lifted desired locations on the inspection object of expectation check and inspection by cautious personnel, portable terminal device and the position relation of checking object according to cautious personnel are presented in the display part of portable terminal device the drawing in the appropriate zone of the inspection object of expecting check and inspection in real time.Thus, need under the situation of the inspection position of examining personnel amendment inspection object, cautious personnel select and the operation of checking the drawing that the position is corresponding in the past, move to the operation of the inspection position corresponding with drawing, but in the present invention, need not the operation that cautious personnel are adjusted to portable terminal device etc. appropriate position, select the operation of appropriate drawing, and the drawing that automatically will check the desired locations of object is presented in the portable terminal device, so play following effect:, can carry out check and inspection at short notice efficiently with the viewpoint distance of the visual burden that can alleviate cautious personnel even also can utilize small-sized device to carry out check and inspection to large-scale inspection object.And, in the present invention, in cautious operation, cautious personnel move portable terminal device successively on the inspection object, also move ordinatedly and switch successively being presented at drawing in the portable terminal device, so play the such effect of record that can also obtain cautious position with the switching that shows drawing simultaneously with this.Thus, though check to as if the situation of huge buildingss such as nuclear power station such as cautious parts, aircraft, rocket etc. under, the present invention also can play can not leak cautious position and can be reliably and carry out the such effect of check and inspection efficiently.

In addition, according to the present invention, because being mapped, the figure surface information in the positional information that will check the portable terminal device on the object and the regulation zone of checking object stores in the storage part, to first image that comprises at least a portion of checking object that utilizes image photography portion to obtain, compare with second image of at least a portion that comprises this inspection object and portable terminal device, thereby obtain the positional information of checking the portable terminal device on the object, from storage part, retrieve the figure surface information in the regulation zone corresponding with obtained positional information, send the figure surface information in the regulation zone of being retrieved to portable terminal device, this figure surface information in this regulation zone is presented in the display part of this portable terminal device, so play following effect: for example check the part etc. of object (driver's seat for example being judged as automobile etc. that portable terminal device is positioned at the expectation check and inspection, engine, tire etc.) under the situation in the regulation zone, can access with by the regional corresponding drawing of the regulation of cautious predetermined each part of the personnel (drawing of driver's seat for example, the drawing of engine, the drawing of tire etc.).Thus, need under the situation of the inspection position of examining personnel amendment inspection object, examine the operation that personnel select the drawing corresponding with the part of checking the position in the past, move to the operation of the inspection position of the part corresponding with drawing, but in the present invention, need not the operation that cautious personnel are adjusted to portable terminal device etc. the position of appropriate part, select the operation of the drawing of appropriate part, and the drawing of the part of the expectation of checking object is presented in the portable terminal device, so play following effect:, can carry out check and inspection at short notice efficiently with the viewpoint distance of the visual burden that can alleviate cautious personnel even also can utilize small-sized device to carry out check and inspection to large-scale inspection object.

In addition, according to the present invention, because by to utilizing first image that image photography portion obtains and second image to carry out projective transformation to become and carries out image processing from the image of frontal photography, by first image after the projective transformation of having carried out Flame Image Process and second image are compared, and obtain the positional information of checking the portable terminal device on the object, so play following effect: even image photography portion is from the inspection object of vergence direction shooting, the image of portable terminal device, the portable terminal device that also can correctly detect cautious personnel concerns with the position of checking object.

In addition, according to the present invention, because at least a portion of portable terminal device, show distinguishing mark, by to comprising first image of at least a portion of checking object, compare with at least a portion that comprises this inspection object and second image that demonstrates the portable terminal device of distinguishing mark, according to distinguishing mark, obtain the positional information of checking the portable terminal device on the object, so play following effect: by image photography portion the distinguishing mark at least a portion that is presented at portable terminal device is detected, can easily judge cautious personnel's portable terminal device and the position relation of checking object.Promptly, the present invention plays following effect: cautious personnel need not when second image is made a video recording, to adjust for the positional information of discerning portable terminal device rightly portable terminal device the position and towards, need not when first image and second image are compared, to handle the positional information of determining portable terminal device by complex image identification, the positional information of portable terminal device can be only obtained, check and inspection can be carried out at short notice efficiently by the image recognition processing of carrying out distinguishing mark.

In addition, according to the present invention, because obtained positional information is adjusted on skew predetermined distance ground, so play following effect: though for example cautious personnel portable terminal device is lifted be not parts on the inspection object of expectation check and inspection etc. directly over but leave a little so that its parts etc. can not enter under the situation of the position under the shade of portable terminal device, also can show by the predetermined drawing that has been offset the position of predetermined distance of cautious personnel (that is, the parts on the inspection object of expectation check and inspection etc. drawing).Thus, the present invention plays following effect: can the drawing in the appropriate zone of the inspection object of expecting check and inspection is presented in the display part of portable terminal device in real time according to cautious personnel's portable terminal device and the position relation of checking object.

Description of drawings

Fig. 1 is the figure that an example of check and inspection method in the past is shown.

Fig. 2 is the figure that ultimate principle of the present invention is shown.

Fig. 3 is the process flow diagram that base conditioning of the present invention is shown.

Fig. 4 is the figure that an example of projective transformation is shown.

Fig. 5 illustrates the figure that the regulation zone is carried out an example of drawing extraction.

Fig. 6 illustrates the figure that the regulation zone is carried out an example of figure region retrieval.

Fig. 7 is the block diagram of an example that the structure of the check and inspection system in the present embodiment is shown.

Fig. 8 is the figure of an example that the figure surface information in the extraction regulation zone in the present embodiment is shown.

Fig. 9 is the figure that an example of the projective transformation method in the present embodiment is shown.

Figure 10 is the figure that an example of the projective transformation method in the present embodiment is shown.

Figure 11 is the process flow diagram that the processing detailed content of the check and inspection system in the present embodiment is shown.

Figure 12 is the process flow diagram of detailed content that the processing of the check and inspection system in the present embodiment is shown.

Drawing reference numeral

100 drawing apparatus for management of information

102 control parts

102a positional information obtaining section

102b drawing information extraction portion

102c drawing information retrieval portion

102d drawing information display section

The 102e image processing part

102f positional information adjustment part

104 Communications Control Interface portions

106 storage parts

106a drawing information database

108 input and output control interface portions

116 image photography portions

200 portable terminal devices

214 display parts

300 networks

Embodiment

Below, the embodiment to drawing apparatus for management of information of the present invention and check and inspection method and program is elaborated with reference to the accompanying drawings.In addition, the invention is not restricted to present embodiment.

(summary of the present invention)

Below, with reference to Fig. 2～Fig. 6 summary of the present invention is described, afterwards, structure of the present invention and processing are elaborated.Fig. 2 is the figure that ultimate principle of the present invention is shown.In addition, Fig. 3 is the process flow diagram that base conditioning of the present invention is shown.In addition, Fig. 4 is the figure that an example of projective transformation is shown.In addition, Fig. 5 illustrates the figure that the regulation zone is carried out an example of drawing extraction.In addition, Fig. 6 illustrates the figure that the regulation zone is carried out an example of figure region retrieval.

The present invention generally says to have following essential characteristic.

At first, as shown in Figure 2, the present invention constitute via network can connect with communicating possess at least to check object (substrate with computing machine etc. in Fig. 2 is that an example describes) carry out the portable terminal device 200 of the entrained display part 214 of the cautious personnel of check and inspection, with the storage part of the drawing that possesses image photography portion 116 (WEB camera etc.) and storage inspection object at least and the image information management apparatus 100 of control part.In addition, in Fig. 2,, at least a portion of portable terminal device 200 of the present invention, show distinguishing mark 2 as an example.Herein, distinguishing mark 2 for example also can be the demonstration that is presented at icon in the display part 214 etc., the lip-deep sign that is presented at the main body of portable terminal device 200, seal etc.

Particularly, in Fig. 2, as an example, the substrate etc. of portable terminal device 200 being lifted computing machine cautious personnel is checked under the situation on the desired locations on the inspection object of expectation check and inspection of object (with reference to the left figure of Fig. 2), the control part of drawing apparatus for management of information 100 is by controlling the image photography portion 116 that possesses in the drawing apparatus for management of information 100, and by use live view function etc. always to the cautious personnel in the camera coverage that is in image photography portion 116 the distinguishing mark 2 of portable portable terminal device 200 monitor with the position relation of checking object (substrate of computing machine etc.), and obtain positional information.Then, the control part of drawing apparatus for management of information 100 is according to obtained positional information, make cautious personnel expect check and inspection the inspection object appropriate zone drawing (drawing (with reference to the right figure of Fig. 2) in the zone corresponding) with the position on the drawing of portable terminal device 200 in real time via network be presented at the personnel of examining in the display part 214 of portable portable terminal device 200.Like this, in the present invention, cautious personnel are by can alleviate visual burden (promptly, cautious personnel can shorten the viewpoint distance of checking object and drawing) the viewpoint distance inspection object of expectation check and inspection and the drawing that is presented at the appropriate zone in the portable terminal device 200 are observed comparison, and carry out check and inspection.

Next, below with reference to Fig. 3, the base conditioning of drawing apparatus for management of information 100 of the present invention is described.

At first, as shown in Figure 3, the control part of drawing apparatus for management of information 100 by to first image that comprises at least a portion of checking object that utilizes image photography portion 116 to obtain, with comprise that at least a portion of this inspections object and second image of portable terminal device 200 compare, and obtain the positional information (step SA-1) of the portable terminal device 200 on the inspection object.That is, the control part of drawing apparatus for management of information 100 is determined the position of portable terminal device according to the difference of first image and second image.

In addition, demonstrate in use under the situation of portable terminal device 200 of distinguishing mark 2, in step SA-1, the control part of drawing apparatus for management of information 100 also can by to first image that comprises at least a portion of checking object, with at least a portion that comprises this inspection object and at least a portion in demonstrate the portable terminal device 200 of distinguishing mark 2 second image compare, according to distinguishing mark 2, obtain the positional information of checking the portable terminal device 200 on the object.

Herein, image photography portion 116 preferably is configured to make a video recording to checking object from frontal, but under the situation that is not frontal, the control part of drawing apparatus for management of information 100 also can be by to utilizing first image that image photography portion 116 obtains and second image to carry out projective transformation to become from the image of frontal photography and carries out image processing, and first image after the projective transformation of Flame Image Process and second image compared, thereby obtain the positional information of checking the portable terminal device 200 on the object.

Herein, below with reference to Fig. 4, an example of projective transformation is described.As shown in Figure 4, the control part of drawing apparatus for management of information 100 is (with reference to the left figure of Fig. 4) under the situation of the ladder diagram picture of photography at the image (comprising first image and second image) of the inspection object that utilizes image photography portion 116 to obtain with being tilted, by carrying out projective transformation to become and carries out image processing is corrected into rectangle diagram picture (with reference to the right figure of Fig. 4) from the image of frontal photography.Then, the control part of drawing apparatus for management of information 100 looks like to be transformed into the drawing coordinate system of corresponding inspection object with this rectangle diagram, obtains the positional information of checking the portable terminal device 200 (not shown) on the object according to the coordinate on the drawing of checking object.In addition, be described in detail the projective transformation that the control part of drawing apparatus for management of information 100 carries out in the back.

Turn back to Fig. 3 once more, storage portion stores at image read-out 100 has under the situation of the figure surface information of checking object, the control part of drawing apparatus for management of information 100 is according to obtained positional information, figure surface information from be stored in storage part extracts the regional figure surface information (step SA-2) of regulation.

That is, the storage portion stores of image read-out 100 of the present invention is utilized the drawing of the inspection object that image reading units (not shown) such as scanner read in advance by the user.In addition, set via input parts such as keyboards in advance by the user and to be used to specify the extraction parameter (for example the parameter that conforms to the size of the display part 214 of portable terminal device 200 etc.) in zone that extracts the scope of which kind of degree according to positional information from drawing, and store in the storage part.Then, the control part of drawing apparatus for management of information 100 is according to the positional information of portable terminal device 200, and the figure surface information from be stored in storage part is according to the figure surface information that extracts parameter extraction regulation zone.

In addition, in step SA-2, the control part of drawing apparatus for management of information 100 also can be according to the controlled positional information of skew predetermined distance, and the figure surface information from be stored in storage part extracts the regional figure surface information of regulation.

Herein, below with reference to Fig. 5, the example that the drawing in regulation zone is extracted describes.Shown in the left figure of Fig. 5, cautious personnel be not portable terminal device 200 is lifted parts on the inspection object of expectation check and inspection etc. directly over but lift and leave a little so that its parts etc. can not enter under the situation of the position (upper parts of components etc.) under the shade of portable terminal device 200, the control part of drawing apparatus for management of information 100 is shown in the right figure of Fig. 5, the distinguishing mark 2 that shows at least a portion according to portable terminal device 200, the drawing of the inspection object of storing from storage part, according to extracting parameter, extraction has been offset the drawing (that is the drawing of the parts etc. on the inspection object of expectation check and inspection) in regulation zone of the position (bottom of the position of portable terminal device 200 etc.) of predetermined distance.Then, the control part of drawing apparatus for management of information 100 is presented in the display part 214 of portable terminal device 200 drawing in the regulation zone of being extracted.

In addition, turn back to the step SA-2 of Fig. 3 once more, under the figure surface information in positional information that the storage part of image read-out 100 will be checked the portable terminal device 200 on the object and the regulation zone of checking object was mapped the situation of storage, the control part of drawing apparatus for management of information 100 was retrieved the figure surface information (step SA-2) in the regulation zone corresponding with obtained positional information from storage part.That is the figure surface information of the storage part of the image read-out 100 of the present invention positional information that will check the portable terminal device 200 on the object and the regulation zone of checking object (for example part etc.) storage that is mapped.Particularly, the figure surface information of the regulation zone of the positional information of the portable terminal device 200 on the inspection object that will obtain by coordinate Calculation etc. according to the image that comprises the inspection object that utilizes image photography portion 116 photography and portable terminal device 200 of the storage part of image read-out 100 of the present invention, the inspection object that reads in advance with image reading units (not shown) such as utilizing scanner by the user (for example part etc.) storage that is mapped.Herein, the user also can be cut into the regulation zone with drawing via input parts such as mouses, and makes the drawing in the regulation zone of checking object.

Herein, below with reference to Fig. 6, an example of the figure region retrieval in regulation zone is described.As shown in Figure 6, as an example, under checking to the situation that likes automobiles such as tractor, portable terminal device 200 is lifted the (driver's seat for example such as part of the inspection object of expectation check and inspection cautious personnel, engine, tire etc.) under the situation in the regulation zone, the distinguishing mark 2 that the control part of drawing apparatus for management of information 100 shows at least a portion to portable terminal device 200 in the regulation zone detects, according to the positional information in detected regulation zone, from storage part retrieval with by (the drawing of driver's seat for example such as the regional corresponding drawing of regulation of cautious predetermined each part of personnel etc., the drawing of engine, the drawing of tire etc.).Then, the control part of drawing apparatus for management of information 100 is presented in the display part 214 of portable terminal device 200 drawing in the regulation zone that is retrieved.

In addition, the control part of drawing apparatus for management of information 100 also can retrieve the figure surface information in the regulation zone corresponding with being offset the controlled positional information of predetermined distance from storage part under the figure surface information in positional information that the storage part of image read-out 100 will be checked the portable terminal device 200 on the object and the regulation zone of checking object is mapped the situation of storage.

Turn back to Fig. 3 once more, the control part of drawing apparatus for management of information 100 sends the figure surface information in the regulation zone of extracting as mentioned above or retrieving to portable terminal device 200 in step SA-2, this figure surface information in this regulation zone is presented in the display part 214 of this portable terminal device 200 (step SA-3).More than, finish summary description of the present invention.

(structure of check and inspection system)

Next, with reference to Fig. 7～Figure 10 the structure of this check and inspection system is described.Fig. 7 is the block diagram of an example that the structure of the check and inspection system in the present embodiment is shown, and only schematically shows the part related to the present invention in this structure.In addition, Fig. 8 is the figure of an example that the drawing in the regulation zone in the present embodiment is shown.Fig. 9 and Figure 10 are the figure that an example of the projective transformation method in the present embodiment is shown.

In Fig. 7, this check and inspection system is made of drawing apparatus for management of information 100 that can connect via network 300 and portable terminal device 200 at least with communicating.At first, the structure of drawing apparatus for management of information 100 is described, next, the structure of portable terminal device 200 is described.

(structure of drawing apparatus for management of information 100)

In Fig. 7, drawing apparatus for management of information 100 roughly constitute possess control part 102, Communications Control Interface portion 104, input and output control interface portion 108, storage part 106 and image photography portion 116.In addition, drawing apparatus for management of information 100 is via wired or wireless communication lines such as communicators such as router and industrial sidings, can be connected with networks 300 such as the Internets with communicating, can be connected with the portable terminal device 200 that possesses display part 214 at least with communicating via this network 300.In addition, narrate the structure of portable terminal device 200 in the back.

In addition, in Fig. 7, the control part 102 of drawing apparatus for management of information 100 is CPU of the integral body of control chart surface information management devices 100 synthetically etc.In addition, the storage part 106 of drawing apparatus for management of information 100 is devices of store various kinds of data storehouse, table etc.The input and output control interface portion 108 of drawing apparatus for management of information 100 is the interfaces that are connected with input part (not shown), efferent (not shown), image photography portion 116.The input and output control interface portion 108 of drawing apparatus for management of information 100 carries out the control of input part, efferent, image photography portion 116.,, except monitor (comprising domestic television set), also can use loudspeaker herein as the efferent of drawing apparatus for management of information 100, and, as the input part of drawing apparatus for management of information 100, also can use keyboard, mouse and microphone etc.In addition, the Communications Control Interface portion 104 of drawing apparatus for management of information 100 be be connected to communication line etc. in the interface that is connected of communicators such as router (not shown).Each one of these drawing apparatus for management of information 100 can connect via communication path arbitrarily with communicating.

Herein, in Fig. 7, the image photography portion 116 of drawing apparatus for management of information 100 possesses the function that the image of at least a portion of the inspection object in the camera coverage and portable terminal device 200 is photographed, for example, be the video camera that constitutes by CCD charge coupled cells such as (Charge Coupled Device, charge-coupled image sensors) etc., digital camera, WEB camera etc.

In addition, in Fig. 7, the storage part 106 of drawing apparatus for management of information 100 is storage unit such as hard disk unit of store various kinds of data storehouse, table (drawing information database 106a etc.).For example, the various programs of using in the various processing of storage part 106 storages, table, file, database etc.

In each textural element of these storage parts 106, drawing information database 106a is storage is utilized the drawing of the inspection object that image reading unit (not shown) such as scanner reads in advance by the user drawing information memory cell.In addition, the extraction parameter (for example the parameter that conforms to the size of the display part 214 of portable terminal device 200 etc.) in zone of the scope of which kind of degree is extracted in drawing information database 106a storage in advance from drawing according to positional information via being used to specify of setting of input parts such as keyboard by the user.In addition, drawing information database 106a also can be the be mapped drawing information memory cell of storage of the figure surface information in the positional information that will check the portable terminal device 200 on the object and the regulation zone of checking object.For example, the drawing information database 106a figure surface information in regulation zone that also can be cut into the inspection object in regulation zone in advance via input parts such as the mouses storage that is mapped with the positional information of the portable terminal device 200 on the inspection object of obtaining by coordinate Calculation etc. according to the image that comprises the inspection object that utilizes image photography portion 116 photography and portable terminal device 200, with the drawing of the inspection object that reads in advance according to image reading units (not shown) such as utilizing scanner by the user.

In addition, in Fig. 7, the control part 102 of drawing apparatus for management of information 100 has the program that is used to store OS control programs such as (Operation System, operating systems), stipulated various treatment steps etc. and the internal storage of desired data.So control part 102 utilizes these programs etc., is used to carry out the information processing of various processing.Control part 102 constitute on concept of function, possess positional information obtaining section 102a, the drawing information extraction 102b of portion, the drawing information retrieval 102c of portion, drawing information display section 102d, image processing part 102e and positional information adjustment part 102f.

Wherein, positional information obtaining section 102a be by to first image that comprises at least a portion of checking object that utilizes image photography portion 116 to obtain, with comprise that at least a portion of this inspections object and second image of portable terminal device 200 compare, and the positional information that obtains the positional information of the portable terminal device 200 on the inspection object obtains the unit.In addition, positional information obtaining section 102a also can by to utilize image processing part 102d described later carry out Flame Image Process projective transformation after first image and second image compare, and obtain the positional information of checking the portable terminal device 200 on the object.In addition, positional information obtaining section 102a has shown at least a portion of portable terminal device 200 under the situation of distinguishing mark 2, also can be by to first image that comprises at least a portion of checking object, compare with second image that comprises at least a portion of this inspection object and demonstrate the portable terminal device 200 of distinguishing mark 2, according to distinguishing mark 2, obtain the positional information of checking the portable terminal device 200 on the object.

In addition, image information extracting part 102b stores under the situation of the figure surface information of checking object at drawing information database 106a, according to the positional information of utilizing positional information obtaining section 102a to obtain, the drawing information extraction unit of the figure surface information in the drawing information extraction regulation zone from be stored in drawing information database 106a.Herein, Fig. 8 is the figure of an example that the figure surface information in the extraction regulation zone in the present embodiment is shown.

As shown in Figure 8, as an example, check to as if the situation of the substrate of computing machine etc. under, drawing information database 106a stores the whole drawing of the substrate of the computing machine that image reading units such as being utilized scanner by the user reads in advance etc.In addition, set via input parts such as keyboards in advance by the user and to be used to specify the extraction parameter (for example the parameter that conforms to the size of the display part 214 of portable terminal device 200 etc.) in zone that from drawing, extracts the scope of which kind of degree according to positional information, and store among the drawing information database 106a.Then, the drawing information extraction 102b of portion is according to the positional information of the portable terminal device 200 on the substrate of computing machine etc., the whole drawing of the substrate of the computing machine from be stored in drawing information database 106a etc. is according to the drawing (drawing 1～drawing 3 etc.) that extracts parameter extraction regulation zone.

Turn back to Fig. 7 once more, the drawing information extraction 102b of portion also can be according to being offset the positional information that predetermined distance is adjusted by positional information described later adjustment part 102f, figure surface information from be stored in drawing information database 106a extracts the regional figure surface information of regulation.

In addition, the drawing information retrieval 102c of portion is that the figure surface information in positional information that drawing information database 106a will check the portable terminal device 200 on the object and the regulation zone of checking object is mapped under the situation of storage, the drawing information retrieval unit of the figure surface information in the retrieval regulation zone corresponding with the positional information of utilizing positional information obtaining section 102a to obtain from drawing information database 106a.In addition, the 102c of drawing information retrieval portion also can retrieve from drawing information database 106a and be offset the next corresponding figure surface information of controlled positional information of predetermined distance by positional information described later adjustment part 102f.

In addition, drawing information display section 102d sends the figure surface information that utilizes the regulation zone that the drawing information extraction 102b of portion extracts to portable terminal device 200, makes the display part 214 of this portable terminal device 200 show the drawing information display unit of this figure surface information in these regulation zones.In addition, drawing information display section 102d sends the figure surface information that utilizes the regulation zone that the drawing information retrieval 102c of portion retrieves to portable terminal device 200, makes the display part 214 of this portable terminal device 200 show the drawing information display unit of this figure surface information in these regulation zones.

In addition, image processing part 102e is by to utilizing first image that image photography portion 116 obtains and second image to carry out projective transformation to become from the image of frontal photography and the graphics processing unit of carries out image processing.

Herein, with reference to Fig. 9 and Figure 10, the projective transformation of being undertaken by image processing part 102e is described.

For example, by using the projection inverse transformation, will revert to original state by the image of image photography portion 116 shootings, thereby carry out the projective transformation of being undertaken by image processing part 102e.Below, an example of projective transformation is described.As shown in Figure 9, at first, when carrying out projective transformation, obtain end point as the image in the shooting face 70 of the image surface of making a video recording by image photography portion 116.For example, the shooting face shape 71 of the picture shape in conduct shooting face 70 is under the situation of rectangle as shown in Figure 10, for end point, obtains these two positions of end point S1 and end point S2.In addition, this end point is meant, in projection under the situation of shape of regulation, the extended line point intersected with each other of two straight lines that in the shape of reality, form abreast.By obtaining end point like this, obtain the original size before the projection, the parameter projective transformation parameter (a11～a32), carry out projective transformation when carrying out projective transformation by following formula (1) according to end point.That is, through type (1), the coordinate (x, y, 1) before the projective transformation is obtained the coordinate (u, v, 1) after the projective transformation, thereby carries out projective transformation.

$\left(\begin{array}{c}u\\ v\\ 1\end{array}\right)=\frac{1}{a31x+a32+1}\left(\begin{array}{ccc}a11& a12& a13\\ a21& a22& a23\\ a31& a32& 1\end{array}\right)\left(\begin{array}{c}\mathrm{<figure-callout\; id="1"\; label="x\; y"\; filenames="H2009101345963E00031.png,H2009101345963E00101.png"\; state="\{\{state\}\}">x</figure-callout>}& \\ y\\ 1\end{array}\right)$ Formula (1)

Like this, by the coordinate as the shooting face shape 71 of the coordinate before the projective transformation is carried out projective transformation, can obtain the coordinate after the projective transformation and obtain as shown in figure 10 as shape 75 after the projective transformation of the shape after the projective transformation.Shape 75 becomes from frontal and observe to use the shape of the actual object of image photography portion 116 shootings, promptly becomes actual object shape 76 similar shapes of the shape with as the face of observation post's shooting in vertical direction the time after this projective transformation.In addition, projective transformation can also be used various conventional arts except above-mentioned technology.

Turn back to Fig. 7 once more, positional information adjustment part 102f is the positional information adjustment unit that the positional information skew predetermined distance that utilizes positional information obtaining section 102a to obtain is adjusted.More than, finish the structure explanation of drawing apparatus for management of information 100.

(structure of portable terminal device 200)

In addition, in Fig. 7, portable terminal device 200 can be connected with drawing apparatus for management of information 100 via network 300 with communicating, constitutes on portable terminal device 200 summarys to possess: the control parts such as CPU (not shown) of synthetically controlling the integral body of portable terminal device 200; Realize the communicators such as antenna (not shown) of network service (for example via the wireless Internet traffic that waits communication line etc.); The Communications Control Interface portion that is connected with the wireless communication part (not shown) of realizing short-range communication (for example utilizing the communication of electric wave, infrared ray, IrDA, Bluetooth (registered trademark) etc.); Input parts (not shown) such as key input part, touch panel and microphone for example; Efferents such as loudspeaker (not shown); Displacement such as 3-axis acceleration sensor, inclination sensor test section (not shown) for example; Image photography portions (not shown) such as CCD camera; The input and output control interface portion that is connected with display part 214 grades such as displays; And storage carries out the storage part (not shown) of the database, table of data, the program of various processing etc., and these each ones can connect via communication path arbitrarily with communicating.Herein, network 300 has drawing apparatus for management of information 200, other portable terminal devices (not shown), the interconnective function of external device (ED) (not shown), for example, also can be the Internet, telephone wire road network (comprising portable terminal device line network, regular phone line network), intranet etc.

Herein, the display part 214 of portable terminal device 200 has and makes the figure surface information that receives by communicators such as antenna, wireless communication part from the drawing apparatus for management of information 100 that connects via network 300 be presented at function the display part 214 in the present embodiment.

In addition, the displacement test section of portable terminal device 200 is the displacement detecting units that detect vibration at least and tilt, that is, also can be to have the sensor (for example 3-axis acceleration sensor, inclination sensor etc.) that the motion converter of object is become the function of electric signal.Herein, the displacement test section of portable terminal device 200 basically also can to fall, the displacement of object that distance, angle, speed, impact, vibration, frequency, flow velocity, pressure etc. are such detects.More than, finish the structure explanation of portable terminal device 200.

Arrive this, finish the structure explanation of this check and inspection system.

(processing of check and inspection system)

Next, with reference to Figure 11 an example of the processing of this check and inspection system in the present embodiment of such formation is elaborated below.Herein, Figure 11 and Figure 12 are the process flow diagrams of an example that the processing detailed content of the check and inspection system in the present embodiment is shown.At first, describe handling according to the drawing information extraction that extracts the drawing that cuts out the regulation zone in the drawing of parameter from be stored in storage part 106, next, the drawing information retrieval of the drawing in retrieval regulation zone from the storage part 106 of storage that the drawing in regulation zone and positional information are mapped is in advance handled described.

(processing of drawing information extraction)

As shown in figure 11, by cautious personnel portable terminal device 200 is lifted on the desired locations on the inspection object of expectation check and inspection, portable terminal device 22 is set to be checked on the object (step SB-1).

Then, control part 102 is by control image photography portion 116, to comprising the image that is set to the portable terminal device 200 of at least a portion position on the inspection object of expectation check and inspection by cautious personnel make a video recording (step SB-2).

Then, the image that image processing part 102e obtains the processing and utilizing image photography portion 116 by control part 102 carries out projective transformation becoming the image from frontal photography, thus carries out image processing (step SB-3).

Then, positional information obtaining section 102a obtains in advance to the processing and utilizing image photography portion 116 by control part 102 and first image of at least a portion by checking object comprising after the processing projective transformation of image processing part 102e, obtain with the processing and utilizing image photography portion 116 by control part 102 in step SB-1 and in step SB-2 second image by at least a portion that comprises this inspection object after the processing projective transformation of image processing part 102e and portable terminal device 200 compare, thereby obtain the positional information (step SB-4) of checking the portable terminal device 200 on the object.

Herein, in at least a portion of portable terminal device 200, demonstrate under the situation of distinguishing mark 2, positional information obtaining section 102a also can obtain the processing and utilizing image photography portion 116 by control part 102 and first image of at least a portion by checking object comprising after the processing projective transformation of image processing part 102e in advance, obtain and in step SB-3, compare with processing and utilizing image photography portion 116 in step SB-2 by second image that demonstrates the portable terminal device 200 of distinguishing mark 2 at least a portion that comprises this inspection object after the processing projective transformation of image processing part 102e and at least a portion by control part 102, thereby, obtain the positional information of checking the portable terminal device 200 on the object according to distinguishing mark 2.

Then, image information extracting part 102b stores under the situation of the figure surface information of checking object at drawing information database 106a, the positional information that obtains according to processing by positional information obtaining section 102a, drawing from be stored in drawing information database 106a extracts the regional drawing (step SB-5) of regulation.That is, the 102b of drawing information extraction portion cuts out the drawing in regulation zone according to the extraction parameter from drawing.

Then, drawing information display section 102d sends the figure surface information in the regulation zone that the processing by the drawing information extraction 102b of portion extracts to portable terminal device 200, makes the display part 214 of this portable terminal device 200 show this figure surface information (step SB-6) in these regulation zones.

Then, by the inspection object and the drawing that be presented at appropriate zone in portable terminal device 200 of cautious personnel, carry out check and inspection (step SB-7) according to the expectation check and inspection.More than, finish the explanation that the drawing information extraction is handled.

(processing of drawing information retrieval)

As shown in figure 12, step SC-5 that this drawing information retrieval is handled and each of the step (step SC-1～SC-4 and SC-7) beyond the SC-6 are handled corresponding to the step SB-5 of the drawing information extraction processing of Figure 11 and the step (step SB-1～SB-4 and SB-7) beyond the SB-6, so omit explanation.

Then, in Figure 12, under the figure surface information in positional information that drawing information database 106a will check the portable terminal device 200 on the object and the regulation zone of checking object was mapped the situation of storage, the drawing information retrieval 102c of portion retrieved the figure surface information (step SC-5) in the corresponding regulation zone of the positional information that obtains with processing by positional information obtaining section 102a from drawing information database 106a.That is, the 102c of drawing information retrieval portion accesses the drawing in the regulation zone of storing among the corresponding drawing information database 106a of the positional information that obtains with processing by positional information obtaining section 102a.

Then, drawing information display section 102d sends the figure surface information in the regulation zone that the processing by the drawing information retrieval 102c of portion retrieves to portable terminal device 200, makes the display part 214 of this portable terminal device 200 show this figure surface information (step SC-6) in these regulation zones.More than, finish the explanation that the drawing information retrieval is handled.

Thus, finish the processing spec of check and inspection of the present invention system.

(other embodiments)

In addition, so far embodiments of the present invention are illustrated, but the present invention can also implement by various embodiment in the scope of the technological thought that the aforesaid right claim is put down in writing except above-mentioned embodiment.

For example, checking that object is shelf and lifts portable terminal device 200 by cautious personnel and take stock under the situation of check and inspections such as operation, drawing information database 106a also can put down in writing the state storage figure surface information of the information such as supplier, quantity of parts etc. with the optional position on the drawing of checking object (shown in the right figure of Fig. 5 such title block etc.).Thus, cautious personnel can make the drawing of information such as the supplier that comprises parts etc., quantity be presented in the display part 214 of portable terminal device 200 check and inspections such as operation of can easily taking stock.

In addition, all or part of of the part that conduct during each that can also manually carry out illustrating in embodiment handled is carried out automatically and the processing that illustrates perhaps can automatically carry out all or part of of the processing that illustrated as the part of manually carrying out by known method.

In addition, for in the above-mentioned document, the treatment step shown in the accompanying drawing, controlled step, concrete title, comprise registration data that each is handled and the isoparametric information of search condition, picture example, database structure, except special situation, can at random change.

In addition, about drawing apparatus for management of information 100 and portable terminal device 200, illustrated each textural element is the key element of concept of function, and need not necessarily physically to constitute like that as shown.

For example, the processing capacity that possesses for each device of drawing apparatus for management of information 100 and portable terminal device 200, each processing capacity of particularly being undertaken by control part, both can pass through CPU (Central Processing Unit, CPU (central processing unit)) and by this CPU explain that the program of carrying out realizes its part all or arbitrarily, in addition, also can be used as the hardware that utilizes hard wired logic and produce and realize its part all or arbitrarily.In addition, program is recorded in the recording medium described later, and mechanically reads as required in drawing apparatus for management of information 100 and the portable terminal device 200.That is, storage part such as ROM or HD etc. records and is used for providing order to carry out the computer program of various processing as the moving ground of OS (Operating System) association to CPU.Carry out by this computer program is loaded among the RAM, constitute control part movingly with CPU association.

In addition, this computer program also can be stored in via in network 300 arbitrarily and the apps server that drawing apparatus for management of information 100 and portable terminal device 200 are connected, can also download its all or part of as required.

In addition, can also be in the recording medium of embodied on computer readable with procedure stores of the present invention.Should " recording medium " comprise that floppy disk, photomagneto disk, ROM, EPROM, EEPROM, CD-ROM, MO, DVD etc. keep " communication media " of program arbitrarily " movably physical medium " or the communication line as via network 300 routers that with LAN, WAN, the Internet are representative time the, the carrier wave in short time herein.

In addition, " program " is the data processing method of recording and narrating by language arbitrarily, description method, and do not limit forms such as source code, binary code.In addition, " program " is not limited to constitute singlely, also comprises the part of disperseing as a plurality of modules or storehouse to constitute, assists the part of reaching its function with the independently program that with OS (Operating System) be representative movingly.In addition, about the concrete structure, read step that in each device shown in the embodiment, are used for reading ﹠ recording medium or, installation steps after reading etc., can use known structure, step.

The various databases of storing in the storage part of drawing apparatus for management of information 100 and portable terminal device 200 etc. (drawing information database 106a etc.) are storage unit such as hard disk units such as storage arrangements such as RAM, ROM, hard disk, floppy disk, CD, and store the various programs used in the various processing, table, database etc.

In addition, drawing apparatus for management of information 100 also can be by connecting signal conditioning packages such as the personal computer both known, workstation, and install and make this signal conditioning package realize that the software of method of the present invention (comprising program, data etc.) realizes.

And the dispersion of device/comprehensive concrete mode is not limited to diagram, and can be according to various additional grades or according to functional burdening, with on the unit function arbitrarily or physically disperse/comprehensive and constitute its all or part of.

(utilizability on the industry)

Such as above detailed description, according to the present invention, can provide following drawing information management device 100 and check and inspection method: the expectation position of portable terminal device 200 being lifted on the inspection object of expecting check and inspection by examining personnel, can be according to cautious personnel's portable terminal device 200 and the position relationship that checks object, the drawing in the appropriate zone of the inspection object of expecting check and inspection is presented in the display part 214 of portable terminal device 200 in real time, thus, cautious personnel need not with portable terminal device etc. be adjusted to appropriate position and towards, even also can utilize small-sized device to carry out check and inspection to large-scale inspection object, can carry out efficiently at short notice check and inspection with the viewpoint distance of the visual burden that can alleviate cautious personnel, so supporting the information equipment of cautious business etc., exceedingly useful in the various fields such as information processing field.

Claims (10)

1. a drawing apparatus for management of information can be connected via network with the portable terminal device that possesses display part at least with communicating, and possess image photography portion, storage part and control part at least, it is characterized in that:

Above-mentioned storage part possesses the drawing information memory cell that the figure surface information of object is checked in storage,

Above-mentioned control part possesses:

Positional information obtains the unit, by to first image that utilizes at least a portion that comprises above-mentioned inspection object that above-mentioned image photography portion obtains, with comprise that at least a portion of this inspection object and second image of above-mentioned portable terminal device compare, and obtain the positional information of the above-mentioned portable terminal device on the above-mentioned inspection object;

Drawing information extraction unit, according to utilizing above-mentioned positional information to obtain the above-mentioned positional information that the unit is obtained, the above-mentioned figure surface information from be stored in above-mentioned drawing information memory cell extracts the regional figure surface information of regulation; And

The drawing information display unit sends the above-mentioned figure surface information that utilizes the afore mentioned rules zone that above-mentioned drawing information extraction unit extracts to above-mentioned portable terminal device, makes the above-mentioned display part of this portable terminal device show this figure surface information in this regulation zone.

2. a drawing apparatus for management of information can be connected via network with the portable terminal device that possesses display part at least with communicating, and possess image photography portion, storage part and control part at least, it is characterized in that:

Above-mentioned storage part possesses the drawing information memory cell that the figure surface information in the positional information that will check the above-mentioned portable terminal device on the object and the regulation zone of above-mentioned inspection object is mapped and stores,

Above-mentioned control part possesses:

Positional information obtains the unit, by to first image that utilizes at least a portion that comprises above-mentioned inspection object that above-mentioned image photography portion obtains, with comprise that at least a portion of this inspection object and second image of above-mentioned portable terminal device compare, and obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object;

The drawing information retrieval unit, the above-mentioned figure surface information in the retrieval afore mentioned rules zone corresponding from above-mentioned drawing information memory cell with the above-mentioned positional information of utilizing above-mentioned positional information to obtain to obtain the unit; And

The drawing information display unit sends the above-mentioned figure surface information that utilizes the afore mentioned rules zone that above-mentioned drawing information retrieval unit retrieves to above-mentioned portable terminal device, makes the above-mentioned display part of this portable terminal device show this figure surface information in this regulation zone.

3. drawing apparatus for management of information according to claim 1 and 2, it is characterized in that: above-mentioned control part also possesses graphics processing unit, this graphics processing unit is by to utilizing above-mentioned first image that above-mentioned image photography portion obtains and above-mentioned second image to carry out projective transformation to become from the image of frontal photography and carries out image processing

Above-mentioned positional information obtains the unit by above-mentioned first image and above-mentioned second image that utilizes above-mentioned graphics processing unit to carry out after the projective transformation of Flame Image Process compared, and obtains the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object.

4. drawing apparatus for management of information according to claim 1 and 2 is characterized in that: at least a portion of above-mentioned portable terminal device, show distinguishing mark,

Above-mentioned positional information obtains the unit by to above-mentioned first image of at least a portion of comprising above-mentioned inspection object, compare with above-mentioned second image that comprises at least a portion of this inspection object and demonstrate the above-mentioned portable terminal device of above-mentioned distinguishing mark, according to above-mentioned distinguishing mark, obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object.

5. drawing apparatus for management of information according to claim 1 and 2, it is characterized in that: above-mentioned control part also possesses the positional information adjustment unit, and this positional information adjustment unit will utilize above-mentioned positional information to obtain the above-mentioned positional information skew predetermined distance of obtaining the unit and adjust.

6. check and inspection method of in the drawing apparatus for management of information, carrying out, this drawing apparatus for management of information can be connected via network with the portable terminal device that possesses display part at least with communicating, and possess image photography portion, storage part and control part at least, it is characterized in that:

Above-mentioned storage part possesses the drawing information memory cell that the figure surface information of object is checked in storage,

This check and inspection method is included in the following steps of carrying out in the above-mentioned control part:

Positional information obtains step, by to first image that utilizes at least a portion that comprises above-mentioned inspection object that above-mentioned image photography portion obtains, with comprise that at least a portion of this inspection object and second image of above-mentioned portable terminal device compare, and obtain the positional information of the above-mentioned portable terminal device on the above-mentioned inspection object;

Drawing information extraction step, according to obtain the above-mentioned positional information that step obtains by above-mentioned positional information, the above-mentioned figure surface information from be stored in above-mentioned drawing information memory cell extracts the regional figure surface information of regulation; And

Figure surface information step display sends the above-mentioned figure surface information in the afore mentioned rules zone that extracts by above-mentioned drawing information extraction step to above-mentioned portable terminal device, makes the above-mentioned display part of this portable terminal device show this figure surface information in this regulation zone.

7. check and inspection method of in the drawing apparatus for management of information, carrying out, this drawing apparatus for management of information can be connected via network with the portable terminal device that possesses display part at least with communicating, and possess image photography portion, storage part and control part at least, it is characterized in that:

Above-mentioned storage part possesses the drawing information memory cell that the figure surface information in the positional information that will check the above-mentioned portable terminal device on the object and the regulation zone of above-mentioned inspection object is mapped and stores,

Above-mentioned check and inspection method is included in the following steps of carrying out in the above-mentioned control part:

Positional information obtains step, by to first image that utilizes at least a portion that comprises above-mentioned inspection object that above-mentioned image photography portion obtains, with comprise that at least a portion of this inspection object and second image of above-mentioned portable terminal device compare, and obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object;

Drawing information retrieval step, the above-mentioned figure surface information in the retrieval afore mentioned rules zone corresponding from above-mentioned drawing information memory cell with obtain above-mentioned positional information that step obtains by above-mentioned positional information; And

Figure surface information step display sends the above-mentioned figure surface information in the afore mentioned rules zone that retrieves by above-mentioned drawing information retrieval step to above-mentioned portable terminal device, makes the above-mentioned display part of this portable terminal device show this figure surface information in this regulation zone.

8. according to claim 6 or 7 described check and inspection methods, it is characterized in that: also possess the image processing step of in above-mentioned control part, carrying out, in this image processing step by to utilizing above-mentioned first image that above-mentioned image photography portion obtains and above-mentioned second image to carry out projective transformation to become and carries out image processing from the image of frontal photography

Obtain in the step in above-mentioned positional information, by above-mentioned first image after the projective transformation of having carried out Flame Image Process in the above-mentioned image processing step and above-mentioned second image are compared, thereby obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object.

9. according to claim 6 or 7 described check and inspection methods, it is characterized in that: at least a portion of above-mentioned portable terminal device, show distinguishing mark,

Obtain in the step in above-mentioned positional information, by to above-mentioned first image of at least a portion of comprising above-mentioned inspection object, compare with above-mentioned second image that comprises at least a portion of this inspection object and demonstrate the above-mentioned portable terminal device of above-mentioned distinguishing mark, according to above-mentioned distinguishing mark, obtain the above-mentioned positional information of the above-mentioned portable terminal device on the above-mentioned inspection object.

10. according to claim 6 or 7 described check and inspection methods, it is characterized in that: also possess the positional information set-up procedure of in above-mentioned control part, carrying out, in this positional information set-up procedure, will obtain the above-mentioned positional information skew predetermined distance that step obtains by above-mentioned positional information and adjust.

Images