JP2015108728A - Projection mapping system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism that projects relevant information on a management object on the management object or in the vicinity thereof with a projector, the mechanism having portability, easily adjusting a focal point, and is capable of appropriately setting a projection direction.SOLUTION: A mapping device 10 includes a reader/writer 12 that can read identification information recorded in an RFID tag 31, a rod-like indication part 11 that has an antenna part at the tip thereof, and a projector 13 that is integrally attached to the indication part 11. When a person holding the mapping device 10 brings the tip of the indication part 11 close to the position of the RFID tag 31, the mapping device 10 acquires relevant information corresponding to the identification information read by the reader/writer 12 from the RFID tag 31 via the antenna part, and projects the acquired relevant information in the vicinity of the tip of the indication part 11 with the projector 13.

Description

  The present invention relates to a technique for displaying information related to an object, and in particular, a technique effective when applied to a projection mapping system that projects information related to a management object such as a building or facility onto the management object or its vicinity by a projector. It is about.

  For example, it is necessary to periodically inspect a management target such as a building, a structure installed outdoors, a factory facility, or perform a repair operation when an abnormality is detected. At this time, position and orientation of piping, wiring, reinforcing bars, parts, etc. installed or buried in places that are not normally visible such as under the floor, behind the ceiling, on the other side of the wall, in the ground, in the housing, etc. in advance By confirming, it is possible to easily and accurately carry out and manage the work.

  Conventionally, when performing such prior confirmation, a paper drawing, a CAD (Computer Aided Design) screen displayed on a portable terminal, etc., and an actual management object (for example, a manhole on the road surface, It was confirmed by comparing with ceiling equipment, piping, etc.). Therefore, there is a problem that it is difficult to confirm sufficient accuracy by visual observation at night or in a dark place, or when there is dirt or damage on the road surface, and there is a high risk of human error. In some cases, it may be difficult to unify the recognition when multiple people work.

  In response to such problems, for example, by projecting various information such as drawings of managed objects obtained using identification information such as IC tags onto the ceiling, floor, etc., the accuracy of confirmation can be improved. Improvements are being considered. As a technique related to this, for example, Japanese Patent Laid-Open No. 2005-267422 (Patent Document 1) receives an identifier reading unit that reads a barcode of an identifier of a document, and receives identifier information from the identifier reading unit. The display target information acquisition unit that accesses the display target information storage unit to retrieve the display target information, the display target information acquisition unit that supplies the retrieved display target information to the display target information display unit, and the related information is projected and displayed on the ceiling A technology related to an information display device having a display target information display unit that is a projector to be used is described.

  Japanese Patent Laid-Open No. 2007-228315 (Patent Document 2) is scheduled to be built in a building by having a 3D image creation device as an image display means, an image projection device, and red / blue glasses or polarized glasses. Related to construction work and inspection support equipment, which is configured to project a three-dimensional image of a structure, a buried object embedded in the wall surface of the building, or a structure built in a building next to the building. The technology is described.

  Further, for example, JP 2006-235373 A (Patent Document 3) includes a plate glass and a light control film, the transparency can be adjusted, and a light control glass that functions as a projection screen when it becomes opaque. A screen having an antenna provided inside the light control glass, for reading out individual information recorded in an IC tag possessed by the user by transmitting and receiving electromagnetic waves, and detecting a user coming in the vicinity; A projector that projects light onto the screen, and a PC that, when an IC tag is detected, changes the screen from transparent to opaque and projects content corresponding to the individual information read from the IC tag onto the screen. A technology relating to a screen system comprising:

JP 2005-267422 A JP 2007-228315 A JP 2006-235373 A

  According to the prior art, by projecting related information such as an image of a management object acquired using an RFID tag or the like onto a wall, ceiling, structure, etc. by a projector, visibility is improved, and by an operator, etc. The accuracy of confirmation can be improved. Further, even when there are a plurality of workers or the like, the recognition and understanding can be made common by concentrating the line of sight and consciousness, which can contribute to improvement of work efficiency and safety.

  However, for example, in the technology described in Patent Document 1, since the projector is built in a desk or wall and the related information is projected onto the ceiling, floor, desk, etc., the construction site, outdoor structure, etc. Taking out and using it for inspection, etc. has problems in terms of portability and portability.

  Also in the technique described in Patent Document 2, an operator needs to wear red / blue glasses or polarized glasses for visually recognizing a 3D image. In addition, special devices and equipment are installed, such as requiring a fixed reader device to read the RFID (Radio Frequency IDentification) tag attached to the worker's head, etc., and grasp the worker's positional information. It is necessary and has problems in terms of portability and portability. Similarly, the technique described in Patent Document 3 is a configuration in which a reader device incorporated in a screen reads an IC tag possessed by a user, and needs to be directly projected onto a road surface, ceiling, or the like where the screen cannot be limited. There are challenges in some cases.

  In addition, even when the projector is configured with a small portable device, there may be cases where the projection surface of the projector is not flat or there is no place where the projector can be fixedly installed, such as at construction sites or factory facilities. There are cases where adjustment of the projection position and focal length is difficult and complicated. Also, for example, when projecting an image such as a design drawing on the floor or ceiling surface according to the installation state of the actual structure, in order to match the projected screen with the actual installation state, at which position It may be difficult to determine which direction to project.

  Therefore, an object of the present invention is to have portability and easy focus adjustment in a mechanism for projecting related information about the management object on the management object or its nearby floor, wall, ceiling, etc. Another object of the present invention is to provide a projection mapping system capable of appropriately setting the projection direction.

  Of the inventions disclosed in this application, the outline of typical ones will be briefly described as follows.

  A projection mapping system according to an exemplary embodiment of the present invention reads identification information recorded on an RFID tag incorporated in an object by a mapping device, and relates related information about the identification information to the object. A projection mapping system for projecting near a position where an RFID tag is incorporated, which has the following characteristics.

  That is, the mapping device is integrally attached to the reader / writer that can read the identification information recorded on the RFID tag, a bar-shaped instruction unit having an antenna unit at a tip of the reader / writer, and the instruction unit. And the reader holding the mapping device reads the RFID tag from the RFID tag via the antenna unit by bringing the tip of the pointing unit close to the position of the RFID tag. The related information corresponding to the identification information is acquired, and the acquired related information is projected near the tip of the instruction unit by the projector.

  Among the inventions disclosed in the present application, effects obtained by typical ones will be briefly described as follows.

  In other words, according to a typical embodiment of the present invention, in a mechanism in which related information about a management target is projected by a projector onto the management target or a nearby floor, wall, ceiling, etc., the projector has portability. The focus adjustment is easy and the projection direction can be set appropriately.

It is the figure which showed the outline | summary about the example of a structure and usage pattern of the projection mapping system which is one embodiment of this invention. (A)-(c) is the figure which showed the outline | summary about the method of determining the projection position and orientation of the projection image by the projector in one embodiment of this invention. (A), (b) is the figure which showed the outline | summary about the example of the mounting method of the mapping apparatus in one embodiment of this invention. It is the figure which showed the outline | summary about the example of a structure and usage pattern of the pen-type mapping apparatus in one embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that components having the same function are denoted by the same reference symbols throughout the drawings for describing the embodiment, and the repetitive description thereof will be omitted.

  The projection mapping system according to one embodiment of the present invention manages, for example, by projecting information on management objects such as pipes, wirings, reinforcing bars, and parts installed on buildings and structures by a projector. This is a system that makes it possible to easily and accurately perform and manage work on an object and its surrounding objects. The managed object may be installed on the surface of a building or structure, or installed or buried in a place where it is usually not visible, such as under the floor, behind the ceiling, on the other side of the wall, in the ground, or inside the housing. May be.

  Specifically, for example, an RFID tag is incorporated in a management object in advance, the RFID tag is read by a bar-shaped reader / writer, and related information such as a design drawing corresponding to the ID is acquired. Is projected on the periphery of the read position by a small projector integrated with the reader / writer. That is, the image of the related information about the management object is projected onto the management object itself or the surrounding floor, road surface, wall, ceiling, and other structures where the management object is installed. The focus of the projector is fixedly adjusted based on the length from the tip of the rod-shaped reader / writer to the position where the projector is attached, reducing the blur of the projected image due to the focal length not matching, The focus adjustment load can be reduced.

  FIG. 1 is a diagram showing an outline of an example of the configuration and usage of a projection mapping system according to an embodiment of the present invention. The projection mapping system 1 reads, for example, an RFID tag 31 incorporated in advance in a management target 30 installed in the structure 20 and the related information corresponding to the management target 30 and reads the image. This is a system including a mapping apparatus 10 that projects and maps onto a management object 30 or its periphery.

  Here, the structure 20 may be a structure such as a floor, a wall, a ceiling, or a machine housing of a building, or a structure formed on land such as a road surface or a slope. Also good. Further, the management object 30 is, for example, a thing installed on the surface of the structure 20 such as a manhole and visible, as well as piping or wiring installed or buried under the floor, behind the ceiling, in the ground, or a reinforcing bar. Also included are parts installed at positions that cannot be seen directly, such as parts. In the example of FIG. 1, the structure 20 and the management target 30 are a road surface and a manhole, respectively. Note that the RFID tag 31 is preferably incorporated in the form of being embedded in the management target 30 or installed inside from the viewpoint of durability or the like. In this case, the RFID tag 31 is incorporated as described later. A mark or the like is displayed on the surface of the management target 30 so that the position can be recognized.

  The mapping device 10 includes a reader / writer 12 having a bar-shaped instruction unit 11 and a small projector 13 integrated with the reader / writer 12. An operator points the vicinity of the position where the RFID tag 31 of the management target 30 is disposed by the tip of the instruction unit 11, and makes the antenna part at the tip of the instruction unit 11 contact the management target 30 or approach the vicinity. Thus, the RFID tag 31 can be read by the reader / writer 12. The projector 13 is attached so as to project an image in the front end direction of the instruction unit 11, and the reader / writer 12 acquires related information corresponding to the read ID, and the management object 30 or its surroundings is acquired by the projector 13. Is projected as a projected image 14.

  The related information includes, for example, various types of information such as design drawings such as CAD around the management target 30 and image data such as photographs, explanation information and work instructions, text information such as manuals, and explanation videos. .

  The operator adjusts the inclination of the instruction unit 11 of the mapping apparatus 10 according to the display position and orientation of the projection image 14 or rotates the mapping apparatus 10 around the instruction unit 11 as an appropriate position. The projected image 14 can be displayed on the screen. In the example of FIG. 1, a case is shown in which a projection image 14 showing the state of a manhole and underground piping is displayed in a superimposed manner on a management object 30 (manhole) installed on the structure 20 (road surface). ing. In this case, it is desirable that the magnification of the projection image 14 at the focal length is adjusted so as to be displayed in the same size as the original size of the management target 30, but is not limited thereto, and is necessary as appropriate depending on the display contents and the like. It can be adjusted to a suitable magnification.

  As described above, in the present embodiment, the focal length of the projector 13 is fixedly adjusted in advance based on the length from the position where the projector 13 is attached to the instruction unit 11 to the tip of the instruction unit 11. However, the focus may be finely adjusted manually separately. The length of the instruction unit 11 is such that the operator can point the ground or the like with the tip of the instruction unit 11 in a standing state. The operability and portability, the size of the projection image 14, and the like. In view of the above, it is desirable that the distance is approximately 1 m.

  The reader / writer 12 is a portable terminal device capable of reading information such as an ID recorded on the RFID tag 31 by performing wireless communication with the RFID tag 31 using an antenna part incorporated in the instruction unit 11, for example. A read / write operation on the RFID tag 31 can be received from an operator, and a processing result can be displayed. Further, the related information about the read RFID tag 31 is acquired from the related information for each RFID tag 31 incorporated in each management object 30 held in advance, or acquired from a server (not shown) by wireless communication. Then, a process of projecting by the projector 13 is also performed. The reader / writer 12 may use a dedicated portable terminal, or may be implemented by operating software on a general-purpose portable terminal such as a smartphone.

  FIG. 2 is a diagram showing an outline of a method for determining the projection position and orientation of the projection image 14 by the projector 13. Here, in the same configuration as in FIG. 1, a state in which the projection image 14 is viewed from the front, that is, a state in which the projection image 14 is viewed from the direction of the projector 13 is illustrated. As shown in the figure, in the present embodiment, the RFID tag 31 is incorporated in the management object 30 (manhole cover in the example of FIG. 2; hereinafter, this may also be collectively referred to as “manhole”). The position is displayed by marking or the like on the management target object 30 by a position mark 32 made up of ▲. The operator can read the RFID tag 31 by aligning the tip of the instruction unit 11 of the mapping apparatus 10 with the position mark 32 as a target. Note that the RFID tag 31 does not necessarily have to be incorporated immediately below the position where the position mark 32 is displayed, and may be incorporated within the effective sensitivity range of the RFID tag 31.

  Furthermore, in the present embodiment, the position where the RFID tag 31 is incorporated into the management object 30 is a position away from the center 33 of the management object 30. That is, if the distance between the center 33 and the outermost periphery of the management target 30 is R, and the distance between the center 33 and the RFID tag 31 mounting position (position mark 32) is r, 0 <r <R. Thereby, the center line 34 which connects the center 33 of the management target object 30 and the position mark 32 can be considered. In this embodiment, since the circular manhole is used as the management object 30, the center of the circle can be set as the center 33. However, when the management object 30 has another shape, the position of the center of gravity or the like. By setting the position similar to the center as the center 33 for convenience and incorporating the RFID tag 31 at a position different from this, it is possible to conceive the center line 34 for convenience.

  For example, as shown in FIG. 2A, the worker has the projector 13 approximately on a plane that includes the center line 34 and is orthogonal to the projection plane of the projection image 14 (the surface of the management target 30). The inclination of the instruction unit 11 of the mapping device 10 is adjusted so that the position is obtained. Further, as shown in FIG. 2B, the rotation angle about the instruction unit 11 is adjusted so that the upward direction of the projected image 14 of the projector 13 matches the direction from the position mark 32 toward the center 33. . Thereby, as shown in FIG. 2C, the orientation of the projection image 14 can be easily adjusted to the actual installation state of the management target 30.

  Depending on the shape and size of the management target 30 and the installation conditions such as dirt and hiding, the direction of the center 33 may be difficult to understand at the position of the position mark 32. Therefore, it is desirable to display the position mark 32 by a display method in which the direction toward the center 33 is easy to understand, such as the ▲ mark and the arrow shown in FIG. Another mark serving as a mark may be displayed at a position on the center 33 or other center line 34. Alternatively, a method may be used in which the corresponding position of the projection image is matched with a feature point such as a contour or a pattern of the management target 30 such as a manhole. The method for determining the projection position and orientation of the projection image 14 described above is not limited to the case where the management target 30 is present downward like a manhole, and the projection direction of the image by the projector 13 is downward. The same applies to the case of the upward direction or the horizontal direction of the wall surface.

  FIG. 3 is a diagram showing an outline of an example of a mounting method of the mapping apparatus 10. FIG. 3A shows an example in which a reader / writer 12 that integrally has a long bar-like portion corresponding to the instruction unit 11 is used from the beginning. At the tip of the instruction unit, there is a minute antenna unit 15, from which an electromagnetic wave for communication output by the reader / writer 12 for reading the RFID tag 31 can be output. Image data of related information corresponding to the ID read by the reader / writer 12 from the RFID tag 31 is output to the projector 13 via the cable 16 or wirelessly and projected.

  It should be noted that the electromagnetic wave output from the antenna unit 15 has such a sensitivity that communication is possible only when the antenna unit 15 is brought into contact with the position mark 32 on the management target 30 or is brought close to a very close distance of about several centimeters. It shall be adjusted to. Thus, communication with the RFID tag 31 is established for the first time when the position mark 32 on the management target 30 is pointed by the tip of the instruction unit 11 so that the contents can be read.

  FIG. 3B shows an example in which the mapping device 10 having the bar-shaped instruction unit 11 is mounted by combining a generally available reader / writer device and an antenna or the like. Here, a structure in which a bar-shaped instruction unit 11 is further attached to the reader / writer 12 having the antenna unit 12a itself is employed. The instruction unit 11 has a cylindrical shape made of, for example, resin, and has a minute antenna such as a loop antenna inside the antenna unit 15 at the tip.

  In the case of a reader / writer 12 that uses a short-wave radio wave such as a UHF (Ultra High Frequency) band, the other end is connected from the loop antenna via a coaxial cable 17 as shown in the figure. In the case of a reader / writer 12 having a dipole-shaped reader / writer opposing antenna 18 and using a radio wave having a long wavelength such as an HF (High Frequency) band, the loop-shaped reader / writer facing the HF band is not particularly shown. An antenna 18 is provided. Thus, it has a role of mediating communication with the RFID tag 31 with the reader / writer 12 that is separated from the antenna unit 15 by the length of the coaxial cable 17.

  In the figure, for the sake of convenience of explanation, a gap is displayed between the reader / writer 12 and the instruction unit 11, but it is desirable that there is no gap. As the mapping device 10, as long as at least the instruction unit 11 and the projector 13 are integrally configured, the reader / writer 12 corresponding to the terminal can be separated. Note that a technique for mounting the rod-shaped reader / writer device as described above is described in, for example, Japanese Patent Application Laid-Open No. 2008-90813.

  In this embodiment, as shown in the example of FIG. 3, the UHF band reader / writer 12 and the corresponding UHF band RFID tag 31 will be described as an example. However, the HF band reader / writer 12 The HF band RFID tag 31 corresponding to this may be used.

  The mapping device 10 in the example of FIGS. 1 to 3 described above is a device in which the length of the bar-shaped instruction unit 11 is about 1 m, and for example, by projecting the arrangement status of the management target 30 at a construction site or the like. It is possible to share accurate information such as drawings among a plurality of field staff. At that time, the line of sight of each person in charge can be concentrated on the projected image 14, and the contents of the related information can be clearly grasped by the brightness of the projection by the projector 13, especially in a dark construction site or at night. it can.

  On the other hand, the length of the instruction unit 11 is not limited to this, and any length can be applied as long as it is portable and can integrate the projector 13. For example, after mounting the function of the antenna unit 15 of the reader / writer 12 on a substantially rod-like tool (approximately 20 cm to 1 m in length) such as a wrench, spanner or driver used at a construction site, the projector 13 is attached and integrated. By doing so, it is desirable to separate the terminal portion of the reader / writer 12, for example, it is possible to provide support such as displaying information related to the screw in the vicinity when turning the screw.

  In addition, the instruction unit 11 is constituted by a pen-type reader / writer, and the projector 13 is attached and integrated, and further, the function as an actual writing instrument is implemented (the terminal portion of the reader / writer 12 is preferably separated). For example, when a user fills in a fixed form such as an application form, help information of the item to be filled in, auxiliary information for input, reference information, and the like can be displayed in the vicinity.

  FIG. 4 is a diagram showing an outline of an example of the configuration and usage pattern of the pen-type mapping apparatus 10. The mapping apparatus 10 includes an instruction unit 11 that also functions as a writing instrument such as a pen, and a projector 13 integrated with the instruction unit 11. In the example of FIG. 4, the reader / writer terminal is not illustrated as being separated, but may be integrated with the instruction unit 11 (pen).

  In the example of FIG. 4, it is shown that a small RFID tag 31 is arranged on the back side of an input field or the like of a document 21 formed of a fixed form such as an application form. As another configuration, for example, in the case where the document 21 is placed at a predetermined position on the underlay, mount, mount, etc. to fill in the document 21, the underlay, mount, mount, etc. By embedding the RFID tag 31 at a predetermined position on the side, the process of incorporating the RFID tag 31 into each document 21 may be avoided.

  Based on the ID of the RFID tag 31 read by the pen-type mapping device 10, related information about the input field or the like is acquired and projected by the projector 13 in the vicinity of the input field or the like. Accordingly, for example, the context help function implemented in an application program running on a PC or the like can be realized in the document 21 as well.

  In the example of FIG. 4, the target on which the related information is projected is the document 21, and the arrangement is clearly up and down for the user. Further, in order to enter characters with the pen-type mapping device 10, it is necessary to hold the mapping device 10 so that the projector 13 can project an image in front of the hand. By determining the top and bottom, it is easy to adjust the direction in which the projection image 14 is displayed.

  As described above, according to the projection mapping system 1 according to the embodiment of the present invention, for example, the RFID tag 31 is previously incorporated in the management target 30, and the RFID tag 31 is attached to the rod-shaped instruction unit. 11 is obtained by pointing at the front end of the portable reader / writer 12 having 11 and related information such as a design drawing corresponding to the ID is acquired. Further, the acquired related information is projected around the tip of the instruction unit 11 by the integrated small projector 13.

  As a result, the mapping device 10 can be easily taken out to a construction site or the like as a portable device, and the focus and the display direction of the projected image 14 can be easily adjusted by adjusting the tilt and rotation of the instruction unit 11. It becomes possible to do. Further, since the related information is acquired by reading the RFID tag 31, the management target 30 can be identified with high accuracy, and the related information about this can be clearly displayed even in a dark place. In addition, it is possible to concentrate the gaze and consciousness of a plurality of workers and efficiently share and grasp information, and it can be expected to reduce human errors associated with work. Further, by using the function of the reader / writer 12 as an information processing terminal, it is possible to automatically and accurately record data on predetermined matters such as work reports and processing histories.

  As mentioned above, the invention made by the present inventor has been specifically described based on the embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention. Needless to say. For example, the above-described embodiment has been described in detail for easy understanding of the present invention, and is not necessarily limited to the one having all the configurations described. In addition, it is possible to add, delete, and replace other configurations for a part of the configuration of the above-described embodiment.

  INDUSTRIAL APPLICABILITY The present invention can be used in a projection mapping system that projects information related to a management target such as a building or facility onto the management target or its vicinity using a projector.

1 ... Projection mapping system,
DESCRIPTION OF SYMBOLS 10 ... Mapping apparatus, 11 ... Instruction | indication part, 12 ... Reader / writer, 12a ... Antenna part, 13 ... Projector, 14 ... Projection image, 15 ... Antenna part, 16 ... Cable, 17 ... Coaxial cable, 18 ... Reader-writer opposing antenna,
20 ... structure, 21 ... documents,
30 ... Management object, 31 ... RFID tag, 32 ... Position mark, 33 ... Center, 34 ... Center line.

Claims (7)

Projection mapping in which identification information recorded on an RFID tag incorporated in an object is read by a mapping device, and related information about the identification information is projected in the vicinity of a position where the RFID tag is incorporated in the object. A system,
The mapping device
A reader / writer capable of reading the identification information recorded on the RFID tag;
A bar-shaped indicating unit having an antenna unit at a tip thereof in the reader / writer;
A projector integrally attached to the instruction unit,
When a person holding the mapping device brings the tip of the instruction unit close to the position of the RFID tag, related information corresponding to the identification information read from the RFID tag by the reader / writer via the antenna unit is obtained. A projection mapping system that acquires and projects the acquired related information near the tip of the instruction unit by the projector. The projection mapping system according to claim 1,
The projection mapping system, wherein a focal length of the projector is adjusted based on a length from a tip of the instruction unit to a position where the projector is attached. The projection mapping system according to claim 1 or 2,
In the object, the RFID tag is incorporated in a second position away from a first position which is a center on the surface of the object or a position similar thereto. The projection mapping system according to claim 3.
A projection mapping system in which a position mark indicating the second position is displayed on the surface of the object in a format in which a direction toward the first position can be grasped. In the projection mapping system of any one of Claims 1-4,
The length of the said instruction | indication part is a projection mapping system which is a length which the person who hold | maintains the said mapping apparatus can stand in the standing position and can point the ground with the front-end | tip of the said instruction | indication part. In the projection mapping system of any one of Claims 1-4,
The said instruction | indication part is a projection mapping system comprised with the substantially rod-shaped tool. The projection mapping system according to claim 1 or 2,
The said instruction | indication part is a projection mapping system comprised by the pen-type writing instrument.