JP2018163652A - Automatic door installation state presentation method, device and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique allowing for confirmation of an operation image of an automatic door installation of which is planned before installation.SOLUTION: An installation state presentation method for presenting an operation state of an automatic door installation of which is planned includes the steps of: taking a real image 28 including a planned installation position of the automatic door; generating a door installation image 34 by superposing a door image 36 of the moving automatic door on the real image 28; and displaying the door installation image 34. Because the door installation image about which the image of the moving automatic door is superposed on the real image including the planned installation position is displayed, operation of an apparatus installation of which is planned can be confirmed in advance.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an automatic door installation state presentation method, apparatus, and system.

  There is known an automatic door that opens and closes according to a detection result of a passerby passing near the entrance and exit of a building.

  Automatic doors are often installed at the front entrance of a building, which greatly affects the design of the building. When a new automatic door is installed or replaced, there is a demand to confirm the appearance image of the building after installation before construction. Japanese Patent Application Laid-Open No. 2004-133620 discloses a technique for displaying an image of a room indoors by overlaying and displaying furniture or decorations that are scheduled to be installed, and confirming the image after installation.

Japanese Patent Laying-Open No. 2015-125774

  A device whose form changes according to the operating state, such as an automatic door, changes the impression of the building appearance depending on the operating state. When installing such equipment, it is desirable to be able to confirm in advance even an image that operates after construction.

  This invention is made | formed in view of such a subject, The objective is to provide the technique which can confirm the operation | movement image of the automatic door which schedules installation before installation.

One aspect of the present invention is an automatic door installation state presentation method. In this method, a step of acquiring a real image including a planned installation position of an automatic door and a door installation image in which a state in which the opening / closing state of the automatic door is changed are added to the planned installation position of the automatic door in the real image are generated. And a step of presenting a door installation image.
“Presentation” includes display and notification to the user, and output to some device. The “position” in the “scheduled installation position” may be rephrased as a place or a space. “Automatic door opening / closing state changes” means not only the process of opening and closing the automatic door, but also a binary display that instantly switches between the fully open and fully closed state of the automatic door in the door installation image. It may be a state of change.

  According to this aspect, since the state of the automatic door is changed together with the actual image including the planned installation position, the operation of the automatic door scheduled for installation can be confirmed in advance.

  Another aspect of the present invention is an automatic door installation state presentation device. This device includes an image acquisition unit that acquires a real image including a planned installation position of an automatic door, and a door installation image in which an automatic door opening / closing state is added to the planned automatic door installation position in the real image. An image processing unit to be generated and a presentation unit for presenting a door installation image are provided.

Yet another aspect of the present invention is an automatic door installation state presentation system. This system includes an installation state presentation device that generates an image in which an automatic door opens and closes at a position where installation is planned, and a marker that serves as a reference for the position at which the automatic door is displayed in the image. An image acquisition unit that acquires a real image including a position and the marker, an image processing unit that generates a door installation image in which a state in which the opening / closing state of the automatic door is changed is added to the real image, and a presentation that presents the door installation image A part.
Yet another embodiment of the present invention is also an automatic door installation state presentation system. This system generates an image in which an automatic door opens and closes at a position where installation is planned, and includes a first device, a second device, and a marker serving as a reference for specifying the position of the automatic door. The first device includes an image acquisition unit that acquires an actual image including a planned installation position of the automatic door and a marker, and a first processing unit. The second device includes a second processing unit that specifies a planned installation position in the actual image from the marker. The first processing unit presents a door installation image to which a state in which the opening / closing state of the automatic door is changed at the position specified by the second processing unit is added.

  It should be noted that any combination of the above-described constituent elements, and those in which constituent elements and expressions of the present invention are mutually replaced between methods, apparatuses, systems, and the like are also effective as an aspect of the present invention.

  According to the present invention, an operation image of an automatic door scheduled for installation can be confirmed before installation.

It is a block diagram which shows the function structure of the installation state presentation apparatus which concerns on 1st Embodiment. It is a figure which shows the flowchart of the door installation image generation process of the installation state presentation apparatus which concerns on 1st Embodiment. It is a figure which shows the imaging | photography screen of the installation state presentation apparatus which concerns on 1st Embodiment. It is a figure which shows a mode that the kind of automatic door is selected by the installation state presentation apparatus which concerns on 1st Embodiment. It is a figure which shows the door installation image which concerns on 1st Embodiment. It is a block diagram which shows the function structure of the installation state presentation system which concerns on 2nd Embodiment. It is a figure which shows the flowchart of the image generation process of the installation state presentation apparatus which concerns on 2nd Embodiment. It is a figure which shows a mode that the installation state presentation apparatus which concerns on 2nd Embodiment image | photographs the image containing a marker. It is a figure which shows the door installation image which concerns on 2nd Embodiment.

  In the following embodiments, the same components are denoted by the same reference numerals, and redundant description is omitted. Moreover, in each drawing, a part of component is abbreviate | omitted suitably for convenience of explanation.

[First Embodiment]
First, an automatic door installation state presentation device will be outlined. The installation state presentation device is a mobile terminal such as a smartphone having an imaging function. Owners who plan to install automatic doors in buildings, facility managers, designers, contractors, etc., photograph the planned positions (locations) of automatic doors using the installation status presentation device. In addition, the type and model of the automatic door to be installed will be selected. On the screen of the installation state presentation device, a door installation image is displayed in which an image in which the state of the selected automatic door changes is superimposed on the actual image including the actual planned construction position. The owners can confirm how the automatic door opens and closes at the planned installation position (location) before actually constructing the automatic door. Since the image after construction becomes clear, the type and type of automatic door suitable for the building can be selected. Hereinafter, owners, facility managers, designers, installers, etc. are referred to as “owners”. A sales person in charge of an automatic door sales company is called a "sales person".

  FIG. 1 shows functional blocks of an installation state presentation device 100 according to the first embodiment. Each block can be realized in terms of hardware by electronic elements such as a CPU of a computer, mechanical parts, and the like, and in terms of software, it is realized by a computer program or the like. Draw functional blocks. Therefore, those skilled in the art will understand that these functional blocks can be realized in various forms by a combination of hardware and software.

The installation state presentation device 100 includes an image processing unit 10, an imaging unit 12 that is an image acquisition unit, a presentation unit 14, an operation unit 16, a storage unit 18, a position detection unit 20, and a posture detection unit 22. The image processing unit 10 generates a door installation image (described later) by superimposing an image of an automatic door to be installed on an image (hereinafter referred to as “real image”) taken by the imaging unit 12.
The position detection unit 20 detects the position (location) of the installation state presentation device 100 using a known technique such as GPS. The posture detection unit 22 detects the posture of the installation state presentation device 100 using known techniques such as a gyro sensor and an acceleration sensor.
The image processing unit 10 synthesizes an automatic door image with an actual image using a known AR (Augmented Reality) technique. The imaging unit 12 is a digital camera provided with an imaging device, and images a place where an automatic door is scheduled to be installed. Image alignment is left to the operations of the sales staff, but after synthesizing the image once, an actual image is taken by moving the automatic door image based on the detection results of the position detection unit 20 and the posture detection unit 22. Even if it is corrected, the sales person does not need to re-align.
The presentation unit 14 is a liquid crystal display, and displays a real image, a door installation image, and the like. The operation unit 16 is a touch panel overlaid on the presentation unit 14 and accepts an operation of a sales person in order to show an installation state of an automatic door to an owner or the like. The storage unit 18 stores a real image, a door image superimposed on the real image, and a door installation image generated by the image processing unit 10.
The storage unit 18 stores various door images such as sliding doors, hinged doors, folding doors, and circular doors. For each type, an image corresponding to an open / close mode such as single-open, double-open, or double-open is stored. Further, an image corresponding to a sash type such as an aluminum sash, a stainless steel sash, a stainless steel sash, a sash color, a size, or a structure is stored. Further, an image corresponding to the glass mode such as the presence or absence of glass and the size is recorded.

  The door installation image generation process will be described with reference to FIGS. FIG. 2 shows a flow of generation processing. First, the imaging unit 12 captures a real image including a planned installation position (location) of the automatic door (S11). FIG. 3 shows a shooting screen. An actual image captured by the imaging unit 12 is displayed in real time on the presentation unit 14 of the installation state presentation device 100. The sales representative moves while adjusting the angle or the like with the installation state presentation device 100 so that the opening 26 of the building 24 where the automatic door is scheduled to be installed falls within the photographing range. In addition, the imaging button 30 is pressed to record a still image including the planned installation position as a real image.

Next, selection of an automatic door that the owner or the like wants to install or that the sales representative determines to be suitable for the needs of the owner or the like is accepted (S12). FIG. 4 shows an automatic door selection acceptance screen. When an actual image including the planned installation position (location) is taken, an automatic door selection window 32 is displayed on the presentation unit 14. The sales representative selects the type of automatic door from the choices such as sliding doors, double sliding doors, circular doors, hinged doors, and folding doors displayed in the selection window 32 according to the instruction of the owner or the like or at his own discretion. The structure which can also select a revolving door, a glide door, etc. may be sufficient.
Next, a window for selecting an opening / closing mode (not shown) is displayed, and the door is located on the right side of the opening when fully open (front view when fully closed). Form) and left-handed (a form in which the door is positioned on the left side of the opening when fully closed in front view). In addition, a sash mode selection window (not shown) is displayed. In the case of an aluminum sash, stainless steel sash, wooden sash, and aluminum sash, the sash color (white, bronze, woodgrain, etc.), normal size frame, narrower than usual A sash mode is selected from options such as a size frame. Then, a glass mode selection window (not shown) is displayed, and the glass mode is selected from options such as glass present, no glass, full glass, upper glass alone, and glass in the longitudinal slit on the door end side.

  When the selection of the type and opening / closing mode of the automatic door is accepted, the image processing unit 10 generates a door installation image in which the image of the automatic door is superimposed on the actual image (S13). The image processing unit 10 acquires a door image corresponding to the selected content from the storage unit 18 and superimposes it on the actual image to generate a door installation image. The presentation unit 14 displays the generated door installation image. Next, the adjustment of the position and size of the door image is received from the sales representative (S14).

  FIG. 5 shows a door installation image 34 displayed on the presentation unit 14. In addition to the door installation image 34, the presentation unit 14 displays a position adjustment button 40, an angle adjustment button 42, an open / close button 44, an image save button 46, a door change button 48, and an end button 50. When the sales person presses the position adjustment button 40, the position can be adjusted by dragging the door image 36. When the angle adjustment button 42 is pressed, the angle can be adjusted by dragging the door image 36. Also, the size of the door image 36 can be adjusted by pinching in or out on the door installation image 34. The sales representative adjusts the position, angle, and size of the door image 36 to the opening 26 of the building 24, which is the planned installation position, by such an operation. The image processing unit 10 may detect the opening 26 of the building 24 using a known image recognition technique, and adjust the position and size of the door image 36 according to the opening 26. Note that no opening may be formed at the planned installation position, and the planned installation position may be inside the building.

  Returning to FIG. 2, when the opening / closing button 44 is pressed by the sales representative (Y in S15), the image processing unit 10 generates a moving image in which the door of the door image 36 opens and closes according to the selected opening / closing mode (S16). ). When the image saving button 46 is pressed (Y in S17), the moving image of the door installation image 34 that opens and closes the door of the door image 36 is saved in the storage unit 18 (S18). When the door change button 48 is pressed (Y in S19), the process returns to S12 to accept the selection of the automatic door. If neither the door change button 48 nor the end button 50 is pressed (N in S19 and N in S20), the process returns to S15. If the end button 50 is pressed (Y in S20), the process ends.

Summarize the above. The sales representative uses the installation state presentation device 100 to photograph the planned installation position (location). Next, the type, open / close mode, sash mode, and glass mode of the automatic door to be considered for installation are selected. On the installation state presentation device 100, a door installation image in which an image of opening and closing of an automatic door is superimposed on a real image is displayed. The door installation image may be displayed while the door is being opened or closed, or may be displayed by switching between two images when the door is fully open and when the door is fully closed.
According to this embodiment, the owner or the like can confirm how the automatic door opens and closes at the planned installation position before actually installing the automatic door. Since you can see the image after installation, you can select an automatic door that matches the exterior design of the building and the required functions. By creating a door installation image before construction and sharing the image after installation with the owner etc., it is possible to avoid troubles occurring with the owner after construction.

The first embodiment has been described above. Hereinafter, deformation techniques will be listed. The operation unit 16 of the installation state presentation device 100 may be configured to accept settings of automatic door attributes, that is, the opening / closing speed of the door, the opening time, the opening / closing stroke such as full open and half open in the door installation image. With this function, it is possible to more specifically confirm how the automatic door operates after installation.
The image processing unit 10 may open and close the door of the door image 36 at a predetermined time interval. This function makes it easier to check how the door operates.
The image processing unit 10 may display an image of a passerby that passes through the automatic door when the door of the door installation image is opened and closed. The operation unit 16 of the installation state presenting apparatus 100 may be configured to accept settings such as the moving direction and the number of passers-by to be displayed. This function can more realistically reproduce the behavior of the automatic door after installation.
Although the presentation unit 14 displayed the door installation image, the door installation image may be output to the outside as data instead of displaying the door installation image. In that case, the door installation image can be displayed by an arbitrary information device. Alternatively, the data may be temporarily stored in the storage unit 18 without being output to the outside, and the effective use thereof may be achieved later. As stored in the storage unit 18, the output to the installation state presentation device 100 is also an aspect of “presentation”.
The image processing unit 10 generates a door installation image by superimposing the door image on the actual image. However, it is not always necessary to generate one image by superposition. For example, position information to be superimposed on the real image and the door image may be generated and output as a “door installation image” as a set with the image data. From this data set, it is possible to easily generate an image in which a state in which an automatic door is operated is added to an actual image.

[Second Embodiment]
FIG. 6 is a functional block diagram of an automatic door installation state presentation system 200 according to the second embodiment. The installation state presentation system 200 includes a marker 102 and an installation state presentation device 104. The installation state presentation device 104 captures a real image including the marker 102 placed near the planned installation position of the automatic door, and generates a door installation image by superimposing the door image on the real image with the position of the marker 102 as a reference. To display. In the first embodiment, the positioning of the door image is left to the sales staff, but in this embodiment, the procedure can be automated.

The marker 102 includes a communication unit 52, a detection unit 54, and a sound output unit 56. The communication unit 52 transmits / receives data to / from the installation state presentation device 104. The detection unit 54 is an infrared reflective sensor, and detects a detection target such as a passerby who passes around. When the automatic door is installed, the detection unit 54 is positioned so as to detect the detection target in an area where the automatic door should detect a detection target such as a passerby. Thereby, when an automatic door is actually installed, it is possible to simulate the operation of the sensor.
The sound output unit 56 is a speaker that outputs an operation sound of an automatic door (for example, an operation sound of an electric lock), a guidance sound, and the like. The installation state presentation device 104 includes a communication unit 58 that transmits and receives data to and from the marker 102 in addition to the configuration of the installation state presentation device 100 according to the first embodiment.

  FIG. 7 shows a flow of a door installation image generation process according to the second embodiment. First, the imaging unit 12 captures a real image including the marker 102 placed near the planned installation position (place) of the automatic door (S21). FIG. 8 shows a shooting screen. The sales representative places the marker 102 near the opening 26 of the building 24 where the automatic door is scheduled to be installed.

Returning to FIG. 7, the selection of the automatic door to be installed is received from the sales representative (S22). The image processing unit 10 constructs a virtual space in which the door image selected on the basis of the position of the marker 102 is arranged in the real image (S23). The image processing unit 10 detects the marker 102 in the actual image using information such as the color and shape of the marker 102 stored in the storage unit 18 and a known image recognition technique. Further, from the position and angle of the installation state presentation device 104 detected by the position detection unit 20 and the posture detection unit 22, a shooting range (view space or view volume) in the virtual space corresponding to the actual shooting range is calculated. Obtain (S24). Next, a door installation image is generated by superimposing an image of the shooting range in the virtual space on the real image (S25). In addition, once a real image including the marker 102 is acquired and the detection result of the posture detection unit 22 at that time is held, even when the real image does not include the marker, From the detection result of the posture detection unit 22 and the detection result of the held posture detection unit 22, the door image can be superimposed on an actual image that does not include the marker 102.
The presentation unit 14 displays the generated door installation image. When a door image exists in the shooting range in the virtual space, the door image appears in the door installation image. Also in this embodiment, it is good also as a structure which can adjust the position of a door image, an angle, and a magnitude | size.

  FIG. 9 shows a door installation image 34. The door installation image 34 is generated by superimposing the door image 36 on the actual image 28 with the position of the marker 102 as a reference. A recording button 62, a door change button 64, and an end button 66 are displayed on the presentation unit 14 along with the door installation image 34.

  Returning to FIG. 7, when the sales person presses the recording button (Y in S26), the image processing unit 10 stores the door installation image 34 in the storage unit 18 and starts recording (S27). If the recording button has already been pressed, recording continues. When the detection unit 54 of the marker 102 detects the passerby 60 (Y in S28), the image processing unit 10 generates a moving image in which the door of the door image 36 is opened and closed (S29). Further, the sound output unit 56 of the marker 102 outputs an operation sound of the automatic door, a voice guidance such as “door opens”, and the like.

  When the door change button 64 is pressed by the sales representative (Y in S30), the image processing unit 10 returns to S22 and accepts the selection of the automatic door. If neither the door change button 64 nor the end button 66 is pressed (N in S30 and N in S31), the process returns to S24. When the end button 50 is pressed (Y in S31), the recording is stopped and the process is ended.

As described above, according to the second embodiment, the use of the marker 102 eliminates the need for positioning the door image with respect to the actual image manually, thereby reducing the labor of the sales staff. Further, since the image processing unit 10 tracks the marker 102 and realizes the positioning of the real image and the door image in real time or in a form close to it, the door installation image can be recorded as a moving image. Therefore, the state after installation of the automatic door can be confirmed more realistically.
Note that the sound output unit 56 may be provided in the installation state presentation device 104. In this case, a virtual surround technology that sounds as if sound is being output from the planned installation position is used. The speaker with which a smart phone is provided can be used, and it is not necessary to newly provide a speaker.

  The present invention has been described based on the embodiments. The embodiments are exemplifications, and it is understood by those skilled in the art that various modifications can be made to the respective constituent elements or combinations of the respective treatment processes, and such modifications are also within the scope of the present invention. is there.

In the first embodiment, a still image is used as an actual image. However, as in the second embodiment, the image processing unit 10 constructs a virtual space in which the door image is arranged, and the situation of the planned installation position is determined. It may be configured to display in real time. In order to calculate the overlapping position of images without using the marker 102 in real time or close to it, the position detection unit 20 and the posture detection unit 22 are used to calculate the direction and amount to move the door image, What is necessary is just to synthesize | combine this with a real image.
The installation state presentation device may be a portable terminal such as a tablet terminal or a notebook PC, or a glasses-type wearable terminal equipped with a camera. Further, the installation state presentation device may include a mobile terminal that captures the planned installation position and a terminal such as a PC connected to the mobile terminal. In this case, the mobile terminal may generate a door installation image and transmit it to the PC terminal.
An actual image captured by the mobile terminal may be transmitted to the PC terminal, and the PC terminal may generate a door installation image. In this case, it is possible to confirm that the automatic door is operating from a remote location at the planned installation position.
In the embodiment, the portable terminal is exemplified as the installation state presentation devices 100 and 104. However, this is not necessarily a single device. Although not shown below, for example, a mobile terminal is a first device, and a cloud-side server or other device is a second device. In addition, the image processing unit 10 of the installation state presentation device 100 in the embodiment is divided into two, which are a first and a second processing unit. The first processing unit is placed on the first device, and the second processing unit is placed on the second device.
A 2nd process part specifies the installation planned position of the automatic door in a real image from the designation | designated by a sales representative or the marker 102. FIG. A 1st process part displays the door installation image to which the mode that the opening-and-closing state of an automatic door changed in the position specified by the 2nd process part was added. However, the first processing unit may generate up to the door installation image, and the second processing unit may receive and display it.
In this aspect, although the point that the position calculation and, in some cases, the generation of the image is performed on the cloud side is different, the rest is the same as each embodiment and their modifications. According to this aspect, calculation or image generation that sometimes increases the load can be executed on the cloud side, and the load on the mobile terminal can be reduced.
The case where the installation state of the automatic door is confirmed has been described above, but the confirmation target device is not limited to this. The installation status presentation device is a state after installation of operating devices such as windows, security gates provided at the entrance of buildings, gates, shutters, platform doors provided at stations, advertising media that display images on displays and projectors, etc. Can be confirmed in advance.

  As the installation state presentation method of these devices, a step of capturing a real image including a planned installation position of the device, a step of generating a device installation image in which an image in which the state of the device changes is superimposed on the real image, and device installation By providing the image presenting step, it is possible to confirm in advance the state after the installation of these devices (the state of being dynamically operated and the state before and after the change).

  Furthermore, as an installation state presentation device for these devices, an image capturing unit that captures a real image including a planned installation position (location) of the device, and image processing for generating a device installation image in which the image in which the device operates is superimposed on the real image By providing a display unit and a presentation unit that presents a device installation image, it is possible to confirm in advance the state after the installation of these devices (the state of dynamic operation or the state before and after the change).

  DESCRIPTION OF SYMBOLS 10 Image processing part, 12 Imaging part (image acquisition part), 14 Presentation part, 28 Real image, 34 Door installation image, 54 Detection part, 56 Sound output part, 100, 104 Installation state presentation apparatus, 102 Marker, 200 Installation state Presentation system.

Claims (11)

A step of acquiring a real image including a planned installation position of the automatic door;
Generating a door installation image in which a state in which the opening / closing state of the automatic door changes is added to the automatic door installation scheduled position in the real image;
Presenting the door installation image;
An automatic door installation state presentation method characterized by comprising: The obtaining step obtains an image including a marker,
2. The automatic door according to claim 1, wherein the step of generating the door installation image aligns the real image and the image of the automatic door based on a position of a marker included in the real image. Installation state presentation method.   In the step of generating the door installation image, when an automatic door is installed at the planned installation position, in the area where the automatic door sensor installed to open the automatic door should detect the detection object, the detection object is 3. The automatic door installation state presentation method according to claim 1 or 2, wherein when detected, the automatic door open / closed state in the door installation image is changed.   4. The automatic door installation state presentation method according to claim 1, wherein the step of generating the door installation image superimposes an image of a passerby that causes the automatic door sensor to react with the door installation image. .   5. The automatic door installation state presentation method according to claim 1, further comprising a step of outputting a sound according to an operation state of the automatic door in the door installation image. An image acquisition unit for acquiring a real image including an automatic door installation planned position;
An image processing unit that generates a door installation image in which a state in which the opening / closing state of the automatic door changes is added to the automatic door installation planned position in the real image;
A presentation unit for presenting the door installation image;
An automatic door installation state presentation device comprising: An installation state presentation device that generates an image in which an automatic door opens and closes at a position where installation is planned, and a marker that serves as a reference for the position at which the automatic door is displayed in the image,
In the installation state presentation device, an image acquisition unit that acquires a real image including a planned installation position and the marker, and a state in which the open / close state of the automatic door is changed to the planned installation position of the automatic door in the real image are added. An automatic door installation state presentation system comprising: an image processing unit that generates a door installation image; and a presentation unit that presents the door installation image.   When an automatic door is installed at the planned installation position, the image processing unit detects an automatic door in the door installation image when the detection target is detected in an area where the automatic door should detect the detection target. 8. The automatic door installation state presentation system according to claim 7, wherein the open / close state is changed.   The said marker is provided with the detection part which detects a detection target object in the area where the said automatic door should detect a detection target object, when the automatic door is installed in the said installation planned position. The automatic door installation status presentation system described.   The automatic door installation state presentation system according to any one of claims 7 to 9, wherein the marker includes a sound output unit that outputs a sound according to an open / closed state of the automatic door in the door installation image. . An automatic door installation state presentation system for generating an image in which an automatic door opens and closes at a position where installation is planned,
A first device, a second device, and a marker serving as a reference for specifying the position of the automatic door,
The first device includes:
An image acquisition unit for acquiring an actual image including the planned installation position of the automatic door and the marker;
Including a first processing unit,
The second device includes a second processing unit that specifies the planned installation position in the real image from the marker,
The first processing unit presents a door installation image to which a state in which the opening / closing state of the automatic door changes at the position specified by the second processing unit is added. .

Images