JP2017041881A - Protective appliance, image communication system, radiation method, and program - Google Patents

Abstract

SOLUTION: A protective appliance that allows a photographing device 1 to be attached, and can obtain data on an entire-celestial-sphere panoramic image from the attached photographing device 1, and transmit it to a prescribed communication terminal 7 via a communication network is adopted.EFFECT: Because the present invention is a protective appliance, it has high affinity with a construction site from a safety aspect. Worker at the site can perform work such as construction in consideration of the protective appliance, and therefore can reduce the possibility of toppling down a communication terminal 3 accidently.SELECTED DRAWING: Figure 8

Description

  The present invention relates to a security device, an image communication system, an irradiation method, and a program.

  In recent years, there has been provided a special digital camera that obtains a 360-degree panoramic image at one time (see Patent Document 1).

  This digital camera obtains an omnidirectional panoramic image, but since the image is curved as it is and it is difficult to see the user, a smartphone or the like displays a predetermined area image that is a part of the omnidirectional panoramic image, The user can view the same planar image as the image taken with the conventional digital camera.

  In addition, there is a system in which a camera (including a Web camera) is installed at a construction site or the like for viewing, and a photographed image is browsed from a local location or a remote location. In many cases, the camera is fixed to a wall, a pillar, a pole, or the like because the purpose is to monitor a specific part. Furthermore, there is a need at a construction site or the like to install a camera on the site so as to check the progress of the work on the site, not for the purpose of monitoring, and to view or supervise it from a remote location. In order to satisfy this need, installation of a camera capable of photographing the entire celestial sphere is superior to installation of conventional cameras in that the entire camera can be viewed from a single camera. The effective camera installation position when the omnidirectional camera is installed and the construction site is photographed from the inside is closer to the center of the space of the photographing range than the conventional wall and pillar. In addition, since the construction site changes day by day, it is required not to fix the fixed point for a long time but to change the position easily according to the situation.

  However, if the omnidirectional camera is to be installed at a position close to the center of the shooting range at the construction site, it is necessary to install it using a tripod, etc., but this method causes the field worker to accidentally tip over. There arises the problem that there is a possibility.

  According to a first aspect of the present invention, there is provided attachment means to which an imaging device that captures a subject and obtains panoramic image data can be attached; acquisition means for acquiring the data from the attached imaging device; A security device, comprising: a transmission unit configured to transmit the acquired data via a communication network to an image management system that transfers the data of the panoramic image to the communication terminal.

  As described above, according to the present invention, an imaging device can be attached, and data of a panoramic image can be acquired from the attached imaging device and sent to a predetermined communication terminal via a communication network. Use safety equipment. In this way, because it is a safety device, it has a high affinity with the construction site from the safety aspect, and workers on the site can proceed with work such as construction while being aware of the safety device (avoidance) The possibility of accidentally overturning the security device can be reduced.

(A) is a left side view of the photographing apparatus, (b) is a front view of the photographing apparatus, and (c) is a plan view of the photographing apparatus. It is a usage image figure of an imaging device. (A) is the hemispherical image (front) image | photographed with the imaging device, (b) is the hemispherical image (back) image | photographed with the imaging device, (c) is the figure which showed the image represented by the Mercator projection. (A) The conceptual diagram which showed the state which covers a sphere with a Mercator image, (b) The figure which showed the omnidirectional panoramic image. It is the figure which showed the position of the virtual camera and predetermined | prescribed area | region at the time of making an omnidirectional panoramic image into a three-dimensional solid sphere. (A) is the three-dimensional perspective view of FIG. 4, (b) is a figure which shows the communication terminal by which the image of the predetermined area | region was displayed on the display. It is the figure which showed the relationship between predetermined area information and a predetermined area image. 1 is a schematic diagram of an image communication system according to an embodiment of the present invention. It is a hardware block diagram of an imaging device. (A) is a perspective view of a communication terminal, (b) is a perspective view of an attachment part. (A) is a top view of a communication terminal, (b) is a side view of a communication terminal. (A) Top view of a guide rail, (b) AA sectional drawing of Fig.12 (a), (c) BB sectional drawing of Fig.12 (a). 2 is a hardware configuration diagram of a communication terminal 3. FIG. It is a hardware block diagram of an image management system and the communication terminal. It is the figure which showed the outline of the process of registration and acquisition of image data. It is a conceptual diagram which shows a base management table. It is a conceptual diagram which shows a terminal management table. It is a conceptual diagram which shows an imaging | photography management table. It is a conceptual diagram which shows an image management table. It is a conceptual diagram of a base layout map. It is a sequence diagram which shows a process of imaging reservation. It is the sequence figure which showed the process which performs photographing instruction. FIG. 10 is a sequence diagram illustrating a layout map display process. It is a sequence diagram which shows the display process of picked-up image data. It is a figure which shows the example of a screen by the supervisor side. It is a figure which shows the example of a screen by the supervisor side. It is a figure which shows the example of a screen by the supervisor side. It is a figure which shows the example of a screen by the supervisor side. It is a figure which shows the example of a screen by the supervisor side. It is a figure which shows the example of a screen by the supervisor side. It is a figure which shows the example of a screen by the supervisor side. It is the figure which showed the condition of the photography field. It is a flowchart which shows control of the movement of the irradiation position of an irradiation image. It is a figure which shows the example of a screen of the relationship between a cursor and the irradiation position of an irradiation image. It is a conceptual diagram which shows the relationship between a cursor and the irradiation position of an irradiation image.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<< Summary of Embodiment >>
<Generation method of panoramic image>
A method for generating an omnidirectional panoramic image will be described with reference to FIGS.

  First, the external appearance of the photographing apparatus 1 will be described with reference to FIG. The photographing apparatus 1 is a digital camera for obtaining a photographed image that is the basis of a panoramic image of a celestial sphere (360 °). 1A is a left side view of the photographing apparatus, FIG. 1B is a front view of the photographing apparatus, and FIG. 1C is a plan view of the photographing apparatus.

  As shown in FIG. 1A, the photographing apparatus 1 has a size that a human can hold with one hand. Further, as shown in FIGS. 1A, 1B, and 1C, on the upper part of the photographing apparatus 1, an image sensor 103a is provided on the front side (front side) and an image sensor is provided on the back side (rear side). 103b is provided. These image sensors 103a and 103b are used in combination with an optical member (for example, fish-eye lenses 102a and 102b described later) capable of capturing a hemispherical image (angle of view of 180 ° or more). Further, as shown in FIG. 1B, an operation unit 115 such as a shutter button is provided on the back side (rear side) of the photographing apparatus 1.

  Next, the usage situation of the imaging device 1 will be described with reference to FIG. FIG. 2 is a usage image diagram of the photographing apparatus. As shown in FIG. 2, the photographing apparatus 1 is used, for example, for photographing a subject around the user by holding it in his hand. In this case, two hemispherical images can be obtained by imaging the subject around the user by the imaging device 103a and the imaging device 103b shown in FIG.

  Next, an outline of processing until an omnidirectional panoramic image is created from an image photographed by the photographing apparatus 1 will be described with reference to FIGS. 3 and 4. 3A is a hemispheric image (front side) photographed by the photographing apparatus, FIG. 3B is a hemispheric image photographed by the photographing apparatus (rear side), and FIG. 3C is represented by Mercator projection. FIG. 6 is a diagram showing an image (hereinafter referred to as “Mercatl image”). FIG. 4A is a conceptual diagram showing a state in which a sphere is covered with a Mercator image, and FIG. 4B is a diagram showing an omnidirectional panoramic image.

  As shown in FIG. 3A, the image obtained by the image sensor 103a is a hemispherical image (front side) curved by a fish-eye lens 102a described later. Also, as shown in FIG. 3B, the image obtained by the image sensor 103b is a hemispherical image (rear side) curved by a fish-eye lens 102b described later. Then, the hemispherical image (front side) and the hemispherical image inverted by 180 degrees (rear side) are combined by the photographing apparatus 1 to create a Mercator image as shown in FIG.

  By using OpenGL ES (Open Graphics Library for Embedded Systems), as shown in FIG. 4A, the Mercator image is pasted so as to cover the spherical surface, and FIG. An omnidirectional panoramic image as shown is created. Thus, the omnidirectional panoramic image is represented as an image in which the Mercator image faces the center of the sphere. OpenGL ES is a graphics library used for visualizing 2D (2-Dimensions) and 3D (3-Dimensions) data. Note that the omnidirectional panoramic image may be a still image or a moving image.

  As described above, since the omnidirectional panoramic image is an image pasted so as to cover the spherical surface, it is uncomfortable when viewed by a human. Therefore, by displaying a predetermined area (hereinafter referred to as “predetermined area image”) of a part of the omnidirectional panoramic image as a flat image with little curvature, a display that does not give a sense of incongruity to humans can be achieved. This will be described with reference to FIGS.

  FIG. 5 is a diagram illustrating the positions of the virtual camera and the predetermined area when the panoramic image is a three-dimensional solid sphere. The virtual camera IC corresponds to the position of the viewpoint of the user who views the omnidirectional panoramic image displayed as a three-dimensional solid sphere. FIG. 6A is a three-dimensional perspective view of FIG. 5, and FIG. 6B is a diagram showing a predetermined area image when displayed on the display. In FIG. 6A, the omnidirectional panoramic image shown in FIG. 4 is represented by a three-dimensional solid sphere CS. If the omnidirectional panoramic image generated in this way is a solid sphere CS, the virtual camera IC is located outside the omnidirectional panoramic image as shown in FIG. The predetermined area T in the omnidirectional panoramic image is specified by predetermined area information of the position of the virtual camera IC in the omnidirectional panoramic image. The predetermined area information is indicated by, for example, coordinates (x (rH), y (rV), and angle of view α (angle)) or coordinates (X, Y, Z). The zoom of the predetermined region T can be expressed by expanding or contracting the range (arc) of the angle of view α. The zoom of the predetermined area T can also be expressed by moving the virtual camera IC closer to or away from the panoramic image.

  Then, as shown in FIG. 6A, the image of the predetermined area T in the omnidirectional panoramic image is displayed on the predetermined display as the predetermined area image as shown in FIG. 6B. Is displayed. The image shown in FIG. 6B is an image represented by predetermined area information (x, y, α) that is initially set (default).

  Here, the relationship between the predetermined area information and the predetermined area image will be described with reference to FIG. FIG. 7 is a diagram showing the relationship between the predetermined region information and the relationship between the predetermined region images. As shown in FIG. 7, the center point CP when the diagonal field angle of the predetermined area T represented by the field angle α of the virtual camera IC is 2L is the (x, y) parameter of the predetermined area information. Become. f is the distance from the virtual camera IC to the center point CP of the predetermined area T. In FIG. 7, a trigonometric function represented by the following formula (1) is generally established.

Lf = tan (α / 2) (Formula 1)
<Outline of image communication system>
Next, an outline of the configuration of the image communication system according to the present embodiment will be described with reference to FIG. FIG. 8 is a schematic diagram of the configuration of the image communication system of the present embodiment.

  As shown in FIG. 8, the image communication system according to the present embodiment includes an imaging device 1, a communication terminal 3, an image management system 5, and a communication terminal 7.

  Among these, the imaging device 1 is a digital camera for obtaining an omnidirectional panoramic image as described above. The photographing apparatus 1 may be a general digital camera. When the communication terminal 3 has a camera, the communication terminal 3 can be a digital camera. In the present embodiment, the description will be made as a digital camera for obtaining an omnidirectional panoramic image for easy understanding. The communication terminal 3 serves as a cradle that charges the photographing device 1 and transmits / receives data. As an example, the communication terminal 3 shows a case of a security device (here, a color cone) installed at a construction site or the like. . In addition, the communication terminal 3 can perform data communication with the photographing apparatus 1 through the contact point, and can perform data communication with the image management system 5 through the communication network 9 using a wireless communication technology such as WiFi. Can do. The communication network 9 is, for example, the Internet.

  The image management system 5 is a server computer, for example, and can perform data communication with the communication terminals 3 and 5 via the communication network 9. OpenGL ES is installed in the image management system 5 and creates a panoramic image. Further, the image management system 5 creates a partial image (predetermined region image or a specific region image described later) of the omnidirectional panoramic image and provides thumbnail data and captured image data to the communication terminal 7.

  The communication terminal 7 is, for example, a notebook PC (Personal Computer), and can perform data communication with the image management system 5 via the communication network 9. The image management system 5 may be configured by a single server computer or may be configured by a plurality of server computers.

  Furthermore, the photographing device 1 and the communication terminal 3 are installed at predetermined positions by the worker X at each construction base such as an apartment. The communication terminal 7 is installed in a head office or the like that supervises and remotely supervises each construction site, and displays an image representing the status of each site sent via the image management system 5, so that the supervisor Y Can view a screen showing the status of each site (hereinafter referred to as a “site status screen”). The image management system 5 is installed in a service company that provides a service for providing the communication terminal 7 with captured image data sent from the communication terminal 3 at each site.

<Hardware Configuration of Embodiment>
Next, the hardware configuration of the imaging device 1, the communication terminals 3 and 7, and the image management system 5 according to the present embodiment will be described in detail with reference to FIGS.

  First, the hardware configuration of the photographing apparatus 1 will be described with reference to FIG. FIG. 9 is a hardware configuration diagram of the photographing apparatus. In the following, the photographing apparatus 1 is an omnidirectional photographing apparatus using two imaging elements, but the number of imaging elements may be three or more. In addition, it is not always necessary to use an apparatus dedicated to omnidirectional imaging. By attaching a retrofit omnidirectional imaging unit to a normal digital camera, smartphone, or the like, the apparatus may have substantially the same function as the imaging apparatus 1. .

  As shown in FIG. 9, the imaging apparatus 1 includes an imaging unit 101, an image processing unit 104, an imaging control unit 105, a microphone 108, a sound processing unit 109, a CPU (Central Processing Unit) 111, a ROM (Read Only Memory). ) 112, SRAM (Static Random Access Memory) 113, DRAM (Dynamic Random Access Memory) 114, operation unit 115, network I / F 116, communication unit 117, and antenna 117a.

  Among these, the imaging unit 101 includes wide-angle lenses (so-called fish-eye lenses) 102a and 102b each having an angle of view of 180 ° or more for forming a hemispherical image, and two imaging units provided corresponding to the wide-angle lenses. Elements 103a and 103b are provided. The image sensors 103a and 103b are image sensors such as a CMOS (Complementary Metal Oxide Semiconductor) sensor and a CCD (Charge Coupled Device) sensor that convert an optical image obtained by a fisheye lens into image data of an electric signal and output the image data. A timing generation circuit for generating a vertical synchronization signal, a pixel clock, and the like, and a register group in which various commands and parameters necessary for the operation of the image sensor are set.

  The imaging elements 103a and 103b of the imaging unit 101 are each connected to the image processing unit 104 via a parallel I / F bus. On the other hand, the imaging elements 103 a and 103 b of the imaging unit 101 are connected to a serial I / F bus (I2C bus or the like) separately from the imaging control unit 105. The image processing unit 104 and the imaging control unit 105 are connected to the CPU 111 via the bus 110. Further, ROM 112, SRAM 113, DRAM 114, operation unit 115, network I / F 116, communication unit 117, and electronic compass 118 are connected to the bus 110.

  The image processing unit 104 takes in the image data output from the image sensors 103a and 103b through the parallel I / F bus, performs predetermined processing on the respective image data, and then combines these image data. Then, data of a Mercator image as shown in FIG.

  In general, the imaging control unit 105 sets a command or the like in a register group of the imaging elements 103a and 103b using the I2C bus with the imaging control unit 105 as a master device and the imaging elements 103a and 103b as slave devices. Necessary commands and the like are received from the CPU 111. The imaging control unit 105 also uses the I2C bus to capture status data of the register groups of the imaging elements 103a and 103b and send it to the CPU 111.

  The imaging control unit 105 instructs the imaging elements 103a and 103b to output image data at the timing when the shutter button of the operation unit 115 is pressed. Some photographing apparatuses have a preview display function by a display and a function corresponding to a moving image display. In this case, output of image data from the image sensors 103a and 103b is continuously performed at a predetermined frame rate (frame / min).

  The imaging control unit 105 also functions as a synchronization control unit that synchronizes the output timing of the image data of the imaging elements 103a and 103b in cooperation with the CPU 111. In the present embodiment, the photographing apparatus is not provided with a display unit, but a display unit may be provided.

  The microphone 108 converts sound into sound (signal) data. The sound processing unit 109 takes in the sound data output from the microphone 108 through the I / F bus and performs predetermined processing on the sound data.

  The CPU 111 controls the overall operation of the photographing apparatus 1 and executes necessary processes. The ROM 112 stores various programs for the CPU 111. The SRAM 113 and the DRAM 114 are work memories, and store programs executed by the CPU 111, data being processed, and the like. In particular, the DRAM 114 stores image data being processed by the image processing unit 104 and processed Mercator image data.

  The operation unit 115 is a general term for various operation buttons, a power switch, a shutter button, a touch panel that has both display and operation functions, and the like. The user inputs various shooting modes and shooting conditions by operating the operation buttons.

  The network I / F 116 is a general term for an interface circuit (USB I / F or the like) with an external medium such as an SD card or a personal computer. Further, the network I / F 116 may be a network interface regardless of wireless or wired. The data of the Mercator image stored in the DRAM 114 is recorded on an external medium via the network I / F 116 or the communication terminal 3 or the like via the network I / F 116 which becomes a network I / F as necessary. Or sent to an external device.

  The communication unit 117 communicates with an external device such as the communication terminal 3 by a short-range wireless technology such as WiFi (wireless fidelity) or NFC via the antenna 117 a provided in the photographing apparatus 1. The communication unit 117 can also transmit Mercator image data to an external device of the communication terminal 3.

  The electronic compass 118 calculates the azimuth and tilt (Roll rotation angle) of the photographing apparatus 1 from the earth's magnetism, and outputs azimuth / tilt information. This azimuth / tilt information is an example of related information (metadata) along Exif, and is used for image processing such as image correction of a captured image. Note that the related information includes each data of the image capturing date and time and the data capacity of the image data.

  Next, the hardware configuration of the communication terminal 3 will be described with reference to FIGS. 10 and 14. 10A is a perspective view of the communication terminal, and FIG. 10B is a perspective view of the mounting portion. FIG. 11A is a plan view of the communication terminal, and FIG. 11B is a side view of the communication terminal.

  As shown in FIG. 10A, the communication terminal 3 mainly includes a color cone 300, an irradiation position control unit 350, and a cover 390. The color cone 300 is made of a plastic with a hollow inside used in a construction site or the like. A communication control unit 310 and a battery 330 are provided in the inner space of the color cone 300. The communication control unit 310 can transmit the data acquired from the imaging device 1 to the image management system 5 via the communication network 9. The battery 330 plays a role for responding to a power failure as a secondary battery. The battery 330 can be charged by being supplied with power from an outlet to which the plug 399 is connected. In addition, an attachment portion 400 having a recess for attaching the photographing apparatus 1 is provided on the upper portion of the color cone 300.

  As shown in FIG. 10B, the attachment portion 400 is formed with an opening 410 that is a concave portion into which the photographing apparatus 1 can be inserted and removed. A convex USB connection I / F 420 that can be inserted into and removed from a concave portion of the USB connection I / F formed on the bottom surface of the photographing apparatus 1 is provided at the bottom of the opening 410. In addition, the imaging device 1 is attached to the communication terminal 3 so that the image sensor 103 a of the imaging device 1 always faces a specific direction of the communication terminal 3. The cover 390 is a plastic or glass transparent cover and protects the photographing apparatus 1. The USB connection I / F may be a Micro USB connection I / F.

  Further, a cable 391 is connected between the attachment unit 400 and the communication control unit 310, and this cable 391 is used for data transmission / reception and power feeding between the attachment unit 400 and the communication control unit 310. A cable 392 is connected between the irradiation position control unit 350 and the communication control unit 310, and this cable 392 is used for data transmission / reception and power feeding between the irradiation position control unit 350 and the communication control unit 310. A cable 393 is connected between the communication control unit 310 and the battery 330, and this cable 393 is used for power supply from the battery 330 to the communication control unit 310. A power supply cable 394 is connected between the battery 330 and the plug 399.

  Further, as shown in FIGS. 11A and 11B, the irradiation position control unit 350 mainly includes a guide rail 360, a plurality of support rods 361 to 368, a support base 372, and an irradiation device 380. It is configured. Among these, the guide rail 360 is a rail for rotating the support base 372 in the θ direction. The plurality of support bars 361 to 368 are bars for supporting the color cone 300 by providing the color cone 300 with a guide rail 360. The support base 372 becomes a base on which the irradiation device 380 is installed, and can rotate the irradiation device 380 by rotating in the θ direction along the guide rail 360.

  Next, the mechanism of the irradiation position control unit 350 will be described in detail with reference to FIG. 12A is a plan view of the irradiation position control unit 350, FIG. 12B is a cross-sectional view taken along line AA in FIG. 12A, and FIG. 12C is a cross-sectional view taken along line BB in FIG. It is.

  12A and 12B, the irradiation position control unit 350 mainly includes a motor 351, a guide rail 360, a rotating base 371, a support base 372, a spur gear 374, and an irradiation device 380. It is constituted by.

  The motor 351 is a servo motor and applies a predetermined rotation to the spur gear 374 via the rotation shaft 375. On the guide rail 360, a ring-shaped turntable 371 is rotatably provided. An internal gear (internal gear) is formed on the turntable 371, meshed with the spur gear 374, and the spur gear 374 is rotated by the motor 351, so that the turntable 371 moves in the θ direction with respect to the guide rail 360. Rotate. Along with this, the support table 372 provided on the turntable 371 also rotates in the θ direction, so that the irradiation device 380 provided on the support table 372 also rotates in the θ direction.

  Furthermore, as shown in FIG. 12C, a pointer 381 and a motor 353 are provided inside the irradiation device 380. An LED 355 is provided at the tip of the pointer 381. The motor 353 is a servo motor and can rotate the pointer 381 in the φ direction via the rotation shaft 383.

  As a result, the irradiation position control unit 350 can irradiate the laser light to almost the area of the subject that the imaging apparatus 1 performs panoramic panoramic imaging.

  Next, the hardware configuration of the communication terminal 3 will be described with reference to FIG. FIG. 13 is an electrical hardware configuration diagram of the communication terminal 3.

  As illustrated in FIG. 13, the communication terminal 3 includes a communication control unit 310 and an irradiation position control unit 350. Among these, the communication control unit 310 is a CPU 301 that controls the operation of the entire communication terminal 3, a ROM 302 that stores basic input / output programs, a RAM (Random Access Memory) 303 that is used as a work area of the CPU 301, and the control of the CPU 301. An EEPROM (Electrically Erasable and Programmable ROM) 304 that reads or writes data, a CMOS sensor 305 as an image sensor that captures an image of a subject under the control of the CPU 301, and a device for electrical connection with various devices An I / F 308 is provided. With this device I / F, as shown in FIG. 10, when the photographing apparatus 1 is attached to the communication terminal 3, the communication terminal 3 is electrically connected to the photographing apparatus 1.

  The EEPROM 304 stores an operating system (OS) executed by the CPU 301, other programs, and various data. A CCD sensor may be used instead of the CMOS sensor 305.

Further, the communication terminal 3 includes an antenna 313a, a communication unit 313 that communicates with other devices (terminals) using a wireless communication signal using the antenna 313a, a GPS (Global Positioning Systems) satellite, or an IMES (indoor GPS). A GPS receiving unit 314 that receives a GPS signal including position information (latitude, longitude, and altitude) of the communication terminal 3 by an indoor MEssaging System), an address bus, a data bus, and the like for electrically connecting the above units Further, the irradiation position control unit 350 is electrically connected to the device I / F 308. The irradiation position control unit 350 includes a motor 351 for rotating (rotating in the θ direction) the irradiation device 380 along the guide rail 360 of the communication terminal 3 illustrated in FIG. A motor driver 352 for controlling the driving of the motor is provided. Further, the irradiation position control unit 350 includes a motor 353 for rotating the pointer 381 in the vertical direction (rotation in the φ direction) at a specific position of the guide rail 360 of the communication terminal 3 illustrated in FIG. , And a motor driver 354 for controlling the drive of the motor 353 is provided. Furthermore, the irradiation position control unit 350 is provided with an LED (Light Emitting Diode) 355 for irradiating laser light, and an LED control circuit 356 for controlling ON / OFF of irradiation of the LED 355. The processing and operation of the motor driver 352, the motor driver 354, and the LED control circuit 356 of the irradiation position control unit 350 are controlled by the CPU 301 of the communication control unit 310.

  Next, the hardware configuration of the communication terminal 7 in the case of the image management system 5 and the notebook PC will be described with reference to FIG. FIG. 14 is a hardware configuration diagram of the image management system 5 and the communication terminal 7. Since the image management system 5 and the communication terminal 7 are both computers, the configuration of the image management system 5 will be described below, and the description of the configuration of the communication terminal 7 will be omitted.

  The image management system 5 includes a CPU 501 that controls the overall operation of the image management system 5, a ROM 502 that stores programs used to drive the CPU 501 such as an IPL, a RAM 503 that is used as a work area for the CPU 501, and a program for the image management system 5. For reading various data such as HD504, HDD (Hard Disk Drive) 505 for controlling the reading or writing of various data to the HD504 in accordance with the control of the CPU 501, and data reading or writing (storage) for a recording medium 506 such as a flash memory. A media drive 507 to be controlled, a display 508 for displaying various information such as a cursor, menu, window, character, or image, and a network I / F 509 for data communication using the communication network 9 An example of a keyboard 511 having a plurality of keys for inputting characters, numerical values, various instructions, a mouse 512 for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like, and a removable recording medium A CD-ROM drive 514 for controlling the reading or writing of various data with respect to a CD-ROM (Compact Disc Read Only Memory) 513, and the above-mentioned components are electrically connected as shown in FIG. A bus line 510 such as an address bus or a data bus.

<< Functional Configuration of Embodiment >>
Next, the functional configuration of this embodiment will be described with reference to FIGS. 9 to 14 and FIG. FIG. 15 is a functional block diagram of the image capturing device 1, the communication terminal 3, the image management system 5, and the communication terminal 7 that constitute a part of the image communication system of the present embodiment. In FIG. 15, the image management system 5 can perform data communication with the communication terminal 3 and the communication terminal 7 via the communication network 9.

<Functional configuration of photographing apparatus 1>
As illustrated in FIG. 15, the imaging device 1 includes a reception unit 12, an imaging unit 13, a sound collection unit 14, a connection unit 18, and a storage / readout unit 19. Each of these units is a function or means realized by any of the constituent elements shown in FIG. 9 being operated by a command from the CPU 111 in accordance with a shooting storage program developed from the SRAM 113 onto the DRAM 114. It is.

  Further, the photographing apparatus 1 has a storage unit 1000 constructed by the ROM 112, the SRAM 113, and the DRAM 114 shown in FIG.

(Each functional configuration of the photographing apparatus 1)
Next, each functional configuration of the photographing apparatus 1 will be described in more detail with reference to FIGS. 9 and 15.

  The accepting unit 12 of the photographing apparatus 1 is mainly realized by the processing of the operation unit 115 and the CPU 111 shown in FIG. 9 and accepts an operation input from a user (worker X in FIG. 8).

  The imaging unit 13 is realized mainly by the processing of the imaging unit 101, the image processing unit 104, the imaging control unit 105, and the CPU 111 shown in FIG. 9, and images a landscape and the like to obtain captured image data.

  The sound collecting unit 14 is realized by the processing of the CPU 108, the sound processing unit 109, and the CPU 111 shown in FIG. 9, and collects sounds around the photographing apparatus 1.

  The connection unit 18 is realized mainly by the USB connection I / F of the recess provided on the bottom surface of the photographing apparatus 1 and the processing of the CPU 111, and receives power supply from the communication terminal 3 and performs data communication.

  The storage / reading unit 19 is realized mainly by the processing of the CPU 111 shown in FIG. 9, and stores various data (or information) in the storage unit 1000 or stores various data (or information) from the storage unit 1000. Read out.

<Functional configuration of communication terminal 3>
As illustrated in FIG. 15, the communication terminal 3 includes a communication control unit 310 and an irradiation position control unit 350. Among these, the communication control unit 310 includes a transmission / reception unit 31, a determination unit 33, a calculation unit 34, a connection unit 38, and a storage / reading unit 39. Each of these units is a function or means realized by any of the constituent elements shown in FIG. 13 being operated by a command from the CPU 301 in accordance with the program for the communication terminal 3 expanded from the EEPROM 304 onto the RAM 303. It is.

  Further, the communication terminal 3 includes a storage unit 3000 constructed by the ROM 302, the RAM 303, and the EEPROM 304 shown in FIG.

  On the other hand, the irradiation position control unit 350 includes a changing unit 35 and an irradiation unit 36. Each of these units is a function or means realized by any of the constituent elements shown in FIG. 13 being operated by a command from the CPU 301 in accordance with the program for the communication terminal 3 expanded from the EEPROM 304 onto the RAM 303. It is.

(Each functional configuration of the communication terminal 3)
Next, each functional configuration of the communication terminal 3 will be described in more detail with reference to FIGS. 13 and 15.

  The transmission / reception unit 31 of the communication control unit 310 is mainly realized by the processing of the communication unit 313 and the CPU 301 shown in FIG. 13, and the image management system 5 and various data (or information) are transmitted via the communication network 9. Send and receive.

  The determination unit 33 is realized mainly by the processing of the CPU 301 shown in FIG. 13, and the distance between the designated position by the cursor 4 and the irradiation position by the LED is within a threshold (for example, 10 cm in the real world). It is judged whether or not there is.

  The calculation unit 34 is mainly realized by the processing of the CPU 301 shown in FIG. 13, and changes from the coordinate system of the panoramic image of the photographic device 1 to the coordinate system of the space of the base where the communication terminal 3 is installed. By converting, the irradiation position of the laser beam in the base space is calculated from the designated position in the panoramic image.

  The connection unit 38 is mainly realized by processing of the USB connection I / F 420 and the CPU 301, and supplies power to the communication terminal 3 and performs data communication. The connection unit 18 is an example of a providing unit that provides omnidirectional panoramic image data, and the connection unit 38 is an example of an acquisition unit that acquires omnidirectional panoramic image data.

  The storage / reading unit 39 is mainly realized by the processing of the CPU 301 shown in FIG. 13, and stores various data (or information) in the storage unit 3000 or stores various data (or information) from the storage unit 3000. Read out.

  On the other hand, the changing unit 35 of the irradiation position control unit 350 is realized mainly by the processing of the motor drivers 352 and 354, the motors 351 and 353, and the CPU 301 shown in FIG. And the rotation of the pointer 381 in the φ direction (up and down movement) are controlled. The irradiation unit 36 of the irradiation position control unit 350 is mainly realized by the processing of the irradiation position control unit 350 shown in FIG. 12, the LED control circuit 356 and the LED 355 shown in FIG. Then, the laser beam irradiation from the irradiation position control unit 350 and the irradiation control are performed.

<Functional configuration of image management system>
Next, each functional configuration of the image management system 5 will be described in detail with reference to FIGS. 14 and 15. The image management system 5 includes a transmission / reception unit 51, a generation unit 54, and a storage / readout unit 59. Each of these units is a function realized by any one of the constituent elements shown in FIG. 14 operating by an instruction from the CPU 501 according to the image management system 5 program expanded from the HD 504 to the RAM 503, or Means.

  Further, the image management system 5 includes a storage unit 5000 constructed by the RAM 503 and the HD 504 shown in FIG. In the storage unit 5000, a base management DB 5001, a terminal management DB 5002, a shooting management DB 5003, and an image management DB 5004 are constructed. Among these, the base management DB 5001 is configured by a base management table described later. The terminal management DB 5002 is configured by a terminal management table described later. The shooting management DB 5003 is configured by a shooting management table. The image management DB 5004 is configured by an image management table described later.

(Base management table)
FIG. 16 is a conceptual diagram showing a base management table. In this base management table, a region ID, a region name, a base ID, a base name, a file name of a base layout map, and a device ID are stored and managed in association with each other. Of these, the region ID is an example of region identification information for identifying a region. The region indicates a certain range, for example, Kanto, Tokyo, Shibuya Ward, New York State, New York City. The base ID is an example of base identification information for identifying the base. The site name indicates the construction site. As shown in FIG. 20, the layout map shows the layout of each site, and can specify the position in the site in detail using two-dimensional coordinates. FIG. 20 is a conceptual diagram of the base layout map. Here, a layout map of an apartment that is a construction site is shown. The device ID is an example of device identification information for identifying the photographing device 1. The layout map data is stored in the storage unit 5000.

(Terminal management table)
FIG. 17 is a conceptual diagram showing a terminal management table. In this terminal management table, device installation position information and predetermined area information are stored and managed in association with each device ID. Among these, the apparatus installation position information indicates the installation position of the photographing apparatus on the base layout map indicated by the two-dimensional coordinates, for example, as shown in FIG. The predetermined area information is the predetermined area information described with reference to FIG. The device ID, device installation position information, and predetermined area information in this terminal management table are information that the supervisor Y previously acquires from the worker X and the like. The worker X notifies the supervisor Y by e-mail or the like when installing each photographing apparatus 1 at a predetermined position in the base.

(Shooting management table)
FIG. 18 is a conceptual diagram showing a photographing management table. In this shooting management table, a shooting title, a shooting start date and time, and a shooting end date and time are stored and managed in association with each base ID. Among these, the shooting title is a title input by the supervisor Y who is a viewer, and is used when the supervisor Y extracts desired shot image data from a plurality of shot image data. The shooting start date and time is the date and time input by the viewer, and indicates the date and time when the shooting apparatus 1 starts (or starts) shooting. The shooting end date and time is the date and time input by the supervisor Y and indicates the date and time when the shooting apparatus 1 ends (or ends) shooting.

(Image management table)
FIG. 19 is a conceptual diagram showing an image management table. In this image management table, for each device ID, an image ID, a file name of captured image data, and a shooting date and time are associated with each other and stored and managed. Among these, the image ID is an example of image identification information for identifying captured image data. The file name of the photographed image data is the file name of the photographed image data indicated by the associated image ID. The shooting date and time is the date and time when the associated shooting image data was shot by the shooting device 1 indicated by the device ID. The photographed image data is stored in the storage unit 5000.

(Each functional configuration of the image management system)
Next, each functional configuration of the image management system 5 will be described in detail with reference to FIGS. 14 and 15.

  The transmission / reception unit 51 of the image management system 5 is realized mainly by the processing of the network I / F 509 and the CPU 501 illustrated in FIG. 14, and the communication terminal 3 or the communication terminal 7 and various data ( Or information).

  The generation unit 54 generates a site status screen representing the status of a specific site as shown in FIGS. 25 to 31 described later.

  The storage / reading unit 59 is realized mainly by the processing of the HDD 505 and the CPU 501 shown in FIG. 14, and stores various data (or information) in the storage unit 5000 or various data (or information) from the storage unit 5000. Information).

<Functional configuration of communication terminal 7>
Next, the functional configuration of the communication terminal 7 will be described in detail with reference to FIGS. 14 and 15. The communication terminal 7 includes a transmission / reception unit 71, a reception unit 72, a display control unit 73, and a storage / readout unit 79. Each of these units is a function or means realized by any one of the constituent elements shown in FIG. 14 operating according to a command from the CPU 501 according to the communication terminal 7 program expanded from the HD 504 to the RAM 503. It is.

  Further, the communication terminal 7 includes a storage unit 7000 constructed by the RAM 503 and the HD 504 shown in FIG.

(Each functional configuration of the communication terminal 7)
Next, each functional configuration of the communication terminal 7 will be described in detail with reference to FIG.

  The transmission / reception unit 71 of the communication terminal 7 is realized mainly by the processing of the network I / F 509 and the CPU 501 shown in FIG. 14 and transmits / receives various data (or information) to / from the image management system 5 via the communication network 9. I do.

  The accepting unit 72 is realized mainly by the processing of the keyboard 511 and mouse 512 and the CPU 501 shown in FIG. 14, and accepts an operation input from a user (supervisor Y in FIG. 8).

  The display control unit 73 is realized mainly by the processing of the CPU 501 shown in FIG. 14 and performs control for displaying various images on the display 508 of the communication terminal 7.

  The storage / reading unit 79 is realized mainly by the processing of the HDD 505 and the CPU 501 shown in FIG. 14, and stores various data (or information) in the storage unit 7000 or various data (or information) from the storage unit 7000. Information).

<< Processing or Operation of Embodiment >>
Subsequently, the processing or operation of the present embodiment will be described with reference to FIGS. First, using FIG. 21, the supervisor Y uses the communication terminal 7 to explain the shooting reservation process of the shooting apparatus 1. FIG. 21 is a sequence diagram illustrating a process for photographing reservation. 25 to 31 are diagrams showing examples of screens on the supervisor side. Among these, FIG.25 and FIG.26 shows a schedule table screen. FIG. 27 to FIG. 31 show site status screens showing the status of specific sites.

  As shown in FIG. 21, when the supervisor Y inputs the base ID into the communication terminal 7, the receiving unit 72 receives the input of the base ID (step S11). In this case, as shown in FIG. 25A, an input field 7110 for inputting the base ID is displayed on the display 508 of the communication terminal 7, and the supervisor Y enters the input field 7110. Enter the base ID of the base that is the construction site you want to view. Thereby, the transmission / reception part 71 transmits the request | requirement of a schedule to the image management system 5 (step S12). This request includes the base ID input in step S11. Accordingly, the transmission / reception unit 51 of the image management system 5 receives the schedule request.

  Next, the storage / reading unit 59 of the image management system 5 searches the shooting management table (see FIG. 18) using the base ID received by the transmission / reception unit 51 as a search key, thereby corresponding shooting title, shooting start date and time. In addition, the photographing end date and time are read out, and the corresponding base name is read out by searching the base management table (see FIG. 16) using the base ID as a search key (step S13). And the production | generation part 54 produces a schedule table screen as shown in FIG.25 (b) based on the various information read by step S13, and the transmission / reception part 51 transmits the schedule table screen to the communication terminal 7. FIG. Is transmitted (step S14). At this time, the base ID is also transmitted together with the schedule table screen data. Thereby, the transmission / reception unit 71 of the communication terminal 7 receives the data of the schedule table screen.

  Next, in the communication terminal 7, the display control unit 73 displays a schedule table screen as shown in FIG. 25B on the display 508 (step S15). On the schedule table screen, a time table is displayed for each day, and a reservation button 7290 is displayed. And the reception part 72 receives imaging | photography reservation from the supervisor Y (step S16). Specifically, when the supervisor Y presses the item 7210 of a desired day and then presses the reservation button 7290, the display control unit 73 displays “reservation for shooting” as shown in FIG. Display the screen. Then, the supervisor Y inputs the shooting title (here, “window frame attachment”), the shooting start time (here, 10:00), and the shooting end time (here, 18:00). When the “OK” button 7380 is pressed, the transmission / reception unit 71 transmits a photographing reservation to the image management system 5 (step 17). This shooting reservation includes a base ID, a shooting title, a shooting start date and time, and a shooting end date and time. Thereby, the transmission / reception unit 51 of the image management system 5 receives the imaging reservation.

  Next, the storage / readout unit 59 of the image management system 5 stores the contents of the shooting reservation as a new record in the shooting management table (see FIG. 18) (step S18). Thus, the shooting reservation process is completed.

  Next, a process in which the image management system 5 issues a shooting instruction to the communication terminal 3 based on the shooting management table (see FIG. 18) will be described with reference to FIG. FIG. 22 is a sequence diagram showing a process of giving a shooting instruction.

  As shown in FIG. 22, the transmission / reception unit 51 of the image management system 5 transmits a photographing instruction to all the communication terminals 3 in the site indicated by the site ID (step S31). This shooting instruction includes a shooting start date and time and a shooting end date and time. Thereby, the communication terminal 3 receives the photographing instruction.

  Next, the communication terminal 3 transmits a photographing start instruction to the photographing apparatus 1 when the photographing start time is reached (step S32). Thereby, the transmission / reception part 11 of the imaging device 1 receives an imaging start instruction.

  Next, the imaging device 1 performs imaging every 10 minutes, for example, and transmits its own device ID, captured image data, related information, and predetermined area information to the communication terminal 3 (step S33). The related information indicates the actual shooting date and time. The predetermined area information indicates a viewpoint direction that is predetermined when the photographing apparatus 1 is shipped from the factory. Thereby, the transmission / reception unit 31 of the communication terminal 3 receives the device ID, the captured image data, the related information, and the predetermined area information.

  Next, the transmission / reception unit 31 of the communication terminal 3 transmits an image registration request to the image management system 5 (step S34). This image registration request includes the device ID, captured image data, related information, and predetermined area information received in step S3. By this. The transmission / reception unit 51 of the image management system 5 receives an image registration request. In the image management system 5, the storage / reading unit 59 newly assigns an image ID to the captured image data received in step S34 (step S35).

  Next, the storage / reading unit 59 records and manages each information for each table (step S36). Specifically, the storage / reading unit 59 manages the terminal management table (see FIG. 17) by overwriting predetermined area information corresponding to the device ID. In addition, the storage / reading unit 59 stores the device ID, the image ID, the file name of the image data, and the shooting date and time as new records in the image management table (see FIG. 19). Among these, the device ID is the ID received in step S34. The image ID is the ID assigned in step S35. The file name of the image data is the file name of the captured image data received at step 34. The shooting date / time is the shooting date / time included in the related information received in step S34.

  Next, the transmission / reception unit 51 transmits a registration completion notification to the communication terminal 3 (step S37). This notification includes an image ID. Thereby, the transmission / reception part 31 of the communication terminal 3 receives the notification of registration completion. Then, the storage / reading unit 39 of the communication terminal 3 stores the image ID in the storage unit 3000 (step S38).

  Next, layout map display processing will be described with reference to FIG. FIG. 23 is a sequence diagram illustrating processing for displaying a layout map.

  As shown in FIG. 23, when the supervisor Y inputs the base ID to the communication terminal 7, the receiving unit 72 receives the input of the base ID (step S51). In this case, as shown in FIG. 25A, an input field 7110 for inputting the base ID is displayed on the display 508 of the communication terminal 7, and the supervisor Y enters the input field 7110. Enter the base ID of the base that is the construction site you want to view. Thereby, the transmission / reception part 71 transmits the request | requirement of a schedule to the image management system 5 (step S52). This request includes the base ID input in step S51. Accordingly, the transmission / reception unit 51 of the image management system 5 receives the schedule request.

  Next, the storage / reading unit 59 of the image management system 5 searches the shooting management table (see FIG. 18) using the base ID received by the transmission / reception unit 51 as a search key, thereby corresponding shooting title, shooting start date and time. In addition, the photographing end date and time are read out, and the corresponding base name is read out by searching the base management table (see FIG. 16) using the base ID as a search key (step S53). And the production | generation part 54 produces a schedule table screen as shown in FIG.26 (b) based on the various information read by step S13, and the transmission / reception part 51 transmits the schedule table screen to the communication terminal 7. FIG. Is transmitted (step S54). At this time, the base ID is also transmitted together with the schedule table screen data. Thereby, the transmission / reception unit 71 of the communication terminal 7 receives the data of the schedule table screen.

  Next, in the communication terminal 7, the display control unit 73 displays a schedule table screen as shown in FIG. 26B on the display 508 (step S55). Here, unlike FIG. 25 (b), a schedule table screen in the case where a shooting reservation has already been made is shown. In FIG. 26B, for example, schedule information 7410 indicating the contents of the shooting schedule performed in the processes of steps S16 to S18 is displayed.

  Next, when the supervisor Y presses the schedule information 7410, for example, the reception unit 72 receives the acquisition of the layout map related to the schedule information 7410 (step S56). Then, the transmitting / receiving unit 71 requests a layout map from the image management system 5 (step S57). This request includes the base ID, the shooting start date and time, and the shooting end date and time. Thereby, the transmission / reception unit 51 of the image management system 5 receives the request for the layout map.

  Next, the storage / read-out unit 59 of the image management system 5 searches the base management table (see FIG. 16) using the base ID received in step S57 as a search key, thereby the file name of the corresponding layout map, And the device ID is read (step 58). The storage / reading unit 59 reads the corresponding device installation position information and the predetermined area information by searching the terminal management table (see FIG. 17) using the read device ID as a search key (step S58).

  Next, the generation unit 54 generates a layout map using each piece of information read out in step S58 (step 59). Then, the transmission / reception unit 51 transmits the layout map data to the communication terminal 7 (step S60). Thereby, the transmission / reception unit 71 of the communication terminal 7 receives the data of the layout map. In the communication terminal 7, the display control unit 73 causes the display 508 to display a site status screen as shown in FIG. 27A (step S61). At the top of the site status screen, a layout map including a pin icon indicating the position taken at the site is displayed.

  Next, display processing of captured image data will be described with reference to FIG. FIG. 24 is a sequence diagram showing display processing of captured image data.

  First, as shown in FIG. 24, when the supervisor Y selects an icon of a desired pin using the cursor 4 as shown in FIG. 27B, the reception unit 72 selects the selected photographing. The device is accepted (step S71). As a result, the transmission / reception unit 71 transmits a request for captured image data captured by the selected imaging device to the image management system 5 (step S72). This request includes the device ID of the imaging device related to the selected icon. As a result, the transmission / reception unit 51 of the image management system 5 receives a request for captured image data. The cursor 4 is moved by operating the mouse 512.

  Next, the storage / reading unit 59 of the image management system 5 searches the image management table (see FIG. 19) by using the device ID received in step S72 as a search key, and thereby the file name of the corresponding first image data. And the captured image data of this file name is read from the storage unit 5000 (step S73).

  Next, the transmission / reception unit 51 of the image management system 5 transmits the base name, the first captured image data of the date and time of shooting, and the shooting date and time to the communication terminal 7 (step S79). In this case, the image ID of the captured image data is transmitted together with the captured image data. Thereby, the transmission / reception unit 71 of the communication terminal 7 receives the site name, the first captured image data of the date and time when the image was captured, and the captured date and time.

  Next, as shown in FIG. 28, the display control unit 73 of the communication terminal 7 displays a predetermined area image below the layout map on the base area screen (step S75). A “pointer OFF” button is displayed at the lower right of the base area screen, and is pressed when the supervisor wants to remotely irradiate the construction site with laser light.

  Next, the supervisor Y moves the cursor 4 up, down, left, and right, so that the accepting unit 72 accepts a change in the predetermined area image (step S76). Thereby, as shown in FIG. 29, the display control unit 73 displays another predetermined region image (hereinafter referred to as “specific region image”) in the same omnidirectional panoramic image (step S77).

  When the supervisor Y moves the cursor 4 and presses the “pointer OFF” button, the accepting unit 72 accepts preparation for laser light irradiation (step S78). As a result, the display control unit 73 changes the “pointer OFF” button to the “pointer ON” button as shown in FIG. 30.

  Next, the supervisor moves the cursor 4 to move to a desired position (in this case, a part of the window frame) in the specific area image as shown in FIG. When clicked, the accepting unit 72 accepts the designated position irradiated with the laser light (step S79). Thereby, the display control unit 73 visually displays the irradiation image 6 shown in FIG. 31 on the specific area image (step S80). Furthermore, the transmission / reception unit 71 transmits designated position coordinate information indicating the coordinates (rH, rV, α) of the designated position in the same coordinate system as the omnidirectional panoramic image to the image management system 5 (step S81). Thereby, the transmission / reception unit 51 of the image management system 5 receives the designated position coordinate information.

  Next, the transmission / reception unit 5 of the image management system 5 transfers the designated position coordinate information to the communication terminal 3 (step S82). Thereby, the transmission / reception unit 31 of the communication terminal 3 receives the designated position coordinate information.

  Next, in the communication terminal 3, the calculation unit 34 converts the coordinate system of the omnidirectional panoramic image in the photographing device 1 into the coordinate system of the space of the base in the communication terminal 3, thereby receiving the designation received in step S82. Based on the position coordinate information, the irradiation position of the laser beam in the base space is calculated (step S83). Note that the image pickup device 103a of the photographing apparatus 1 shown in FIG. 10A is attached so as to be always in a specific direction of the communication terminal 3 that is a color cone, and therefore, coordinate conversion is possible.

  Next, the changing unit 35 changes at least one of the position of the irradiation position 380 and the inclination of the pointer 381 toward the irradiation position calculated in step S83 (step S84). When the position of the irradiation position 380 and the inclination of the pointer 381 are already directed to the irradiation position calculated in step S83, the changing unit 35 does not change the position of the irradiation position 380 and the inclination of the pointer 381. . And the irradiation part 36 starts irradiation of a laser beam (step S85). As a result, at a base such as a construction site, the irradiation position control unit 350 irradiates the irradiation position 8 with laser light as shown in FIG. 32 (step S85). As described above, since the supervisor Y can visually instruct the remote worker of the work position and the like, the supervisor Y can convey the work contents more accurately while calling the worker X. it can.

  Here, the control of the movement of the irradiation position of the irradiation image will be described in detail with reference to FIGS. FIG. 33 is a flowchart showing control of movement of the irradiation position of the irradiation image. FIG. 34 is a diagram illustrating a screen example of the relationship between the cursor and the irradiation position of the irradiation image. FIG. 35 is a conceptual diagram showing the relationship between the cursor and the irradiation position of the irradiation image.

  First, the connection unit 38 of the communication terminal 3 acquires captured image data including the irradiation image 6 as illustrated in FIG. 32 from the imaging device 1 (step S91). Next, the calculation unit 34 specifies the position (x ′, y ′, α ′) of the irradiation image 6 in the omnidirectional image (step S92). Then, the calculation unit 34 calculates the distance between the specified position (x, y, α) specified by the cursor 4 and the position (x ′, y ′, α ′) of the specified irradiation image (step) S93). For example, in FIG. 34A, there is a case where the distance between the position designated by the cursor 4 and the position of the irradiation image 6 is separated.

Here, the relationship between the cursor and the irradiation position of the irradiation image will be described with reference to FIG. The solid sphere CS in FIG. 35 is the same as the solid sphere CS in FIGS. 5 and 6, and originally exists in the virtual space, but represents the relationship between the cursor 4 and the irradiation image 6 displayed on the communication terminal 7. For convenience, it is shown in FIG. As shown in FIG. 35, since the position of the image sensor 103a (103b) of the communication terminal 3 and the position of the irradiation device 380 are different, the straight line L1 connecting the irradiation device 380 and the irradiation image 6 is the image sensor 103a. And the straight line L2 connecting the cursor 4 is not parallel. Further, when there are walls A and B having different distances from the communication terminal 3, the real-world distance between the position of the cursor 4 and the irradiation position 8 of the irradiation image 6 is also different. For example, in FIG. 35, when there is a wall A close to the image sensor 103a and a wall B far from the image sensor 103a, the distance between the position designated by the cursor 4 and the position of the irradiated image 6 is distance a and distance b, respectively. They are different. Therefore, feedback control by the processing after the following step S94 is required.

  Therefore, the determination unit 33 determines whether the distance calculated by the calculation unit 34 is within a threshold (step S94). If the distance is within the threshold (YES), the control of the movement of the irradiation position of the irradiation image 6 ends. On the other hand, when the distance exceeds the threshold value (NO), the calculation unit 34 determines the designated position (x, y, α) designated by the cursor 4 and the position (x ′, y ′, α) of the specified irradiation image. An adjustment value is calculated from the distance to “)” (step S96). Then, the changing unit 35 changes the irradiation position 8 of the irradiation image 6 so that the position (x ′, y ′, α ′) of the irradiation image approaches the designated position (x, y, α). As a result, as shown in FIG. 34B, the distance between the position designated by the cursor 4 and the position of the irradiation image 6 is narrowed and overlapped.

<< Main effects of this embodiment >>
As described above, according to the present embodiment, the imaging device 1 can be attached, the data of the omnidirectional panoramic image is acquired from the attached imaging device 1, and the predetermined communication terminal 7 is obtained via the communication network 9. A security device such as a color cone that constitutes a part of the communication terminal 3 that can be sent to is adopted. In this way, because it is a safety device, it has a high affinity with the construction site from the safety aspect, and workers on the site can proceed with work such as construction while being aware of the safety device (avoidance) The possibility that the communication terminal 3 is accidentally overturned can be reduced. In particular, when the security device is a color cone, there is an effect that the installation location can be easily changed due to daily situation changes.

  Further, at a site such as a construction site, as shown in FIG. 32, the irradiation position control unit 350 irradiates the irradiation position 8 with laser light, so that the supervisor Y visually recognizes the remote worker. Therefore, the supervisor can tell the work contents more accurately while calling the worker.

[Supplement of Embodiment]
The image management system 5 in the above embodiment may be constructed by a single computer, or may be constructed by a plurality of computers arbitrarily allocated by dividing each unit (function, means, or storage unit). Good.

  In addition, a recording medium such as a CD-ROM in which the programs of the above-described embodiments are stored, and the HD 504 in which these programs are stored may be provided domestically or abroad as a program product. it can.

1 Shooting device 3 Communication terminal (an example of security equipment)
5 Image management system 7 Communication terminal 9 Communication network 31 Transmission / reception unit (an example of transmission means, an example of reception means)
33 determination unit 34 calculation unit (an example of calculation means)
35 Changing part (an example of changing means)
36 Irradiation part (an example of irradiation means)
38 connection part (an example of an acquisition means)
310 Communication control unit 350 Irradiation position control unit 400 Mounting portion (an example of mounting means)
508 Display (an example of display means)
5000 storage unit 5001 base management DB (an example of base management means)
5002 Terminal management DB (an example of terminal management means)
5003 Shooting management DB (an example of shooting management means)
5004 Image management DB (an example of image management means)

JP 2014-131215 A

Claims (7)

Mounting means to which a photographing device for capturing a subject and obtaining panoramic image data can be mounted;
Obtaining means for obtaining the data from the attached imaging device;
Transmitting means for transmitting the acquired data via a communication network to an image management system for transferring the data of the omnidirectional panoramic image to a predetermined communication terminal;
A security device characterized by comprising: The security device according to claim 1,
Irradiating means for irradiating the subject with laser light;
Receiving means for receiving position coordinate information sent from a predetermined communication terminal via the image management system and indicating a specified position in the coordinate system of the omnidirectional panoramic image;
Changing means for changing at least one of the position and inclination of the irradiation means based on the received position coordinate information;
A security device characterized by comprising: The security device according to claim 2,
By converting the coordinate system of the omnidirectional panoramic image in the imaging device to the coordinate system of the space of the base where the security device is installed, the laser in the space of the base from the specified position in the omnidirectional panoramic image Having calculation means for calculating the irradiation position of light,
The security device according to claim 1, wherein the changing unit changes at least one of the position and the inclination of the irradiation unit so that the laser beam is irradiated to the calculated irradiation position.   The security device according to any one of claims 1 to 3, wherein the security device is a color cone. The security device according to any one of claims 1 to 4,
The communication terminal;
An image communication system comprising: Received from the predetermined communication terminal via the image management system for transferring the omnidirectional panoramic image data to the predetermined communication terminal, and receives the position coordinate information indicating the designated position in the coordinate system of the omnidirectional panoramic image Receiving step to
A change step of changing at least one of the position and the tilt of the irradiation means for irradiating the subject with laser light based on the received position coordinate information;
An irradiation step of irradiating the laser beam after the change;
The irradiation method characterized by performing.   A program causing a computer to execute the method according to claim 6.

Images