WO2018079767A1 - Dispositif de génération d'image de bâtiment, et système d'affichage d'image de bâtiment - Google Patents

Dispositif de génération d'image de bâtiment, et système d'affichage d'image de bâtiment Download PDF

Info

Publication number
WO2018079767A1
WO2018079767A1 PCT/JP2017/039075 JP2017039075W WO2018079767A1 WO 2018079767 A1 WO2018079767 A1 WO 2018079767A1 JP 2017039075 W JP2017039075 W JP 2017039075W WO 2018079767 A1 WO2018079767 A1 WO 2018079767A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
unit
building
composite
moving body
Prior art date
Application number
PCT/JP2017/039075
Other languages
English (en)
Japanese (ja)
Inventor
大野　達司
崇 佐久間
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Priority to JP2018547818A priority Critical patent/JP6695063B2/ja
Publication of WO2018079767A1 publication Critical patent/WO2018079767A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • This disclosure relates to a building image generation device and a building image display system.
  • Patent Document 1 describes a security system that displays an image captured by a desired security camera among a plurality of installed security cameras on a display unit.
  • images captured by a plurality of security cameras are displayed separately. For example, when trying to grasp the overall situation of a building, a plurality of images must be viewed. It is difficult to grasp the situation. In particular, when there is a moving body such as an intruder, it is difficult to grasp the position of the moving body around the building in the security system.
  • the present disclosure has been made in view of the above circumstances, and provides a building image generation device and a building image display system that can easily grasp the situation around the building, in particular, the position of the moving body around the building. With the goal.
  • a building image generation apparatus includes an image acquisition unit, a composite image generation unit, a composite image storage unit, a mobile body extraction unit, and a mobile body display image generation unit.
  • the image acquisition unit acquires a plurality of images captured by a plurality of imaging units that capture the periphery of a building as a plurality of captured images.
  • the composite image generation unit combines the plurality of captured images acquired by the image acquisition unit to generate a composite image viewed from a virtual viewpoint.
  • the composite image storage unit stores the composite image generated by the composite image generation unit.
  • the moving body extraction unit compares a plurality of composite images each of which is captured from a plurality of captured images captured at different times in the composite image storage unit, and positions thereof are changed in the plurality of composite images. Extract moving objects.
  • the mobile object display image generation unit generates a mobile object display image by combining the image element of the mobile object extracted by the mobile object extraction unit with one of the plurality of composite images.
  • the building image display system includes a plurality of imaging units that capture the periphery of a building and a building image generation device.
  • the building image generation apparatus includes an image acquisition unit, a composite image generation unit, a composite image storage unit, a mobile body extraction unit, a mobile body display image generation unit, and an image display unit.
  • the image acquisition unit acquires a plurality of images captured by the plurality of imaging units as a plurality of captured images.
  • the composite image generation unit combines the plurality of captured images acquired by the image acquisition unit to generate a composite image viewed from a virtual viewpoint.
  • the composite image storage unit stores the composite image generated by the composite image generation unit.
  • the moving body extraction unit compares a plurality of composite images each of which is captured from a plurality of captured images captured at different times in the composite image storage unit, and positions thereof are changed in the plurality of composite images. Extract moving objects.
  • the mobile object display image generation unit generates a mobile object display image by combining the image element of the mobile object extracted by the mobile object extraction unit with one of the plurality of composite images.
  • the image display unit displays the moving body display image.
  • a building image display system displays a plurality of imaging units that capture the periphery of a building, a building image generation device, and a moving body display image generated by the building image generation device.
  • the building image generation apparatus includes an image acquisition unit, a composite image generation unit, a composite image storage unit, a mobile body extraction unit, a mobile body display image generation unit, and an image transmission unit.
  • the image acquisition unit acquires a plurality of images captured by the plurality of imaging units as a plurality of captured images.
  • the composite image generation unit combines the plurality of captured images acquired by the image acquisition unit to generate a composite image viewed from a virtual viewpoint.
  • the composite image storage unit stores the composite image generated by the composite image generation unit.
  • the moving body extraction unit compares a plurality of composite images each of which is captured from a plurality of captured images captured at different times in the composite image storage unit, and positions thereof are changed in the plurality of composite images. Extract moving objects.
  • the mobile object display image generation unit generates a mobile object display image by combining the image element of the mobile object extracted by the mobile object extraction unit with one of the plurality of composite images.
  • the image transmission unit transmits the moving body display image to the image display terminal.
  • FIG. 1 is a block diagram of a building image display system according to the first embodiment.
  • FIG. 2A is a perspective view of a building in the same building image display system.
  • FIG. 2B is a plan view of a building in the same building image display system.
  • FIG. 3 is a view showing a composite image in the building image display system same as above.
  • FIG. 4A is a diagram showing an image captured by an imaging unit provided in front of a building in the building image display system same as above.
  • FIG. 4B is a diagram showing an image captured by the imaging unit provided on the right side of the building in the building image display system same as above.
  • FIG. 4C is a diagram showing an image captured by the imaging unit provided on the rear surface of the building in the building image display system same as above.
  • FIG. 4A is a diagram showing an image captured by an imaging unit provided in front of a building in the building image display system same as above.
  • FIG. 4B is a diagram showing an image captured by the imaging unit provided on the
  • FIG. 4D is a diagram showing an image captured by the imaging unit provided on the left side of the building in the building image display system same as above.
  • FIG. 5 is a diagram showing a moving body display image in the building image display system same as above.
  • FIG. 6 is a block diagram of a building image display system according to the second embodiment.
  • FIG. 7 is a diagram showing a moving object trajectory image in the building image display system same as above.
  • FIG. 8 is a view showing an enlarged image in the building image display system same as above.
  • FIG. 9 is a block diagram of a building image display system according to the third embodiment.
  • the present disclosure relates to a building image generation apparatus and a building image display system, and more specifically, a building image that generates a moving body display image in which a moving body is further displayed by combining images of a plurality of imaging units that capture the periphery of the building.
  • the present invention relates to a generation device and a system using the same.
  • the building image display system 1 according to the first embodiment and the building image generation device 3 used therefor will be described with reference to FIGS.
  • the building image display system 1 includes a plurality of imaging units 2 (21 to 24) and a building image generation device 3.
  • the imaging unit 2 captures an image of the surroundings of the building 10.
  • the imaging unit 2 includes an imaging device, an optical component such as a wide-angle lens, a signal processing circuit, and the like.
  • the imaging element has sensitivity to infrared light and visible light, such as a CCD (Charge-Coupled Device) image sensor, and photographs a predetermined range at a predetermined frame rate.
  • the optical component includes a wide-angle lens that collects light on the image sensor and a diaphragm.
  • the signal processing circuit scans all pixels (light receiving elements) of the image sensor, reads the pixel value (charge) of each pixel as an analog electric signal, and converts the electric signal into a digital signal (image data).
  • Known techniques can be used as appropriate for such image pickup elements, optical components, and signal processing circuits, and detailed descriptions thereof are omitted.
  • the building 10 has a rectangular box shape, and the side surfaces of the building 10 are defined as a front surface 11, a right surface 12, a rear surface 13, and a left surface 14.
  • a total of four imaging units 2 are provided on the front surface 11, the right surface 12, the rear surface 13, and the left surface 14, one by one.
  • the entire periphery is set as an imaging range so that no blind spots are formed around the building 10.
  • the building image generation apparatus 3 includes an image acquisition unit 31, a composite image generation unit 32, a composite image storage unit 33, a mobile body extraction unit 34, a mobile body display image generation unit 35, An image display unit 36 and a control unit 30 are provided.
  • the image acquisition unit 31, the composite image generation unit 32, the composite image storage unit 33, the moving body extraction unit 34, the mobile body display image generation unit 35, the image display unit 36, and the control unit 30 are in one case. It is stored in.
  • the image acquisition unit 31 acquires images captured by the plurality of imaging units 21 to 24 as a plurality of captured image images 51 to 54 (see FIGS. 4A to 4D).
  • the image acquisition unit 31 is configured by an I / O interface (Input-Output Interface), and can perform bidirectional communication that allows not only reception (acquisition of captured images) but also transmission.
  • the image acquisition unit 31 is connected to the plurality of imaging units 2 so as to be able to communicate with each other wirelessly or by wire.
  • the image acquisition unit 31 can acquire an image captured by the imaging unit 2 as a captured image and take it into the building image generation device 3.
  • I / O interface a known technique can be used as appropriate, and a detailed description thereof will be omitted.
  • the composite image generation unit 32 combines the plurality of captured images 51 to 54 acquired by the image acquisition unit 31 to generate a composite image 5 (see FIG. 3) viewed from the virtual viewpoint 15 (see FIG. 2A). It is.
  • Such a technique is a known technique as disclosed in, for example, Japanese Patent No. 3300334, and various similar known techniques can be used as appropriate. This technique will be briefly described.
  • the virtual viewpoint 15 can be determined at an arbitrary position and in an arbitrary direction. In the first embodiment, it is determined as a viewpoint directed downward from a position of about several m above the center of the building 10.
  • the relationship between the composite image 5 to be generated and the image captured by each imaging unit 2 is determined, and a mapping table is created.
  • the mapping table determines the correspondence between the plurality of pixels of the composite image 5 and all the pixels of the captured images 51 to 54 captured by the plurality of imaging units 2.
  • the mapping table stores a mapping between a plurality of pixels of the composite image 5 and all pixels of the respective captured images 51 to 54 captured by the plurality of imaging units 2.
  • the pixel 511 of the captured image 51 photographed by the imaging unit 21 provided on the front surface 11 shown in FIG. 4A and the pixel of the modified image 510 corresponding to the captured image 51 of the composite image 5 shown in FIG. 512 is associated with the mapping table.
  • transformation image 520 corresponding to the captured image 52 of the synthesized images 5 shown in FIG. 522 is associated with the mapping table.
  • transformation image 530 corresponding to the captured image 53 of the synthesized images 5 shown in FIG. 532 is associated with the mapping table.
  • transformation image 540 corresponding to the captured image 54 of the synthesized images 5 shown in FIG. 542 is associated with the mapping table.
  • the synthesized image 5 is generated by synthesizing each pixel of each imaging unit 2 as a predetermined corresponding pixel of the synthesized image 5 and displaying the illustration of the building 10.
  • the synthesized image 5 is generated by synthesizing the captured images 51 to 54 of the respective imaging units 2 at a temporary point, and information (metadata) such as date and time at this time is linked.
  • the composite image 5 is generated at predetermined time intervals.
  • the composite image storage unit 33 stores the composite image 5 generated by the composite image generation unit 32.
  • the composite image storage unit 33 is configured by a nonvolatile memory such as an EEPROM (ElectricallyrErasablerasand Programmable Read Only Memory) or a flash memory.
  • the moving body extraction unit 34 compares a plurality (usually two) of composite images 5 each of a plurality of captured images 51 to 54 captured at different times (times), As shown in FIG. 3, the moving body 6 whose position is changed in the plurality of composite images 5 is extracted.
  • the moving body extraction unit 34 is configured using, for example, a processor for image processing.
  • the moving body extraction unit 34 extracts the moving body 6 such as a person by analyzing the composite image 5.
  • known techniques such as those operating by the background difference method or the inter-frame difference method can be used as appropriate, and detailed description thereof will be omitted.
  • the moving object display image generating unit 35 displays an image element (referred to as a moving object display 70) of the moving object 6 surrounding the moving object 6 so that the moving object 6 extracted by the moving object extracting unit 34 stands out. 5 (see FIG. 3) to generate the moving body display image 7 shown in FIG.
  • the moving object display 70 shows the outline of the moving object 6 portion of the composite image 5 with a line of a specific color, or draws a specific figure such as a circle around the center of the moving object 6 so that the moving object 6 It is displayed so that it can be easily recognized, and its specific mode is not limited.
  • the image display unit 36 displays the moving body display image 7.
  • the image display unit 36 is composed of, for example, a liquid crystal display on which the moving body display image 7 is displayed, but various known image display units 36 can be used as appropriate, and detailed description thereof is omitted.
  • the image display part 36 is visible from the outside through the transparent part of the case accommodated or through the opening of the case accommodated.
  • the control unit 30 controls operations of the image acquisition unit 31, the composite image generation unit 32, the composite image storage unit 33, the mobile body extraction unit 34, the mobile body display image generation unit 35, and the image display unit 36.
  • the control unit 30 is composed of, for example, a microcomputer, and controls the operation of each element by executing a program stored in a ROM (Read Only Memory). This is possible and will not be described in detail.
  • each of the imaging units 21 to 24 captures an imaging space at a predetermined frame rate, and captures an image for one frame each time an image for one frame is captured.
  • 51 to 54 are output to the image acquisition unit 31.
  • the control unit 30 may control the imaging unit 2 to image the imaging space at a predetermined frame rate.
  • the captured images 51 to 54 for one frame of each of the imaging units 21 to 24 captured from the image acquisition unit 31 are combined by the composite image generation unit 32 to generate a composite image 5 for one frame.
  • the composite image 5 generated by the composite image generation unit 32 is stored in the composite image storage unit 33 together with date / time information for each frame.
  • the synthesized image 5 for one frame generated by the synthesized image generating unit 32 is compared with the synthesized image 5 for the immediately preceding frame stored in the synthesized image storage unit 33 by the moving body extracting unit 34.
  • the moving body 6 is extracted.
  • the moving object 6 extracted by the moving object extracting unit 34 is generated by the moving object display image generating unit 35, and the moving object display 70 is combined with the synthesized image 5 for one frame.
  • the moving body display image 7 for one frame is generated.
  • the moving body display image 7 for one frame generated by the moving body display image generation unit 35 is displayed on the image display unit 36.
  • the building image display system 1 synthesizes the captured images 51 to 54 around the plurality of buildings 10 captured by the plurality of imaging units 2 (21 to 24) into one composite image 5 (actually Since the moving body display image 7) is generated, the situation around the building 10 can be easily grasped.
  • the building image display system 1 extracts the moving body 6 from the synthesized image 5 and combines the moving body display 70 to generate the moving body display image 7, the building image display system 1 around the building 10 of the moving body 6 is used. Easy to grasp the position.
  • the building image display system 1 can generate the moving body display image 7 viewed from the virtual viewpoint 15 above the building 10 without providing the imaging unit 2 in the sky.
  • the composite image 5 having a data capacity smaller than the sum of the data capacities of the plurality of captured images 51 to 54 around the building 10 captured by the plurality of imaging units 2 (21 to 24) is stored.
  • the data capacity stored in the unit 33 can be small.
  • the building image display system 1 according to the second embodiment includes the following components in addition to the components included in the building image display system 1 according to the first embodiment.
  • description is abbreviate
  • the building image generation device 3 includes a moving body storage unit 37, a moving body trajectory image generation unit 38, and a size determination unit 39. Further prepare.
  • the moving body storage unit 37 stores the moving body 6 extracted by the moving body extraction unit 34.
  • the mobile storage unit 37 is configured by a nonvolatile memory such as an EEPROM or a flash memory.
  • the moving object locus image generation unit 38 moves the locus of the moving object 6 (referred to as a moving object locus 80) from the data of the plurality of moving objects 6 stored in the moving object storage unit 37.
  • the moving object locus image 8 is generated by being combined with the body display image 7.
  • the size determination unit 39 determines whether or not the size of the moving body 6 extracted by the moving body extraction unit 34 is within a predetermined range.
  • control unit 30 includes an image acquisition unit 31, a composite image generation unit 32, a composite image storage unit 33, a mobile body extraction unit 34, a mobile body display image generation unit 35, an image display unit 36, and a movement Operations of the body storage unit 37, the moving body trajectory image generation unit 38, and the size determination unit 39 are controlled.
  • each of the imaging units 21 to 24 captures an imaging space at a predetermined frame rate, and captures an image for one frame each time an image for one frame is captured.
  • 51 to 54 are output to the image acquisition unit 31.
  • the control unit 30 may control the imaging unit 2 to image the imaging space at a predetermined frame rate.
  • the captured images 51 to 54 for one frame of each of the imaging units 21 to 24 captured from the image acquisition unit 31 are combined by the composite image generation unit 32 to generate a composite image 5 for one frame.
  • the composite image 5 generated by the composite image generation unit 32 is stored in the composite image storage unit 33 together with date / time information for each frame.
  • the synthesized image 5 for one frame generated by the synthesized image generating unit 32 is compared with the synthesized image 5 for the immediately preceding frame stored in the synthesized image storage unit 33 by the moving body extracting unit 34.
  • the moving body 6 is extracted.
  • the extracted mobile object 6 is stored in the mobile object storage unit 37 together with date / time information for each frame.
  • the size determination unit 39 determines whether or not the size of the mobile body 6 extracted by the mobile body extraction unit 34 is within a predetermined range.
  • the moving body display image generation unit 35 generates a moving body display 70, and this moving body display 70 is 1 By combining with the composite image 5 for the frame, the moving body display image 7 for one frame is generated.
  • the size determining unit 39 determines that the size of the moving body 6 is not within the predetermined range, it is considered to be a small animal such as a cat or noise and has a low security effect.
  • the generation unit 35 does not generate the moving object display image 7.
  • the composite image 5 that is not combined with the mobile object display 70 is handled as the mobile object display image 7 as it is.
  • the moving body display image 7 for one frame generated by the moving body display image generation unit 35 can be displayed on the image display unit 36.
  • the moving body display for one frame generated by the moving body display image generation unit 35 is performed by the moving body trajectory image generation unit 38.
  • the moving object locus 80 is combined with the image 7 to generate a moving object locus image 8 for one frame.
  • the moving object locus 80 is constituted by a moving object display 70 generated from the moving object 6 for one or more past frames stored in the moving object storage unit 37.
  • the moving body locus image 8 for one frame generated by the moving body locus image generation unit 38 can be displayed on the image display unit 36.
  • a portion desired to be seen in the moving object locus image 8, particularly a portion where the moving object display 70 is displayed can be enlarged and displayed on the image display unit 36.
  • this enlarged display is performed by a method (so-called digital zoom) in which one pixel of the moving object trajectory image 8 is displayed similarly in a plurality of pixels.
  • the building image display system 1 of the second embodiment has the following effects in addition to the effects obtained in the building image display system 1 of the first embodiment.
  • the building image display system 1 Since the building image display system 1 according to the second embodiment generates the moving object locus image 8, it is easy to grasp the moving object locus 80 around the building 10 of the moving object 6, and the destination of the moving object 6 can be determined. Easy to predict.
  • the building image display system 1 does not need to display the moving body display 70 when the moving body 6 is not a specific object such as an intruder, and it is difficult to call useless attention.
  • the building image display system 1 according to the third embodiment includes the following components in addition to the components included in the building image display system 1 according to the second embodiment.
  • symbol is attached
  • the building image generation device 3 includes an image display terminal 91 and an image transmission unit 40.
  • the image display terminal 91 displays the mobile object display image 7 generated by the building image generation device 3.
  • an image display terminal 91 what is called a smart phone, a tablet, a personal computer, etc. can be used suitably, and is not specifically limited.
  • the image transmission unit 40 transmits the mobile object display image 7 to the image display terminal 91.
  • the image transmission unit 40 is configured by an I / O interface, and can perform bidirectional communication that allows not only transmission but also reception by wireless or wired communication.
  • I / O interface known techniques can be used as appropriate, and detailed description thereof is omitted.
  • the image display terminal 91 is connected to the image transmission unit 40 via a transmission path 9 that transmits wirelessly or by wire.
  • a transmission signal obtained by modulating a packet divided into a number corresponding to the data size by a predetermined digital modulation method is transmitted via the transmission path 9.
  • a transmission line 9 for example, a so-called Internet can be used, but it is not particularly limited.
  • control unit 30 includes an image acquisition unit 31, a composite image generation unit 32, a composite image storage unit 33, a mobile body extraction unit 34, a mobile body display image generation unit 35, a mobile body storage unit 37, The operations of the moving object trajectory image generation unit 38, the size determination unit 39, and the image transmission unit 40 are controlled.
  • the building image display system 1 of the third embodiment does not include the image display unit 36 included in the building image display system 1 of the second embodiment.
  • the moving body locus image 8 for one frame generated by the moving body locus image generation unit 38 is output from the image transmission unit 40 to the transmission path 9.
  • the moving body locus image 8 for one frame output to the transmission path 9 is received by the image display terminal 91 and displayed on the display unit of the image display terminal 91.
  • the building image display system 1 of the third embodiment has the following effects in addition to the effects obtained in the building image display system 1 of the second embodiment.
  • the moving body trajectory image 8 is displayed on the display unit of the image display terminal 91 via the transmission path 9, the moving body at a place away from the building image generation device 3 is displayed.
  • the trajectory image 8 can be displayed.
  • the image display terminal 91 is a so-called smartphone and the transmission path 9 is a wireless internet on the way, the moving body trajectory image 8 (or the moving body display image 7 or the composite image 5) can be easily obtained from the outside. Can see.
  • the building 10 may not be a rectangular box shape, and the shape and size are not limited.
  • the imaging unit 2 may not be provided on the front surface 11, the right surface 12, the rear surface 13, and the left surface 14 of the building 10 one by one. That is, a plurality of imaging units 2 may be provided on one side surface of the building 10, or a side surface that is not provided may exist, or the total number may not be four.
  • the imaging unit 2 does not have to have a shooting range around the entire building 10, and a blind spot may be formed in a part of the periphery of the building 10.
  • the imaging unit 2 may have a fisheye lens instead of a wide-angle lens.
  • the imaging unit 2 may not have a wide-angle lens or a fish-eye lens, and may be provided with a wide-angle lens or a normal lens that is not a fish-eye lens, so that the entire periphery of the building 10 is set as a shooting range. Can do.
  • the imaging device included in the imaging unit 2 is not limited to a CCD image sensor, but may be an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor.
  • CMOS Complementary Metal Oxide Semiconductor
  • the building image generation device 3 may be configured by a general-purpose computer (so-called personal computer) widely used in homes and offices.
  • the images of the imaging units 2 combined with the composite image 5 are preferably taken at the same time, but may not necessarily be taken at the same time. Further, the predetermined time interval at which the composite image 5 is generated is not particularly limited, and may not be constant.
  • the composite image storage unit 33 and the moving body storage unit 37 may be other storage means such as a hard disk instead of a nonvolatile memory such as an EEPROM or a flash memory.
  • the building image generation device 3 of the first aspect includes an image acquisition unit 31, a composite image generation unit 32, and a composite image storage unit. 33, a moving body extraction unit 34, and a moving body display image generation unit 35.
  • the image acquisition unit 31 acquires a plurality of images captured by the plurality of imaging units 2 (21 to 24) that capture the periphery of the building 10 as a plurality of captured images 51 to 54.
  • the composite image generation unit 32 combines the plurality of captured images 51 to 54 acquired by the image acquisition unit 31 to generate the composite image 5 viewed from the virtual viewpoint 15.
  • the composite image storage unit 33 stores the composite image 5 generated by the composite image generation unit 32.
  • the moving body extraction unit 34 compares a plurality of composite images 5 each of the plurality of captured images 51 to 54 captured at different times in the composite image storage unit 33, and positions them in the plurality of composite images 5.
  • the moving body 6 in which is changed is extracted.
  • the moving object display image generation unit 35 generates the moving object display image 7 by combining the image element of the moving object 6 extracted by the moving object extraction unit 34 with one of the plurality of composite images 5.
  • the moving body display image 7 by generating the moving body display image 7, it is easy to grasp the situation around the building 10, particularly the position of the moving body 6 around the building 10.
  • the second mode is realized by a combination with the first mode.
  • the building image generation device 3 of the second aspect further includes an image display unit 36 that displays the moving object display image 7.
  • the third mode is realized by a combination with the first mode or the second mode.
  • the building image generation device 3 of the third aspect further includes an image transmission unit 40 that transmits the moving object display image 7 to the image display terminal 91 that displays the moving object display image 7.
  • the third aspect it is possible to transmit the moving body display image 7 to the image display terminal 91 remote from the building image generation device 3.
  • the fourth aspect is realized by a combination with any one of the first to third aspects.
  • the building image generation device 3 according to the fourth aspect further includes a moving body storage unit 37 and a moving body locus image generation unit 38.
  • the moving body storage unit 37 stores the image elements of the moving body 6 extracted by the moving body extraction unit 34.
  • the moving object locus image generation unit 38 combines the locus 80 of the moving object 6 with the moving object display image 7 from the plurality of image elements stored in the moving object storage unit 37 to generate the moving object locus image 8.
  • the moving object locus image 8 makes it easy to grasp the locus 80 around the building 10 of the moving object 6, and the moving destination of the moving object 6 can be easily predicted.
  • the fifth aspect is realized by a combination with any one of the first to fourth aspects.
  • the building image generation device 3 according to the fifth aspect further includes a size determination unit 39 that determines whether or not the size of the mobile body 6 extracted by the mobile body extraction unit 34 is within a predetermined range. When the size determination unit 39 determines that the size of the moving body 6 is not within the predetermined range, the building image generation device 3 determines the moving body display image 7 in the moving body display image generation unit 35. Does not generate.
  • the moving body display 70 is not displayed, and unnecessary information can be omitted from the user.
  • the building image display system 1 includes a plurality of imaging units 2 that image the periphery of the building 10 and a building image generation device 3.
  • the building image generation device 3 includes an image acquisition unit 31, a composite image generation unit 32, a composite image storage unit 33, a mobile body extraction unit 34, a mobile body display image generation unit 35, and an image display unit 36.
  • the image acquisition unit 31 acquires a plurality of images captured by the plurality of imaging units 2 (21 to 24) as a plurality of captured images 51 to 54.
  • the composite image generation unit 32 combines the plurality of captured images 51 to 54 acquired by the image acquisition unit 31 to generate the composite image 5 viewed from the virtual viewpoint 15.
  • the composite image storage unit 33 stores the composite image 5 generated by the composite image generation unit 32.
  • the moving body extraction unit 34 compares the plurality of composite images 5 each of the images from the plurality of imagings 51 to 54 captured at different times in the composite image storage unit 33, and compares them in the plurality of composite images 5.
  • the moving body 6 whose position has changed is extracted.
  • the moving object display image generation unit 35 generates the moving object display image 7 by combining the image element of the moving object 6 extracted by the moving object extraction unit 34 with one of the plurality of composite images 5.
  • the image display unit 36 displays the moving body display image 7.
  • the sixth aspect by generating the moving body display image 7, it is easy to grasp the situation around the building 10, particularly the position of the moving body 6 around the building 10. Further, it is not necessary to prepare an image display unit separately from the building image generation device 3.
  • the building image display system 1 displays a plurality of imaging units 2 that image the periphery of the building 10, the building image generation device 3, and the moving body display image 7 generated by the building image generation device 3.
  • the building image generation device 3 includes an image acquisition unit 31, a composite image generation unit 32, a composite image storage unit 33, a mobile body extraction unit 34, a mobile body display image generation unit 35, and an image transmission unit 40.
  • the image acquisition unit 31 acquires a plurality of images captured by the plurality of imaging units 2 (21 to 24) as a plurality of captured images 51 to 54.
  • the composite image generation unit 32 combines the plurality of captured images 51 to 54 acquired by the image acquisition unit 31 to generate the composite image 5 viewed from the virtual viewpoint 15.
  • the composite image storage unit 33 stores the composite image 5 generated by the composite image generation unit 32.
  • the moving body extraction unit 34 compares a plurality of composite images 5 each of the plurality of captured images 51 to 54 captured at different times in the composite image storage unit 33, and positions them in the plurality of composite images 5.
  • the moving body 6 in which is changed is extracted.
  • the moving object display image generation unit 35 generates the moving object display image 7 by combining the image element of the moving object 6 extracted by the moving object extraction unit 34 with one of the plurality of composite images 5.
  • the image transmission unit 40 transmits the moving object display image 7 to the image display terminal 91.
  • the seventh aspect by generating the moving body display image 7, it is easy to grasp the situation around the building 10, particularly the position of the moving body 6 around the building 10. In addition, it is possible to display the moving object display image 7 on the image display terminal 91 away from the building image generation device 3.
  • the building image generation device 3 further includes a moving body storage unit 37 and a moving body trajectory image generation unit 38.
  • the moving body storage unit 37 stores the image elements of the moving body 6 extracted by the moving body extraction unit 34.
  • the moving object locus image generation unit 38 combines the locus 80 of the moving object 6 with the moving object display image 7 from the plurality of image elements stored in the moving object storage unit 37 to generate the moving object locus image 8.
  • the moving object locus image 8 makes it easy to grasp the locus 80 around the building 10 of the moving object 6, and it is easy to predict the moving destination of the moving object 6.
  • the ninth aspect is realized by a combination with any of the sixth to eighth aspects.
  • the building image generation device 3 according to the ninth aspect further includes a size determination unit 39 that determines whether or not the size of the mobile body 6 extracted by the mobile body extraction unit 34 is within a predetermined range. When the size determination unit 39 determines that the size of the moving body 6 is not within the predetermined range, the building image generation device 3 determines the moving body display image 7 in the moving body display image generation unit 35. Does not generate.
  • the moving body display 70 is not displayed, and unnecessary information can be omitted from the user.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Burglar Alarm Systems (AREA)
  • Alarm Systems (AREA)
  • Image Analysis (AREA)

Abstract

La présente invention vise à fournir un dispositif de génération d'image de bâtiment, et un système d'affichage d'image de bâtiment, permettant de comprendre facilement la position d'un corps en mouvement à proximité d'un bâtiment. Un système d'affichage d'image de bâtiment (1) comporte une pluralité d'unités d'imagerie (2) qui image les alentours d'un bâtiment, et un dispositif de génération d'image de bâtiment (3). Le dispositif de génération d'image de bâtiment (3) comprend une unité d'acquisition d'image (31), une unité de génération d'image composite (32), une unité de stockage d'image composite (33), une unité d'extraction de corps en mouvement (34), et une unité de génération d'image d'affichage de corps en mouvement (35). L'unité d'acquisition d'image (31) acquiert une pluralité d'images capturées par l'unité d'imagerie (2) en tant qu'une pluralité d'images capturées (51-54). L'unité de génération d'image composite (32) combine la pluralité d'images capturées (51-54) de sorte à générer une image composite vue depuis une perspective imaginaire (15). L'unité de stockage d'image composite (33) stocke l'image composite. L'unité d'extraction de corps en mouvement (34) compare une pluralité d'images composites (5) générées à partir de la pluralité d'images capturées (51-54) capturées à différents moments dans l'unité de stockage d'image composite (33), et extrait un corps en mouvement. L'unité de génération d'image d'affichage de corps en mouvement (35) combine l'affichage de corps en mouvement avec les images composites, et génère une image d'affichage de corps en mouvement. Une unité de commande (30) commande le fonctionnement de chaque élément.
PCT/JP2017/039075 2016-10-31 2017-10-30 Dispositif de génération d'image de bâtiment, et système d'affichage d'image de bâtiment WO2018079767A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018547818A JP6695063B2 (ja) 2016-10-31 2017-10-30 建物画像生成装置および建物画像表示システム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-213654 2016-10-31
JP2016213654 2016-10-31

Publications (1)

Publication Number Publication Date
WO2018079767A1 true WO2018079767A1 (fr) 2018-05-03

Family

ID=62025072

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/039075 WO2018079767A1 (fr) 2016-10-31 2017-10-30 Dispositif de génération d'image de bâtiment, et système d'affichage d'image de bâtiment

Country Status (2)

Country Link
JP (1) JP6695063B2 (fr)
WO (1) WO2018079767A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008118466A (ja) * 2006-11-06 2008-05-22 Matsushita Electric Ind Co Ltd 監視システム
JP2011077981A (ja) * 2009-10-01 2011-04-14 Panasonic Corp 監視カメラシステム
JP2014072598A (ja) * 2012-09-28 2014-04-21 Hitachi Kokusai Electric Inc 侵入者監視システム

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5960472B2 (ja) * 2012-03-30 2016-08-02 セコム株式会社 画像監視装置
WO2014162554A1 (fr) * 2013-04-04 2014-10-09 株式会社Ａｍａｔｅｌ Système et programme de traitement d'image

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008118466A (ja) * 2006-11-06 2008-05-22 Matsushita Electric Ind Co Ltd 監視システム
JP2011077981A (ja) * 2009-10-01 2011-04-14 Panasonic Corp 監視カメラシステム
JP2014072598A (ja) * 2012-09-28 2014-04-21 Hitachi Kokusai Electric Inc 侵入者監視システム

Also Published As

Publication number Publication date
JPWO2018079767A1 (ja) 2019-08-08
JP6695063B2 (ja) 2020-05-20

Similar Documents

Publication Publication Date Title
CN113508575B (zh) 基于角速率测量的高动态范围处理的方法和系统
US10298828B2 (en) Multi-imaging apparatus including internal imaging device and external imaging device, multi-imaging method, program, and recording medium
US11871105B2 (en) Field of view adjustment
CN102075683A (zh) 数字图像处理设备和数字图像处理设备的拍摄方法
KR102235231B1 (ko) 촬상 제어장치 및 그 제어 방법
KR102386385B1 (ko) 전자 장치 및 전자 장치의 이미지 압축 방법
US20220122228A1 (en) Chrominance Denoising
KR20180129667A (ko) 표시 제어 장치, 표시 제어 방법 및 저장 매체
JP5730928B2 (ja) 撮像画像表示装置、撮像システム、撮像画像表示方法およびプログラム
JP7112529B2 (ja) 撮像装置、撮像方法、及びプログラム
US20190037123A1 (en) Image pickup apparatus and method for controlling the same
JP2018067851A (ja) 撮像制御プログラム、撮像制御方法および情報処理装置
WO2018079767A1 (fr) Dispositif de génération d'image de bâtiment, et système d'affichage d'image de bâtiment
KR101237975B1 (ko) 영상 처리 장치
TWI448976B (zh) 超廣角影像處理方法與其系統
KR101407119B1 (ko) 초광각 카메라를 이용한 카메라 시스템
JP6213640B2 (ja) 画像処理装置、画像処理方法、撮像装置、及びシステム
US9716819B2 (en) Imaging device with 4-lens time-of-flight pixels and interleaved readout thereof
JP7321187B2 (ja) 画像処理方法及び装置、カメラアセンブリ、電子機器、記憶媒体
JP7390634B2 (ja) ロビーインターホン、インターホンシステム、画像情報出力方法及びプログラム
WO2015052959A1 (fr) Dispositif d'imagerie, systeme d'imagerie, procede d'imagerie et programme d'imagerie
JP2011166388A (ja) 撮像装置および撮像条件の設定方法
JP2019193094A (ja) インターホン装置、情報端末及びインターホンシステム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17865661

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018547818

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17865661

Country of ref document: EP

Kind code of ref document: A1