WO2012137367A1 - Système d'accumulation d'images - Google Patents

Système d'accumulation d'images Download PDF

Info

Publication number
WO2012137367A1
WO2012137367A1 PCT/JP2011/069923 JP2011069923W WO2012137367A1 WO 2012137367 A1 WO2012137367 A1 WO 2012137367A1 JP 2011069923 W JP2011069923 W JP 2011069923W WO 2012137367 A1 WO2012137367 A1 WO 2012137367A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
additional information
images
image capturing
unit
Prior art date
Application number
PCT/JP2011/069923
Other languages
English (en)
Japanese (ja)
Inventor
豊彦 林
Original Assignee
株式会社日立国際電気
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社日立国際電気 filed Critical 株式会社日立国際電気
Publication of WO2012137367A1 publication Critical patent/WO2012137367A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0017—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information
    • G08G5/0021—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information located in the aircraft
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories

Definitions

  • the present invention relates to an image storage system in which an image capturing device is provided in a moving body such as a vehicle, a ship, and an aircraft, and an image captured by the image capturing device is stored and stored in association with additional information characterizing the image.
  • a system in which a camera is fixedly installed and monitored in a remote monitoring room based on an image captured by the camera, or a record of this image is held in practical use.
  • a camera is mounted on a moving body such as a vehicle or an aircraft, and images are recorded and recorded by the camera while the moving body is in operation.
  • a system in which images can be used for analyzing the cause of an accident has been put into practical use.
  • an imaging unit, a position information acquisition unit, and an information communication unit are provided in a vehicle that has been registered as a member, and an image taken by a vehicle at a position desired by another member is centered.
  • a system that can be obtained and viewed via the Internet.
  • the present invention has been made in view of the above-described conventional circumstances, and solves the problem in the case of using a fixedly installed camera, and also enables image storage to be used for monitoring or subsequent confirmation.
  • the purpose is to provide a system.
  • An image storage system includes an image capturing device provided on a moving body, and an image management device that stores an image and additional information that characterizes the image in association with each other.
  • an image is captured by an image capturing device on a moving body such as a vehicle, a ship, an aircraft, a mobile phone, and the like, and additional information characterizing the image is acquired.
  • the additional information is first transmitted from the image capturing apparatus to the image management apparatus, and when the image management apparatus requests an image based on the additional information, the image corresponding to the additional information is transmitted to the image management apparatus.
  • the received image is stored and stored in association with the additional information, and if there is an instruction including designation by the additional information from a terminal device operated by the user or the like, the corresponding stored and stored accordingly Output an image.
  • the image capturing apparatus includes an image capturing unit that captures an image, an acquisition unit that acquires additional information that characterizes an image captured by the image capturing unit, and additional information acquired by the acquiring unit via a wireless section.
  • Additional information transmitting means for transmitting to the image management apparatus, request receiving means for receiving a request from the image management apparatus, and an image management apparatus for transmitting an image corresponding to the additional information in response to a request from the image management apparatus via a wireless section
  • An image transmission unit that transmits the additional information to the image management device, and an image characterized by the additional information based on the received additional information.
  • a determination unit that determines whether or not the image is necessary, a request transmission unit that transmits a request for an image that the determination unit determines to be necessary, an image reception unit that receives an image from the image capture device, and a received image And storage means for storing in association with the additional information, and a, and output means for outputting a corresponding image stored in the storage means in accordance with instruction including designation by the additional information.
  • image capturing devices are provided in a large number of moving bodies, and images captured by these moving bodies are stored in the image management device in association with additional information.
  • a wide variety of images with different characteristics such as the time of shooting can be stored in the image management device, but the present invention is not limited to this. Also by this, since the moving body moves, it is possible to accumulate a wide variety of images having different characteristics as described above in the image management apparatus.
  • identification information that can identify a moving object (that is, an image capturing device) ( ID), importance level information added by the operator of the image capturing apparatus when the image is captured, and the like can be selectively used.
  • ID an image capturing device
  • a large number of images taken in a predetermined range (area) including the position are displayed in time series.
  • the patrol can be performed. Only images taken by a specific type of moving body such as a car can be displayed and output, and only images with high importance can be displayed and output by using importance information.
  • a GPS, a direction sensor, a clock, and the like may be provided exclusively for acquiring the location, direction, and time taken from these, but a navigation system provided in a moving body such as a vehicle. It is also possible to obtain the position and azimuth from, and to acquire the time from a clock provided in the moving body.
  • the image capturing device automatically captures images at a predetermined cycle so that the images are automatically stored in the image management device.
  • An image may be stored in the image management apparatus by operating the image capturing apparatus to capture an image.
  • either a still image or a moving image may be taken and stored and stored, and a set of intermittent images such as frame dropping may be handled as one image.
  • the image capturing device since the image capturing device is provided on the moving body, the image capturing device performs information communication by wireless communication. However, information communication is performed by wired communication using a wired line in the middle of the image management device. May be.
  • the image management device determines whether or not the image characterized by the additional information is necessary based on the additional information, thereby omitting the transmission processing and storage accumulation processing of the image that is less necessary, and the system configuration. Simplification and speeding up of operation have been realized, but as this judgment criterion, the already stored image and the shooting position (location), shooting direction, shooting time, etc. are the same or in a similar range set in advance. Arbitrarily set from the viewpoint of the necessity of the system according to the purpose of use of the system, such as no need for images, or no need for images of position, orientation, time etc. in a preset range can do.
  • the image received by the image management apparatus is stored in association with the additional information, but according to the additional information, for example, images of the same and similar places are arranged and stored in time series according to the shooting time. It is suitable to search and output images stored and accumulated based on the additional information if they are stored with classification or organization as in the above, but it is not necessary to perform such classification and storage. Since the image stored and accumulated can be retrieved and output based on the additional information, the additional information and the image need only be associated with each other.
  • the correspondence stored in the storage unit in response to an instruction including designation by additional information input from a terminal device used by a user outside the image management apparatus
  • the present invention is not limited to such a configuration, and the image management device displays and outputs the corresponding image to the administrator who uses the image management device. You may make it show.
  • the image management apparatus has response means for transmitting a response to the image photographing apparatus in response to receiving an image from the image photographing apparatus, and the image photographing apparatus does not receive a response from the image management apparatus Holds the transmitted image in the memory, and retransmits the image after receiving the response.
  • the terminal device in addition to the image management device and the image capturing device, a terminal device used by the user can be provided.
  • the terminal device includes an output unit that outputs an instruction including designation by additional information to the image management device, an input unit that inputs an image output from the image management device, and a display that displays the input image Means.
  • the display output means of the terminal device or the image management apparatus serves as an interface for the user or administrator.
  • the display output means is configured as follows. It is good. By classifying the images stored and accumulated by the image management apparatus based on the position information (additional information) for each predetermined position range (area), or by classifying the same when the terminal apparatus or the image management apparatus displays and outputs Then, the image accumulation amount for each area is displayed on the screen of the display output means. Specifically, based on an instruction including designation by position information (additional information), the display output means displays a map of the area including the position and surrounding areas on the screen, and displays each area of the map. In accordance with the number of images stored and stored in correspondence with the number of images, a change in an aspect that can be visually identified (such as making a difference in density, changing the color, or displaying the number of stored images) is displayed.
  • the position where each moving body (camera) exists in the map on the screen may be displayed using the identification information (ID) of the moving body included in the additional information.
  • the image management device or the terminal device may transmit a movement instruction to the moving body. For example, in an area where there is a high necessity for an image such as an area where there are few images stored or accumulated or an area where there is no image stored or accumulated. A moving instruction for moving the moving body may be transmitted so that the image management apparatus stores and accumulates the images shot in the area.
  • the camera image capturing means
  • known camera shake correction means for vibrations in the front / rear / right / left and up / down directions may be provided in the camera. Therefore, based on the moving speed and moving direction of the moving body acquired by the acquiring unit, it is preferable to control the electric lens of the camera and the electric pan head that instructs the camera to prevent the image blurring.
  • An image storage system comprising an image capturing device provided on a moving body and an image management device for storing images, wherein the image capturing device captures images by image capturing means for capturing images and image capturing means
  • An acquisition unit that acquires additional information characterizing the image, an additional unit that adds additional information characterizing the image to the image captured by the image capturing unit, and an image with the additional information added to the image management apparatus via the wireless section
  • the image management apparatus includes: a receiving unit that receives an image to which additional information is added; a storage unit that stores the received image in association with the additional information; and a designation based on the additional information.
  • An image storage system comprising: output means for outputting a corresponding image stored in the storage means in response to an instruction to be included.
  • an image is captured by an image capturing device provided on a moving body, and the image is stored and stored in association with additional information. Therefore, a large number of cameras are fixed on a street, for example, by a small number of image capturing devices. Similar to the surveillance system installed in the image, it is possible to store and accumulate images in a wide area, and to use the images stored and accumulated based on the additional information according to the characteristics of the image.
  • the image management apparatus prior to transmitting an image captured by the image capturing apparatus to the image management apparatus, it is determined whether or not an image to be stored and stored is necessary based on additional information characterizing the image. Therefore, it is possible to simplify the system configuration and speed up the system operation by omitting the processing load required for image communication and the processing load required for storage accumulation, which are not necessary for storage accumulation.
  • images taken by a camera mounted on a moving body are managed in time series according to location, and are provided to a supervisor (service user) like a video taken by a fixed camera. be able to.
  • FIG. 1 is a configuration diagram of an image storage system according to an embodiment of the present invention.
  • 1 is a functional block diagram of an image capturing apparatus according to an embodiment of the present invention.
  • 4A and 4B are views for explaining a method for preventing image blur according to an embodiment of the present invention.
  • An image storage system will be specifically described based on an embodiment thereof.
  • still images are taken and stored and stored.
  • the present invention can also be configured as a system that takes moving images and records and stores them.
  • automobiles such as patrol cars, ambulances, taxis, and guard vehicles are used as moving bodies.
  • the present invention can be used for ships and airplanes. Can be used as a moving body, and a mobile phone with a camera carried by a user can also be used as a moving body.
  • a service provider operates an information terminal device such as a portable information terminal device or a personal computer with images collected using a large number of various types of public vehicles such as police cars, ambulances, and passenger cars. It is configured as a system that provides users who want to.
  • the vehicle 1 is provided with an image capturing device 10 that captures images outside the vehicle
  • the service provider 2 is provided with an image storage / delivery server 20 as an image management device.
  • the service provider 2 includes a system management server (WEB server) 30 that distributes a WEB screen for providing a service, and an NTP server 40 for time synchronization of all the image capturing devices (cameras) 10. Is also provided.
  • WEB server system management server
  • a plurality of wireless relay stations (access points) 3 that are wirelessly connected to the image capturing apparatus 10 are provided.
  • the wireless relay station 3 is connected to the image storage / delivery server 20 of the service provider 2 and the system via the Internet network 4. It is connected to a management server (WEB server) 30 and an NTP server 40.
  • Reference numeral 5 in the figure denotes a router that controls communication information to the image storage / delivery server 20, system management server (WEB server) 30, and NTP server 40. Therefore, the image capturing device 10 provided in the vehicle 1 is connected to the image management device (image storage / delivery server) 20 via the wireless section, and communicates information such as images and additional information.
  • the terminal device 50 is a personal computer or portable wireless communication terminal having a communication function that is owned and operated by the user, and is connected to each device of the service provider 2 via the Internet network 4 so as to be communicable.
  • the wireless relay station 6 is a facility for wirelessly connecting the terminal device 50 to the Internet network 4 and is a public wireless LAN or the like.
  • the image capturing apparatus 10 includes a camera (image capturing unit) 11 that captures an image outside the vehicle, and additional information (position, image capturing) that characterizes each of the images (still images) obtained by the camera 11.
  • additional information position, image capturing
  • wireless communication device 13 that performs wireless communication with the wireless relay station 3
  • operating device 14 that receives input from the operator
  • image capturing device 10 The wireless communication device 13 is provided with a memory 16 used for image retransmission processing.
  • the camera 11 is a camera that electrically (preferably automatically) adjusts the focus of the lens and adjusts the aperture.
  • the camera 11 is fixed to the vehicle 1 so as to capture the traveling direction of the vehicle 1 and always captures a moving image.
  • a still image is shot under shooting conditions (shutter timing, aperture, exposure, resolution, etc.) instructed in accordance with the control of the control means 15 and the image data is output to the control means.
  • images are taken at a predetermined cycle, such as every 5 minutes.
  • the acquisition unit 12 includes a clock, a GPS terminal, and a direction sensor, acquires time, position, and direction, acquires importance information input from the operation unit 14, and further, from the speedometer of the vehicle 1, The travel speed information (vehicle speed pulse etc.) of the vehicle is acquired.
  • the acquisition unit 12 also holds a preset camera ID in a nonvolatile memory (not shown).
  • the camera ID is information for identifying each image capturing device 10, and by using the association between the vehicle on which the image capturing device 10 is mounted and the camera ID, each vehicle or vehicle mounted with the camera ID is used. Can be specified. Further, in order to achieve highly accurate time synchronization between the image capturing apparatus 10 and the service provider 2, it is preferable that the clock is automatically synchronized with an NTP (Network Time Protocol) server 40 via a communication network.
  • NTP Network Time Protocol
  • the control means 15 basically captures and temporarily stores an image from the camera 11 at a predetermined cycle (for example, several seconds to several minutes), and also adds additional information (position, position, etc.) when the camera 11 captures the image. (Azimuth, time, camera ID, importance, etc.) is acquired by the acquisition means 12, and the acquired additional information (and image) is transmitted to the image management apparatus 20 by the wireless communication device 13 via the wireless relay station 3 and the Internet network 4 Send it. Additional information transmitting means is constituted by means for executing these functions.
  • the control unit 15 causes the wireless communication device 13 to receive the image request transmitted from the image management apparatus 20.
  • a request receiving unit is configured.
  • the control unit 15 causes the wireless communication device 13 to transmit an image corresponding to the already transmitted additional information to the image management apparatus 20 in response to a request from the image management apparatus 20.
  • the control means 15 is provided with a memory that temporarily holds an image to be transmitted between the transmission of the additional information and the transmission of the image.
  • Image transmitting means is constituted by means for executing these functions.
  • the control unit 15 controls the shooting conditions of the camera 11 based on the speed information acquired by the acquisition unit 1 to prevent blurring of the captured image.
  • the camera 11 sends a shooting start preparation signal to the control means 15 before shooting, and when the control means 15 receives this signal, the optimal vehicle speed is determined based on the current vehicle speed and the positional relationship between the current position and the subject.
  • the shooting conditions are determined and sent to the camera 11 as a control signal.
  • the camera 11 receives the control signal, controls the lens and the like, and starts shooting after the shooting conditions are satisfied.
  • the timing of capturing an image from the camera 11 is not limited to a periodic trigger, but may be triggered by a speed error, a signal from the operation device 14, or the like, and triggered by a request from the image management device 20. It may be something that lets you shoot. That is, the acquired additional information (especially importance) is periodically transmitted to the image management apparatus 20, and an image is captured from the camera 11 only when there is a request from the image management apparatus 20. If accuracy is required for the position and time, the additional information is reacquired and transmitted to the image management apparatus 20 together with the image.
  • a part of the image acquisition device 10 also serves as a car navigation device, it may be triggered by having approached a predetermined position on the map or receiving a beacon.
  • the image acquisition device 10 also serves as a driving support device, it may be triggered by the detection of road parking or the occurrence of a collision avoidance event.
  • the basic operation is periodic image capturing
  • the acquired image is not preferable (for example, the image is blurred, most of the field of view is blocked by the vehicle ahead, etc.).
  • Additional information may be reacquired.
  • the well-known Lucas-Kanade method local gradient method
  • the camera 11 may have a camera head function that electrically changes the shooting direction and orientation. In that case, the camera pan head and the lens are also controlled according to the speed of the vehicle 1 to prevent blurring of the captured image.
  • a moving body is a rail vehicle, you may obtain positional information from kilometer information.
  • FIG. 6 shows a shooting angle of view of the camera 11 mounted on the moving body at the time of shooting in order to explain the prevention of camera shake.
  • the horizontal angle of view angle of the camera 11 immediately before shooting is ⁇
  • the horizontal angle of view angle of the camera 11 at the end of shooting is ⁇
  • the moving distance of the camera 11 during still image shooting is Y
  • the distance from the camera 11 to the subject is a shooting angle of view of the camera 11 mounted on the moving body at the time of shooting in order to explain the prevention of camera shake.
  • the horizontal angle of view angle of the camera 11 immediately before shooting is ⁇
  • the horizontal angle of view angle of the camera 11 at the end of shooting is ⁇
  • the moving distance of the camera 11 during still image shooting is Y
  • the distance from the camera 11 to the subject is the distance from the camera 11 to the subject.
  • the image storage / delivery server (image management apparatus) 20 is based on communication means 21 for communicating information such as images and additional information via the router 5, and additional information received from the image capturing apparatus 10.
  • a determination unit 22 that determines whether or not the image characterized by the additional information is necessary, and a request transmission unit 23 that transmits a request for an image determined to be necessary by the determination unit 22 to the corresponding image capturing apparatus 10 via the communication unit 21.
  • Categorizing means 24 for classifying the received image based on the additional information and storing it in the database memory 25 in association with the additional information; instruction accepting means for accepting an instruction including designation by the additional information received by the communication means 21 26.
  • It means 27 comprises a map database 28 which holds a map, a map of the required area corresponding to the image retrieved by the retrieval means 27 is transmitted in response to the retrieved image.
  • the communication unit 21 includes a response unit 29 that transmits an image reception response to the image capturing device 10 in response to receiving an image from the image capturing device 10.
  • the communication means 21 constitutes additional information receiving means for receiving additional information from the image capturing apparatus 10 and image receiving means for receiving images, and the images received by the classification means 24 and the database memory 25 correspond to the additional information.
  • a storage means for storing information, and an output receiving means for outputting a corresponding image stored in the storage means in response to an instruction including designation by the additional information by the instruction receiving means 26, the search means 27, and the communication means 21. is doing.
  • the image management apparatus 20 displays the searched image on the screen, this display screen constitutes output means.
  • the classifying unit 24 arranges the received images in advance based on the additional information, for example, by grouping them at the same shooting position (or an area of a predetermined area including the position). Although it is stored in the database memory 25, if an image and additional information characterizing the image are associated and stored as shown in FIG. 4, a desired image can be searched later based on the additional information.
  • the classification unit 24 may be eliminated, and the received image may be stored and accumulated in the database memory 25 in association with the additional information.
  • a camera ID for identifying each image capturing device, a position where the image is captured, a direction where the image was captured, a time when the image was captured, and an operator at the shooting site when capturing the image The added importance is used, and the additional information is processed in association with the image to be photographed.
  • the additional information some of these may be adopted.
  • various information can be used from the viewpoint of how much images with different characteristics are necessary.
  • the camera ID is a type ID for identifying the type of moving body such as a patrol car or an ambulance by managing the correspondence between the image management apparatus 20 and the type of moving body on which the image capturing apparatus 10 is mounted.
  • each additional information such as position and time has a predetermined width. Is set in the determination unit 22, and the determination unit 22 determines whether the received additional information is the same or similar to the additional information stored in the database memory 25. Is determined to be necessary when no image is already stored in the database memory 25. It should be noted that how much the similar width is set is arbitrarily determined according to the system operational requirements in consideration of the necessity of details of stored and accumulated images and the degree of reduction of the processing load. You only have to set it.
  • the terminal device 50 includes a communication unit 51 that communicates information including an instruction including designation by additional information and information such as an image, a display processing unit 52 that performs display processing of a received image, and the image that has undergone display processing. And a display screen 53 for displaying a display screen, etc., and an operation means 54 for receiving an operation input from a user such as an instruction including designation by additional information. Therefore, the communication unit 51 and the operation unit 54 constitute an output unit that outputs an instruction including designation by additional information to the image management device 20, and the communication unit 51 and the display processing unit 52 output the image output from the image management device 20. An input means for inputting is configured.
  • images captured at a fixed period by the camera 10 mounted on the moving body 1 are collected by the image storage / delivery server 20 via the communication path, and the image storage / delivery server 20 Based on the added additional information, for example, from the direction information and the position information, it is classified according to the direction and place where the image was taken, and the classified images are further classified into a certain range that is regarded as almost the same time based on the time information.
  • the data is stored and accumulated in the database memory 25 in such a manner that the images are classified into time images.
  • images are arranged in time series for each area, and it is possible to provide a video from the past to the present of a specific area to a monitor who operates the terminal device 50.
  • the management server 30 distributes a WEB screen for providing the service to the terminal device (client) 50 of the supervisor, and the terminal device 50 is provided by accessing the service.
  • the stored and stored images can be browsed on the WEB screen.
  • the terminal device 50 in the system of the present embodiment is a PC or a portable information terminal, and can receive this service anywhere as long as there is a browser and an Internet connection environment that run on it.
  • the NTP server 40 synchronizes the time of all the image capturing devices (cameras) 10.
  • FIG. 7 shows a processing sequence between the image capturing device (camera) 10 and the image management device (storage distribution server) 20.
  • the image capturing apparatus 10 sequentially transmits additional information of images to be periodically captured to the image management apparatus 20 (step S1).
  • the image management apparatus 20 determines the necessity of the image based on the received additional information (step S2), and requests the image that has been determined to be necessary from the image capturing apparatus 10 that is the transmission source (step S3). For example, from the position information included in the additional information, whether the source image capturing device 10 (that is, the moving body 1) has moved to another area, or is there no other image capturing device (moving body) in that area? If the transmission source image capturing device 10 (moving body) stays in the same area, it is determined that the image is not duplicated. If there is an image capturing device, it is determined that an image is unnecessary in the other area.
  • the image capturing apparatus 10 Upon receiving the image request from the image management apparatus 20, the image capturing apparatus 10 performs an image capturing process corresponding to the additional information from which the request is determined (step S4), and the captured image is captured by the image management apparatus. 20 (step S5), the image management apparatus 20 stores and accumulates the image received from the image management apparatus 20 in the database memory 25 in association with the additional information (step S6), and repeats the same processing as described above. (Step S7).
  • the image capturing apparatus 10 transmits the additional information at the present time to the image management apparatus 20 before capturing an image, and captures an image when an image transmission request is received from the image management apparatus 20.
  • the information is transmitted to the management device 20, and even if processing for periodically transmitting additional information about an image to be taken in the future is performed, the position and time of the additional information are set to a predetermined value.
  • the characterization of the image by the additional information can be ensured, and according to such processing, the image capturing device can be secured.
  • the burden of 10 image capturing processes can be reduced.
  • additional information when the image capturing apparatus 10 captures an image is transmitted to the image management apparatus 20, and when the image management apparatus 20 makes a transmission request for the image, the captured image is image-managed. You may make it transmit to the apparatus 20.
  • FIG. 8 shows a more detailed processing sequence in the image capturing apparatus (camera) 10.
  • the image capturing apparatus 10 transmits additional information such as position information to the image management apparatus 20 at a predetermined cycle (step S10), and receives an image transmission request for the additional information from the image management apparatus (storage / delivery server) 20. Is determined (step S11).
  • the image management apparatus 20 has a one-to-one communication between each image capturing apparatus 10 and the image management apparatus 20. Include a camera ID (mobile ID) as a destination for an image request or the like.
  • the image capturing apparatus 10 When the image capturing apparatus 10 receives the image transmission request, the image capturing apparatus 10 performs image capturing processing, inputs the orientation information and position information acquired by the acquiring unit 12 to the control unit 15 (step S12), and the control unit 15 Based on the input information, the camera head and lens of the camera 11 are controlled to prevent image blurring (step S13), and the camera 11 takes an image (a still image in this example) (step S14).
  • the image is transmitted to the request source image management apparatus 20 by the wireless communication device 13 (step S15). Then, the image capturing device 10 determines whether or not a reception response to the transmitted image has been received from the image management device 20 (step S16). If no reception response is received, the image capturing device 10 holds the transmitted image in the memory 16 (step S17). ).
  • Step S16 After receiving an image to the image management device 20, if a reception response is not obtained, it is considered that there is a line abnormality such as a disconnection state such as a wireless line from the image capturing device 10 to the image management device 20. Is stored in the memory 16, and when a corresponding reception response or a reception response to another additional information image is obtained from the image management apparatus 20 (step S16), the presence or absence of the image stored in the memory 16 is determined. (Step S18), the held image is transmitted again to the image management apparatus 20 by the wireless communication device 13 (Step S19).
  • a line abnormality such as a disconnection state such as a wireless line from the image capturing device 10 to the image management device 20.
  • the same ID (image ID in the example of FIG. 4) is added to the additional information transmitted earlier and the image transmitted later, or the additional information transmitted earlier is added to the image.
  • the correspondence relationship between the additional information and the image may be maintained by the method.
  • the image to be transmitted is temporarily stored in the memory 16 so that the reception level is normal. It is also possible to transmit the image according to the reception level by transmitting the image at the time of becoming.
  • FIG. 9 shows a more detailed processing sequence in the image management apparatus (storage distribution server) 20.
  • the image management apparatus 20 receives additional information such as a camera ID and position information periodically transmitted from the image capturing apparatus (camera) 10 (step S20)
  • the image management apparatus 20 displays the additional information received this time and the additional information received last time.
  • the image management apparatus 20 transmits an image transmission request to the image capturing apparatus 10 that has transmitted the additional information (step S23). Then, when receiving the requested image (step S24), the image management apparatus 20 transmits an image reception response to the image capturing apparatus 10 that is the transmission source (step S25).
  • the source image capturing device 10 can be specified by, for example, the camera ID included in the additional information, and the image that is the target of the transmission request or reception response can be specified by, for example, the image included in the additional information. This can be done by ID.
  • the additional information can be transmitted to the image management apparatus 20 together with the image captured by the image capturing apparatus 10.
  • images are added from a plurality of image capturing apparatuses 10 simultaneously in the same area.
  • the image management apparatus 20 transmits a request for suspension of image transmission to other image capturing apparatuses except for one, and the image capturing apparatus 10 that has received the suspension request transmits the image.
  • the additional information especially position information and camera ID
  • the image management device 20 detects that the image capturing apparatus 10 that transmits an image from the additional information has moved to another area, the image transmission is performed to one of the other image capturing apparatuses.
  • the resumption request is transmitted, and the image capturing apparatus that has received the distribution resumption request resumes image transmission. In this way, even if there are a plurality of image capturing devices in the same area, the number of image capturing devices that perform image transmission can be limited to one.
  • FIG. 10 shows an example of an image classification method based on the additional information.
  • a plurality of images shot in a preset range (area) including the position are classified in time series, and the images are transmitted to the terminal device 50 and displayed on the screen 53.
  • a to d are areas
  • M1 and M2 are different image capturing devices 10 (moving bodies)
  • g1 is an image captured by the moving body M1 at the time T in the area a
  • g2 is an area where the moving body M2 is at the time T.
  • An image captured at b, g3 is an image captured by the moving body M1 in the area b at time T + 1
  • g4 is an image captured by the moving body M2 in the area c at time T + 1
  • g5 is an image captured by the moving body M1 in the area c at time T + 2.
  • a photographed image, g6, is an image photographed in the area d by the moving body M2 at time T + 2.
  • time series images g2 and g3 are obtained for area b
  • time series images g4 and g5 are obtained for area c. That is, by transmitting images classified in time series for each area to the terminal device 50 and displaying them on the screen 53, the user of the terminal device 50 continuously monitors images in a specific area in time series. It becomes possible to do.
  • the user operates the operation means 54 to transmit an instruction including additional information from the terminal device 50 to the image management device 20.
  • the image management device 20 searches the database memory 25 for an image corresponding to the additional information, and transmits a map of a necessary area corresponding to the search result to the transmission source terminal device 50 together.
  • the terminal device 50 receives the image and map of the search result, the terminal device 50 displays and outputs the image on the screen 53 so that the user can view it.
  • FIG. 11 shows an example of the screen display of the terminal device 50
  • FIG. 11 (a) shows the display of the main screen
  • FIG. 11 (b) shows the image display displayed by selecting the area.
  • 60 is an area where a user inputs position information for designating an image browsing area
  • 61 is a button for searching for an image taken by a bus or taxi
  • 62 is a police car or an ambulance, etc.
  • 63 is a button for instructing to search for an image taken by an aircraft or a ship
  • 64 is a button for instructing image forward or reverse display
  • 65 is an image for viewing an image.
  • 66 is a button for instructing a return to the main screen.
  • buttons constitute the operation means 54 of the terminal device 50.
  • an instruction including the position information input to the region 60 as additional information is transmitted to the image management apparatus 20, and the image management apparatus 20 displays the image of the area including the position information and the area.
  • the peripheral image is transmitted to the terminal device 50 together with the additional information.
  • the image management device 20 is instructed every time the terminal device 50 designates position information, time information, mobile type information, and the like. The corresponding image may be transmitted.
  • the terminal device 50 may acquire its own position using the GPS function or the like and include the position information as default in the additional information without instructing the area 60 by inputting the position information.
  • the image management device 50 may provide a map centered on the position from position information such as an address input in the area 60 and display it on the main screen of the terminal device 50.
  • a map corresponding to the designated position information is displayed on the main screen, and each area partitioned in the map is displayed in a different manner depending on the number of images taken in the area. ing. Specifically, the area 80 with a relatively large number of captured images is displayed with a relatively dark background color, and the area 81 with a relatively small number of captured images is displayed with a relatively light background color. Thus, the user can intuitively grasp the size of the image for each area.
  • an image taken in the area shown in FIG. 11B is displayed, and the image advance / return button 64 is operated to operate the area. Can be viewed in chronological order.
  • the display on the main screen can be changed to a map of the sky or the sea, and the user can see the sky image sent from the aircraft or the sea sent from the ship. It is possible to browse images.
  • the sky image can know local weather information
  • the sea image can know local ocean conditions, and it is possible to search from the image information when an accident such as distress or grounding occurs at sea.
  • the terminal device 50 has a taxi or bus equipped with the image capturing device 10 as well as the position 70 where the user (terminal device) exists.
  • the position 71 and the position 72 where an emergency vehicle such as a patrol car on which the image capturing device 10 is mounted are displayed on the map of the main screen in a manner such as being color-coded so that each can be identified.
  • the service provider discriminates an area where the moving body is not traveling or is traveling less or an area where a specific type of moving body is not traveling. For example, the service provider notifies the moving body equipped with the image capturing device 10 to move to an area where the moving body is not traveling (that is, an area where no image is accumulated), and is necessary. It is possible to collect images in various areas. In addition, the service provider can be used for efficient patrol by notifying the police station of areas where patrol cars are not patroling.
  • the image management device 20 determines whether or not an image is necessary based on the additional information, and receives and stores only the necessary image from the image capturing device 10, but as shown in FIG.
  • a configuration in which the function of determining whether an image is necessary may be eliminated. That is, the image capturing apparatus 10 is configured to add additional information acquired when the camera 11 captures an image to the image management apparatus 20 by the control means (addition means) 15 and transmit the image to the image management apparatus 20.
  • the control means (addition means) 15 When 20 receives the image with the additional information added, it stores the received image in the database memory 25 in association with the additional information. Also with such a configuration, a necessary image can be retrieved from stored and accumulated images based on the additional information and provided to the terminal device 50, as in the above embodiment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Television Signal Processing For Recording (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)
  • Traffic Control Systems (AREA)

Abstract

La présente invention rend possible de stocker et d'accumuler des images dans un large éventail de secteurs et d'utiliser les images ensuite conformément aux caractéristiques des images par un petit nombre de dispositifs de prise de vue (10) de manière similaire à un système de surveillance dans lequel un grand nombre de caméras sont installées d'une manière fixe dans les rues. Un dispositif de prise de vue (10) installé dans un objet mobile (1) acquiert des informations supplémentaires qui caractérisent une image prise par un moyen de prise de vue, transmet les informations supplémentaires à un dispositif de gestion d'images (20), lorsqu'une requête d'image est faite par le dispositif de gestion d'images (20), prend une image par le moyen de prise de vue, et transmet l'image prise au dispositif de gestion d'images (20). Le dispositif de gestion d'images (20) associe, stocke et accumule des informations supplémentaires et des images reçues, et lors de la réception, en provenance d'un dispositif terminal (50), d'une instruction comprenant une désignation faite par des informations supplémentaires, transmet une image correspondant à celles-ci au dispositif terminal (50) et rend l'image visible.
PCT/JP2011/069923 2011-04-01 2011-09-01 Système d'accumulation d'images WO2012137367A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011-081370 2011-04-01
JP2011081370A JP2012216102A (ja) 2011-04-01 2011-04-01 画像蓄積システム

Publications (1)

Publication Number Publication Date
WO2012137367A1 true WO2012137367A1 (fr) 2012-10-11

Family

ID=46968795

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/JP2011/069924 WO2012137368A1 (fr) 2011-04-01 2011-09-01 Dispositif d'imagerie, dispositif de gestion et système de vidéosurveillance
PCT/JP2011/069923 WO2012137367A1 (fr) 2011-04-01 2011-09-01 Système d'accumulation d'images

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/069924 WO2012137368A1 (fr) 2011-04-01 2011-09-01 Dispositif d'imagerie, dispositif de gestion et système de vidéosurveillance

Country Status (3)

Country Link
JP (1) JP2012216102A (fr)
GB (1) GB2502922B (fr)
WO (2) WO2012137368A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016058468A1 (fr) * 2014-10-16 2016-04-21 努比亚技术有限公司 Terminal mobile, serveur, procédé de prise de vue et support de stockage informatique
CN107483830A (zh) * 2017-09-13 2017-12-15 惠州Tcl移动通信有限公司 一种基于移动终端的照片拍摄控制方法、系统及存储介质

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6238989B2 (ja) 2013-08-06 2017-11-29 三菱電機株式会社 列車内監視方法及び列車内監視システム
JP6486744B2 (ja) * 2015-03-25 2019-03-20 株式会社日本総合研究所 地域監視サーバ、提供端末及びそのシステム
JP7047374B2 (ja) * 2017-12-25 2022-04-05 トヨタ自動車株式会社 情報収集システム
JP6964756B2 (ja) * 2018-03-13 2021-11-10 本田技研工業株式会社 表示データ生成装置及びプログラム
DE102019208770A1 (de) * 2019-06-17 2020-12-17 Siemens Mobility GmbH Verfahren und Vorrichtung für ein Schienenfahrzeug
JP6771117B1 (ja) * 2020-02-07 2020-10-21 エヌエイチエヌ コーポレーション 情報提供サーバ、情報提供方法、及びプログラム
US20230131426A1 (en) * 2020-03-31 2023-04-27 Nec Corporation Information display control device, information display control method, and recording medium on which program is recorded

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61105964A (ja) * 1984-10-30 1986-05-24 Canon Inc 画像情報処理システム
JP2003233555A (ja) * 2002-02-13 2003-08-22 Zenrin Datacom Co Ltd 情報管理システム
JP2007102575A (ja) * 2005-10-05 2007-04-19 Fujifilm Corp 撮影システム
JP2008028688A (ja) * 2006-07-21 2008-02-07 Uie Japan:Kk 画像配信システム

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11160080A (ja) * 1997-12-01 1999-06-18 Harness Syst Tech Res Ltd 移動体情報システム
US20030210806A1 (en) * 2002-05-07 2003-11-13 Hitachi, Ltd. Navigational information service with image capturing and sharing
JP4214847B2 (ja) * 2003-06-27 2009-01-28 オンキヨー株式会社 コンテンツ記録システム
JP2005318380A (ja) * 2004-04-30 2005-11-10 Matsushita Electric Ind Co Ltd データ記録装置およびデータ記録システム
JP2006114985A (ja) * 2004-10-12 2006-04-27 Canon Electronics Inc 画像記録システム及びその制御方法及びプログラム及び記憶媒体
JP4367353B2 (ja) * 2005-02-14 2009-11-18 株式会社デンソー 交通情報提供システム、交通情報提供センタ、車載用情報収集装置
JP4761944B2 (ja) * 2005-11-18 2011-08-31 株式会社東芝 車載用ナビゲーション装置、標示認識方法、ナビゲーションシステム、サーバ
JP2007166181A (ja) * 2005-12-13 2007-06-28 Matsushita Electric Ind Co Ltd データ取得装置及びデータ記録システム並びにデータ記録方法
JP4735243B2 (ja) * 2005-12-26 2011-07-27 アイシン・エィ・ダブリュ株式会社 車両情報提供システム
JP4748140B2 (ja) * 2007-11-12 2011-08-17 株式会社デンソー 情報配信システム、情報管理サーバ、および情報配信装置
JP2010020661A (ja) * 2008-07-14 2010-01-28 Hitachi Ltd 移動体向け情報配信システム、情報配信方法及び情報配信装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61105964A (ja) * 1984-10-30 1986-05-24 Canon Inc 画像情報処理システム
JP2003233555A (ja) * 2002-02-13 2003-08-22 Zenrin Datacom Co Ltd 情報管理システム
JP2007102575A (ja) * 2005-10-05 2007-04-19 Fujifilm Corp 撮影システム
JP2008028688A (ja) * 2006-07-21 2008-02-07 Uie Japan:Kk 画像配信システム

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016058468A1 (fr) * 2014-10-16 2016-04-21 努比亚技术有限公司 Terminal mobile, serveur, procédé de prise de vue et support de stockage informatique
CN107483830A (zh) * 2017-09-13 2017-12-15 惠州Tcl移动通信有限公司 一种基于移动终端的照片拍摄控制方法、系统及存储介质
WO2019052450A1 (fr) * 2017-09-13 2019-03-21 惠州Tcl移动通信有限公司 Procédé et système de commande de prise de photos sur la base d'un terminal mobile et support d'informations
CN107483830B (zh) * 2017-09-13 2020-08-11 惠州Tcl移动通信有限公司 一种基于移动终端的照片拍摄控制方法、系统及存储介质
US11394871B2 (en) 2017-09-13 2022-07-19 Huizhou Tcl Mobile Communication Co., Ltd. Photo taking control method and system based on mobile terminal, and storage medium

Also Published As

Publication number Publication date
WO2012137368A1 (fr) 2012-10-11
GB2502922A (en) 2013-12-11
GB2502922B (en) 2017-07-05
JP2012216102A (ja) 2012-11-08
GB201316192D0 (en) 2013-10-23

Similar Documents

Publication Publication Date Title
WO2012137367A1 (fr) Système d'accumulation d'images
JP6486744B2 (ja) 地域監視サーバ、提供端末及びそのシステム
KR101582441B1 (ko) 영상 정보 수집 시스템 및 이동 객체에 대한 영상 정보를 수집하는 방법
KR101783982B1 (ko) 차량용 감시 카메라를 이용한 통합 관제 시스템 및 그 방법
JP4470992B2 (ja) 映像管理システム
US8947262B2 (en) Image data collection from mobile vehicles with computer, GPS, and IP-based communication
JP2019036872A (ja) 捜査支援装置、捜査支援方法及び捜査支援システム
JP5306660B2 (ja) 監視システム及びセキュリティ管理システム
KR101397453B1 (ko) 영상 감시 시스템 및 그 방법
KR100835085B1 (ko) 무인교통사고기록장치를 이용한 실시간 교통사고처리시스템 및 방법
JP2019083379A (ja) 塵芥収集車における映像管理システム
JP2006221537A (ja) 交通情報提供システム、交通情報提供センタ、車載用情報収集装置
KR101840300B1 (ko) Cctv 영상의 검색 장치 및 방법
JP2001325695A (ja) 交通流監視装置
KR101474790B1 (ko) 협업용 감시카메라 및 이를 이용한 안전 감시 시스템
EP2827259A1 (fr) Procédé de fourniture de données d'image d'un emplacement
WO2013111494A1 (fr) Système de surveillance
KR20050114906A (ko) 통합 및 독립적 구성 조합에 의한 불법 주정차 무인 단속시스템 및 그것의 운용방법
JP2004140586A (ja) 侵入監視システムとその制御装置と監視用端末装置と侵入監視プログラム
JP5404453B2 (ja) 車両監視装置
JP2018170573A (ja) 監視システム
JP6941458B2 (ja) 監視システム
WO2013111479A1 (fr) Système de surveillance
WO2013094405A1 (fr) Système de contrôle
KR20130057265A (ko) 스마트폰용 블랙박스 영상 제보 시스템 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11862905

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11862905

Country of ref document: EP

Kind code of ref document: A1