JP7841835B2 - Monitoring system, management device, and recording setup method - Google Patents

Description

This invention relates to a technology for monitoring using imaging devices installed in mobile objects such as vehicles.

Conventionally, the technology of using in-vehicle cameras as surveillance cameras is known.

For example, Patent Document 1 describes a security system comprising a monitoring device and a surrounding image transmission device. In this system, the monitoring device monitors the state of a monitored area where a power supply device for supplying power to the vehicle is installed. The surrounding image transmission device is mounted on a vehicle equipped with a charge control unit for charging the vehicle's battery by receiving power from the power supply device, and an on-board camera for capturing images of the vehicle's surroundings. When the vehicle is parked within the monitored area, the device transmits surrounding images captured via the on-board camera to the monitoring device.

Japanese Patent Publication No. 2016-139865

The security system described in Patent Document 1 may assume the use of an in-vehicle camera as a surveillance camera; therefore, if the vehicle is moved, it becomes impossible to monitor the area around where it was previously parked.

Furthermore, the security system described in Patent Document 1 may be a system that uses an in-vehicle camera in a single vehicle as an auxiliary to a relatively small-scale home security system; therefore, the construction of a large-scale security system using in-vehicle cameras in multiple vehicles is not envisioned.

Recently, while the installation of surveillance cameras in parking lots and similar areas is becoming more common, the monitoring range is often limited to only certain areas (for example, only the entrance to the parking lot). Therefore, there is a risk of insufficient surveillance.

In one aspect, the present invention aims to enable monitoring by utilizing the imaging devices provided by each of multiple mobile objects.

A monitoring system according to one aspect of this disclosure comprises a management device and imaging devices mounted on each of a plurality of mobile bodies. The management device includes a stop schedule determination unit, a recording setting determination unit, and a communication unit. The stop schedule determination unit determines the stop position and stop period for each of the plurality of mobile bodies within the monitoring area. The recording setting determination unit determines the recording settings for the imaging devices mounted on each of the plurality of mobile bodies. The communication unit of the management device transmits recording setting information regarding the recording settings of the imaging devices mounted on each of the plurality of mobile bodies to the imaging devices mounted on each of the plurality of mobile bodies. The imaging device comprises an imaging unit, a communication unit, and a recording control unit. The imaging unit captures images of a subject and generates video data. The communication unit of the imaging device receives recording setting information from the management device. The recording control unit controls the recording performed using the imaging unit based on the recording setting information.

One embodiment of the present disclosure comprises a stop schedule determination unit, a recording setting determination unit, and a communication unit. The stop schedule determination unit determines the stop position and stop period for each of the multiple mobile objects within the monitoring area. The recording setting determination unit determines the recording settings for the imaging devices mounted on each of the multiple mobile objects. The communication unit transmits recording setting information related to the recording settings of the imaging devices mounted on each of the multiple mobile objects to the imaging devices mounted on each of the multiple mobile objects.

One aspect of the recording setting method of this disclosure involves a computer performing the following processes: determining the stopping position and stopping period for each of a plurality of moving objects within a monitoring area; determining the recording settings for the imaging devices mounted on each of the plurality of moving objects; and transmitting the recording setting information related to the said recording settings for the imaging devices mounted on each of the plurality of moving objects to the imaging devices mounted on each of the plurality of moving objects.

Monitoring can be performed by utilizing the imaging devices equipped on each of the multiple mobile units.

This diagram illustrates the configuration of a monitoring system. This diagram illustrates the functional configuration of the control device. This diagram illustrates the functional configuration of an imaging device. This is a diagram illustrating a computer's hardware configuration. This flowchart illustrates the processes performed by the management device. This is a diagram illustrating vehicle information. This diagram illustrates parking lot information, which is part of the area being monitored. This diagram illustrates a list of parking schedule information. This figure shows examples of vehicle parking in a parking lot that is part of the monitoring area. This diagram illustrates the recording settings list information.

The embodiments of the present invention will be described below with reference to the drawings.

Figure 1 is a diagram illustrating the configuration of monitoring system 1.

The monitoring system 1 illustrated in Figure 1 comprises a management device 10 and imaging devices 30 mounted on each of the multiple vehicles 20. The management device 10 and each imaging device 30 are connected to a communication network 40 via wireless or wired connections, and can communicate through this communication network 40. Note that the vehicles 20 are an example of mobile devices.

The management device 10, for example, determines the parking position and parking period of each vehicle 20 within the monitoring area, determines the recording settings of the imaging device 30 mounted on each vehicle 20, and transmits recording setting information related to the recording settings of the imaging device 30 mounted on each vehicle 20 to the imaging device 30 mounted on each vehicle 20. Note that the parking position and parking period of the vehicle 20 are examples of the stopping position and stopping period of the moving object.

The imaging device 30 receives recording setting information from, for example, the management device 10, and controls the recording of the subject (the area surrounding the vehicle 20 on which the imaging device 30 is mounted) based on this recording setting information. The imaging device 30 can also be described as an in-vehicle device equipped with imaging capabilities.

In this type of monitoring system 1, the imaging devices 30 mounted on each vehicle 20 are used to monitor (including surveillance) the target area. The monitoring system 1 will be described in more detail below.

Figure 2 illustrates the functional configuration of the control device 10.

The management device 10 illustrated in Figure 2 comprises a control unit 101, a storage unit 102, and a communication unit 103.

The control unit 101 controls each part of the management device 10. The control unit 101 also includes a parking schedule determination unit 111 and a recording setting determination unit 112. Note that the parking schedule determination unit 111 is an example of a stop schedule determination unit.

The parking schedule determination unit 111 determines the parking position and parking period for each vehicle 20 within the monitoring area. The monitoring area may include multiple vehicle parking positions with assigned priorities. In this case, the parking schedule determination unit 111 may select and determine the parking position for each vehicle 20 within the monitoring area from among the multiple vehicle parking positions based on their priority and the imaging range (capable range of capture) of the imaging device 30. In the case of multiple vehicle parking positions with assigned priorities, for example, a higher priority may be assigned to a vehicle parking position that can record an area with a high need for monitoring. Multiple vehicle parking positions are an example of multiple moving object stopping positions.

The recording setting determination unit 112 determines the recording settings for the imaging device 30 mounted on each vehicle 20. The recording settings include the setting of the imaging range (shooting range) and the imaging period (shooting period). The imaging range also indicates the imaging angle of view (shooting angle of view) and the imaging direction (shooting direction). The imaging period is also the parking period determined by the parking schedule determination unit 111.

The memory unit 102 stores vehicle information, monitoring area information, parking schedule list information, and recording settings list information, etc. Vehicle information refers to information about multiple vehicles 20. Monitoring area information refers to information about the parking locations of multiple vehicles included in the monitoring area. Parking schedule list information is a list of parking locations and parking periods for each vehicle 20 in the monitoring area. Recording settings list information is a list of recording settings for the imaging devices 30 mounted on each vehicle 20. Specific examples of vehicle information, monitoring area information, parking schedule list information, and recording settings list information will be described later.

The communication unit 103 communicates with an external device (e.g., an imaging device 30) via the communication network 40. For example, the communication unit 103 transmits recording setting information, determined by the recording setting determination unit 112, to the imaging devices 30 mounted on each vehicle 20. This ensures that, for example, recording setting information for imaging device 30A is transmitted to imaging device 30A, and recording setting information for imaging device 30B is transmitted to imaging device 30B, and so on, with each imaging device 30 receiving its own recording setting information.

Figure 3 illustrates the functional configuration of the imaging device 30.

The imaging device 30 illustrated in Figure 3 includes a control unit 301, an imaging unit 302, a current position detection unit 303, a display unit 304, a storage unit 305, and a communication unit 306.

The control unit 301 controls each part of the imaging device 30. The control unit 301 also includes a recording control unit 311. The recording control unit 311 controls the recording performed using the imaging unit 302 based on the recording setting information received by the communication unit 306 from the management device 10. More specifically, it controls the imaging unit 302 to perform imaging based on the recording setting information and to store the generated video data in the storage unit 305.

The imaging unit 302 captures images of the subject (the area surrounding the vehicle 20 on which the imaging device 30 is mounted) and generates video data. The imaging unit 302 can have a variable or fixed imaging range. An imaging unit 302 with a variable imaging range can, for example, capture any area within a 360-degree range around the vehicle, like a 360-degree camera, or capture any area within a portion of the area around the vehicle, like a camera equipped with a variable-focus lens (varifocal lens) (hereinafter referred to as a "varifocal camera"). An imaging unit 302 with a fixed imaging range can capture only a portion of the area around the vehicle, like a camera equipped with a fixed-focus lens (hereinafter referred to as a "normal camera"). In the case of an imaging unit 302 with a variable imaging range, the imaging range of the imaging unit 302 is controlled by the recording control unit 311. Furthermore, regardless of the type of imaging unit 302, the imaging period of the imaging unit 302 is controlled by the recording control unit 311.

The current location detection unit 303 detects the current location.

The display unit 304 displays various information.

The memory unit 305 stores recording setting information and video data, etc. The recording setting information is received by the communication unit 306 from the management device 10. The video data is generated by the imaging unit 302.

The communication unit 306 communicates with an external device (e.g., the management device 10) via the communication network 40. For example, the communication unit 306 receives recording setting information from the management device 10.

Furthermore, the management device 10 and the imaging device 30 may be implemented by a computer 50 having the hardware configuration illustrated in Figure 4.

Figure 4 illustrates the hardware configuration of computer 50.

The computer 50 illustrated in Figure 4 includes a processor 501, memory 502, storage device 503, reader 504, communication interface 506, and input/output interface 507, which are connected to each other via a data bus 508 to enable data transmission and reception.

The processor 501 may be a single processor, a multi-processor, or a multi-core processor. The processor 501 utilizes the memory 502 to execute a program (for example, a program describing the processing procedures described later), thereby functioning as the control unit 101 of the management device 10 or the control unit 301 of the imaging device 30.

The processor 501 may also be connected to a camera 511 and a GPS device 512. The camera 511 includes, for example, an image sensor such as a CCD or CMOS. The GPS device 512 includes a sensor for detecting the current position. When the imaging device 30 is implemented by the computer 50, the camera 511 and GPS device 512 may provide the functions of the imaging unit 302 and the current position detection unit 303. In this case, the camera 511 may be a 360-degree camera, a varifocal camera, or a normal camera. Note that GPS is an abbreviation for Global Positioning System. CCD is an abbreviation for Charge Coupled Device. CMOS is an abbreviation for Completeness Metal Oxide Semiconductor.

Memory 502 is, for example, a semiconductor memory, and includes a RAM area and a ROM area. RAM stands for Random Access Memory, and ROM stands for Read Only Memory.

The storage device 503 is, for example, a semiconductor memory such as a hard disk or flash memory, or an external storage device. When the management device 10 is implemented by the computer 50, the storage device 503 may provide the functions of the storage unit 102. When the imaging device 30 is implemented by the computer 50, the storage device 503 may provide the functions of the storage unit 305.

The reader 504 accesses the removable storage medium 505 according to instructions from the processor 501. The removable storage medium 505 can be implemented as, for example, a semiconductor device (such as a USB memory stick), a medium through which information is input/output via magnetic action (such as a magnetic disk), or a medium through which information is input/output via optical action (such as a CD-ROM or DVD). Note that USB is an abbreviation for Universal Serial Bus. CD is an abbreviation for Compact Disc. DVD is an abbreviation for Digital Versatile Disc.

The communication interface 506 communicates via various communication networks (e.g., communication network 40) according to instructions from the processor 501. When the management device 10 is implemented by the computer 50, the communication interface 506 may provide the functions of the communication unit 103. When the imaging device 30 is implemented by the computer 50, the communication interface 506 may provide the functions of the communication unit 306.

The input/output interface 507 provides interfaces with the input device 513 and the output device 514. The input device 513 includes keyboards, mouse devices, button switches, touch panels, etc. The output device 514 includes display devices, audio output devices, etc. If the imaging device 30 is implemented using the computer 50, the output device 514 may provide the functionality of the display unit 304.

The program executed by the processor 501 of the computer 50 is provided, for example, in the following form.
(1) It is pre-installed in the storage device 503.
(2) Provided by a removable storage medium 505.
(3) Provided from the program server via the communication network.

The hardware configuration of computer 50 is illustrative, and the embodiment is not limited thereto. For example, some parts of the configuration may be deleted, or new configurations may be added. Furthermore, for example, some or all of the functions of the above-described functional configuration may be implemented as hardware such as FPGA, SoC, ASIC, or PLD. FPGA stands for Field Programmable Gate Array. SoC stands for System-on-a-chip. ASIC stands for Application Specific Integrated Circuit. PLD stands for Programmable Logic Device.

Next, we will explain the processes performed in the monitoring system 1, focusing on those performed by the management device 10. Here, as an example, we will assume that the multiple vehicles 20 are taxis, trucks, buses, etc., operated by a vehicle operation company. Furthermore, we will assume that the monitoring area is a parking lot (including its surroundings) that serves as a waiting area for vehicles operated by the vehicle operation company.

Figure 5 is a flowchart illustrating the processing performed by the management device 10. Figure 6 is an example of vehicle information. Figure 7 is an example of parking lot information, which is the monitoring area information. Figure 8 is an example of parking schedule list information. Figure 9 is an example of vehicle 20 parking in the monitoring area parking lot. Figure 10 is an example of recording settings list information.

In the process illustrated in Figure 5, at S101, the control unit 101 (parking schedule determination unit 111) of the management device 10 determines the parking schedule (parking position and parking period) for each vehicle 20 in the parking area, which is the area to be monitored. This determination is made, for example, based on vehicle information and parking information stored in the storage unit 102 beforehand.

The vehicle information, as illustrated in Figure 6, includes the vehicle ID, vehicle registration number, type of mounted imaging device 30 (mounted camera type), and information regarding the ability to set the imaging range of the mounted imaging device 30 for each of the multiple vehicles 20. In the imaging range setting status, "○" indicates that the imaging range (imaging angle of view and imaging direction) can be set, "△" indicates that only the imaging angle of view can be set, and "×" indicates that the imaging range cannot be set. For example, if the imaging device 30 is a 360-degree camera, the imaging range setting status will be "○," if it is a varifocal camera, it will be "△," and if it is a normal camera, it will be "×." In the vehicle information illustrated in Figure 6, for example, vehicle 20 with vehicle ID "1" has a vehicle registration number of "xxx-xxxx," a mounted camera type of "360-degree camera," and an imaging range setting status of "○."

The parking information, as illustrated in Figure 7, includes information on the parking location number, priority level, and presence or absence of a charging device for each of the multiple vehicle parking locations within the parking lot. The priority number indicates the priority level; a smaller value indicates a higher priority, with "1" representing the highest priority. For example, the priority level may be set higher for vehicle parking locations that can record areas requiring high monitoring. In this case, areas not included in the field of view of pre-installed surveillance cameras in the parking lot (blind spots) may be considered areas requiring high monitoring. The charging device is a device that supplies power for charging to vehicle 20 if the vehicle 20 is an electric vehicle or the like. In the parking information illustrated in Figure 7, for example, vehicle parking location number "A1" indicates a priority level of "1" and the presence or absence of a charging device is "Yes".

In S101, the parking schedule (parking position and parking period) for each vehicle 20 in the parking lot is determined based on this vehicle information and parking lot information. In this determination, for example, the parking position and parking period for each vehicle 20 are determined so that the entire parking lot (including its surroundings) can always be imaged without blind spots by at least two or more imaging devices 30 mounted on each of the multiple vehicles 20. In this case, the parking positions of vehicles 20 equipped with imaging devices 30 capable of setting a wider imaging range may be determined to be higher priority vehicle parking positions. The parking position of each vehicle 20 in the parking lot is selected and determined from among multiple vehicle parking positions indicated in the parking lot information.

The parking schedule (parking location and parking period) for each vehicle 20 determined in S101 is stored in the storage unit 102 as parking schedule list information. As illustrated in Figure 8, the parking schedule list information includes information about the parking location, parking period, and operating period for each vehicle 20 for one day (from 0:00 to 0:00 the following day). In the parking schedule list information illustrated in Figure 8, for example, vehicle 20 with vehicle ID "1" is shown to be parked at parking location No. "A1" from 0:00 to 7:00, operating (moving outside the parking lot) from 7:00 to 21:00, and then parked at parking location No. "A4" from 21:00 to 0:00.

This parking schedule information is, for example, notified to the drivers of each vehicle 20 in advance, and each driver parks their vehicle 20 in the parking lot according to the parking schedule for the vehicle they are driving. As a result, for example, at 10 PM in the parking lot, as illustrated in Figure 9, vehicle 20 with vehicle ID "3" is parked at parking space No. "A1", vehicle 20 with vehicle ID "5" is parked at parking space No. "A2", vehicle 20 with vehicle ID "7" is parked at parking space No. "A3", and vehicle 20 with vehicle ID "1" is parked at parking space No. "A4". In the parking lot illustrated in Figure 9, vehicle parking spaces such as "A1" and "A2" are also vehicle parking spaces that can record areas that are blind spots of the surveillance cameras 60 pre-installed in the parking lot.

After S101 is completed, in S102, the control unit 101 (recording setting determination unit 112) determines the recording settings (including the setting of the imaging range and imaging period) for the imaging device 30 mounted on each vehicle 20. This determination is made, for example, based on vehicle information and the parking schedule (parking position and parking period) for each vehicle 20 determined in S101. In this determination, the parking period is set as the imaging period. Furthermore, for example, for imaging devices 30 with a variable imaging range (e.g., a 360-degree camera or a varifocal camera), the imaging range may be determined to be the widest possible imaging range, or, if monitoring is unnecessary in a part of the area around the parking position due to a wall or the like, the imaging range may be set to exclude that part.

The recording settings for the imaging devices 30 mounted on each vehicle 20, as determined in S102, are stored in the storage unit 102 as recording setting list information. As illustrated in Figure 10, the recording setting list information includes information for each vehicle 20, such as the vehicle ID, parking position No., the imaging period of the mounted imaging device 30, and the imaging range (imaging direction, imaging angle of view). Note that "Not configurable" for the imaging direction indicates that the imaging direction of the mounted imaging device 30 is not variable. Similarly, "Not configurable" for the imaging angle of view indicates that the imaging angle of the mounted imaging device 30 is not variable. In the recording setting list information illustrated in Figure 10, for example, the recording settings for the imaging device 30 mounted on vehicle 20 with vehicle ID "1" indicate that the imaging period is from 0:00 to 7:00 at parking position No. "A1" and from 21:00 to 0:00 at parking position No. "A4," and that the imaging direction and imaging angle of view during that period are omnidirectional, 360 degrees.

After S102 is completed, in S103, the communication unit 103 transmits the recording setting information for the imaging devices 30 mounted on each vehicle 20, as determined in S102, to the imaging devices 30 mounted on each vehicle 20. This transmits the recording setting information for each imaging device 30, for example, the recording setting information for imaging device 30A is transmitted to imaging device 30A, the recording setting information for imaging device 30B is transmitted to imaging device 30B, and so on.

When step S103 is completed, the process illustrated in Figure 5 is finished.

Meanwhile, in the imaging device 30 mounted on each vehicle 20, when the communication unit 306 receives recording setting information from the management device 10, the control unit 301 (recording control unit 311) controls the recording performed using the imaging unit 302 based on that recording setting information. More specifically, it controls the imaging unit 302 to perform imaging according to the recording settings (including the settings for the imaging range and imaging period) indicated by the recording setting information, and to store the generated video data in the storage unit 305.

In this way, the video data stored in the memory unit 305 of the imaging device 30 mounted on each vehicle 20 is transmitted from the imaging device 30 to the management device 10 in response to a request from the management device 10, and stored in the memory unit 102 of the management device 10. As a result, the management device 10 can obtain video data from the imaging device 30 mounted on each vehicle 20 that captures, for example, a full day's worth of footage of the entire parking lot (including its surroundings), which is the area to be monitored, without any blind spots. This video data enables monitoring of the target area, the parking lot (including its surroundings), allowing for confirmation of, for example, the presence of suspicious persons, suspicious vehicles, people involved in accidents or incidents (women, children, the elderly, etc.), and the presence of harmful animals.

As described above, according to this embodiment, monitoring can be performed by utilizing the imaging device 30 provided in each of the multiple vehicles 20.

In this embodiment, if the parking position of the vehicle 20 does not conform to the parking schedule, a warning display may be shown on the display unit 304 of the imaging device 30 mounted on the vehicle 20. Such a warning display may be shown, for example, when the location information of the vehicle's parking position during the parking period indicated in the parking schedule is compared with the location information detected by the current location detection unit 303 of the imaging device 30, and the two differ. This comparison may be performed by the imaging device 30 or by the management device 10. In the former case, for example, the location information of the vehicle's parking position during the parking period indicated in the parking schedule may be transmitted from the management device 10 to the imaging device 30 for comparison. In the latter case, for example, the location information detected by the current location detection unit 303 of the imaging device 30 may be transmitted from the imaging device 30 to the management device 10 for comparison, and the comparison result may be transmitted from the management device 10 to the imaging device 30.

Furthermore, in this embodiment, the vehicle 20 may be an autonomous vehicle. In this case, a parking schedule for the vehicle 20 may be registered in advance, and the vehicle 20 may autonomously park in a predetermined parking position for a predetermined parking period according to the parking schedule.

Furthermore, in this embodiment, the vehicle 20 may be a battery-powered vehicle. In this case, a charging device for charging the battery may be installed in vehicle parking positions with high priority. For example, as shown in the parking information illustrated in Figure 7, a charging device may be installed in vehicle parking positions with high priority, such as "1" to "4".

Furthermore, while the embodiment described an example in which a vehicle 20 was used as the mobile object, a drone capable of unmanned flight may also be used as the mobile object.

Furthermore, the embodiments described above also include the following embodiments of the program and the recording medium on which the program is stored.

Determine the stopping position and stopping period for each of the multiple moving objects within the monitoring area.
The recording settings of the imaging devices mounted on each of the aforementioned multiple moving bodies are determined.
Recording setting information relating to the recording settings of the imaging device mounted on each of the plurality of mobile bodies is transmitted to the imaging device mounted on each of the plurality of mobile bodies.
A program characterized by having a computer perform a process.

Although embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above, and various improvements and modifications are possible without departing from the spirit of the invention.

1 Monitoring System 10 Management Device 20 Vehicle 40 Communication Network 50 Computer 60 Surveillance Camera 101 Control Unit 102 Memory Unit 103 Communication Unit 111 Parking Schedule Determination Unit 112 Recording Setting Determination Unit 301 Control Unit 302 Imaging Unit 303 Current Location Detection Unit 304 Display Unit 305 Memory Unit 306 Communication Unit 311 Recording Control Unit 501 Processor 502 Memory 503 Storage Device 504 Reader 505 Removable Storage Medium 506 Communication Interface 507 Input/Output Interface 508 Data Bus 511 Camera 512 GPS Device 513 Input Device 514 Output Device

Claims (2)

A stop schedule determination unit that determines the stopping position and stopping period for each of multiple moving objects within the monitoring area,
A recording setting determination unit that determines the recording settings of the imaging device mounted on each of the plurality of moving bodies,
The system comprises a communication unit that transmits recording setting information relating to the recording settings of the imaging device mounted on each of the plurality of mobile bodies to the imaging device mounted on each of the plurality of mobile bodies ,
The aforementioned monitoring area includes multiple stopping positions for moving objects, with priority given to each location.
The stop schedule determination unit selects and determines the stopping position of each of the multiple moving objects in the monitoring area based on the priority order and the imaging range of the imaging device from among the multiple moving object stopping positions.
A control device characterized by the following features. Determine the stopping position and duration for each of the multiple moving objects within the monitoring area.
The recording settings of the imaging devices mounted on each of the aforementioned multiple mobile bodies are determined.
The recording setting information relating to the recording settings of the imaging device mounted on each of the plurality of moving bodies is transmitted to the imaging device mounted on each of the plurality of moving bodies.
The aforementioned monitoring area includes multiple stopping positions for moving objects, with priority given to each location.
The stopping position and stopping period for each of the multiple moving bodies are selected and determined from among the multiple moving body stopping positions based on the priority order and the imaging range of the imaging device.
A recording setup method characterized by having a computer perform the processing.