JP7124848B2 - Management device and management method - Google Patents

Description

The present invention relates to a management apparatus and management method for managing data of equipment associated with mobile bodies.

Patent Literature 1 discloses an image recording device, a so-called drive recorder, in which a camera is installed in a vehicle, and the surroundings of the vehicle are photographed when an event occurs, and the acquired image is verified after the fact. For example, when it is determined that the vehicle is traveling in a position where the object to be photographed is within the photographing range of the camera as an event occurrence, it is described that the object is photographed by the camera of the drive recorder.

In addition, in Patent Document 2, based on key information corresponding to the identifier and reservation information included in the access request requested from the administrator terminal, the acquisition target data that needs to be managed is specified, and the communication status and reservation information with the device are specified. A management server that communicates and transmits and receives target data corresponding to an access request is disclosed.

JP 2017-098865 A JP 2019-215869 A

However, in the technique disclosed in Patent Literature 1, image shooting settings are made based on a specific position where an object to be shot falls within the shooting range of a camera installed in a vehicle. It does not take into consideration the administrator's intentions regarding the use of the data and the purpose of using the data after shooting.

Further, in the technology disclosed in Patent Document 2, data that needs to be managed based on detection of various behaviors of a vehicle or the like is selected from data to be acquired, such as video, that is constantly stored in a storage unit in a drive recorder. Although it is possible to specify and store it in the management server, new data overwrites old data every moment when there is no vehicle behavior, and there is necessary data for that time period. Even in such a case, it is not possible to properly acquire the data to be used.

Therefore, in order to solve the above-described problems, the present invention provides a method for acquiring data stored in a device associated with a detection target according to detection conditions and operating conditions determined according to the purpose of data utilization. It is an object of the present invention to provide a management device and a management method that enable further data utilization because of the ability to operate.

The management device of the present invention uses specific data associated with the data to be detected in the management device for communicating with one or more devices and performing a desired operation associated with data stored in the device. a table storing detection conditions and operating conditions including information about an acquisition target area determined according to a purpose; a data processing unit that performs at least one of execution, control, and planning of a predetermined operation for specific data , wherein the table includes an area table that stores detection conditions for detecting the data; an operation setting table that stores an operation condition for specifying the specific data associated with the ID determined according to the purpose of use of the data, wherein the data processor satisfies the detection condition for the specific device; and performs data processing according to the operating conditions for the data, and the operation setting table stores at least entry of a detection target into the target area and/or Leaving is stored as a detection condition, and the data processing unit specifies the device with which communication is performed based on the position information of the detection target and the detection condition.

With this configuration, a device associated with a detection target that satisfies a detection condition and an operation condition according to the purpose of data utilization is specified, data such as video stored in the device is acquired, and a required predetermined operation is obtained. can be performed and/or planned.

According to the present invention, from among acquisition target data such as videos that are stored and overwritten in a storage unit in a device under the control of a plurality of users, data that is determined according to the administrator's purpose of use is selected. Data required for management can be specified based on the detection conditions and operating conditions, and processing such as data acquisition can be performed under desired operating conditions.

1 is a diagram showing a system configuration in the present disclosure; FIG. It is a block diagram which shows the functional structure of a management server. 3 is a diagram showing a specific example of an area table 102; FIG. 4 is a diagram showing a specific example of an area operation setting table 103; FIG. FIG. 10 is a diagram showing a specific example of an area detection record table 104; FIG. 4 is a diagram showing a specific example of a key information storage table 105; FIG. FIG. 10 is an explanatory diagram for explaining image clipping processing; FIG. 4 is a diagram for explaining the movement of the vehicle 200 and an image clipped at that time; FIG. 2 is a block diagram showing a functional configuration of a drive recorder 200a; FIG. FIG. 11 is a sequence diagram showing an operation when the administrator terminal 110 sets the area video operation for the management server 100; FIG. 4 is a sequence diagram of an operation (pattern 1) when the management server 100 acquires video from the drive recorder 200a; FIG. 10 is a sequence diagram showing operations when administrator terminal 110 sets area video operations for management server 100 and drive recorder 200a. FIG. 10 is a sequence diagram of an operation (pattern 2) when the management server 100 acquires video from the drive recorder 200a; FIG. 11 is a sequence diagram showing presetting processing in pattern 3; FIG. 10 is a sequence diagram of an operation (pattern 3) when the management server 100 acquires video from the drive recorder 200a; FIG. 11 is a sequence diagram of an operation (pattern 4) when the management server 100 acquires video from the drive recorder 200a; 4 is a diagram showing an example of a search screen of an administrator terminal 110; FIG. 2 is a hardware configuration diagram of a management server 100; FIG.

Embodiments of the present invention will be described with reference to the accompanying drawings. Where possible, the same parts are denoted by the same reference numerals, and overlapping descriptions are omitted.

FIG. 1 is a diagram showing the configuration of a video data management system captured by a drive recorder, which is the optimum embodiment of the present invention. As shown in FIG. 1 , the system of the present disclosure includes management server 100 and vehicle 200 . A vehicle 200 is a moving object such as an automobile or a train, and includes a plurality of devices. One of the plurality of devices has a drive recorder 200a as a device. The drive recorder 200a is a photographing device that photographs and stores still images or moving images within a predetermined range inside and outside the vehicle 200 as the vehicle 200 moves. Although the present embodiment exemplifies a drive recorder installed on a moving body such as a vehicle, it may be another detection target as long as it is a moving body, such as a ship or an aircraft. Alternatively, it may be a device (moving object) that can be wirelessly operated or autonomously moved, such as a drone. In the case of a drone or the like, the object to be photographed is not limited to the front or rear, and may be an image photographed in all directions of 360°.

Furthermore, the detection target is described as a device placed on a mobile object, but it is not limited to a mobile object. In that case, the detection target may be a person or other moving object, and the devices may be detected independently without coordinating the relative movement relationship of the devices. In addition, it is not limited only to the acquisition of video data, but also execution and execution of general operations assumed in future data processing, such as data acquisition and control, acquisition reservation, transfer to image analysis processing, and operation planning based on transfer results. Needless to say, it includes a plan including operation control at the video acquisition reserved time.

Management server 100 is a management server for managing data stored in drive recorder 200 a , which is one of the devices installed in each of vehicles 200 . The management server 100 acquires the video that satisfies the acquisition conditions set by the administrator terminal 110 from the drive recorder 200a.

It should be noted that the vehicle 200 is assumed to be, for example, a transportation vehicle used by a transportation company, a bus used by a bus company, or a business vehicle such as a taxi used by a taxi company. Used by businesses. The image to be grasped differs depending on the company/enterprise. In addition, the purpose of using the vehicle is not limited to business use. However, the vehicle for personal use may be, for example, a vehicle that has a contractual relationship with a parking lot or a vehicle that temporarily uses the parking lot. In short, the drive recorder 200a may be installed in a general personal drive recorder with the management program of the present invention (such as firmware including a management table in the drive recorder) to enable communication with the management server 100 side. Moreover, it is not limited to the drive recorder, and may be installed in a mobile object itself such as a drone, or may be installed in a device associated with a mobile object, that is, a device such as a smartphone owned by a person. Needless to say.

Next, the functional configuration of the management server 100 will be explained. FIG. 2 is a block diagram showing the functional configuration of the management server. As shown in FIG. 2, the management server 100 includes a data processing unit 101, an area table 102, an area operation setting table 103, an area detection recording table 104, an image key information storage table 105, an image data table 106 and a communication unit 107. consists of

The data processing unit 101 selects, from the video data stored in the drive recorder 200a, video data that satisfies the area operation conditions, which are acquisition conditions stored in the area operation setting table 103, to the drive recorder 200a via the communication unit 107. This part is obtained by communicating with For example, it does not take into account the acquisition of camera images at locations where accidents frequently occur. etc.), camera installation position/shooting direction, and vehicle entry/exit purpose.

The area table 102 is a table that stores information about an image acquisition target area, and consists of an area master area, an area area, and an area terminal setting area. A specific example is shown in FIG. FIG. 3(a) shows a specific example of the area master area. As shown in the figure, the area master area stores information in which the area master ID, the area master name, and the contents of the area master are associated with each other. The area master ID is an ID for distinguishing between areas that meet predetermined conditions defined as area masters. The area master name is the name of the area master. As for the contents of the area master, for example, the contents common to the area IDs associated with the area master IDs are described so that the administrator and the user who set the area master later can confirm the contents. As will be described later, the area master is, for example, a large area that bundles and manages geographically small areas, and is composed of at least one or more areas.

Note that the area master here does not necessarily have to be inclusive of the configured area. An area master ID may be associated with a plurality of area IDs. Specifically, for example, for each managed object such as a toll road or train route, a bus route station or interchange, a bridge, a branch point, or a bus stop, an area image is displayed for the purpose of watching the safety of getting on and off of vehicles and people. In order to acquire data, an area master ID may be assigned to each route, and an area ID may be assigned to each station or bus stop on the route and associated with each other.

It goes without saying that the area master ID and the area ID are not necessarily one-to-many, and may be managed in many-to-one or many-to-many depending on the purpose of use of video data captured in the target area. stomach. The point is that the area ID and area master ID can be used flexibly in order for the administrator to acquire the necessary video data, etc., and in particular, it is used to enable efficient settings when setting search conditions. It goes without saying that In addition, it goes without saying that in an area area described later, it is possible to collectively set and change operating conditions for a plurality of area IDs using an area master ID.

FIG. 3(b) shows a specific example of the area region. As shown in the figure, the area area stores information that associates an area master ID, an area ID, an area name, and an area range. An area master contains multiple areas. Area ID is an ID for identifying an area. The area name is the name of the area. The area range is information that defines the range, and is defined by coordinate information such as GPS information, for example.

In addition to coordinate information that can be specified as an absolute position, position information specified by combining other information as a relative position may be used. In addition, in the present embodiment, the area is literally defined and explained with the position information as the starting point, but it is not necessarily limited to this, and the position at the time of change with some information to be detected as the starting point In addition to specifying an area using information, the detection range may be flexibly determined according to the purpose of data use, and defined by indirectly derived position information at the time of detection.

Specifically, as described in Patent Document 2, data is acquired in advance from other devices such as dangerous behavior, caution behavior, railroad crossing and temporary stop behavior at a stop position, signal ignoring behavior, and speeding behavior. Needless to say, an area in which the safety of a vehicle should be more considered may be set autonomously or dominantly by an administrator, and used for the area detection of the present invention to be used for the safety of other vehicles. stomach.

In addition, maintenance event data of the vehicle itself, changes in data related to surrounding vehicles such as tailgating and traffic jams, crosswinds and road freezes, obstacles on roads and routes, which are not specified in the event video acquisition patent of Patent Document 2 Objects are detected based on the analysis results of forward images, and detected based on the results of comparative analysis of front and rear images from snowplows and cleaning vehicles. Needless to say, it can be used for area detection and used for safety of other vehicles.

FIG. 3(c) shows an area terminal setting area. As shown in the figure, the area terminal setting area stores information that associates device IDs with area IDs. A device ID is an ID for identifying the drive recorder 200a or the like. This information may be used to acquire the image of the drive recorder 200a indicated by the device ID when the vehicle enters the area of the area ID.

In addition, although it will be described again, the embodiment of the present invention is described as a drive recorder, but it is not necessarily limited to a drive recorder installed in a vehicle or the like. In addition, it may be a device associated with a device that can be wirelessly operated or autonomously moved such as a drone, such as a ship or aircraft, or a device such as a mobile terminal or smartphone possessed by a person, not necessarily connected to a camera. Needless to say, it is not limited to the equipment that is used. In addition, for example, for the purpose of animal protection and breeding, a small device attached to a collar or belt may be used to acquire images viewed from the pet side, or to manage position information. Needless to say.

In addition, it may be a device fixedly installed at a specific location, such as a fixed camera or an environment sensor other than a moving object. It goes without saying that

The area table 102 may store a plurality of areas (area IDs) that match the purpose of using the video in association with the area master ID. Area operation conditions in the area operation setting table 103 may be defined for each area master ID. This makes it possible to define area operating conditions for a plurality of areas using a single ID called area master ID. For example, assume that an area master ID is associated with a plurality of areas including bridges. By associating the area master ID with the area operating conditions, it is possible to obtain an image for collectively observing aged deterioration of a bridge or the like.

The area operation setting table 103 is a part that stores area operation conditions, which are conditions for acquiring images shot by the drive recorder 200a. FIG. 4 is a diagram showing a specific example of the area operation setting table 103. As shown in FIG. As shown in the figure, the area operation setting table 103 includes an area ID, operation timing, image upload (operation type), target camera, image clipping time, number of image uploads (upper limit number of operations), detection speed band, detection temperature band and It stores information associated with management notifications and the like. The area ID in the area operation setting table 103 corresponds to the detection condition, and the operation timing, image upload, target camera, image clipping time, image upload count, detection speed range, detection temperature range, and management notification correspond to the operation condition. . Among them, the video clipping time corresponds to the operation reservation information. In addition, although not exemplified here, the time (detection time or operation time) at which the video is acquired, that is, the operation reservation information may be information related to some time. For example, in order to operate a fixed camera periodically, various sensors detect traffic volume, typhoon, and heavy rain, and operate it during the time period detected by the sensor. Images may be used to prevent traffic accidents and disasters based on the detection results assumed by data processing, such as operating during the time period in which video analysis results that cause traffic accidents and disasters are detected. The use of images depends on the purpose of use, and various uses may be assumed, and the state information to be detected may include a wide range of sensor information related to the vehicle, such as vehicle speed.

As mentioned above, the area ID may be the area master ID, or the operation should be set in at least one item. can of course be set.

This area operation setting table 103 is set from the administrator terminal 110, and sets operation conditions according to the purpose of use of the video that the administrator intends to acquire.

Here, the operation timing will be described with reference to FIG. 7, which will be described later with regard to the video clipping process. It is possible to cut out an image for a predetermined time starting from when the vehicle 200 entered the specified range (area IN), cut out an image starting from the time when the vehicle 200 left the specified range and go back a predetermined time (area OUT), or It indicates whether the image is cut out from the area until the area exits (area IN-OUT).

In order to facilitate understanding of the present invention, the above operation timing is explained as an example of an area, but it is not necessarily limited to an area. It may be a detection criterion according to the purpose of use of the data such as the desired image. For example, it detects changes in maintenance event data of the vehicle itself, which is not specified in the event video acquisition patent of Patent Document 2, or detects changes in data related to the distance to the rear vehicle such as tailgating or traffic congestion. Detect crosswinds, frozen roads, obstacles on roads and navigation routes based on analysis results of front images, detect snowplow vehicles and cleaning vehicles based on comparison analysis results of front and rear images, etc. It goes without saying that it may be a change in data that can be detected by a mobile object such as the mobile object itself or a device associated with the mobile object. In that case, another condition table should be provided in the same manner as the tables called area master area, area area, and area terminal setting area, and the condition name and the range satisfying the condition, which are determined by other information instead of the location information, should be set. The detection conditions based on the information of the target to be detected will be described later, but it goes without saying that the detection conditions may be determined by other information instead of the positional information.

Image uploading is performed by a method of acquiring images in response to a request (including an acquisition request, an access request, and an acquisition reservation) from the administrator of the management server 100, or by automatically acquiring images by the management server 100. set. This video UPLOAD is used to determine whether or not the video is to be acquired immediately. Here, too, the explanation will focus on uploading video data, but it is not necessarily limited to video data. Needless to say, the target device may be operated by DOWNLOAD of the prescribed control signal. In the automatic processing, regardless of whether it is the management server or the drive recorder that determines the detection and operating conditions to be described later, the video data is immediately transmitted from the drive recorder 200a according to the setting of the video UPLOAD, and the management server 100 In addition to acquiring images, the management server 100 automatically acquires images when an event such as a dangerous behavior is detected, when an image acquisition reservation has been made, such as when communication with the drive recorder 200a is not possible. Needless to say.

The target camera indicates the type of camera from which images are to be obtained, for example, the image of the front camera, the image of the indoor camera, or the images of both cameras. Needless to say, the cameras are not limited to the front or indoors, and any number of cameras can be installed in any direction and in any position inside or outside the room, and the rear cameras may be included. In that case, it is possible to adopt a method of acquiring images of the rear camera or camera-equipped rearview mirror outside the vehicle via a control device managed by the vehicle, and communication with related equipment (camera in this case). need only be connected by some means such as proximity communication, and needless to say, is not limited in any way. In the case of images, information specifying the target camera is useful. Needless to say, it is also possible to detect that the wheel of the vehicle is punctured and provide it as useful information to a manager or the like. This is merely an example, and it goes without saying that vehicle abnormality information can enable the acquisition and detection of various image data particularly in relation to safe driving.

The video clipping time indicates the clipping time of the video to be acquired. The clipped video is clipped with the operation timing as a starting point. "Area ALL" may be set in this column. When "Area ALL" is set and the operation timing is set to "Area IN/OUT", the image from when the vehicle 200 enters the target area for image acquisition until it leaves is shown. Indicates to be clipped.

In either case, for example, in order to reliably acquire video scenes that are essential for the purpose of using the video data, the clipping of the video is started and ended several seconds before or after the operation timing. It goes without saying that this is also a good thing.

The number of video uploads indicates the upper limit of the number of video uploads in one day. This is set because there is no point in uploading many times a day when looking at deterioration over time such as roads. In addition, when viewing aging deterioration of roads, tunnel walls, ceilings, bridges, etc., it may be necessary to obtain a single image with a higher resolution than the number of times the image is acquired. Depending on the installation position and specifications of the camera, for example, in the case of the ceiling, wall, and road, it is installed outside the vehicle facing upward, sideways, and downward, and the imaging range of the camera is moved in parallel with the direction of movement of the vehicle. Needless to say, various operating conditions are conceivable, such as reducing the dynamic speed of the image or adopting a shooting method (zoom-in shooting) that improves the resolution.

The detected speed band indicates the moving speed of the vehicle 200, which is a condition for obtaining an image. An image of the vehicle 200 moving within the speed range set here is acquired, and an image of the vehicle 200 moving at a speed other than the speed range is not acquired. It should be noted that, as explained in the modification above, it is not necessarily limited to detecting the moving speed of a device that moves together with a moving object such as a person or a vehicle. In addition to vehicles, aircraft such as drones, ships, and other devices associated with moving objects can detect the speed of moving objects. It goes without saying that you can.

The detection temperature range is, for example, one of the conditions for monitoring the effects on the object to be photographed, such as food or animals placed on a vehicle or cargo bed during transportation by a mobile body, or for the purpose of safe driving of the vehicle, the engine, radiator, etc. A temperature range for setting some operating conditions is shown, and the conditions need not necessarily be set. In the above example, it is needless to say that the temperature range that is the operating condition is different for each object to be monitored, such as food, animals, engines, radiators, etc., and it is limited to acquiring images shot in the set temperature range. It goes without saying that this is not the case.

The administrator notification is indicated by ON/OFF, and is set whether or not to notify the administrator when the image is acquired. Administrator notifications are sent based on the purpose of use, such as distinguishing devices and data that meet the operating conditions with the highest priority, such as when you want to send images all at once or when there are many areas to be acquired. Whether it is present or not is set.

The area detection record table 104 stores area detection information acquired from the drive recorder 200a, a moving object such as a vehicle to be detected, or a device such as a fixed camera installed in the area. FIG. 5 shows a specific example of the area detection record table 104. As shown in FIG. As shown in the figure, the area detection record table 104 stores the device ID, area ID (or area master ID, if necessary), area IN date and time (or area OUT date and time, if necessary), speed, and temperature. Remember. The device ID is the ID of the drive recorder 200a that captured the image. The area ID is the ID of the area where the image was taken. The area IN date and time is the date and time when the vehicle 200 entered the area. The speed is the speed of the vehicle 200 at the time of photographing. The temperature is the temperature at the time of shooting by the drive recorder 200a. These pieces of information are information about the area at the time of shooting or state information of the vehicle 200 .

The image key information storage table 105 is a table that stores key information for searching images to be acquired, which is acquired from the drive recorder 200a. FIG. 6 is a diagram showing a specific example thereof. The image key information storage table 105 is stored by the data processing unit 101 in the area detection information (area detection record table 104) device ID, area ID, area IN date/time (or area OUT date/time), speed, temperature, and image acquisition information. The presence/absence is generated in association with the video ID of the clipped video. Also, the organization ID and driver ID are taken out based on a driver DB (not shown) or recorded in an external memory as information detected by an IC card reader before driving. These pieces of information are associated with device IDs, and the device IDs are associated with vehicles. The driving area is derived from an area DB (not shown) and an area ID. The administrator terminal 110 can use this video key information storage table 105 to search for videos using video keys. As with the event video data, it goes without saying that if the administrator wishes to obtain later the video to which the video key has been assigned, the administrator will receive an access request using this video key and transmit the target video data file.

The image data table 106 is a table that stores images captured by the drive recorder 200a. The image data table 106 stores image IDs and image data in association with each other. A video ID is assigned when a video is acquired in the management server 100 . The video data table 106 is linked with the video key information storage table 105 by the video ID.

The communication unit 107 is a part that communicates with the drive recorder 200a.

Next, the functional configuration of the drive recorder 200a of the present disclosure is shown. FIG. 9 is a block diagram showing the functional configuration of the drive recorder 200a. As shown in the figure, the drive recorder 200a includes a communication module 201, a GPS module 202, an IC card reader 203, a recording unit 204, a camera 205, a camera 206, a microphone 207, a speaker 208, a display unit 209, a G sensor 210, and a control unit. 211 , various behavior detection units 212 , power/ignition input units 213 , vehicle data input units 214 , and I/O input units 215 .

The communication module 201 is a part that communicates with the management server 100, and performs communication using a mobile communication network, for example.

The GPS module 202 is a part that performs positioning. In addition, as a configuration for performing positioning, depending on the surface area of the target area (GPS for a space with good visibility in a macro area, positioning sensor for a space with poor visibility in a micro area) In addition to GPS, proximity communication may be performed with various sensors to specify a relative position.

An IC card reader 203 is a part that reads an IC card.

A recording unit 204 is a portion that records information in an external memory such as an SD card. In the present disclosure, images captured by cameras 205 and 206 are recorded by recording unit 204 in an external memory such as an SD card. The recording unit 204 records the location information of the vehicle 200 at that time along with the video. In addition, in patterns 2 to 4, which will be described later, various tables corresponding to the area table 102, the area operation setting table 103, and the area detection recording table 104 are stored in the external memory.

A camera 205 and a camera 206 are parts for capturing images. Take still or moving images. Camera 205 captures the traveling direction of vehicle 200 , and camera 206 captures the interior of vehicle 200 . In addition, a rear camera for photographing the rear of the vehicle may be provided. It should be noted that the installation positions and the number of cameras are not limited to those shown in the drawings and embodiments, nor are they limited to the front or indoors, and any number of cameras can be installed in any direction and in any position inside or outside the room. Yes, it goes without saying that a rear camera could be included. In that case, it is possible to adopt a method of acquiring images of the rear camera or camera-equipped rearview mirror outside the vehicle via a control device managed by the vehicle, and communication with related equipment (camera in this case). need only be connected by some means such as proximity communication, and needless to say, is not limited in any way.

A microphone 207 and a speaker 208 are parts for inputting sound and outputting sound.

The display unit 209 is a portion that displays setting information for the drive recorder 200a.

The G sensor 210 is a sensor that detects weight.

The control section 211 is a section that controls the communication module 201 to the I/O input section 215 .

The various behavior detection unit 212 is a part that detects various behaviors of the vehicle 200 . For example, the various behavior detection units 212 detect various states based on position information measured by the GPS module 202, weight information detected by the G sensor 210, and the vehicle speed pulse and temperature input from the vehicle data input unit 214. This is the part to do. For example, in patterns 2 to 4, which will be described later, the vehicle 200 enters or leaves a predetermined area, or its state (information about the vehicle itself such as speed and angular velocity of the steering wheel, surrounding environment of the vehicle such as temperature, etc.) (such as information about

The power/ignition input unit 213 is an input unit for supplying power to the drive recorder 200a.

A vehicle data input unit 214 is a portion for inputting vehicle data such as a vehicle speed pulse. For example, the temperature is measured by a temperature sensor (not shown) and input via the vehicle data input unit 214 .

The I/O input section 215 is an interface section for external devices. Therefore, it goes without saying that the information about various sensors mounted on the vehicle may be obtained by communicating with the vehicle control device or the like.

The operations of the management server 100 and the drive recorder 200a thus configured will be described. FIG. 10 is a sequence diagram showing operations when the administrator terminal 110 sets an area table, which is an area definition and video acquisition conditions, to the management server 100 .

The administrator terminal 110 transmits information to the management server 100 by inputting information for creating an area master (including area information and area terminal setting information) according to the operation by the administrator (S11). The management server 100 stores area master information in the area table 102 . In addition, the manager terminal 110 sets the area operation conditions according to the operation by the manager and transmits them to the management server 100 (S12). In the management server 100 , the data processing unit 101 stores the received area operation conditions in the area operation setting table 103 . In addition, although the explanation in this embodiment has been given as an example in which the administrator sets the dominant operating condition, the present invention is not limited to this, and the operation setting is autonomously set according to the information of the detection target. It is also possible to make it work.

Specifically, as described in Patent Document 2, data is acquired in advance from other devices such as dangerous behavior, caution behavior, railroad crossing and temporary stop behavior at a stop position, signal ignoring behavior, and speeding behavior. Needless to say, an area in which the safety of a vehicle should be more considered may be set autonomously or dominantly by an administrator, and used for the area detection of the present invention to be used for the safety of other vehicles. stomach. In addition, maintenance event data of the vehicle itself, changes in data related to surrounding vehicles such as tailgating and traffic jams, crosswinds and road freezes, obstacles on roads and routes, which are not specified in the event video acquisition patent of Patent Document 2 Objects are detected based on the analysis results of front images, and detected based on the results of comparative analysis of front and rear images of snowplows and cleaning vehicles, and the detected positional information is indirectly set as an area. , area detection, and may be used for the safety of other vehicles.

The area master information and the like are set by the administrator, for example, based on the shooting location of the desired image among the images of the drive recorder 200a. Examples of locations where images to be acquired include intersections where many accidents occur and school zones where many complaints are made. In addition, in order to investigate aged deterioration of roads, bridges, tunnels, etc., such places may be defined as acquisition target areas.

In addition, for railway operators, in order to check the conditions of forests and rivers along the railway line, drive recorders 200a are installed on the trains to check the track and other facilities along the track, and to check the flooding of the river. Such areas may be defined.

In addition, for nursing care providers, their users, and their families, in order to judge whether the users are being treated appropriately, pick-up locations, etc. are set as acquisition target areas, and camera types are indoor cameras, rear cameras, and pick-up locations. It may be a fixed camera or the like installed in the .

It can also be applied to the transportation business of pets and racehorses, and it is possible to determine whether loading, unloading, and transportation are handled appropriately by defining the cargo bed at the loading location and transportation time as an acquisition target area. Also, by defining an arbitrary area on the transport route, it is possible to see whether the transport is being carried out appropriately from the perspective of the pet, not the vehicle, such as sharp curves and steep slopes.

In addition, for snowfall operators, area setting for grasping the situation of the site and work progress, area setting for traffic congestion prediction for expressway operators, and general loading and unloading work of transportation operators area setting (and indoor camera) for carrier check (empty space confirmation).

In addition, accident-prone locations, bridges, tunnels, and other locations prone to deterioration over time may be extracted from, for example, a separately prepared map database, and automatically defined based on the location information. For example, locations where accidents frequently occur are stored in a database by the police or the like, and the area can be defined by using the database. In addition, the age of bridges and tunnels is also stored in a database by government offices, etc., and information on bridges that have passed a predetermined age may be taken out and an area may be defined based on the position thereof.

Next, the operation when the management server 100 acquires video from the drive recorder 200a will be described. FIG. 11 is a sequence diagram showing a specific example (pattern 1) of the operation.

In the drive recorder 200a, when the engine of the vehicle 200 is started and power is supplied, the GPS module 202 starts acquiring position information (S201). In addition, the cameras 205 and 206 start capturing images, and the recording unit 204 starts recording images (S202). The recorded video is recorded in an external memory such as an SD card by the recording unit 204 . The communication module 201 transmits position information to the management server 100 at predetermined intervals (S203). In addition to this position information, state information including sensor information such as vehicle speed, event detection video information, and temperature installed in various vehicles may be transmitted.

In the management server 100, the data processing unit 101 acquires position information from the drive recorder 200a via the communication unit 107, and stores the device ID, position information, and time of the drive recorder 200a in a position information buffer (not shown). Store (S101). The data processing unit 101 refers to the acquired position information and the area table 102 to determine whether the vehicle has entered and/or exited the image acquisition target area (S102). It can be determined that the vehicle 200 has entered the area when the position information within the area is received after receiving the position information outside the area. Conversely, after it is determined that the vehicle 200 has entered the area, it can be determined that the vehicle 200 has left the area when position information outside the area is received.

When it is determined that the user has entered and/or exited the acquisition target area (S102: Enter/Exit), the data processing unit 101 acquires the corresponding area ID from the area table 102 . The data processing unit 101 refers to the area operation setting table 103 and determines whether or not the state information such as the vehicle speed received together with the position information matches the area operation conditions associated with the area ( S103). That is, the data processing unit 101 determines whether or not the state information of the vehicle 200 satisfies the area operating conditions (state information such as a predetermined vehicle speed and a predetermined temperature). Also, it is determined whether or not the number of video uploads has reached the upper limit. Whether or not the upper limit of the number of video uploads has been reached is determined based on the number of times the vehicle 200 has entered or left the area. For example, in S102, the number of times of entering or leaving each area is stored. The vehicle 200 of the drive recorder 200a that transmits the video may be the same or different. This area operation condition is an acquisition condition corresponding to the area ID defined in the area operation setting table 103 .

The data processing unit 101 further determines whether or not the image that satisfies these area operation conditions is to be acquired immediately (S104). That is, the data processing unit 101 refers to the area operation setting table 103, and if the image UPLOAD information is set to be automatic, determines that the image is to be acquired immediately, and performs immediate acquisition processing.

Then, when it is determined that the image is to be acquired immediately, the data processing unit 101 transmits an image acquisition command to the drive recorder 200a (S105). This video acquisition command includes operation timing (timing of entering or exiting an area, etc.) and video clipping time. The operation timing and the video clipping time are extracted from the operation condition corresponding to the area ID obtained in S102 in the area operation setting table 103. FIG.

In the drive recorder 200a, the control unit 211 performs video clipping processing based on the video acquisition command, and transmits the clipped video together with the device ID to the management server 100 (S204). Positional information and the like are recorded at predetermined timings in the video captured by the drive recorder 200a. The control unit 211 performs clipping processing of the video recorded in the external memory based on the operation timing and the video clipping time included in the video acquisition command.

In the management server 100, the data processing unit 101 assigns a video ID to the video transmitted from the drive recorder 200a and stores it in the video data table 106 (S106). The data processing unit 101 also stores the device ID sent together with the video in the area detection recording table 104 in association with the area ID, area IN date and time, speed, and temperature (S106). The data processing unit 101 also extracts the key information for the image key information storage table 105 from the area detection recording table 104 or the like, and stores it in the image key information storage table 105 in association with the image ID of the previously acquired image. (S106). Then, the data processing unit 101 determines whether or not administrator notification is necessary (S107). Whether or not there is an administrator notification is set in the area operation setting table 103 .

If it is determined that it is necessary here, the data processing unit 101 performs notification processing to the effect that the image has been acquired to the administrator terminal 110 (S107: Yes). If it is not necessary, the process ends and waits for the next position information.

In the above step S104, if the immediate image acquisition is "No", the data processing unit 101 acquires the area detection information from the drive recorder 200a without acquiring the image, and the area detection recording table 104 and A video key information storage table 105 is generated. At that time, the data processing unit 101, similarly to the video acquisition data including key information related to the event video disclosed in Patent Document 2, stores the video ID when the administrator makes an access request or at the date and time set by the operating conditions. Give. Along with the periodic transmission of position information, information indicating that the image corresponding to the image ID has not yet been acquired is transmitted to the management server.

If "No" in each of steps S102 and S103, the process is terminated.

Here, the video clipping processing S204 will be described. FIG. 7 is an explanatory diagram for explaining the relationship between operation timing and video clipping processing. As shown in the figure, vehicle 200 is assumed to move from area IN to area OUT. Here, in the area operation command (S105) in FIG. 13, if it is specified to cut back from area IN shown in FIG. 4, for example, operation timing: area IN, video cutout time: 10 seconds If so, the control unit 211 cuts out the video from the time 10 seconds before the detection time of the area IN to the detection time of the area IN from the video stored in the external memory every moment. It is desirable that the management server 100 and the drive recorder 200a are managed using the same time by GPS time correction or the like so that there is no discrepancy between the internal times. In addition, it goes without saying that taking into consideration the control delay and the time lag of the detection time, the image of the time before or after x seconds may be cut out. Needless to say, the time is not limited to 10 seconds, and can be arbitrarily determined by an administrator or the like.

As with the event video, the video is recorded in the recording unit 204 of the drive recorder 200a moment by moment, including at least the position information at the detection time. Therefore, the control unit 211 specifies the video clipping time zone from the time when entry into and/or exit from the area is detected from the position information stored in S101 and the video clipping time set in the area operation setting table, It is possible to cut out a video of a specified time period from the video that is recorded moment by moment. In addition, the drive recorder 200a periodically receives a signal for specifying a position from a GPS, a sensor, or the like, and is capable of associating the position information with the image information. Needless to say, it is possible to guess the image traced back to the position to be assumed based on known position information, and cut out the image based on a plurality of pieces of position information.

Note that there is more than one operation timing. It is set by the administrator according to the purpose of use of the image to be acquired. For example, when it is desired to see the driving situation of the driver, the appropriate timing is good. For example, it is an image at the timing of area IN or area OUT. When looking at aging deterioration of a road or the like, an image from area IN to area OUT is preferable. In addition, as explained above, the detection criterion is not limited to the area, and it goes without saying that the detection criterion may be some information to be detected, for example, the timing at which the driver's dozing or distraction detected as an event image is detected. stomach. At that time, it is needless to say that environmental information (for example, vehicle speed, distance from front and rear vehicles, etc.) around the vehicle that caused the driver to fall asleep may be acquired together with the image.

Further, in the area operation command, when it is specified to clip backward from the area OUT, for example, when the operation timing: area OUT and the image clipping time: 10 seconds are specified, the control unit 211 A video is cut out from the video recorded every second in the recording unit 204 of the drive recorder 200a from the time 10 seconds before the detection time of the area OUT to the detection time of the area OUT. The extraction position is specified in the same manner as described above.

In this case as well, it is needless to say that an image of a time before or after x seconds may be further cut out in consideration of the control delay and the time lag of the detection time.

Also, if the area operation command designates that the video of all areas from area IN to area OUT is to be clipped, that is, operation timing: area IN/OUT, video clipping time: area ALL. In this case, the control unit 211 refers to the storage time of the video stored in the external memory every moment, and cuts out the video over the entire area from the area IN to the area OUT. Note that if the area operation setting table 103 specifies operation timing: area IN/OUT and video clipping time: 15 seconds, the data processing unit 101 sets the time 15 seconds before the timing when the area IN is detected. to the time when the area IN is detected, and from the time 15 seconds before the time when the area OUT is detected to the time when the area OUT is detected. An area operation instruction is generated for synthesizing with the video data. Needless to say, each video ID may be assigned and managed without combining.

In this way, the video just before entering the area, the video just before leaving the area, or the video while passing through the area can be cut out. As described above, the length of the video to be clipped may be set to a fixed number of seconds, or the number of seconds to be clipped may be set according to the running speed or the like. For example, it may be set to 10 seconds up to 30 km/h and 5 seconds up to 60 km/h. Depending on the purpose of use of the video, the faster the speed, the shorter the clipped video. Alternatively, it may be dynamically set by the difference in seconds between the area OUT time and the area IN time. These clipping time determination methods are set in the video clipping time of the area operation setting table 103, and the clipping time is calculated based thereon. In addition, it goes without saying that the clipping time may be determined based on various information in order to reliably acquire the video scene that is indispensable for the purpose of using the video data.

FIG. 8 is a diagram for explaining the movement of the vehicle 200 and an image clipped at that time. FIG. 8(a) shows an image traced back from area IN and an image traced back from area OUT. Here, the image captured by the indoor camera 206 of the drive recorder 200a is specified as an acquisition target.

As shown in the figure, when the site of a factory or the like is set as the area and the camera is set as an indoor camera, the management server 100 acquires the image of the driver when the vehicle 200 enters the site from the roadway. be able to. Similarly, the management server 100 can acquire an image of the driver when the vehicle 200 leaves the site. By acquiring images in this way, it is possible to grasp the driving situation of the driver.

In addition, as shown in FIG. 8B, an image may be acquired in order to comprehend the aged deterioration state of the road. In FIG. 8B, a bridge is specified as an area, and the front camera 205 is set as a camera for image acquisition. In FIG. 8B, the management server 100 can acquire the video of the entire area from area IN to area OUT.

These video clipping processes can be similarly applied to modified examples (patterns 2 to 4) described later.

Next, the operation of the modified example of the management server 100 and the drive recorder 200a according to the present disclosure will be described. 12 and 13 are sequence diagrams showing processing in the modification (pattern 2). The process in pattern 2 differs from the process in pattern 1 in that the drive recorder 200a detects area entry/exit and transmits area detection information to the management server 100 based on the detected area entry/exit. Therefore, the area master definition process is performed for the drive recorder 200a. Here, description will be made focusing on different processing.

In FIG. 12, the administrator terminal 110 performs area master creation and area operating condition setting processing (S11, S12). The management server 100 stores the area operation conditions in the area operation setting table 103 (S13).

Also, in the management server 100, the data processing unit 101 transmits to the drive recorder 200a an instruction to write the area master information acquired by creating the area master (S14).

In the drive recorder 200a, the control unit 211 stores the area master information in the external memory by the recording unit 204 (S21). The external memory has a table equivalent to the area table 102 and stores area information.

In this way, the drive recorder 200a stores the area information indicating the image acquisition target area, and can transmit the area detection information to the management server 100 when entering and/or leaving the acquisition target area. can. The area detection information includes device ID, area ID, area IN date/time (or area OUT date/time), speed, temperature, and the like.

Next, the image acquisition processing shown in pattern 2 will be described with reference to FIG. 13 . Note that step S203a is a process corresponding to S102 in FIG. 11, and the contents of the process are the same. In the drive recorder 200a, position information acquisition and video recording are started (S201, S202). It is determined whether the area is included in the range (corresponding to the area table 102) (S203a). When the position information is determined to be included in the range, the control unit 211 transmits area detection information to the management server 100 via the communication module 201 (S203b). The area detection information includes device ID, area ID, area IN date/time (or area OUT date/time), vehicle speed, and temperature. Needless to say, position information is not limited to GPS as in pattern 1.

In the management server 100, the data processing unit 101 determines whether the state information (speed, temperature, etc.) of the area detection information satisfies the area operation condition corresponding to the area ID defined in the area operation setting table 103. (S103). Then, when the data processing unit 101 determines that the area operation condition is satisfied and the condition for immediate image acquisition is satisfied, the data processing unit 101 transmits an area operation command to the drive recorder 200a (S105). Thereafter, the processes of S106 to S107 and S204 are performed.

In this manner, the drive recorder 200a automatically detects entry into and/or exit from a predetermined image acquisition target area, and transmits area detection information indicating it to the management server 100. can be sent to In the drive recorder 200a, there is no need to periodically transmit position information for area determination in order to perform area determination on the management server side, and the management server 100 receives a notification when it enters the target area. , the load of image acquisition processing can be reduced.

Next, pattern 3 in the image acquisition process will be described. In pattern 3, the drive recorder 200a further determines whether or not the video satisfies the acquisition conditions.

FIG. 14 is a sequence diagram showing presetting processing in pattern 3. As shown in FIG. As shown in FIG. 14, when management server 100 receives area master information and area operating conditions from administrator terminal 110 (S11 and S12), management server 100 issues an instruction to write area master information and area operating conditions to drive recorder 200a. Send. In the drive recorder 200a, the communication module 201 receives the data, and the control unit 211 stores it in the recording unit 204 such as an external memory (S21a). Information corresponding to the area table 102 and the area operation setting table 103 is stored in the external memory. This enables the drive recorder 200a to detect areas and determine area operation conditions.

In addition, in the management server 100, all of the area operation conditions may be stored, and image UPLOAD information included in the area operation conditions (indicating manual acquisition or automatic ) may be stored.

Next, specific processing in pattern 3 will be described. FIG. 15 is a sequence diagram showing the process. As shown in the figure, steps S203a and S203b in the drive recorder 200a are different processes. Therefore, a description focusing on this process will be given. Note that steps S203a to S203c are processes corresponding to steps S102 to S103 in FIG. 11, and the contents of the processes are the same.

In the drive recorder 200a, position information acquisition and video recording are started (S201-S202), and various behavior detectors 212 detect entry into or exit from the area (S203a). The control unit 211 acquires area detection information including the area ID of the detected area, the area IN date and time (or area OUT date and time if necessary), and other state information such as vehicle speed and temperature.

Based on the area detection information, the control unit 211 determines whether or not the area operating conditions stored in the external memory are satisfied (S203c). If not satisfied, the process ends. If the conditions are satisfied, the control unit 211 transmits area detection information via the communication module 201 (S203b).

In the management server 100, when the data processing unit 101 receives the area image detection information, it determines whether the area is subject to immediate image acquisition based on the area ID, and requests image acquisition (S105). , image data storage processing, image key information storage table 105 generation (S106), and administrator notification processing (S107).

This enables the drive recorder 200a to detect areas and determine area operation conditions.

Next, the process of pattern 4 will be described. FIG. 16 is a sequence diagram showing the operation of pattern 4. As shown in FIG. In pattern 4, the presets shown in FIG. 14 are made. This pattern 4 is different from pattern 3 in that step S203d is performed in the drive recorder 200a.

In the drive recorder 200a, information corresponding to the area table 102 and the area operation setting table 103 is stored in advance.

Then, in the drive recorder 200a, position information acquisition and video recording are started (S201, S202), and determination of area entry, etc., and determination of conformity to area operation conditions are made (S203c). Then, when these determinations are "yes", the control unit 211 determines whether or not the image is to be transmitted immediately (S203d). This is determined based on whether the video is manually transmitted by the administrator terminal 110 or automatically transmitted.

Then, when it is determined that the image is to be immediately transmitted, the control unit 211 cuts out the designated image from the image stored in the external memory based on the operation timing and the image cutout time set in the drive recorder 200a. conduct. The control unit 211 uses the communication module 201 to transmit the clipped video together with its area detection information (S204).

Then, in the management server 100, the data processing unit 101 acquires the clipped video data and stores it in the video data table 106, acquires the area detection information, and stores it in the area detection recording table 104 (S106a). . Also, a video key information storage table 105 is generated. On the other hand, when receiving only area detection information, the data processing unit 101 stores it in the area detection record table 104 . When the image key information storage table 105 is generated, it is stored that the image has not yet been obtained.

Next, a video search process using the video key information storage table 105 will be described. FIG. 17 is a diagram showing an example of a search screen of the administrator terminal 110. As shown in FIG. The administrator can search for images captured in the vehicle 200 by operating the administrator terminal 110 . The search screen, as shown in FIG. 17, is composed of a narrow search condition setting part, a search button, a search list, and a video screen. As shown in FIG. 17, the administrator uses organization ID, driver ID, device ID, area master ID, area ID, driving area, driving time zone, speed zone, and temperature zone as search keys to search for images. can do. The administrator terminal 110 enables image retrieval by referring to the image key information storage table 105 of the management server 100 .

FIG. 18 is a hardware configuration diagram of the management server 100. As shown in FIG. The management server 100 shown in FIG. 2 physically includes, as shown in FIG. It is configured as a computer system including an output device 15 such as a display, a communication module 16 such as a data transmission/reception device such as a network card, and an auxiliary storage device 17 such as a hard disk or semiconductor memory. Each function in FIG. 2 is implemented by loading predetermined computer software (program) onto hardware such as CPU 11 and RAM 12 shown in FIG. 16 and reading and writing data in the RAM 12 and the auxiliary storage device 17 .

Next, functions and effects of the management server 100 and the drive recorder 200a according to the present disclosure will be described. A management system according to the present disclosure includes a management server 100 and a drive recorder 200a. This management system manages video (data) stored in drive recorders 200a (equipment) among equipment arranged in a plurality of vehicles 200 (moving bodies). Although the drive recorder 200a is the specific device here, it is not necessarily limited to the drive recorder 200a. Among all the devices with which the management server 100 communicates, the devices that satisfy the detection conditions stored in the area areas shown in FIGS. 3B and 3C are the specific devices.

Also, if the mobile object is a drone, the camera control device of the drone is applicable, and if the mobile object is a person, the smart phone carried by the person is applicable.

In addition to examples in which the position information of the moving object and the device do not necessarily match, examples in which only the moving object moves are also included as modified examples. can be defined as detection conditions, in which case the fixed camera corresponds to the specific device.

This management system is defined according to the purpose of use of the video, operation timing of entering and / or exiting the target area specified based on one or more area IDs and position information, and the operation timing An area operation setting table 103 is provided for storing video acquisition conditions (data acquisition conditions) including at least a corresponding data acquisition range (cutout time) for each area ID.

Then, the management system communicates with the drive recorder 200a (device) to acquire the video (data) that satisfies the video acquisition condition (data acquisition condition) among the video (data) stored in the drive recorder 200a (device). and a data processing unit that

In patterns 1 and 2 of the present disclosure, the area operation setting table 103 is mainly provided in the management server 100, but as in patterns 3 and 4, the drive recorder 200a includes the area operation setting table 103, A management system may be constructed including the drive recorder 200a. This pattern is a difference in implementation to be able to respond flexibly to the processing capabilities of the management server and devices, the communication environment between the management server and devices, etc. Functionally, it is provided in the management server. It goes without saying that the management server can flexibly respond to differences in the processing capabilities of devices and functional differences between old and new terminals, and can compensate for differences in capabilities and functions.

According to this disclosure, the management server 100 acquires the image of the drive recorder 200a based on the image acquisition conditions including the operation timing when the vehicle 200 enters the image acquisition target area and the image acquisition range (image cutout time). can be done. The acquisition conditions for this video can be determined according to the administrator's criteria in accordance with the purpose of use of the video. Therefore, the administrator can acquire the video according to the purpose of use. For example, not only the latitude and longitude of the object to be photographed and the drive recorder 200a, but also the moving speed of the vehicle 200, the type of location to be photographed (highway, general road, unloading and pick-up location, parking lot, etc.), the type of camera ( The image can be acquired based on the imaging pattern according to the purpose of entering/exiting the vehicle (front, interior).

In the present disclosure, the area operation setting table 103 further stores image acquisition timing as an image acquisition condition (data acquisition condition). The data processing unit 101 further acquires data based on the acquisition timing. The acquisition timing is determined depending on whether the image of the drive recorder 200a is automatically acquired (i.e., acquired immediately upon notification (or after a predetermined period of time has elapsed)) or manually by the administrator. be done. Depending on the purpose of use of the video, there are cases where it is not necessary to acquire the video automatically and immediately. Therefore, from the point of view of the administrator, it is possible to set either one.

Further, the area operation setting table 103 further stores the camera type of the drive recorder 200a (device) as a video acquisition condition. This camera type indicates whether it is a front camera that captures the traveling direction of the vehicle 200 or an interior camera that captures the interior. The data processing unit 101 acquires an image captured by a camera corresponding to the camera type of the drive recorder 200a (device).

Depending on the purpose of using the image, there are cases where it is desired to manage the road in the traveling direction of the vehicle 200 (or where the vehicle 200 has passed) and other images, and there are cases where it is desired to manage the driving state of the driver. By setting the type of camera as an acquisition condition, it is possible to acquire images according to the administrator's purpose of use.

Further, the area operation setting table 103 further stores state information when the vehicle 200 (moving body) acquires an image as an image acquisition condition (data acquisition condition). The state information is, for example, the speed of the vehicle 200 and the temperature (indoor or outdoor) detected by the sensor of the vehicle 200 . The data processing unit 101 further acquires data based on the state information.

Depending on the purpose of using the image, it may be desired to acquire the image corresponding to the state information of the vehicle 200 . For example, by acquiring an image according to the speed of the vehicle 200, it is possible to grasp the driving situation of the driver according to the speed. Also, by acquiring an image according to the temperature, it is possible to grasp the transportation state of the animal during transportation.

In addition, the area operation setting table 103 further stores the upper limit of the number of image acquisition times as an image acquisition condition. The data processing unit 101 acquires the video based on the number of acquisitions. A plurality of videos may not be necessary depending on the administrator's purpose of using the videos. In the present disclosure, video acquisition can be restricted.

In the management system of the present disclosure, the data processing unit 101 receives area detection information, which is information regarding the time of image acquisition, from the drive recorder 200a (device). Then, based on the area detection information, a key information table to be used for searching the acquired video is generated. For example, the area detection information is the date and time of entering the area, the date and time of leaving, the speed of the vehicle 200, and the temperature. By associating these pieces of information with images as key information used for retrieval, image retrieval becomes possible. Note that this association can be searched based on video key information including area detection information, video ID, recording date and time, etc., such as when the video is not acquired immediately, and the video data itself can be searched and then a video acquisition request or the like is made. Needless to say.

The area table 102 stores a plurality of area IDs that match the purpose of using video (data) in association with area master IDs. Image acquisition conditions are set in the area operation setting table 103 for each area master ID.

According to this disclosure, it is possible to collectively define video acquisition conditions for each area master ID.

Further, in the management system of the present disclosure, when the data processing unit 101 receives area detection information, which is information regarding the time of video acquisition, from the drive recorder 200a, the drive recorder 200a stores video that satisfies the acquisition conditions according to the area detection information. determine whether or not

According to this disclosure, when the drive recorder 200a is configured to perform area detection, as shown in pattern 2 above, the area detection information can be used to extract video that satisfies the acquisition conditions.

In addition, in the present disclosure, the data processing unit 101 of the management server 100 transmits the operation timing and the data acquisition range to the drive recorder 200a, thereby allowing the drive recorder 200a to cut out the video and acquire the video.

According to this disclosure, under the control of the management server 100, image acquisition that satisfies acquisition conditions is enabled.

In the management system in pattern 1 above, the drive recorder 200 a includes a communication module 201 that periodically transmits position information of the vehicle 200 to the management server 100 .

The management server 100 enters and/or exits the image acquisition target area based on the area table 102 including at least one or more area IDs and coordinate information specifying the image acquisition target area and the position information of the vehicle 200. A data processing unit 101 for detecting is provided. It functions as an area detector. Area operation for storing, for each area ID, a data acquisition condition including at least an operation timing for an image acquisition target area and an image acquisition range corresponding to the operation timing, which is determined according to the purpose of use of the image. Equipped with a setting table 103, the data processing unit 101 communicates with the drive recorder 200a and acquires data that satisfies data acquisition conditions among the data stored in the drive recorder 200a.

In the disclosure in this pattern 1, the drive recorder 200a does not need to detect the area by periodically transmitting the position information from the drive recorder 200a. Therefore, the configuration can be simplified.

Further, in pattern 3, in the drive recorder 200a, the control unit 211 functions as an area detection unit and is an area table (area table 102 ) and the position information of the vehicle 200, entry into and/or exit from the acquisition target area is detected. Then, the control unit 211 functions as an acquisition condition determination unit, and determines the operation timing of entering and/or exiting the vehicle 200 according to the purpose of use of the video, and the data acquisition range ( Based on an area operation setting table (corresponding to the area operation setting table 103) that stores data acquisition conditions including at least video clipping time for each area ID, it is determined whether or not the image acquisition conditions are satisfied.

When the control unit 211 determines that the video acquisition condition is satisfied, the communication module 201 transmits the area detection information detected by the control unit 211 to the management server 100 .

In the management server 100, when the area detection information is acquired, the data processing unit 101 communicates with the drive recorder 200a and acquires the data that satisfies the image acquisition conditions among the images stored in the drive recorder 200a.

In this pattern 3 disclosure, the drive recorder 200a performs area detection and determination of operating conditions. Therefore, it has tables corresponding to the area table 102 and the area operation setting table 103 . According to this disclosure, many processes are performed on the drive recorder 200a side, thereby simplifying the processing on the management server 100 side.

In pattern 4, in addition to pattern 3, the control unit 211 controls the operation timing of the vehicle entering and/or exiting the area 200, which is determined according to the purpose of use of the image, and the operation timing. The control unit 211 retrieves the video that satisfies the data acquisition condition from the external memory based on the area operation setting table that stores the video acquisition conditions including at least the data acquisition range (video clipping time) for each area ID. .

In particular, when the vehicle is outside the mobile phone network or GPS range such as an underground parking lot, even if the management server 100 cannot judge the detection conditions and operating conditions according to Patterns 1 and 2, the drive recorder 200a can detect the vehicle sensor. The position of the vehicle is detected based on information from environment sensors such as the above, and it is determined whether or not the detection conditions and operating conditions are met. Then, when immediately and automatically transmitting the video that satisfies the data acquisition conditions according to the operating conditions, the communication module 201 stores the transmission to the management server 100 side in the reservation information table on the drive recorder 200a side (not shown). It is stored and transmitted when communication becomes possible.

When the administrator side manually transmits the video data, when an access request (not shown) is received, the drive recorder 200a side transmits the video data as a response to the access request. Also, even in areas where visibility is good and GPS information is received, for example, driving skill spots (S-curves, sideways, sideways, temporary stop positions, uphill temporary stop positions, etc.) When accuracy is required, detection based on GPS signals has limitations and is susceptible to scrambled information. Even in that case, if detection is performed based on relative positions, a person who wants to obtain a driver's license or a driving teacher can confirm the results of driving skills by video based on the obtained video.

According to this disclosure, most of the processing is performed on the drive recorder 200a side. Therefore, the processing in the management server 100 can be simplified.

Here, in any pattern, for some reason between the management server 100 and the drive recorder 200a, data such as video cannot be acquired, or if the video data itself is sent to the management server 100, the communication traffic is burdened. In order to reduce the amount of data to be transmitted, the control unit 211 does not transmit the video data itself, but uses a video identifier and other information that will be key information of the video data (for example, position or time information) may be transmitted.

In that case, the relationship between the image key information storage table in FIG. 6, the vehicle management table 105 described in Patent Document 2, the vehicle management table 215 on the device side, and the embodiment described in the reservation information table 104 are applied. Then, the image data of the specific area is managed/obtained. The following describes an embodiment disclosed in Patent Document 2, in which the vehicle management table is managed by the management server and the device side, and the management server later acquires the image based on the image key information.

First, a video identifier, key information of video data, and a video file are recorded in the device-side vehicle management table 215 stored in a plurality of devices under the management of the user. Thereafter, the key information or the like is voluntarily transmitted from the plurality of devices to the management server 100, or the key information or the like is actively transmitted in response to an access request from the management server 100, and the vehicle management table on the management server 100 side is displayed. 105, key information and the like stored in a plurality of devices are recorded.

In the vehicle management table 105 on the management server 100 side, the device identifier is required as a table item that does not exist in the vehicle management table 215 in order to distinguish the information in the vehicle management table 215 on the device side. In this regard, the reservation information table in FIG. 3 of Patent Document 2 is also provided in order to specify which video identifier of the plurality of devices is reserved.

On the other hand, in the video data storage area of the vehicle management table 215 on the device side, since the video data associated with the video identifier is stored moment by moment, the video data is complete in principle. However, in principle, in order to reduce the amount of data to be transmitted, the video data itself is not sent to the vehicle management table 105 on the management server 100 side. time information). After that, the video data is transmitted based on a predetermined condition, and the acquisition status flag is updated to "acquired".

For this reason, the image data storage area of the vehicle management table 105 does not have all the image data in principle. Therefore, in order to distinguish whether or not the video data has been acquired, an acquisition status flag is required as a table item that does not exist in the vehicle management table 215, and the acquired, not acquired, reserved, and unavailable states are distinguished. .

Further, in the video data storage area of the vehicle management table 215, the video data associated with the video identifier is recorded regardless of whether communication with the management server 100 is possible or not. Then, if communication between the management server 100 and the target device cannot be established, the video data cannot be acquired. Therefore, in order to distinguish whether or not image data can be acquired, an acquisition availability flag is necessary as a table item that does not exist in the vehicle management table 215, and distinguishes between communication enabled and communication disabled states.

When an access request or playback request for video data is made on the management screen of the administrator terminal 300, which will be described later, a list of key information stored in multiple devices under management is stored in the vehicle management table 105. An image acquisition state is iconized for each key information, etc., and an access request or a reproduction request can be easily made by clicking the icon. When the acquisition is completed, the icon display on the management screen is also changed to "acquired" by changing the acquisition status flag to "acquired".

Also, in the video list frame in the search refinement condition setting screen of FIG. (5) Area ID, (6) Driving area, (7) Driving time zone, (8) Speed zone, (9) Temperature zone, etc. , and image acquisition status flags are displayed, and by clicking the image acquisition status, it is possible to easily acquire data of images that have not yet been acquired by making an access request.

In addition, although these inventions are mainly described in the case where the management server 100 acquires video data from the drive recorder 200a, the invention It is not limited to transmitting/receiving target data. For example, it is possible to perform control to autonomously avoid obstacles and move based on real-time images acquired from flying objects. Thereby, the target data that needs to be transmitted and received between the management server and the target device is detected in the target area based on the detection conditions and operation conditions described above, and the desired operation is performed or planned. It goes without saying that

In addition, it goes without saying that the invention is used in various usage scenes, but in that case, the following terms used in the above description are respectively used for "video data", "target data",
"Get footage" to "perform or plan the desired action",
"data transmission" to "data transmission or control of target equipment",
"Acquisition process" to "Acquisition or control process, or operation reservation",
"area detection notification" to "detection notification",
"Device to be acquired" to "Device to be sent/received",
"Notification of acquisition reservation completion" to "Notification of transmission/reception reservation completion",
The category of the invention is not limited to "management system", but the detailed description of the invention for the category related to "management device", "management method", or "program" that realizes these "management methods" It goes without saying that the description is easily adaptable.

In the above-described embodiments, application examples to a drive recorder mounted on a vehicle or a drone have been described, but the present invention can also be applied to devices such as smartphones that take pictures with a camera. For example, when a user enters or exits a predetermined area while holding a smartphone, the present invention can also be applied to clipping processing of only the video shot in that area.

Also, when it is applied to a drone, it can be applied to remote control in addition to shooting processing. For example, when the drone enters or exits a predetermined area, it performs a predetermined action. Predetermined actions include obstacle avoidance actions based on analysis of video captured by the drone's camera. By activating the image analysis function when entering a predetermined area, more detailed processing can be performed. In addition, when using drones for delivery, it can also be used for recognition processing of delivery destinations.

DESCRIPTION OF SYMBOLS 100... Management server 200... Vehicle 200a... Drive recorder 110... Administrator terminal 101... Data processing part 102... Area table 103... Area operation setting table 104... Area detection recording table 105... Video key information Storage table 106... Video data table 107... Communication unit.

Claims (12)

In a management device for communicating with one or more devices to perform desired actions associated with data stored on the devices,
a table for storing detection conditions and operating conditions including information about an acquisition target area determined according to the purpose of use of specific data associated with the data to be detected;
a data processing unit that communicates with a specific device that satisfies the detection condition and the operation condition based on the detection target information, and performs at least one of execution, control, and planning of a predetermined operation for the specific data in the data;
with
The table is
an area table storing detection conditions for detecting the data;
an operation setting table storing an operation condition for specifying the specific data associated with an ID determined according to the purpose of use of the specific data;
has
The data processing unit communicates with a specific device that satisfies the detection condition and performs data processing on the data according to the operating condition;
The operation setting table stores at least entry and/or exit of a detection target into and/or out of the target area as a detection condition for each target area specified based on one or more pieces of position information;
The data processing unit identifies the device that communicates based on the position information of the detection target and the detection condition.
management device. 2. The management device according to claim 1 , wherein said operating condition indicates an acquisition range of said specific data among data existing in said device. The data is information that is constantly acquired in the device,
The management device according to claim 1 or 2 . the predetermined operation is data acquisition and/or control of the specific device or the device that can communicate with the specific device;
The management device according to any one of claims 1 to 3 , wherein when the target is detected based on the detection condition, the operating condition for the device associated with the target is specified and data communication is performed. The data processing unit autonomously sets the detection conditions and/or operating conditions by analyzing information on the detection target.
The management device according to any one of claims 1-4 . the predetermined operation is data acquisition and/or control of the specific device or the device that can communicate with the specific device;
Communicating with a device associated with an area of interest detected based on location information of a detection target to obtain data and/or control the specific device or the device based on the operating condition;
A management device according to any one of claims 1 to 5 . The data processing unit operates the device by transmitting at least one of operation timing and/or operation range to the device.
The management device according to any one of claims 1-6 . In a management device for communicating with one or more devices to perform desired actions associated with data stored on the devices,
a table for storing detection conditions and operating conditions including information about an acquisition target area determined according to the purpose of use of specific data associated with the data to be detected;
a data processing unit that communicates with a specific device that satisfies the detection condition and the operation condition based on the detection target information, and performs at least one of execution, control, and planning of a predetermined operation for the specific data in the data;
with
The data processing unit stores a detection result based on the detection condition as area detection information, and generates a key information table used for searching the data based on the area detection information and/or the operating condition.
management device. In a management device for communicating with one or more devices to perform desired actions associated with data stored on the devices,
a table for storing detection conditions and operating conditions including information about an acquisition target area determined according to the purpose of use of specific data associated with the data to be detected;
a data processing unit that communicates with a specific device that satisfies the detection condition and the operation condition based on the detection target information, and performs at least one of execution, control, and planning of a predetermined operation for the specific data in the data;
with
having an area table that stores a plurality of areas that match the purpose of use of the data in association with an area master;
making it possible to set the operating conditions for the associated areas for each of the area masters;
management device. A management method for communicating with one or more devices to perform desired actions associated with data stored on the devices, comprising:
with reference to a table storing detection conditions and operating conditions including information about an acquisition target area determined according to the purpose of use of the specific data associated with the data to be detected;
performing data processing of at least one of execution, control, and planning of a predetermined operation for specific data in the data by communicating with a specific device that satisfies the detection conditions and operation conditions from the detection target information;
The data processing stores detection results based on detection conditions as area detection information, and generates a key information table used for searching the data based on the area detection information and/or the operating conditions.
management method. A management method for communicating with one or more devices to perform desired actions associated with data stored on the devices, comprising:
with reference to a table storing detection conditions and operating conditions including information about an acquisition target area determined according to the purpose of use of the specific data associated with the data to be detected;
performing data processing of at least one of execution, control, and planning of a predetermined operation for specific data in the data by communicating with a specific device that satisfies the detection conditions and operation conditions from the detection target information;
having an area table that stores a plurality of areas that match the purpose of use of the data in association with an area master;
making it possible to set the operating conditions for the associated areas for each of the area masters;
management method. 12. The management method according to claim 10 , wherein said data processing causes said device to operate by transmitting at least one of operation timing and/or data acquisition range to said device.

Images