JP2022003492A - Management device, management method, management system, and program - Google Patents

Abstract

To provide a management device capable of communicating with a device or the like under condition determined according to a purpose of use of video data or the like, acquiring the video data or the like stored in the device or the like, and controlling the device or the like.SOLUTION: A management server periodically receives data or the like including a position information of a vehicle 200 or the like from a drive recorder 200a installed in the vehicle 200 or the like, and comprises an area operation setting table 103 which is used for determining whether or not a condition for detecting entry and/or exit of the vehicle 200 or the like into/from an area and an operation condition such as data acquisition determined according to a purpose of use of the video data or the like are satisfied for each area specified based on one or more location information. Then, a communication unit 107 of the management server 100 communicates with the drive recorder 200a that satisfies the detection condition and the operation condition, and acquires the video data or the like stored in the drive recorder 200a and the data of the vehicle 200 or the like.SELECTED DRAWING: Figure 2

Description

The present invention relates to a management device, a management method, a management system and a program for managing data of a device associated with a mobile body.

Patent Document 1 discloses an image recording device, a so-called drive recorder, in which a camera is installed in a vehicle, the surroundings of the vehicle are photographed when an event occurs, and the acquired image is verified after the fact. For example, as the occurrence of an event, there is a description that when it is determined that the vehicle is traveling in a position where the object to be photographed falls within the shooting range of the camera, the object is photographed by the camera of the drive recorder.

Further, in Patent Document 2, the acquisition target data that needs to be managed is specified based on the identifier included in the access request requested from the administrator terminal and the key information corresponding to the reservation information, and the communication status with the device and the reservation information are specified. The management server that makes a communication connection based on the above and sends / receives the target data corresponding to the access request is disclosed.

Japanese Unexamined Patent Publication No. 2017-098865 Japanese Unexamined Patent Publication No. 2019-215869

However, in the technique disclosed in Patent Document 1, the shooting setting of the image is set based on a specific position where the object to be shot falls within the shooting range of the camera installed in the vehicle, and the shooting setting is set to other than the image. No consideration is given to the intentions of the administrator according to the use of data and the purpose of using the data after shooting.

Further, in the technology disclosed in Patent Document 2, data that needs to be managed based on various behavior detections of vehicles, etc., from the data to be acquired such as images that are stored moment by moment in the storage unit in the drive recorder. Although it can be specified and stored in the management server, the data in the time zone when various behaviors such as vehicles do not occur is overwritten with the old data every moment, and there is necessary data in that time zone. Even in that case, the data you want to use cannot be acquired properly.

Therefore, in order to solve the above-mentioned problems, the present invention obtains data or the like stored in a device associated with a detection target in accordance with detection conditions and operating conditions determined according to the purpose of using the data. It is an object of the present invention to provide a management device, a management method, a management system, and a program that enable further data utilization because they can be operated.

The management device of the present invention is a management device for communicating with one or more devices and performing a desired operation associated with the data stored in the device, depending on the purpose of use of the data associated with the detection target. An operation setting table that stores predetermined detection conditions and operation conditions, and a data processing unit that communicates with a specific device that satisfies the conditions from the information of the detection target to execute and / or plan a predetermined operation. Be prepared.

With this configuration, a device associated with a detection target that satisfies the detection conditions and operation conditions according to the purpose of using the data is specified, data stored in the device, such as a video, is acquired, and a required predetermined operation is performed. Can be executed and / or planned.

According to the present invention, it is determined according to the purpose of use of the administrator from among the data to be acquired such as a video that is momentarily stored and overwritten in the storage unit in the device under the control of a plurality of users. Data required for management can be specified based on the detection conditions and the operating conditions, and processing such as data acquisition can be performed under the desired operating conditions.

It is a figure which shows the system configuration in this disclosure. It is a block diagram which shows the functional structure of a management server. It is a figure which shows the specific example of the area table 102. It is a figure which shows the specific example of the area operation setting table 103. It is a figure which shows the specific example of the area detection record table 104. It is a figure which shows the specific example of the key information storage table 105. It is explanatory drawing for demonstrating the cutout process of a moving image. It is a figure for demonstrating the movement of a vehicle 200 and the cut-out image at that time. It is a block diagram which shows the functional structure of the drive recorder 200a. It is a sequence diagram which shows the operation when the administrator terminal 110 sets the area image operation with respect to the management server 100. It is a sequence diagram of the operation (pattern 1) when the management server 100 acquires the image from the drive recorder 200a. It is a sequence diagram which shows the operation when the administrator terminal 110 sets the area image operation with respect to the management server 100 and the drive recorder 200a. It is a sequence diagram of the operation (pattern 2) when the management server 100 acquires the image from the drive recorder 200a. It is a sequence diagram which shows the preset process in pattern 3. It is a sequence diagram of the operation (pattern 3) when the management server 100 acquires the image from the drive recorder 200a. It is a sequence diagram of the operation (pattern 4) when the management server 100 acquires the image from the drive recorder 200a. It is a figure which shows an example of the search screen of the administrator terminal 110. It is a hardware configuration diagram of the management server 100.

An embodiment of the present invention will be described with reference to the accompanying drawings. When possible, the same parts are designated by the same reference numerals, and duplicate description is omitted.

FIG. 1 is a diagram showing a configuration of a video data management system captured by a drive recorder, which is an optimum embodiment of the present invention. As shown in FIG. 1, the system of the present disclosure is configured to include a management server 100 and a vehicle 200. The vehicle 200 is a mobile body such as an automobile or a train, and includes a plurality of devices. One of the plurality of devices includes a drive recorder 200a, which is a device. The drive recorder 200a is a photographing device, and captures and stores still images or moving images in a predetermined range inside and outside the vehicle 200 as the vehicle 200 moves. In this embodiment, a drive recorder arranged on a moving body such as a vehicle is illustrated, but if it is a moving body, it may be another detection target, and may be a moving body such as a ship or an aircraft. Further, it may be a device (mobile body) capable of wireless operation or autonomous movement such as a drone. In a drone or the like, the object to be photographed is not limited to the front or the rear, and an image may be taken in all directions of 360 °.

Further, although the detection target is described as a device placed on a mobile body, the detection target is not limited to the mobile body, and for example, a fixed camera installed in a specific place as a communication target device may be targeted. In that case, the detection target may be a person or another moving object, and the relative movement relationship of the devices may not be coordinated and may be detected independently. In addition, not only the acquisition of video data, but also the execution of all operations expected in future data processing such as data acquisition and control, transfer to acquisition reservation and image analysis processing, and operation plan based on the transfer result. Needless to say, it includes a plan including operation control at the video acquisition reservation time.

The management server 100 is a management server for managing data stored in the drive recorder 200a, which is a device among the devices arranged in each of the plurality of vehicles 200. The management server 100 acquires a video satisfying the acquisition conditions set by the administrator terminal 110 from the drive recorder 200a.

The vehicle 200 is assumed to be a transportation vehicle used by a transportation company, a bus used by a bus company, or a commercial vehicle such as a taxi used by a taxi company. Used by businesses. The images you want to grasp differ depending on the company / business operator. The purpose of using the vehicle is not limited to business use, but it can also be applied to vehicles for end users of leasing companies and non-life insurance companies, each of which has a contractual relationship, such as in the case of BtoBtoC. The vehicle may be a vehicle for individuals, for example, a vehicle having a contractual relationship with a certain parking lot or a vehicle temporarily using the parking lot. In short, the drive recorder 200a may be installed in a general personal drive recorder in the management program of the present invention (such as firmware including a management table in the drive recorder) to enable communication with the management server 100 side. Further, the present invention is not limited to the drive recorder, and may be installed on the mobile body itself such as a drone, or may be installed on a device associated with the mobile body, that is, a device such as a smartphone owned by a person. Needless to say.

Next, the functional configuration of the management server 100 will be described. FIG. 2 is a block diagram showing a functional configuration of the management server. As shown in FIG. 2, the management server 100 includes a data processing unit 101, an area table 102, an area operation setting table 103, an area detection recording table 104, a video key information storage table 105, a video data table 106, and a communication unit 107. Consists of.

Among the video data stored in the drive recorder 200a, the data processing unit 101 drives the video data satisfying the area operation condition, which is the acquisition condition stored in the area operation setting table 103, via the communication unit 107. It is a part to be acquired by communicating with. For example, we do not consider acquiring camera images at accident-prone points, and according to the standards of the administrator, the moving speed of the vehicle, the type of location (expressway, general road, unloading / pick-up location, parking lot). Etc.), the image is acquired according to the camera installation position / shooting direction, and the purpose of entering / advancing the vehicle.

The area table 102 is a table for storing information about an area to be acquired for video, and includes an area master area, an area area, and an area terminal setting area. A specific example is shown in FIG. FIG. 3A shows a specific example of the area master area. As shown in the figure, the area master area stores information associated with the area master ID, the area master name, and the contents of the area master. The area master ID is an ID for identifying areas having predetermined conditions defined as an area master. The area master name is the name of the area master. As for the contents of the area master, for example, the contents common to the area ID associated with the area master ID are described so that the administrator or the user who set the area master later can confirm the contents. As will be described later, the area master is, for example, a large area in which small geographical areas are bundled and managed, and is composed of at least one area.

The area master here does not necessarily have to have an inclusion relationship with the configured area, and can be flexibly controlled by some management standard, such as having a common purpose of using data such as area images captured when the area is detected. The area master ID may be associated with a plurality of area IDs. Specifically, for example, area images for the purpose of monitoring the safety of getting on and off vehicles and people for each management target such as toll roads or train lines, bus line stations and interchanges, bridges, branch points and bus stops. In order to acquire data, an area master ID may be assigned to each line, and an area ID may be assigned to each station or bus stop on the line and associated with each other.

Further, it goes without saying that the area master ID and the area ID are not necessarily one-to-many, and may be managed in many-to-one or many-to-many depending on the purpose of use such as video data captured in the target area. stomach. The point is that the area ID and area master ID can be used flexibly in order for the administrator to acquire the necessary video data, etc., and in particular, it is used to enable efficient setting when setting search conditions. Needless to say, it's okay. Needless to say, in the area area described later, it is possible to collectively set and change the operating conditions of a plurality of area IDs by using the area master ID.

FIG. 3B shows a specific example of the area area. As shown in the figure, the area area stores information associated with the area master ID, the area ID, the area name, and the area range. The area master contains a plurality of areas. The area ID is an ID for identifying the area. The area name is the name of the area. The area range is information that defines the range, and is defined by coordinate information such as GPS information.

In addition to the coordinate information that can be specified as an absolute position, the position information that can be specified by combining with other information as a relative position may be shown. Further, in the present embodiment, the area is defined and explained with the position information as the starting point, as the wording says, but it is not necessarily limited to this, and the position at the time of change starting from some information to be detected is used as the starting point. In addition to specifying the area using information, the range to be detected flexibly is defined according to the purpose of use of the data, and it may be defined by the indirectly derived position information at the time of detection.

Specifically, as described in Patent Document 2, data is acquired in advance from other devices such as dangerous behavior, caution behavior, temporary stop behavior at railroad crossings and temporary stop positions, signal ignoring behavior, and speed violation behavior. Needless to say, an area where the safety of a vehicle or the like should be given more consideration may be set autonomously or by an administrator and used for area detection of the present invention and may be used for the safety of other vehicles or the like. stomach.

Furthermore, changes in maintenance event data of the vehicle itself, data on surrounding vehicles such as road rage and traffic jams, crosswinds and road freezes, obstacles on roads and routes, which are not specified in the event video acquisition patent of Patent Document 2, Detect objects based on the analysis results of the front image, detect based on the comparison analysis results of the front and rear images of the snow removal vehicle and the cleaning vehicle, and set the area based on the detected position information. Needless to say, it may be used for area detection and safely used for other vehicles.

FIG. 3C shows an area terminal setting area. As shown in the figure, the area terminal setting area stores information in which the device ID and the area ID are associated with each other. The device ID is an ID for identifying the drive recorder 200a or the like. Using this information, among the images of the drive recorder 200a indicated by the device ID, the image when entering the area of the area ID may be acquired.

In addition, although it will be described again, in the embodiment of the present invention, it is described as a drive recorder, but it is not necessarily limited to the drive recorder arranged in the vehicle or the like, and if it is a moving body, it is a vehicle. In addition, it may be a device associated with a device capable of wireless operation or autonomous movement such as a drone such as a ship or an aircraft, or it may be a device such as a mobile terminal or a smartphone owned by a person, and a camera is not necessarily connected. It goes without saying that it is not limited to the equipment that is used. In addition, for example, for the purpose of animal protection and breeding, a small device installed on a collar or belt may be able to acquire images seen from the pet side and manage location information. Needless to say.

Further, it may be a device fixedly installed in a specific place such as a fixed camera or an environment sensor other than the moving body. In this case, the movement of the relatively associated moving body is detected and data or the like is acquired. Needless to say, you can do it.

The area table 102 may store a plurality of areas (area IDs) that match the purpose of using the video in association with the area master ID. Then, the area operation conditions of the area operation setting table 103 may be defined for each area master ID. Thereby, the area operation condition for a plurality of areas can be defined by using one ID called the area master ID. For example, assume that a plurality of areas including a bridge are associated with the area master ID. By associating the area master ID with the area operating conditions, it is possible to acquire an image for collectively observing aged deterioration in a bridge or the like.

The area operation setting table 103 is a part that stores the area operation conditions, which are the acquisition conditions of the video captured by the drive recorder 200a. FIG. 4 is a diagram showing a specific example of the area operation setting table 103. As shown in the figure, the area operation setting table 103 includes an area ID, an operation timing, an image UPLOAD (operation type), a target camera, an image cutout time, an image UPLOAD number (upper limit number of operations), a detection speed band, a detection temperature zone, and the like. Stores information associated with management notifications. The area ID in the area operation setting table 103 corresponds to the detection condition, and the operation timing, the image UPLOAD, the target camera, the image cutout time, the number of times the image UPLOAD, the detection speed band, the detection temperature band, and the management notification correspond to the operation conditions. .. Of these, the video cutout time corresponds to the operation reservation information. In addition, although not illustrated here, the time (detection time or operation time) at which the video is acquired, that is, the operation reservation information may be information related to some time. For example, in order to operate a fixed camera on a regular basis, various sensors detect traffic volume, typhoons, and heavy rains and operate them during the time period detected by the sensors, or something based on the transfer result to image analysis processing. Images may be used to prevent traffic accidents and disasters based on the detection results assumed by data processing, such as operating during the time when the image analysis results that cause traffic accidents and disasters are detected. It should be noted that the utilization of the video depends on the purpose of use, and various uses may be assumed, and the state information of the detection target may widely include sensor information related to the vehicle such as the vehicle speed.

As described above, the area ID may be the area master ID, the operation may be set by at least one item, and the operation at the time of area detection may be performed even if all the items are not itemized in the table configuration. Needless to say, you can set.

The area operation setting table 103 is set from the administrator terminal 110, and operation conditions are set according to the purpose of use of the video to be acquired by the administrator.

Here, the operation timing will be described with reference to FIG. 7, which will be described later, for the video cutting process. Whether to cut out the image for a predetermined time starting from the time when the vehicle 200 enters the specified range (area IN), or to cut out the image retroactively for a predetermined time from the time when the vehicle 200 exits (area OUT), or enter. Indicates whether to cut out the image from to to exit (area IN-OUT).

In order to promote the understanding of the present invention, the above-mentioned operation timing will be described as an example of the area, but the operation timing is not necessarily limited to the area, and the data is acquired in a certain event described when the area master and the area are managed. It may be a detection standard according to the purpose of use of the data such as the desired video. For example, it detects changes in maintenance event data of the vehicle itself, which is not specified in the event video acquisition patent of Patent Document 2, and detects changes in data related to the approach distance to the rear vehicle such as road rage and traffic jam. , Crosswinds, road freezes, obstacles on roads and routes, etc. can be detected based on the analysis results of the front image, and can be detected based on the comparison analysis results of the front and rear images of snow removal vehicles and cleaning vehicles. Needless to say, it may be a change in data that can be detected by the moving body itself or a device associated with the moving body. In that case, as with the tables called area master area, area area, and area terminal setting area, another condition table is provided, and the condition name and the range that satisfies the condition are defined by other information instead of location information. The detection conditions to be set and based on the information to be detected will be described later, but it goes without saying that the detection conditions may be determined by other information instead of the position information.

The video UPLOAD has a method of acquiring a video according to a request (including an acquisition request, an access request, and an acquisition reservation) from the administrator of the management server 100, or whether the management server 100 automatically acquires the video. Set. This video UPLOAD is used for determining whether or not the video is immediately acquired. Although the video data UPLOAD will be mainly described here as well, it is not necessarily limited to the video data, and the UPLOAD of the data related to the moving body itself such as a vehicle or the device associated with the moving body or the operation of the device is described. Needless to say, the target device may be operated by DOWNLOAD of the specified control signal. In the automatic processing, regardless of whether the subject that determines the detection and operating conditions described later is the management server or the drive recorder, the drive recorder 200a transmits immediate video data according to the video UPLOAD setting, and the management server 100 determines. In addition to acquiring the video, the management server 100 automatically acquires the video when an event such as dangerous behavior is detected, or when a video acquisition reservation is made when communication with the drive recorder 200a is not possible. Needless to say.

The target camera indicates, for example, the image of the front camera, the image of the indoor camera, or the image of both cameras, or the type of the camera for which the image is to be acquired. It is not limited to the front or the room, and any number can be installed in any direction and position inside and outside the room, and it goes without saying that the rear camera may be included. In that case, a method of acquiring the image of the rear-view mirror with a camera or the rear-view mirror outside the room via the control device managed by the vehicle may be adopted, and communication with the related device (camera in this case) may be adopted. Needless to say, is not limited as long as it is connected by some means such as proximity communication. In the case of video, information that identifies the target camera is useful, but for example, from the vibration cycle of the vehicle when one wheel of the vehicle punctures, the amplitude of vertical vibration, and the tilt of the vehicle due to gyro data, which part is front, back, left, or right. Needless to say, it may be possible to detect that the wheel of the vehicle has punctured or the like and provide it as useful information to the administrator or the like. It goes without saying that vehicle abnormality information can be used to acquire and detect various video data, especially in relation to safe driving.

The video cutout time indicates the cutout time of the video to be acquired. The video to be cut out is cut out starting from the operation timing. "Area ALL" may be set in this field. When "Area ALL" is set and the operation timing is set to "Area IN / OUT", the image of the vehicle 200 from entering the target area for image acquisition to exiting is displayed. Indicates that it will be cut out.

In any case, for example, in order to surely acquire the video scene that is indispensable for the purpose of using the video data, the cutting of the video is started or ended about a few seconds after the operation timing is started. Needless to say, it's good.

The video UPLOAD count indicates the upper limit of the number of video uploads in one day. This is set because there is no point in uploading many times a day when looking at deterioration over time such as roads. When observing the deterioration of roads, tunnel walls, ceilings, bridges, etc. over time, it may be necessary to have a higher resolution of one video than the number of video acquisitions. In this case, it is connected. Depending on the installation position and specifications of the camera, for example, in the case of a ceiling, wall, or road, install it upward, sideways, or downward outside the vehicle, and move the image pickup range of the camera in parallel with the moving direction of the vehicle. Needless to say, various operating conditions can be considered, such as reducing the dynamic speed of the image and adopting a shooting method (zoom-up shooting) that improves the resolution.

The detection speed band indicates the moving speed of the vehicle 200, which is a condition for acquiring an image. The image of the vehicle 200 moving within the speed range set here is acquired, and the image of the vehicle 200 moving at a speed other than the speed range is not the acquisition target. As described in the above modification, the fixed camera installed at a specific position is not necessarily limited to detecting the moving speed of a device that moves integrally with a moving object such as a person or a vehicle. You may detect the speed when a person is reflected in the imaging range, and the detection speed is the speed of the moving object detected by a vehicle, an aircraft such as a drone, a ship, or other equipment associated with a moving object. Needless to say, you can do it.

The detection temperature zone is, for example, one of the conditions for monitoring the influence on the object to be photographed such as food or animals placed on the vehicle or the loading platform during transportation by a moving object, or for the purpose of safe driving of the vehicle, such as an engine or a radiator. The temperature zone for setting some operating conditions is indicated by setting the temperature of the detection target as the temperature of the detection target, and the conditions do not necessarily have to be set. In the above example, it goes without saying that the temperature zones that are the operating conditions are different for each of the monitoring targets such as food, animals, engines, and radiators, and it is limited to acquiring images taken in the set temperature zones. It goes without saying that it is not something that will be done.

The administrator notification is indicated by ON / OFF, and whether or not to notify the administrator at the time of video acquisition is set. Administrator notifications are based on the purpose of use, such as when you want to send videos in a batch, when there are many areas to be acquired, etc., and when the administrator has the highest priority and distinguishes between devices and data that meet the operating conditions. The presence or absence is set.

The area detection recording table 104 stores area detection information acquired from a drive recorder 200a, a moving object such as a vehicle to be detected, or a device such as a fixed camera installed in the area. FIG. 5 shows a specific example of the area detection recording table 104. As shown in the figure, the area detection recording table 104 displays the device ID, area ID (or area master ID if necessary), area IN date and time (or area OUT date and time if necessary), speed, and temperature. Remember. The device ID is the ID of the drive recorder 200a that has been photographed. The area ID is the ID of the photographed area. The area IN date and time is the date and time when the vehicle 200 entered the area. The speed is the speed at the time of shooting of the vehicle 200. The temperature is the temperature at the time of shooting by the drive recorder 200a. These information are information about the area at the time of shooting or state information of the vehicle 200.

The video key information storage table 105 is a table for storing key information for searching a video to be acquired, which is acquired from the drive recorder 200a. FIG. 6 is a diagram showing a specific example thereof. In the video key information storage table 105, the data processing unit 101 acquires the device ID, area ID, area IN date / time (or area OUT date / time), speed, temperature, and video of the area detection information (area detection recording table 104). The presence or absence is generated in association with the video ID of the cut out video. Further, the organization ID and the driver ID are taken out based on the driver DB (not shown) or recorded in the external memory as information detected by the IC card reader before the operation. This information is associated with the device ID, and the device ID is associated with the vehicle. The traveling area is derived from an area DB and an area ID (not shown). The administrator terminal 110 can use the video key information storage table 105 to search for a video using the video key. As with the event video data, it goes without saying that when the administrator wants to acquire a video to which a video key has been once assigned, an access request by the video key is received and the target video data file is transmitted.

The video data table 106 is a table for storing video captured by the drive recorder 200a. The video data table 106 stores the video ID and the video data in association with each other. The video ID is assigned when the video is acquired by the management server 100. The video data table 106 is linked with the video key information storage table 105 by the video ID.

The communication unit 107 is a unit that communicates with the drive recorder 200a.

Next, the functional configuration of the drive recorder 200a of the present disclosure will be shown. FIG. 9 is a block diagram showing a functional configuration of the drive recorder 200a. As shown in the figure, the drive recorder 200a includes a communication module 201, a GPS module 202, an IC card reader 203, a recording unit 204, a camera 205, a camera 206, a microphone 207, a speaker 208, a display unit 209, a G sensor 210, and a control unit. It includes 211, various behavior detection units 212, a power supply / ignition input unit 213, a vehicle data input unit 214, and an I / O input unit 215.

The communication module 201 is a part that communicates with the management server 100, and for example, performs communication using a mobile communication network.

The GPS module 202 is a part that performs positioning. The configuration for positioning is based on the area of the target area (GPS if the space has good visibility in the macro area, and the positioning sensor if the space has poor visibility in the micro area). In addition to GPS, a method may be used in which proximity communication is performed with various sensors to specify a relative position.

The IC card reader 203 is a part for reading an IC card.

The recording unit 204 is a unit that records information in an external memory such as an SD card. In the present disclosure, the images taken by the cameras 205 and 206 are recorded by the recording unit 204 in an external memory such as an SD card. The recording unit 204 records the position information of the vehicle 200 at that time together with the video. In addition, in patterns 2 to 4 described later, various tables corresponding to the area table 102, the area operation setting table 103, and the area detection recording table 104 are stored in the external memory.

The camera 205 and the camera 206 are parts for capturing images. Take a still or moving image. The camera 205 photographs the traveling direction of the vehicle 200, and the camera 206 photographs the interior of the vehicle 200. In addition, a rear camera for photographing the rear of the vehicle may be provided. The installation position and number of cameras are not limited to this drawing or the embodiment, and are not limited to the front or the room, and any number of cameras can be installed in any direction or position inside or outside the room. Needless to say, the rear camera may be included. In that case, a method of acquiring the image of the rear-view mirror with a camera or the rear-view mirror outside the room via the control device managed by the vehicle may be adopted, and communication with the related device (camera in this case) may be adopted. Needless to say, is not limited as long as it is connected by some means such as proximity communication.

The microphone 207 and the speaker 208 are parts that input sound and output sound.

The display unit 209 is a unit that displays setting information for the drive recorder 200a.

The G sensor 210 is a sensor that detects the load.

The control unit 211 is a unit that controls the communication modules 201 to I / O input unit 215.

The various behavior detection units 212 are portions that detect various behaviors in the vehicle 200. For example, the various behavior detection units 212 detect various states based on the position information measured by the GPS module 202, the weighted information detected by the G sensor 210, and the vehicle speed pulse and temperature input from the vehicle data input unit 214. This is the part to do. For example, in patterns 2 to 4 described later, whether the vehicle 200 has entered or exited a predetermined area, or its state (information about the vehicle itself such as speed and angular velocity of the steering wheel, and the surrounding environment of the vehicle such as temperature). Information about) etc.) is detected.

The power / ignition input unit 213 is an input unit for supplying power to the drive recorder 200a.

The vehicle data input unit 214 is a unit for inputting vehicle data such as a vehicle speed pulse. For example, the temperature is measured by a temperature sensor (not shown) and input via the vehicle data input unit 214.

The I / O input unit 215 is an interface portion for an external device. Therefore, it goes without saying that information on various sensors mounted on the vehicle may be acquired by communicating with the vehicle control device or the like.

The operation of the management server 100 and the drive recorder 200a configured in this way will be described. FIG. 10 is a sequence diagram showing an operation when the administrator terminal 110 sets an area table, which is an area definition and a video acquisition condition, for the management server 100.

The administrator terminal 110 transmits to the management server 100 by inputting information for creating an area master (including other area information and area terminal setting information) according to the operation by the administrator (S11). The management server 100 stores the area master information in the area table 102. Further, the administrator terminal 110 sets the area operating conditions according to the operation by the administrator and transmits them to the management server 100 (S12). In the management server 100, the data processing unit 101 stores the received area operation conditions in the area operation setting table 103. The description in this embodiment is described by an example in which the administrator sets the dominant operating conditions, but the present invention is not limited to this, and the operation settings are autonomously set according to the information to be detected. It is also possible to do it.

Specifically, as described in Patent Document 2, data is acquired in advance from other devices such as dangerous behavior, caution behavior, temporary stop behavior at railroad crossings and temporary stop positions, signal ignoring behavior, and speed violation behavior. Needless to say, an area where the safety of a vehicle or the like should be given more consideration may be set autonomously or by an administrator and used for area detection of the present invention and may be used for the safety of other vehicles or the like. stomach. Furthermore, changes in maintenance event data of the vehicle itself, data on surrounding vehicles such as road rage and traffic jams, crosswinds and road freezes, obstacles on roads and routes, which are not specified in the event video acquisition patent of Patent Document 2, By detecting objects based on the analysis results of the front image, or by detecting based on the comparison analysis results of the front and rear images of the snow removal vehicle and the cleaning vehicle, the detected position information is indirectly set as an area. Needless to say, it may be used for area detection and safely used for other vehicles.

This area master information or the like is set by the administrator, for example, based on the shooting location of the image to be acquired in the image of the drive recorder 200a. The shooting locations of the images you want to acquire include intersections with frequent accidents and school zones with many complaints. In addition, such a place may be defined as an acquisition target area in order to investigate aging deterioration of roads, bridges, tunnels, and the like.

In addition, for railway operators, in order to check the conditions of forests and rivers along the railway lines, a drive recorder 200a is installed on the trains, and it is used to check the railway tracks and other facilities along the railway tracks, and to check the flooding of rivers. Such areas may be defined.

In addition, for the long-term care provider or its users / family members, in order to judge whether the users are being handled appropriately, the pick-up area is set as the acquisition target area, and the camera type is indoor camera, rear camera, and pick-up place. It may be a fixed camera installed in.

It can also be applied to the transportation business of pets and racehorses, and it is possible to define the loading platform at the loading location and transportation time as the acquisition target area and check whether the loading / unloading and transportation are properly handled. In addition, by defining an arbitrary area on the transportation route, it is possible to see whether the transportation is properly performed from the viewpoint of a pet or the like, not to a vehicle, such as a sharp curve or a steep slope.

In addition, for snowfall operators, area setting for grasping the status of sites and work progress, area setting for traffic congestion prediction for expressway operators, and generally for transportation operators' luggage loading and unloading work. Area setting for the purpose, area setting (and indoor camera) for checking the loading platform of the transportation company (checking the empty space), etc. can be considered.

In addition, accident-prone locations, bridges, tunnels, and other locations that are prone to deterioration over time may be extracted from, for example, a separately prepared map database and automatically defined based on the location information. For example, police and the like have created a database of accident-prone locations, and by using that database, it is possible to define areas. In addition, the age of bridges and tunnels is also stored in a database by government offices and the like, and information on bridges and the like that have passed a predetermined age may be taken out and an area may be defined based on the position.

Next, the operation when the management server 100 acquires the video from the drive recorder 200a will be described. FIG. 11 is a sequence diagram showing a specific example (pattern 1) of the operation.

In the drive recorder 200a, when the engine of the vehicle 200 is started and power is supplied, the GPS module 202 starts acquiring position information (S201). Further, the camera 205 and the camera 206 start video recording, and the recording unit 204 starts video recording (S202). The recorded video is recorded in an external memory such as an SD card by the recording unit 204. The communication module 201 transmits the position information to the management server 100 at a predetermined cycle (S203). In addition to this position information, state information including sensor information such as vehicle speed, event detection video information, and temperature installed in various vehicles may be transmitted.

In the management server 100, the data processing unit 101 acquires position information from the drive recorder 200a via the communication unit 107, and stores the device ID, position information, and time of the drive recorder 200a in the position information buffer (not shown). Remember (S101). The data processing unit 101 refers to the acquired position information and the area table 102, and determines whether the video has entered or exited the acquisition target area (S102). It can be determined that the vehicle 200 has invaded the area when the position information in the area is received after the position information that has been outside the area is received. On the contrary, when it is determined that the vehicle has entered the area and then the position information outside the area is received, it can be determined that the vehicle 200 has left the area.

When it is determined that the user has entered or / or exited the acquisition target area (S102: entry / exit), the data processing unit 101 acquires the corresponding area ID from the area table 102. The data processing unit 101 refers to the area operation setting table 103, and determines whether or not the state information such as the vehicle speed received together with the position information conforms to the area operation conditions associated with the area ( S103). That is, the data processing unit 101 determines whether or not the state information of the vehicle 200 satisfies the area operating conditions (state information such as a predetermined vehicle speed and a predetermined temperature). In addition, it is determined whether or not the number of times of video UPLOAD has reached the upper limit. Whether or not the upper limit of the number of video UPLOADs has been reached is determined based on the number of times the vehicle 200 has entered or exited the area. For example, in S102, the number of times of entering or leaving each area is stored. The vehicle 200 of the drive recorder 200a for transmitting the image may be the same or different. This area operation condition is an acquisition condition corresponding to the area ID defined in the area operation setting table 103.

The data processing unit 101 further determines whether or not the video satisfying the area operating conditions is immediately acquired (S104). That is, the data processing unit 101 refers to the area operation setting table 103, and if the video UPLOAD information is automatically set, determines that the video is an immediate acquisition target, and performs immediate acquisition processing.

Then, when it is determined that the video is to be acquired immediately, the data processing unit 101 transmits a video acquisition command to the drive recorder 200a (S105). This video acquisition command includes operation timing (timing when the area is entered, timing when the area is exited, etc.) and video cutting time. The operation timing and the video cutout time are taken out from the operation conditions corresponding to the area ID acquired in S102 in the area operation setting table 103.

In the drive recorder 200a, the control unit 211 performs a video cutting process based on the video acquisition command, and transmits the cut video together with the device ID to the management server 100 (S204). In the video image taken by the drive recorder 200a, position information and the like are recorded at predetermined timings. The control unit 211 performs a video cutting process recorded in the external memory based on the operation timing and the video cutting time included in the video acquisition command.

In the management server 100, the data processing unit 101 allocates a video ID and stores the video transmitted from the drive recorder 200a in the video data table 106 (S106). Further, the data processing unit 101 stores the device ID sent together with the video in the area detection recording table 104 in association with the area ID, the area IN date and time, the speed, and the temperature (S106). Further, the data processing unit 101 takes out the key information for the video key information storage table 105 from the area detection recording table 104 or the like, and stores it in the video key information storage table 105 in association with the video ID of the previously acquired video. (S106). Then, the data processing unit 101 determines whether or not the administrator notification is necessary (S107). The presence / absence of administrator notification is set in the area operation setting table 103.

If it is determined that it is necessary here, the data processing unit 101 performs notification processing to the effect that the video has been acquired to the administrator terminal 110 (S107: Yes). If it is not necessary, the process ends and the next position information is waited for.

If the video immediate acquisition is "No" in step S104, the data processing unit 101 acquires the area detection information from the drive recorder 200a without acquiring the video, and the area detection recording table 104 and The video key information storage table 105 is generated. At that time, the data processing unit 101 generates a video ID in order to perform the video ID at the time of the administrator's access request or at the date and time set by the operating conditions, as in the video acquisition data including the key information regarding the event video disclosed in Patent Document 2. Give. Then, in addition to the periodic location information transmission, information indicating that the video corresponding to the video ID has not been acquired is transmitted to the management server.

If "No" is selected in steps S102 and S103, the process ends once.

Here, the video cutting process S204 will be described. FIG. 7 is an explanatory diagram for explaining the relationship between the operation timing and the video cutting process. As shown in the figure, the vehicle 200 is assumed to move from the area IN to the area OUT. Here, when it is specified in the area operation command (S105) of FIG. 13 to cut back from the area IN shown in FIG. 4, for example, the operation timing: area IN and the video cutout time: 10 seconds are specified. If so, the control unit 211 cuts out the image from the time 10 seconds before the detection time of the area IN to the detection time of the area IN from the image stored in the external memory every moment. It is desirable to manage using the same time by GPS time correction or the like so that the internal time of the management server 100 and the drive recorder 200a does not deviate from each other. Needless to say, in consideration of the control delay and the time lag of the detection time, the video with a time of about x seconds may be cut out. Needless to say, the time is not limited to 10 seconds, and the administrator or the like can arbitrarily decide.

Like the event video, the video is recorded in the recording unit 204 of the drive recorder 200a every moment including at least the position information at the detection time. Therefore, the control unit 211 specifies the video cutting time zone from the time when the entry and / or exit to the area is detected from the position information stored in S101 and the video cutting time set in the area operation setting table. It is possible to cut out the video of the specified time zone from the video recorded every moment. Further, since the drive recorder 200a periodically receives a signal for specifying a position from GPS, a sensor, or the like and can associate the position information with the video information, it is necessary based on the detected position information. Needless to say, it is possible to infer an image that traces back to the position to be determined based on known position information and cut out the image based on a plurality of position information.

The operation timing is not one. It is set by the administrator according to the purpose of use of the video to be acquired. For example, if you want to see the driving situation of the driver, the timing suitable for it is good. For example, it is an image of the timing of area IN or area OUT. If you want to see the deterioration of roads over time, the images from area IN to area OUT are good. In addition, as explained above, the detection criteria are not limited to the area, and it goes without saying that the detection criteria may be some information to be detected, for example, the timing when the driver's doze or aside detected as an event video is detected. stomach. At that time, it goes without saying that environmental information around the vehicle or the like that caused the doze (for example, the vehicle speed or the distance between the front and rear vehicles) may be acquired together with the video.

Further, when the area operation command specifies to cut out retroactively from the area OUT, for example, when the operation timing: area OUT and the video cutout time: 10 seconds are specified, the control unit 211 sets the control unit 211. From the video recorded moment by moment in the recording unit 204 of the drive recorder 200a, the video is cut out from the time 10 seconds back from the detection time of the area OUT to the detection time of the area OUT. The specification of the cutting position is the same as above.

In this case as well, it goes without saying that the video with a time of about x seconds may be cut out in consideration of the control delay and the time lag of the detection time.

Further, when the area operation command specifies that the video of the entire area from the area IN to the area OUT is cut out, that is, the operation timing: area IN / OUT and the video cutout time: area ALL are specified. In this case, the control unit 211 refers to the storage time of the image stored in the external memory every moment, and cuts out the image over the entire area from the area IN to the area OUT. When the operation timing: area IN / OUT and the video cutout time: 15 seconds are specified in the area operation setting table 103, the data processing unit 101 recurs from the timing at which the area IN is detected by 15 seconds. As a video including multiple timings for which you want to acquire video, from the time when the area IN is detected and from the time when the area OUT is detected 15 seconds back to the time when the area OUT is detected, the video data is 30 seconds. Generates an area operation command to synthesize with the video data of. Needless to say, video IDs may be assigned to each and managed without compositing.

In this way, it is possible to cut out the image immediately before entering the area, the image immediately before leaving the area, or the image while passing through the area. As described above, the length of the image to be cut out may be set by fixing the number of seconds or by setting the number of seconds to be cut out according to the traveling speed or the like. For example, up to 30 km / h may be set to 10 seconds, up to 60 km / h may be set to 5 seconds, and the like. Depending on the purpose of using the video, the faster the speed, the shorter the video to be cut out. Further, it may be dynamically set by the number of seconds of the difference between the area OUT time and the area IN time. These cutting time determination methods are set in the video cutting time of the area operation setting table 103, and the cutting time is calculated based on the video cutting time. In addition, it goes without saying that the cutting time may be determined based on various information in order to surely acquire the video scene that is indispensable for the purpose of using the video data.

FIG. 8 is a diagram for explaining the movement of the vehicle 200 and the cut-out image at that time. FIG. 8A shows an image traced back from the area IN and an image traced back from the area OUT. Here, the image taken by the indoor camera 206 of the drive recorder 200a is designated as the acquisition target.

As shown in the figure, when a site such as a factory is set as an area and the camera is set as an indoor camera, the management server 100 acquires the image of the driver when the vehicle 200 enters the site from the roadway. be able to. Similarly, the management server 100 can acquire the image of the driver when the vehicle 200 leaves the site. By acquiring the video in this way, it is possible to grasp the driving status of the driver.

Further, as shown in FIG. 8B, video may be acquired in order to grasp the aging deterioration state of the road. In FIG. 8B, a bridge is designated as an area, and the front camera 205 is set as a camera to be image-acquired. In FIG. 8B, the management server 100 can acquire the image of the entire area from the area IN to the area OUT.

These video cropping processes can be similarly applied to the modified examples (patterns 2 to 4) described later.

Next, the operation in the modified example of the management server 100 and the drive recorder 200a in the present disclosure will be described. 12 and 13 are sequence diagrams showing the processing in the modified example (pattern 2). The processing in the pattern 2 is different from the processing in the pattern 1 in that the drive recorder 200a detects the area entry / exit and transmits the area detection information to the management server 100 based on the detection. Therefore, the area master definition process is performed on the drive recorder 200a. Here, the explanation will be focused on different processes.

In FIG. 12, the administrator terminal 110 creates an area master and sets an area operating condition (S11, S12). The management server 100 stores the area operation conditions in the area operation setting table 103 (S13).

Further, in the management server 100, the data processing unit 101 transmits a write command of the area master information acquired by creating the area master to the drive recorder 200a (S14).

In the drive recorder 200a, the control unit 211 stores the area master information in the external memory by the recording unit 204 (S21). The external memory has a table corresponding to the area table 102 and stores the area information.

In this way, the drive recorder 200a can store the area information indicating the acquisition target area of the video, and transmit the area detection information to the management server 100 when entering or / or exiting the acquisition target area. can. The area detection information includes a device ID, an area ID, an area IN date / time (or an area OUT date / time), a speed, a temperature, and the like.

Next, the image acquisition process shown by the pattern 2 will be described with reference to FIG. Note that step S203a is a process corresponding to S102 in FIG. 11, and the processing content is the same. In the drive recorder 200a, position information acquisition and video recording are started (S201, S202), and the various behavior detection units 212 define the position information detected by the GPS module 202 in the area master information stored in the external memory. It is determined whether or not it is included in the range (corresponding to the area table 102) (S203a). When it is determined that the position information is included in the range, the control unit 211 transmits the area detection information to the management server 100 via the communication module 201 (S203b). The area detection information includes a device ID, an area ID, an area IN date / time (or an area OUT date / time), a vehicle speed, and a temperature. Needless to say, the position information is not limited to GPS as in pattern 1.

In the management server 100, whether or not the state information (speed, temperature, etc.) of the area detection information satisfies the area operation condition corresponding to the area ID defined in the area operation setting table 103 by the data processing unit 101. Is determined (S103). Then, when the data processing unit 101 determines that the area operation condition is satisfied and further satisfies the condition for immediate image acquisition, the data processing unit 101 transmits an area operation command to the drive recorder 200a (S105). Hereinafter, the processes of S106 to S107 and S204 are performed.

In this way, the drive recorder 200a automatically detects that the drive recorder 200a has entered or / or exited the acquisition target area of the predetermined video, and the management server 100 outputs the area detection information indicating that. Can be sent to. In the drive recorder 200a, it is not necessary to periodically transmit the position information for area determination in order to perform the area determination on the management server side, and in the management server 100, a notification comes when the target area is entered. , The load of video acquisition processing can be reduced.

Next, the pattern 3 in the video acquisition process will be described. In the pattern 3, the drive recorder 200a further determines whether or not the video satisfies the acquisition condition.

FIG. 14 is a sequence diagram showing the preset processing in the pattern 3. As shown in FIG. 14, when the management server 100 receives the area master information and the area operating conditions from the administrator terminal 110 (S11 and S12), the management server 100 issues an instruction to write the area master information and the area operating conditions to the drive recorder 200a. Send. In the drive recorder 200a, the communication module 201 receives the signal, and the control unit 211 stores it in the recording unit 204 such as an external memory (S21a). Information corresponding to the area table 102 and the area operation setting table 103 is stored in the external memory. As a result, the drive recorder 200a can detect the area and determine the area operating conditions.

In the management server 100, all of the area operating conditions may be stored, and the video UPLOAD information (manual acquisition or automatic acquisition) included in the area operating conditions is shown in order to determine the video immediate acquisition process. ) May be memorized.

Next, the specific processing in the pattern 3 will be described. FIG. 15 is a sequence diagram showing the processing. As shown in the figure, steps S203a to S203b in the drive recorder 200a are different processes. Therefore, the explanation focusing on this process will be given. It should be noted that steps S203a to S203c are processes corresponding to S102 to S103 in FIG. 11, and the processing contents are the same.

In the drive recorder 200a, position information acquisition and video recording are started (S201 to S202), and various behavior detection units 212 detect that they have entered or exited the area (S203a). The control unit 211 acquires area detection information including the area ID of the detected area, the area IN date / time (or the area OUT date / time if necessary), and other state information such as vehicle speed and temperature.

Based on the area detection information, the control unit 211 determines whether or not the area operating conditions stored in the external memory are satisfied (S203c). If it is not satisfied, the process ends. If the condition is satisfied, the control unit 211 transmits the area detection information via the communication module 201 (S203b).

When the data processing unit 101 receives the area video detection information in the management server 100, the data processing unit 101 determines whether the area is the target for immediate video acquisition based on the area ID, and requests video acquisition (S105) and the area detection recording table 104. , Video data storage processing, video key information storage table 105 generation (S106), and administrator notification processing (S107).

As a result, the drive recorder 200a can detect the area and determine the area operating conditions.

Next, the processing of the pattern 4 will be described. FIG. 16 is a sequence diagram showing the operation of the pattern 4. In pattern 4, the presets shown in FIG. 14 are made. This pattern 4 differs from the pattern 3 in that step S203d is performed on the drive recorder 200a.

In the drive recorder 200a, information corresponding to the area table 102 and the area operation setting table 103 is stored by presetting.

Then, in the drive recorder 200a, position information acquisition and video recording are started (S201, S202), and a determination of area entry and the like and a determination of area operation condition conformity are made (S203c). Then, when these judgments are "yes", the control unit 211 determines whether or not the video is immediately transmitted (S203d). This is determined based on whether the video is manually transmitted or automatically transmitted by the administrator terminal 110.

Then, when it is determined that the video is immediately transmitted, the control unit 211 cuts out the designated video from the video stored in the external memory based on the operation timing and the video cutout time set in the drive recorder 200a. conduct. The control unit 211 uses the communication module 201 to transmit the cut-out video together with the area detection information (S204).

Then, in the management server 100, the data processing unit 101 acquires the cut-out video data and stores it in the video data table 106, and also acquires the area detection information and stores it in the area detection recording table 104 (S106a). .. Further, the video key information storage table 105 is generated. On the other hand, when the data processing unit 101 receives only the area detection information, the data processing unit 101 stores it in the area detection recording table 104. When the video key information storage table 105 is generated, it is stored that the video has not been acquired.

Next, a video search process using the video key information storage table 105 will be described. FIG. 17 is a diagram showing an example of a search screen of the administrator terminal 110. The administrator can search the video captured by the vehicle 200 by operating the administrator terminal 110. As shown in FIG. 17, the search screen is composed of a narrowed search condition setting portion, a search button, a search list, and a video screen. As shown in FIG. 17, the administrator searches the video using the organization ID, the driver ID, the device ID, the area master ID, the area ID, the traveling area, the traveling time zone, the speed zone, and the temperature zone as the search key. can do. The administrator terminal 110 makes it possible to search for a video by referring to the video key information storage table 105 of the management server 100.

FIG. 18 is a hardware configuration diagram of the management server 100. Physically, as shown in FIG. 18, the management server 100 shown in FIG. 2 has one or a plurality of CPUs 11, RAMs 12 and ROM 13 as main storage devices, and input devices 14 such as keyboards and mice as input devices. It is configured as a computer system including an output device 15 such as a display, a communication module 16 which is a data transmission / reception device such as a network card, and an auxiliary storage device 17 such as a hard disk or a semiconductor memory. For each function in FIG. 2, the input device 14, the output device 15, and the communication module are controlled by the CPU 11 by loading predetermined computer software (program) on the hardware such as the CPU 11 and the RAM 12 shown in FIG. It is realized by operating 16 and reading and writing data in the RAM 12 and the auxiliary storage device 17.

Next, the effects of the management server 100 and the drive recorder 200a in the present disclosure will be described. The management system in the present disclosure includes a management server 100 and a drive recorder 200a. This management system manages the video (data) stored in the drive recorder 200a (device) among the devices arranged in each of the plurality of vehicles 200 (mobile bodies). Here, the drive recorder 200a is a specific device, but it is not necessarily limited to the drive recorder 200a. Among all the devices with which the management server 100 communicates, the device satisfying the detection condition stored in the area area shown in FIGS. 3 (b) and 3 (c) is the specific device.

If the mobile is a drone, the camera control device of the drone is applicable, and if the mobile is a person, the smartphone owned by the person is applicable.

In addition to the example where the position information of the moving object and the device do not always match, the example where only the moving object moves is included as a modified example, and a person or a vehicle crosses the shooting area of the fixed camera, and the vicinity of the position of the fixed camera. Various changes in the above can be set as detection conditions, in which case a fixed camera corresponds to a specific device.

This management system determines the operation timing of the moving object entering and / or leaving the target area specified based on one or more area IDs and location information determined according to the purpose of using the video, and the operation timing. An area operation setting table 103 is provided for storing video acquisition conditions (data acquisition conditions) including at least the corresponding data acquisition range (cutout time) for each area ID.

Then, the management system communicates with the drive recorder 200a (device) to acquire the video (data) that satisfies the video acquisition condition (data acquisition condition) among the video (data) stored in the drive recorder 200a (device). It is equipped with a data processing unit.

In patterns 1 and 2 of the present disclosure, the area operation setting table 103 is mainly provided in the management server 100, but the drive recorder 200a includes the area operation setting table 103 as in patterns 3 and 4. A management system may be constructed including the drive recorder 200a. This pattern is an implementation difference to enable flexible response depending on the processing capacity of the management server and equipment, the communication environment between the management server and the equipment, etc., and is functionally provided in the management server. It goes without saying that the difference between the device and the device is that the management server can flexibly respond to the processing capacity of the device and the functional difference between the old and new terminals, and can compensate for the difference in capability and function.

According to this disclosure, the management server 100 acquires the video of the drive recorder 200a based on the video acquisition conditions including the operation timing when the vehicle 200 enters the target area for video acquisition and the video acquisition range (video cutout time). Can be done. The acquisition condition of this video can be determined by the standard of the administrator according to the purpose of use of the video. Therefore, the administrator can acquire the video according to the purpose of use. For example, not only the latitude and longitude of the shooting target and the drive recorder 200a, but also the moving speed of the vehicle 200, the type of the shooting target (highway, general road, unloading & pick-up place, parking lot, etc.), the type of camera ( Images can be acquired based on the image pickup pattern according to the purpose of entry / exit of the vehicle (front, indoor), and the purpose of entry / advancement of the vehicle.

In the present disclosure, the area operation setting table 103 further stores the image acquisition timing as the image acquisition condition (data acquisition condition). The data processing unit 101 further acquires data based on the acquisition timing. This acquisition timing is determined by whether the video of the drive recorder 200a is automatically acquired (that is, whether it is acquired immediately after the notification is received (or even after a predetermined time has elapsed)) or whether it is manually acquired by the administrator. Be done. Depending on the purpose of using the video, it may not be necessary to automatically acquire the video immediately. Therefore, it is possible to set which one to use from the viewpoint of the administrator.

Further, the area operation setting table 103 further stores the camera type of the drive recorder 200a (device) as a video acquisition condition. This camera type indicates whether it is a front camera that shoots the traveling direction of the vehicle 200 or an indoor camera that shoots the interior. The data processing unit 101 acquires an image taken by a camera corresponding to the camera type of the drive recorder 200a (device).

Depending on the purpose of using the image, there are cases where it is desired to manage the road in the traveling direction (or where the vehicle has passed) of the vehicle 200 and other images, and there are cases where it is desired to manage the driving state of the driver. By setting the camera type as an acquisition condition, it is possible to acquire images according to the purpose of use of the administrator.

Further, the area operation setting table 103 further stores the state information when the vehicle 200 (moving body) acquires the image as the image acquisition condition (data acquisition condition). The state information is, for example, the speed of the vehicle 200, the temperature detected by the sensor of the vehicle 200 (indoor or outdoor). The data processing unit 101 further acquires data based on the state information.

Depending on the purpose of using the video, it may be desired to acquire the video according to the state information of the vehicle 200. For example, by acquiring an image corresponding to the speed of the vehicle 200, it is possible to grasp the driving situation of the driver according to the speed. In addition, by acquiring an image according to the temperature, it is possible to grasp the transport state of the animal at the time of transporting the animal.

Further, the area operation setting table 103 further stores the upper limit of the number of times of image acquisition as an image acquisition condition. The data processing unit 101 acquires a video based on the number of acquisitions. Depending on the purpose of using the video of the administrator, multiple videos may not be required. In this disclosure, the acquisition of video can be restricted.

In the management system of the present disclosure, the data processing unit 101 receives area detection information, which is information related to the time of video acquisition, from the drive recorder 200a (device). Then, based on the area detection information, a key information table used for searching the acquired video is generated. For example, the area detection information is the date and time of entering the area, the date and time of exiting the area, the speed of the vehicle 200, and the temperature. By associating this information with the video as the key information used for the search, the video search becomes possible. It should be noted that this association may be searched based on the video key information including the area detection information, the video ID, the recording date and time, etc., such as when the video is not acquired immediately, and the video data itself may be searched and then the video acquisition request or the like may be made. Needless to say.

The area table 102 stores a plurality of area IDs that match the purpose of use of the video (data) in association with the area master ID. The video acquisition conditions of the area operation setting table 103 are set for each area master ID.

According to this disclosure, it is possible to collectively determine the video acquisition conditions for each area master ID.

Further, in the management system of the present disclosure, when the data processing unit 101 receives the area detection information which is the information related to the image acquisition from the drive recorder 200a, the drive recorder 200a stores the image satisfying the acquisition condition according to the area detection information. Determine if you are doing it.

According to this disclosure, when the drive recorder 200a shown in the above pattern 2 has a configuration for area detection, the area detection information can be used to take out an image satisfying the acquisition condition.

Further, in the present disclosure, the data processing unit 101 of the management server 100 transmits the operation timing and the data acquisition range to the drive recorder 200a, so that the drive recorder 200a performs the image cutting process and enables the image acquisition.

According to this disclosure, it is possible to acquire a video satisfying the acquisition conditions according to the control of the management server 100.

In the management system according to the pattern 1, the drive recorder 200a includes a communication module 201 that periodically transmits the position information of the vehicle 200 to the management server 100.

The management server 100 enters and / or exits the video acquisition target area based on the area table 102 including at least one area ID and coordinate information that specifies the video acquisition target area and the position information of the vehicle 200. A data processing unit 101 for detecting the above is provided. This functions as an area detector. Then, the area operation for storing at least the data acquisition condition including the operation timing for the image acquisition target area and the image acquisition range according to the operation timing, which is determined according to the purpose of using the image, for each area ID. The data processing unit 101 includes the setting table 103, and among the data stored in the drive recorder 200a, the data satisfying the data acquisition condition is communicated with the drive recorder 200a and acquired.

In the disclosure in this pattern 1, it is not necessary to perform area detection on the drive recorder 200a side by periodically transmitting the position information from the drive recorder 200a. Therefore, the configuration can be simplified.

Further, in the pattern 3, in the drive recorder 200a, the control unit 211 functions as an area detection unit and is an area table (area table 102) including at least one area ID and coordinate information that specifies an image acquisition target area. ) And the position information of the vehicle 200, the entry and / or exit to the acquisition target area is detected. Then, the control unit 211 functions as an acquisition condition determination unit, and the operation timing of entering and / or exiting the vehicle 200, which is determined according to the purpose of using the video, and the data acquisition range (data acquisition range according to the operation timing). It is determined whether or not the video acquisition condition is satisfied based on the area operation setting table (corresponding to the area operation setting table 103) that stores the data acquisition condition including at least the video cutout time) for each area ID.

When the communication module 201 is determined by the control unit 211 to satisfy the video acquisition condition, the communication module 201 transmits the area detection information detected by the control unit 211 to the management server 100.

When the data processing unit 101 acquires the area detection information in the management server 100, among the images stored in the drive recorder 200a, the data satisfying the image acquisition condition is communicated with the drive recorder 200a and acquired.

In the disclosure according to this pattern 3, the drive recorder 200a performs area detection and determination of operating conditions. Therefore, it has a table corresponding to the area table 102 and the area operation setting table 103. According to this disclosure, the processing on the management server 100 side is simplified by performing a lot of processing on the drive recorder 200a side.

Further, in the pattern 4, in addition to the pattern 3, the control unit 211 responds to the operation timing of entering and / or exiting the 200 areas of the vehicle, which is determined according to the purpose of using the image, and the operation timing. Based on the area operation setting table that stores the video acquisition conditions including at least the data acquisition range (video cutout time) for each area ID, the control unit 211 extracts the video satisfying the data acquisition conditions from the external memory. ..

In particular, when the vehicle is outside the mobile phone network such as an underground parking lot or GPS, even if the detection conditions and operating conditions cannot be determined on the management server 100 side by patterns 1 and 2, the vehicle sensor on the drive recorder 200a side. The position of the vehicle is detected based on the information of the environment sensor such as, and it is judged whether the detection condition and the operation condition are satisfied. Then, when the communication module 201 immediately and automatically transmits the video satisfying the data acquisition conditions according to the operating conditions, the transmission to the management server 100 side is transmitted to the reservation information table on the drive recorder 200a side (not shown). Store it and send it when communication becomes possible.

Further, when the video data is manually transmitted from the administrator side, when an access request (not shown) is received, the drive recorder 200a side transmits the video data as a response to the access request. Also, even in areas where GPS information is well received, for example, about the position where you want to acquire the image of the driving skill spot (S-shaped curve, sideways, width adjustment, temporary stop position, uphill temporary stop position, etc.) When accuracy is required, detection based on GPS signals is limited and susceptible to scrambled information. Even in that case, if the detection is performed based on the relative position, the person who wants to obtain a driver's license or the driving teacher can confirm the result of the driving technique on the video based on the acquired video.

According to this disclosure, most of the processing is performed on the drive recorder 200a side. Therefore, the processing in the management server 100 can be simplified.

Here, in any pattern, the management server 100 may not be able to acquire data such as video for some reason between the drive recorder 200a, and if the video data itself is transmitted to the management server 100, the communication traffic will be overloaded. In order to reduce the amount of transmission data, the control unit 211 does not send the video data itself, but instead sends the video identifier and other information that is key information of the video data (for example, position or position or). Time information) may be sent.

In that case, the relationship between the video key information storage table of FIG. 6, the vehicle management table 105 described in Patent Document 2, the vehicle management table 215 on the device side, and the embodiment described in the reservation information table 104 are applied. Then, the video data of the specific area is managed / acquired. The following describes an embodiment in which the vehicle management table disclosed in Patent Document 2 is managed by the management server and the device side, and the management server later acquires the video based on the video key information.

First, the video identifier, the key information of the video data, and the video file are recorded in the vehicle management table 215 on the device side stored in the plurality of devices under the control of the user. After that, the key information or the like is voluntarily transmitted from the plurality of said devices to the management server 100, or the key information or the like is actively transmitted in response to the access request from the management server 100, and the vehicle management table on the management server 100 side. Key information and the like stored in a plurality of devices are recorded in 105.

The vehicle management table 105 on the management server 100 side needs the device identifier as a table item that does not exist in the vehicle management table 215 in order to distinguish the information of the vehicle management table 215 on the device side. In this respect, the reservation information table of FIG. 3 of Patent Document 2 is also provided in order to specify which video identifier of the plurality of the devices is reserved.

On the other hand, in the video data storage area of the vehicle management table 215 on the device side, the video data associated with the video identifier is stored moment by moment, so that the video data is available in principle. However, in order to reduce the amount of transmitted data in principle, the vehicle management table 105 on the management server 100 side does not send the video data itself, but the video identifier and other information that is key information of the video data (for example, position or position or). Time information) is sent. After that, the video data is transmitted based on a predetermined condition, and the acquisition status flag is updated to acquired.

For this reason, in principle, the video data is not available in the video data storage area of the vehicle management table 105. Therefore, in order to distinguish whether the video data has been acquired, the acquisition status flag is required as a table item that does not exist in the vehicle management table 215, and the acquired, unacquired, reserved, and unacquirable states are distinguished. ..

Further, in the video data storage area of the vehicle management table 215, the video data associated with the video identifier is recorded regardless of the communication enable / disable state with the management server 100, but the video data storage area of the vehicle management table 105 is recorded. Then, if the management server 100 cannot communicate with the target device, the video data cannot be acquired. Therefore, in order to distinguish whether or not the video data can be acquired, the acquisition availability flag is required as a table item that does not exist in the vehicle management table 215, and the states of communication enable and communication failure are distinguished.

Then, when an access request or a reproduction request for video data is made on the management screen of the administrator terminal 300, which will be described later, a list of key information and the like stored in a plurality of managed devices is displayed in the vehicle management table 105. It is displayed based on the above, and the video acquisition status is converted into an icon for each key information, etc., and an access request or a playback request can be easily made by clicking the icon. When the acquisition is completed, the icon display on the management screen is also changed to acquired by changing the acquisition status flag to acquired.

Further, in the video list frame in the refined search condition setting screen of FIG. 17, for example, (1) organization ID, (2) driver ID (may be a name), (3) device ID, and (4) area master. Recording date / time, vehicle name, and status of images extracted by narrowing search conditions such as ID, (5) area ID, (6) driving area, (7) driving time zone, (8) speed zone, (9) temperature zone, etc. , The video acquisition status flag is displayed, and by clicking the video acquisition status, it is possible to easily acquire data by an access request for unacquired video.

Although these inventions are mainly described in that the management server 100 acquires video data from the drive recorder 200a, the present invention relates to a device in which the management server 100 is collided with a vehicle or an air vehicle. It is not limited to transmitting and receiving the target data, and it is possible to control the movement so as to autonomously avoid obstacles and the like based on a real-time image acquired from, for example, an air vehicle. As a result, the target area of the target data that needs to be sent and received between the management server and the target device is detected based on the above-mentioned detection conditions and operating conditions, and the desired operation is performed or a plan thereof is performed. Needless to say, you can do it.

Needless to say, it is an invention used in various usage scenes, but in that case, the following terms used in the above description refer to "video data" as "target data", respectively.
"Get video" to "Perform or plan the desired action",
"Data transmission" to "Data transmission or control of target device",
"Acquisition processing" is "acquisition or control processing, or operation reservation",
"Area detection notification" is changed to "Detection notification",
"Acquisition target device" is "Transmission / reception target device",
"Notification of completion of acquisition reservation" is changed to "Notification of completion of transmission / reception reservation",
The category of the invention is not limited to the "management system", but the details of the invention for the "management device", the "management method", or the category related to the "program" that realizes these "management methods". It goes without saying that it is easily adaptable to the explanation.

In the above-described embodiment, an application example in a drive recorder or a drone mounted on a vehicle has been described, but it can also be applied to a device such as a smartphone for taking a picture with a camera. For example, when a user moves in and out of a predetermined area while holding a smartphone, it can be applied to a process of cutting out only the video shot in that area.

Also, when trying to apply to a drone, it can be applied to remote control other than shooting processing. For example, when the drone enters and exits a predetermined area, a predetermined operation is performed. As a predetermined operation, there is an obstacle avoidance operation by analyzing an image taken by a drone camera. By activating the video analysis function when entering a predetermined area, more detailed processing can be performed. In addition, when the drone is used for delivery, it can also be used for recognition processing of the delivery destination.

100 ... management server, 200 ... vehicle, 200a ... drive recorder, 110 ... administrator terminal, 101 ... data processing unit, 102 ... area table, 103 ... area operation setting table, 104 ... area detection recording table, 105 ... video key information Storage table, 106 ... Video data table, 107 ... Communication unit.

Claims (17)

In a management device for communicating with one or more devices and performing a desired operation associated with the data stored in the device.
An operation setting table that stores the detection conditions and operation conditions determined according to the purpose of use of the data associated with the detection target, and
A data processing unit that communicates with a specific device that satisfies the detection conditions and the operation conditions from the information to be detected to execute and / or plan a predetermined operation.
A management device equipped with. The operation setting table stores at least the entry and / or exit of the detection target into the target area as a detection condition for each target area specified based on one or more position information.
The data processing unit identifies the device that communicates based on the position information of the detection target and the detection conditions.
The management device according to claim 1. The predetermined operation is data acquisition and / or control of the specific device or the device capable of communicating with the specific device.
The management device according to claim 1 or 2, wherein when the target is detected based on the detection conditions, the operating conditions for the device associated with the target are specified and data communication is performed. As the operation conditions, at least one of the operation timing, the maximum number of operations, the type of the camera associated with the device, the operation reservation information, and the state information of the detection target is stored in the area operation setting table.
The data processing unit enables autonomous operation based on the information of the detection target based on the area operation setting table.
The management device according to any one of claims 1 to 3. The predetermined operation is data acquisition and / or control of the specific device or the device capable of communicating with the specific device.
Communicates with the device associated with the detected target area based on the location information of the detection target, acquires data based on the operating conditions, and / or controls the specific device or the device.
The management device according to any one of claims 1 to 4. The data processing unit operates the device by transmitting at least one of the operation timing and / or the operation range to the device.
The management device according to any one of claims 1 to 5. The data processing unit stores the detection result based on the detection condition as area detection information, and generates a key information table used for searching the data based on the area detection information and / or the operation condition.
The management device according to any one of claims 1 to 5. It has an area table that stores a plurality of areas that match the purpose of use of the data in association with the area master.
The operating conditions for the associated area can be set for each area master.
The management device according to any one of claims 1 to 7. In a management method for communicating with one or more devices and performing the desired operation associated with the data stored in that device.
From the information of the detection target, the entry and / or exit of the detection target into the target area specified based on one or more position information is detected.
A management method in which data processing is performed so as to perform a predetermined operation and / or plan by communicating with a specific device satisfying the above conditions based on the operation conditions determined according to the purpose of using the data. The predetermined operation is data acquisition and / or control of the specific device or the device capable of communicating with the specific device.
The management method according to claim 9, wherein when the target is detected based on the detection conditions, the operating conditions for the device associated with the target are specified and data communication is performed. As the operation condition, at least one of the operation type, the upper limit number of operations, the camera type, the operation reservation information, and the state information of the detection target is stored in the area operation setting table.
As the operating conditions according to the purpose of using the data, it is possible to set autonomously or by the administrator by the information of the detection target.
The management method according to claim 9 or 10. The data processing stores the detection result based on the detection condition as area detection information, and generates a key information table used for searching the data based on the area detection information and / or the operation condition.
The management method according to any one of claims 9 to 11. It has an area table that stores a plurality of areas that match the purpose of use of the data in association with the area master.
The operating conditions for the associated area can be set for each area master.
The management method according to any one of claims 9 to 12. The management method according to any one of claims 9 to 13, wherein the data processing operates the device by transmitting at least one of an operation timing and / or a data acquisition range to the device. In a management system consisting of one or more devices that are matched to multiple mobile objects and a management server that acquires data stored in the devices.
The equipment is
It has a communication unit that periodically transmits data including position information and status information of the mobile body to the management server, and a storage unit that stores the data.
The device or management server
An area detection unit that detects the entry and / or exit of the moving object into the target area specified based on one or more position information, and
A judgment unit that determines whether or not the operating conditions determined according to the purpose of use of the data are satisfied in response to the detection, and a judgment unit.
When the determination unit determines that the operating conditions are satisfied, the data is communicated between the management server and the device based on the operating conditions, and data acquisition and / or control execution and / or planning is performed. A management system equipped with a processing unit. In a program executed by an information processing device that uses management data to communicate with one or more devices and perform and / or plan the desired operation associated with the target data stored in that device.
For each area ID of the target area specified based on one or more position information, at least the detection conditions for entering and / or exiting the detection target into the target area, and the operating conditions determined according to the purpose of using the data. Is stored as area operation setting data to store
Based on the area operation setting data, it is possible to perform autonomous or dominant operation by the administrator based on the information of the detection target.
A program that features that. Based on the autonomous or dominant operation by the administrator, the vehicle information to be detected, at least the driver information including the driver ID or name, the device ID, the area master ID, the area ID, the traveling area, and the traveling time zone. , Speed information or temperature information, sensor information installed in the vehicle is stored as video key information storage data that is stored in association with video data.
It is possible to narrow down by using at least one item of the video key information storage data.
Demonstrate the refined search function by the administrator device operated by the administrator.
The program according to claim 16.

Images