JP2018129589A - Data processing system and data processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a data processing system and a data processing method capable of shortening the stop time of data processing, due to waiting for arrival of data from each device, by restraining the impact of variation of delay of respective transmission data.SOLUTION: In a data processing system having multiple data transmitters, data storage units and data processing units, the data transmitter packetizes acquired monitoring data, transmits the packet while adding the acquisition time of the monitoring data to the header of the packet, the data storage unit stores reception packets received from the multiple data transmitters, and group information for specifying a group out of the multiple data transmitters, and reception packets transmitted from data transmitters belonging to the groups specified by the group information and the monitoring time of the header is within a prescribed time are integrated to generate an integration packet, which is then transmitted to the data storage unit.SELECTED DRAWING: Figure 11

Description

  The present invention relates to a data processing system and a data processing method.

  In recent years, a monitoring system that performs integrated data analysis using captured images and sensing data transmitted from a monitoring device such as a plurality of cameras and sensors installed at different locations in a monitoring area has been used. For example, processing such as person tracking, posture estimation, and three-dimensional shape estimation may be performed based on captured images transmitted from a plurality of cameras. For example, in a suspicious person monitoring device composed of a monitoring camera, an image distribution unit, a network unit, an image processing unit, and an integration unit, the image distribution unit transmits the image received from each monitoring camera with a time, The image received by the processing unit and the integration unit is tracked, and the tracking result of each camera is processed in an integrated manner in consideration of the given time to detect a suspicious person (for example, see Patent Document 1).

JP 2013-206140 A

  In this way, in a system that analyzes data from a plurality of monitoring devices in an integrated manner, it is necessary to perform data analysis by acquiring data at substantially the same time from each monitoring device at substantially the same time. However, even when data is transmitted almost simultaneously in each monitoring device, delay variation occurs for each data transmitted due to the influence of the congestion degree of the communication path and the processing capability of the relay device. For this reason, in the apparatus which receives and analyzes these data, the timing which each data arrives differs, and there existed a problem that required data could not be received substantially simultaneously. For this reason, in the conventional system, it is necessary to take measures such as stopping the analysis processing on the receiving side and waiting until all necessary data is received until the data acquired at approximately the same time is available, and analyze in real time. There was a problem of having an adverse effect when processing had to be performed.

  The present invention provides a data processing system and a data processing method capable of suppressing the influence of delay variation for each transmission data and shortening the data processing stop time due to waiting for the arrival of data from each device. With the goal.

  According to one aspect of the present invention for solving such a problem, a data processing system including a plurality of data transmission devices, a data storage device, and a data processing device is provided. In such a data processing system, the data transmission device packetizes the monitoring data acquired by monitoring the surrounding situation, adds the acquisition time of the monitoring data to the header portion of the packet, and transmits the data. A reception unit that receives a packet transmitted from the data transmission device, a reception packet received by the reception unit, a storage unit that stores group information that specifies a group of the plurality of data transmission devices, and a reception packet Integrated packet generation for generating an integrated packet by integrating received packets transmitted from a data transmitting device belonging to the group specified by the group information and having a header portion acquisition time within a predetermined period And a transmission unit that transmits the generated integrated packet to the data processing device.

  In such a data processing system, the data transmission device acquires position information related to the position where the monitoring data is acquired, adds the position information to the header portion, and transmits it. The data storage device is based on the position information added to the header portion. It is preferable to further include a group information update unit that updates the group information.

  Moreover, in such a data processing system, it is preferable that the group information update unit determines a period for updating the group information according to the moving speed of the data transmission device.

  Further, in such a data processing system, the integrated packet generation unit, among the received packets transmitted from the data transmitting device belonging to the group specified by the group information, there is no received packet whose acquisition time is within a predetermined period, Information indicating that there is no received packet within a predetermined period is preferably included in the integrated packet.

  In such a data processing system, the integrated packet generation unit receives monitoring data of a received packet transmitted from a data transmitting device belonging to the group specified by the group information and having an acquisition time within a predetermined period. When the number of integrated packets necessary for storing is 2 or more, the integrated monitoring data may be generated by sequentially integrating the divided monitoring data obtained by dividing the monitoring data of each data transmission apparatus belonging to the group into the integrated packet number. preferable.

  According to another aspect of the present invention, there is provided a data processing method in a data processing system having a plurality of data transmission devices, a data storage device, and a data processing device. The data processing method includes a step in which the data transmission device packetizes the monitoring data acquired by monitoring the surrounding situation, adds the acquisition time of the monitoring data to the header portion of the packet, and transmits the packet. In the device, the receiving unit receives a packet transmitted from a plurality of data transmitting devices, and the storage unit receives the received packet received by the receiving unit, and group information that specifies a group of the plurality of data transmitting devices. The integrated packet generator is a received packet transmitted from a data transmitting device belonging to the group specified by the group information among the received packets, and the acquisition time of the header part is within a predetermined period Generating a unified packet by integrating the received packets in the network, and a transmission unit And a step of transmitting a.

  According to the present invention, it is possible to suppress the influence of delay variation for each transmission data, and to shorten the data processing stop time due to waiting for the arrival of data from each device.

1 is an overall configuration diagram of a data processing system 1 according to an embodiment of the present invention. 3 is a functional block diagram of a control unit 12 in the data transmission device 10. FIG. 3 is a block diagram of a storage unit 21 in the data storage device 20. FIG. It is a figure which shows the example of the group information memorize | stored in the group information storage part. 3 is a functional block diagram of a control unit 22 in the data storage device 20. FIG. 4 is a flowchart illustrating packet generation processing in the data transmission device 10. It is a figure which shows the example which divides | segments monitoring data into two packets, and transmits. It is a figure which shows the structure of a monitoring data packet. 4 is a flowchart showing group information update processing in the data storage device 20. 4 is a flowchart showing integrated packet generation processing in the data storage device 20. It is a figure which shows the integrated packet which integrated several monitoring data. It is a figure which shows the size of the monitoring data in the integrated packet production | generation process of FIG.

  Hereinafter, a data processing system and a data processing method according to the present invention will be described with reference to the drawings. However, it should be understood that the present invention is not limited to the drawings or the embodiments described below.

  FIG. 1 is an overall configuration diagram of a data processing system 1 according to an embodiment of the present invention. As shown in FIG. 1, the data processing system 1 includes a plurality of data transmission devices 10, a data storage device 20, and a data processing device 30. The data transmission device 10 and the data storage device 20 and the data storage device 20 and the data processing device 30 are connected via a communication network 90 having one or a plurality of local / wide area wired / wireless communication networks. Is done. Here, the communication network between the data transmission device 10 and the data storage device 20 and the communication network between the data storage device 20 and the data processing device 30 are schematically shown as one communication network 90. These communication networks may be separate. It is assumed that time synchronization is generally achieved among the plurality of data transmission devices 10, the data storage device 20, and the data processing device 30.

  In one embodiment of the data processing system 1 to which the present invention is applied, for example, a plurality of data transmissions provided with various sensors such as a monitoring camera, a human sensor, a temperature sensor, and a gas sensor in a monitoring area such as a building premises. A device 10 is installed to monitor safety in the monitoring area. For example, a plurality of surveillance cameras are installed around an imaging area such as a building entrance, and the imaging area can be simultaneously imaged from different angles. Monitoring data such as images, temperatures, and gas concentrations acquired by these cameras and sensors is analyzed by the data processing device 30 in order to detect the occurrence of abnormality in the monitoring area. At this time, for example, the data processing device 30 analyzes the posture of the person, the three-dimensional shape of the object, and the like using a plurality of image data obtained by photographing a plurality of surveillance cameras at the same time from different angles. Suspicious person and suspicious object can be detected.

  For this reason, the data transmission device 10 according to the present embodiment adds its own identification information, time information, and position information to the monitoring data acquired by the camera or sensor, and transmits it to the data storage device 20 on the communication path. . The data storage device 20 uses the identification information, time information, and position information of the data transmission device 10 to transmit to the data processing device 30 an integrated packet in which the monitoring data acquired at approximately the same time at a nearby location is integrated. . Thereby, for example, the data processing device 30 can simultaneously receive, from the data storage device 20, image data obtained by photographing a plurality of monitoring cameras at the same time from different angles at the same photographing region. For this reason, the data processing device 30 does not have to wait until all the images necessary for image analysis are prepared, and can analyze the image in real time with almost no delay.

  Hereinafter, the configuration of each device of the data processing system 1 according to the present embodiment will be described.

  The data transmission device 10 packetizes the monitoring data acquired by monitoring the surrounding situation, and stores the identification information of itself and the time information and position information regarding the time and position at which the monitoring data is acquired in the header part of the packet, and the data It transmits to the storage device 20. In the present embodiment, the data transmission device 10 may be, for example, a device in which an information processing unit such as a microcontroller is incorporated in a monitoring camera or various sensors. The data transmission device 10 may be a portable information terminal such as a smartphone or a tablet having a camera or a sensor. The data transmission device 10 may not be fixedly installed at a certain point in the monitoring area, may be mounted on a moving vehicle, a drone, or the like, or may be a wearable device worn by a person.

  As illustrated in FIG. 1, the data transmission device 10 includes a storage unit 11, a control unit 12, a monitoring unit 13, a position detection unit 14, and a communication unit 15.

  The storage unit 11 stores codes and data of various computer programs executed in the data transmission device 10. For example, the storage unit 11 can include a semiconductor memory such as a RAM, a ROM, and an EPROM. The storage unit 11 may have any type of storage device such as a magnetic storage device or an optical storage device.

  The control unit 12 includes a processor and peripheral circuits, and the processor implements various processes in the data transmission apparatus 10 by executing various computer programs stored in the storage unit 11. The computer program executed by the control unit 12 may be stored in advance in the storage unit 11 and provided via a computer-readable storage medium such as a magnetic storage medium, an optical storage medium, a semiconductor storage medium, or the communication unit 15. May be stored in the storage unit 11. The functional modules realized by the control unit 12 will be described in detail later.

  The monitoring unit 13 monitors the surrounding situation, acquires monitoring data regarding the monitored surrounding situation, and passes the monitoring data to the control unit 12. The monitoring unit 13 may pass time information related to the acquisition time at which the monitoring data is acquired to the control unit 12. For example, the monitoring unit 13 is a variety of sensors according to an object or purpose to be monitored, such as a monitoring camera, an infrared sensor, an ultrasonic sensor, a temperature sensor, a rainfall sensor, and a gas sensor installed at different angles in different monitoring areas. Can be configured. The data transmission device 10 may include a plurality of monitoring units 13.

  In the present embodiment, the example in which the monitoring unit 13 is incorporated in the data transmission device 10 to form an integrated device is shown, but a separate monitoring device independent of the data transmission device 10 may be used. In this case, the monitoring device and the data transmission device 10 have a wired / wireless communication line communication interface that connects each other, and monitoring data is transmitted from the monitoring device to the data transmission device 10 via this communication interface.

  The position detection unit 14 detects the position of the data transmission device 10 and passes information related to the detected position to the control unit 12. The position information may be an absolute position such as a latitude and longitude altitude, or a relative position from a certain point. For example, the position detection unit 14 can detect the position of the data transmission device 10 by using a movement amount measurement using a GPS, a wireless communication network, an acceleration sensor, a gyroscope, or the like. When the monitoring unit 13 is a monitoring device separate from the data transmission device 10, the position detection unit 14 may be included in the monitoring device. In this case, the position detection unit of the monitoring apparatus can acquire the position information of the monitoring apparatus and transmit the acquired position information to the data transmission apparatus 10 via the wired / wireless communication line in the same manner as the monitoring data.

  The communication unit 15 is a communication interface with a wired / wireless communication line connected to the data storage device 20. The communication unit 15 transmits / receives data to / from the data storage device 20 via the communication network 90.

  FIG. 2 is a functional block diagram of the control unit 12 in the data transmission apparatus 10. As shown in FIG. 2, the control unit 12 includes a monitoring data acquisition unit 121, a time information acquisition unit 122, and a position information acquisition as functional modules realized by executing the computer program stored in the storage unit 11. Means 123 and packet generation means 124.

  The monitoring data acquisition unit 121 receives the monitoring data from the monitoring unit 13 and passes the acquired monitoring data to the packet generation unit 124. The monitoring data acquisition unit 121 may receive monitoring data every time the monitoring unit 13 acquires monitoring data, or may periodically receive monitoring data from the monitoring unit 13. Moreover, the monitoring data acquisition means 121 may acquire monitoring data from the monitoring unit 13 in response to a request.

  The time information acquisition unit 122 acquires time information related to the time at which the monitoring data is acquired, and passes it to the packet generation unit 124 as the time information of the monitoring data. The time information may be an absolute time such as local standard time or a relative time from a certain time point.

  For example, the time information acquisition unit 122 may use the time read from the time measuring unit (not shown) of the data transmission device 10 when the monitoring data is received from the monitoring unit 13 as the time information of the monitoring data. Further, the time information acquisition unit 122 may receive the acquisition time when the monitoring data is acquired from the monitoring unit 13.

  The position information acquisition unit 123 acquires information related to the position of the data transmission device 10 from the position detection unit 14 and passes the information to the packet generation unit 124 as the position information of the monitoring data.

  The packet generation unit 124 packetizes the monitoring data received from the monitoring data acquisition unit 121, and the time information and position information of the monitoring data received from the time information acquisition unit 122 and the position information acquisition unit 123 in the header part of the packet. Is added to generate a monitoring data packet. The packet generator 124 transmits the generated monitoring data packet to the storage device 20 via the communication unit 15. The packet generation process performed by the packet generation unit 124 will be described in detail later.

  The data storage device 20 receives and integrates monitoring data packets from the plurality of data transmission devices 10 via the communication network 90, and transmits the integrated integrated packets to the data processing device 30 via the communication network 90. The data storage device 20 is an information processing device such as a server, for example.

  The data storage device 20 is preferably arranged at a position closer to the data transmission device 10 than the data processing device 30 on the communication network 90. For example, the data storage device 20 may be a network server arranged in a wide area communication network such as a communication network provided by a communication carrier.

  As illustrated in FIG. 1, the data storage device 20 includes a storage unit 21, a control unit 22, and a communication unit 23.

  The storage unit 21 stores codes and data of various computer programs executed in the data storage device 20. For example, the storage unit 21 can include a semiconductor memory such as a RAM, a ROM, and an EPROM. The storage unit 21 may have any type of storage device such as a magnetic storage device or an optical storage device.

  FIG. 3 is a block diagram of the storage unit 21 in the data storage device 20. As illustrated in FIG. 3, the storage unit 21 of the data storage device 20 includes a group information storage unit 211 and a received packet storage unit 212.

  The group information storage unit 211 stores group information that specifies a group of the data transmission device 10 that integrates monitoring data.

  FIG. 4 is a diagram illustrating an example of group information stored in the group information storage unit 211. The group information is information indicating a combination of the data transmission apparatuses 10 that are transmission sources of a plurality of monitoring data that the data processing apparatus 30 needs to process at the same time. The group information may be stored in advance in the group information storage unit 211, read from a computer-readable storage medium such as a magnetic storage medium, an optical storage medium, a semiconductor storage medium, or the input unit (see FIG. (Not shown) or stored in the group information storage unit 211 based on information transmitted from another device such as the data processing device 30 via the communication network 90.

  As shown in FIG. 4, the group information includes an item “group member”, and uses identification information such as an address of the data transmission device 10 to use the “data transmission device A” and “data transmission device B” belonging to the group. ”And“ data transmission device D ”can be designated. The group information includes an item “group condition”, and the group information is assigned to the group according to the condition of the existence area that exists in the “area within 1 km radius centered on 35.68 ° north latitude and 139.56 ° east longitude”. The data transmitting apparatus 10 to which it belongs may be specified. When a group is fixedly set by an invariant “group member”, the “group condition” may be omitted. When a group is designated by a “group condition” such as an existing area, the “group member” of the group information may be updated by the movement of the data transmission device 10 or the like. Fixed group members and group conditions can be used as group identification information, but other group identification information may be added to the group information as necessary.

  The reception packet storage unit 212 stores monitoring data packets received from the plurality of data transmission apparatuses 10 via the communication unit 23.

  The control unit 22 includes a processor and peripheral circuits, and the processor implements various processes in the data storage device 20 by executing various computer programs stored in the storage unit 21. The computer program executed by the control unit 22 may be stored in the storage unit 21 in advance, and is provided via a computer-readable storage medium such as a magnetic storage medium, an optical storage medium, a semiconductor storage medium, or the communication unit 23. It may be stored in the storage unit 21. The functional module realized by the control unit 22 will be described in detail later.

  The communication unit 23 is a communication interface with a wired / wireless communication line connected to the data transmission device 10 and the data processing device 30. The communication unit 23 is a communication interface for transmitting / receiving data to / from the data transmitting apparatus 10 via the communication network 90 and transmitting / receiving data to / from the data processing apparatus 30 via the communication network 90. is there.

  FIG. 5 is a functional block diagram of the control unit 22 of the data storage device 20. As shown in FIG. 5, the control unit 22 includes a packet reception unit 221, a group information update unit 222, and an integrated packet generation unit as functional modules realized by executing the computer program stored in the storage unit 21. 223.

  The packet receiving unit 221 receives the monitoring data packet transmitted from the data transmitting apparatus 10 via the communication unit 23 (receiving unit) and stores it in the received packet storage unit 212.

  The group information update unit 222 updates the group information stored in the group information storage unit 211 based on the received packet position information stored in the received packet storage unit 212. The processing performed by the group information update unit 222 will be described in detail later.

  Based on the group information in the group information storage unit 211, the integrated packet generation unit 223 selects monitoring data stored in the integrated packet from the received packets stored in the received packet storage unit 212, and generates an integrated packet. . The integrated packet generation unit 223 transmits the generated integrated packet to the data processing device 30 via the communication unit 23 (transmission unit). The integrated packet generation processing by the integrated packet generation means 223 will be described in detail later.

  The data processing device 30 is an information processing device that receives an integrated packet from the data storage device 20 via the communication network 90 and performs data analysis such as image analysis using monitoring data of the received integrated packet. For example, the data processing device 30 simultaneously receives, from the data storage device 20 by the integrated packet, image data obtained by the monitoring cameras of the plurality of data transmission devices 10 shooting the same shooting area from different angles at approximately the same time, and the posture of the person And a three-dimensional shape of an object can be analyzed to detect a suspicious person or a suspicious object. The data processing device 30 may be a high function information processing device such as a workstation, for example.

  FIG. 6 is a flowchart showing packet generation processing in the data transmission apparatus 10. The processing flow shown in FIG. 6 is realized by the control unit 12 executing the computer program code stored in the storage unit 11. The packet generation process is a process in which the packet generation unit 124 packetizes the monitoring data acquired by the monitoring unit 13 and generates a monitoring data packet in which time information and position information are added to the header portion.

  When receiving the monitoring data from the monitoring unit 13, the packet generation unit 124 starts a loop L601 that is executed every time the monitoring data is acquired (step S601). In step S601, when the monitoring data is not acquired for a predetermined time or more, or when the end of the packet generation process is instructed from an input unit (not shown) of the data storage device 20 or a scheduler, the packet generation unit 124 performs the process. You may end.

  When entering the loop L601, the packet generation unit 124 acquires the time information and position information of the monitoring data from the time information acquisition unit 122 and the position information acquisition unit 123 (step S602).

  Next, the packet generation means 124 determines the number of packets necessary for transmitting the monitoring data when packetizing the monitoring data. When the size of the monitoring data acquired from the monitoring data acquisition unit 121 exceeds the size that can be stored in the payload of one packet, the packet generation unit 124 needs to transmit the monitoring data in a plurality of packets. For this reason, the packet generation unit 124 determines the number of packets necessary to transmit the monitoring data, for example, by dividing the size of the monitoring data by the data size that can be stored in the payload portion of the packet. When dividing the monitoring data into a plurality of packets, the packet generation unit 124 may consider, for example, that the minimum unit of monitoring data necessary for the analysis processing by the data processing device 30 does not straddle the plurality of packets.

  FIG. 7 is a diagram illustrating an example in which monitoring data is divided into two packets and transmitted. For example, as shown in FIG. 7, when two packets are required to transmit the monitoring data acquired from the monitoring data acquisition unit 121, the packet generation unit 124 divides the monitoring data into two parts, Monitoring data (1/2) can be stored in the payload portion of packet 1, and the latter monitoring data (2/2) can be stored in the payload portion of packet 2. In each header part of the two packets into which the monitoring data is divided, the address, time information, and position information of the data transmission device 10 are stored.

  Returning to FIG. 6, the packet generator 124 starts a loop L602 that is executed for the number of packets necessary to transmit the monitoring data according to the determined number of packets (step S603). When the monitoring data is stored in one packet, this loop L602 is executed only once.

  The packet generation unit 124 generates the packet by storing the time information and the position information acquired in step S602 in the header part of the packet to be processed (step S604). Note that, in the case where the monitoring data is divided into a plurality of packets, an example in which time information and position information common to the plurality of packets is stored is shown here. However, the packet generation unit 124 includes, for example, image The relative time from the monitoring data acquisition time of the first packet may be calculated and stored using the monitoring data transmission speed such as the data frame rate and the amount of stored data such as the number of frames. The packet generation unit 124 transmits the generated monitoring data packet to the data storage device 20 via the communication unit 15 (step S605).

  FIG. 8 is a diagram illustrating the structure of the monitoring data packet. As shown in FIG. 8, the monitoring data packet has a header part having information on data stored in the packet and a payload part for storing data. In the monitoring data packet transmitted by the packet generator 124, the address, time information, and position information of the transmission source data transmitting apparatus 10 are stored in the header portion, and the monitoring data is stored in the payload portion. For example, an IP address and a port number are used as the communication address of the data transmission device 10. When the communication address is unique on the communication network 90, it can also be used as identification information of the data transmission device 10. In this embodiment, a packet is used as a unit for transmitting data. However, according to the communication protocol of the communication unit 15, other data units such as segments, frames, and units having areas corresponding to the header portion and payload portion of the packet are used. May be used.

  Returning to FIG. 6, when the packet generation unit 124 finishes executing the loop L602 for the number of packets necessary for transmission of monitoring data (step S606), the packet generation unit 124 ends the loop L601 (step S607) and returns to the top of the loop L601. .

  FIG. 9 is a flowchart showing group information update processing in the data storage device 20. The processing flow shown in FIG. 9 is realized by the control unit 22 executing the computer program code stored in the storage unit 21. The group information update process in FIG. 9 is a process in which the group information update unit 222 updates the group member of the group information using the position information of the received packet.

  For example, when the group of the data transmission device 10 is specified in the existence area where the data transmission device 10 exists, as in the group condition of the group information shown in FIG. 4, it is carried by a person or mounted on a vehicle or a drone. If the data transmitting apparatus 10 moves, the group member of the group information may change. For this reason, the group information updating unit 222 needs to update the group member of the group information according to a change in the position of the data transmission device 10 or the like. In the example of group information in FIG. 4, this process is not necessary when a group is designated as a fixed group member. Here, an example of the group information update process performed when the group condition specifies that the group is located within a predetermined existence area is shown.

  The group information update unit 222 starts a loop L901 that is executed at predetermined time intervals (step S901). The time interval for executing the loop L901 is 5 minutes when the data transmission device 10 that transmits the monitoring data to the data storage device 20 is carried by a person such as a wearable device, like a sensor mounted on an automobile. In the case of a device that moves at a relatively high speed, it is preferable to set appropriately according to the moving speed of the data transmitting apparatus 10 such as 30 seconds. In addition, when all the data transmission apparatuses 10 are fixedly installed at a predetermined position in the monitoring area, this process may be executed only once at the time of activation.

  Next, the group information update unit 222 starts a loop L902 executed for each data transmission apparatus 10 (step S902). Then, the group information update unit 222 extracts the latest received packet last received from the data transmission apparatus 10 to be processed from the received packets stored in the received packet storage unit 212, and the header part of the latest received packet Is acquired (step S903).

  The group information updating unit 222 starts a loop L903 executed for each group in order to update the group information of each group based on the acquired latest position information of the data transmitting apparatus 10 (step S904).

  The group information update unit 222 determines whether or not the latest position information acquired in step S903 satisfies the group condition specified by the group information of the processing target group (step S905). For example, in the case of the group condition in FIG. 4, the group information update unit 222 indicates that the latest position information of the target data transmission apparatus 10 is “an area within a radius of 1 km centered on north latitude 35.68 ° and east longitude 139.56 °. It is determined whether or not the present area is indicated (step S905).

  When it is determined that the latest position information acquired in step S903 indicates the presence area of the group condition (Yes in step S905), the group information update unit 222 satisfies the group registration condition. Is updated to become a member of the target group (step S906). On the other hand, when it is determined that the latest position information indicates the outside of the existing area (No in step S905), the group registration condition is not satisfied. Therefore, the group information update unit 222 sets the target data transmission apparatus 10 to the target group. The group information is updated so as not to be a member (step S907).

  When the group information of all the groups has been updated for the target data transmission device 10, the group information update unit 222 ends the loop L903 (step S908).

  When the update of all the group information for all the data transmission devices 10 is completed, the group information update unit 222 ends the loop L902 (step S909).

  After exiting the loop L902, the group information update unit 222 determines whether or not there is an instruction to end processing from an input unit (not shown) of the data storage device 20 or a scheduler (step S910). If there is no instruction to end the process (No in step S910), the group information updating unit 222 proceeds to step S911 to continue the process, and if there is an instruction to end the process (Yes in step S910), the process ends.

  In order to execute the loop L901 at a predetermined time interval, the group information update unit 222 performs a sleep process until the predetermined time interval is reached (step S911), and then returns to the top of the loop L901 (step S901) (step S901). S912).

  FIG. 10 is a flowchart showing integrated packet generation processing in the data storage device 20. The processing flow shown in FIG. 10 is realized by the control unit 22 executing the computer program code stored in the storage unit 21. The integrated packet generation process is a process in which the integrated packet generation unit 223 integrates the monitoring data of the received packet selected based on the group information to generate an integrated packet.

  FIG. 11 is a diagram illustrating an integrated packet obtained by integrating a plurality of monitoring data. In the example of FIG. 11, the monitoring data acquisition time and the integration reference time “2016/12/29 14:33:00” received from the data transmission devices A, B, and D registered as group members in the group information The monitoring data of the three received packets satisfying the integration condition that the difference between them is within “1 minute” before and after is integrated to generate an integrated packet. In FIG. 11, the address and monitoring data of each data transmitting apparatus 10 are integrated into the payload portion of the integrated packet, but may be further integrated including the acquisition time of the monitoring data.

  FIG. 12 is a diagram showing the size of monitoring data in the integrated packet generation process of FIG. As shown in FIG. 12, in the integrated packet generation process of FIG. 10, the size of the original monitoring data transmitted from the data transmitting apparatus 10 fits in the payload of one received packet, and the data in the payload of the integrated packet It is assumed that the size can be stored in the maximum data size that can be stored per transmission device 10. A case where the size of the original monitoring data does not fit in one received packet or cannot be stored in one integrated packet will be described later.

  As shown in FIG. 10, the integrated packet generation unit 223 starts a loop L1001 that is executed at predetermined time intervals (step S1001). The time interval for executing the loop L1001 is preferably matched to the processing interval of the monitoring data group in the data processing device 30. For example, when the monitoring data group is processed every 100 ms in the data processing device 30, this loop is also preferably executed every 100 ms.

  When the integrated packet generation unit 223 enters the loop L1001 and starts the loop L1002 to be executed for each group of the data transmission device 10 (step S1002), the integrated packet becomes a reference for specifying a period for integrating the monitoring data. Time is determined (step S1003). The integration reference time may be the current time. For example, when the packet is received from the data transmission device 10 with a delay, the integration reference time is determined by integrating the past time by a predetermined time, for example, 500 ms before the current time. It is good also as time. Further, the integrated packet generation unit 223 may use the time transmitted from another device such as the data transmission device 10 or the data processing device 30 as the integration reference time.

  Next, the integrated packet generation unit 223 starts a loop L1003 that is executed for each data transmission device 10 registered as a group member included in the group information of the group to be processed (step S1004).

  The integrated packet generation means 223 sequentially checks the acquisition time of the monitoring data based on the time information in the header part of the received packet stored in the received packet storage unit 212 and transmitted from the data transmission device 10 to be processed, and integrated with the acquisition time. It is confirmed whether there is a received packet whose difference from the reference time is within a predetermined threshold (for example, 100 ms) (step S1005).

  When there is a received packet in which the difference between the acquisition time of the monitoring data and the integration reference time is within a predetermined threshold (for example, 100 ms) (Yes in step S1005), the integrated packet generation unit 223 adds the payload to the received packet. The stored monitoring data is stored together with the address of the target data transmission device 10 in the corresponding part of the payload portion of the integrated packet (step S1006).

  When there is no received packet in which the difference between the acquisition time of the monitoring data of the target data transmission apparatus 10 and the integration reference time is within a predetermined threshold (No in step S1005), the reception transmitted from the target data transmission apparatus 10 There is no monitoring data to be integrated in the packet. Therefore, the integrated packet generation means 223 confirms that there is no monitoring data such as 0x20 which is an ASCII code indicating a blank (space), for example, along with the address of the target data transmitting apparatus 10 in the corresponding portion of the payload of the integrated packet. The indicated value is stored (step S1007). When the monitoring data to be integrated is not transmitted from the data transmission device 10 of the group member by transmitting the integrated packet indicating that the monitoring data does not exist to the data processing device 30 in this way. Even so, it is possible to ensure that data is transmitted to the data processing device 30 at a predetermined interval without waiting for the monitoring data to be integrated transmitted. When it is necessary to transmit an integrated packet after all necessary monitoring data is prepared, the integrated packet generation unit 223 may wait for reception of a necessary monitoring data packet instead of this step.

  When all the monitoring data to be integrated is stored in the integrated packet for the data transmitting devices 10 of all the group members of the target group and the integrated packet is completed, the integrated packet generating unit 223 exits the loop L1003 (step S1008). . The integrated packet generation unit 223 that has exited the loop L1003 transmits the completed integrated packet to the data processing device 30 via the communication unit 23 (step S1009).

  When the integrated packet is generated and transmitted for the group information of all groups, the integrated packet generator 223 exits the loop L1002 (step S1010). Then, the integrated packet generation unit 223 determines whether or not there is an instruction to end processing from an input unit (not shown) of the data storage device 20 or a scheduler (step S1011). If there is no instruction to end the process (No in step S1011), the integrated packet generation unit 223 proceeds to step S1012 to continue the process, and if there is an instruction to end the process (Yes in step S1011), the process ends.

  In order to execute the loop L1001 at a predetermined time interval, the integrated packet generation unit 223 performs a sleep process until the predetermined time interval is reached (step S1012), and then returns to the head of the loop L1001 (step S1001) (step S1001). S1013).

  In the above-described example, it is assumed that the size of the original monitoring data transmitted from the data transmission device 10 is a size that can be accommodated in the payload of one received packet and can be stored in the corresponding portion of the payload portion of the integrated packet. However, a case where monitoring data cannot be stored in one integrated packet will be described below.

  Actually, particularly with respect to the integrated packet, the monitoring data transmitted from the data transmission device 10 of the same group may not fit in the payload portion of one integrated packet. In this case, it will be divided into a plurality of integrated packets to be transmitted, but in consideration of the purpose of the present invention, only the monitoring data from some of the data transmission devices 10 will not be terminated in advance. It is preferable to divide the monitoring data from each data transmission device 10 into the same number and send it.

  In order to explain more specifically, a case will be described in which the monitoring data from the three data transmission apparatuses 10 (A, B, D) designated in the same group is transmitted in a lump in an integrated packet. Assume that 400 bytes of data can be sent per data transmission device 10 in the payload portion of the integrated packet. The size of the monitoring data to be integrated is 1200 bytes for the data transmission device A and 600 bytes for the data transmission device B. Assume that the data transmission device D has 300 bytes. At this time, the monitoring data of the data transmitting apparatus A needs to be transmitted in three integrated packets, while the data transmitting apparatus B transmits two integrated data and the data transmitting apparatus D transmits one integrated packet. become. However, if the monitoring data of each data transmission device 10 is transmitted at a different number of times, the data processing device 30 on the receiving side will receive the data after receiving the first and second monitoring data from the data transmission devices D and B. The process must be stopped and waited until the third monitoring data from the transmitting apparatus A is received.

  Therefore, the integrated packet generation means 223 calculates the number of integrated packets necessary to store the monitoring data of each of the data transmission devices A, B, and D, compares the number of necessary integrated packets, The monitoring data of each of the transmission devices A, B, and D is divided by the same number of integrated packets and stored in the payload portion of the integrated packet. For example, the integrated packet generation unit 223 divides the size of the maximum monitoring data among the data transmission devices A, B, and D by the maximum data size that can be stored in one payload of the integrated packet per data transmission device 10. The number of integrated packets can be the same. In this example, the integrated packet generation means 223 transmits 200 bytes of data from the data transmitting apparatus B in units of 200 bytes in accordance with the required number of integrated packets (three) of the data transmitting apparatus A having the largest monitoring data size. The device D divides the data into 100 bytes and adjusts the division size so that the transmission of the data of the data transmission devices B and D is completed in three transmissions. It is possible to reduce the burden on the data processing device 30 such as stopping the processing to wait.

  In addition, when the size of each piece of monitoring data is very small, such as temperature data, a plurality of pieces of monitoring data are stored together in the integrated packet instead of storing each piece of monitoring data in the integrated packet. Although transmission is also conceivable, in this case, it is preferable to group them in a certain time range. When processing waveform data such as audio from a plurality of data transmission devices 10, when the sampling rates are different among the devices, the data is not collected by the number or size of the data, but is collected in a certain time range. This is because the data processor 30 can easily process the waveform data.

  For example, there are two data transmission devices (A, B), the data transmission device A acquires 1 byte of monitoring data at a sampling rate of 1 kHz, and the data transmission device B acquires 2 bytes of monitoring data at a sampling rate of 2 kHz. Then, a description will be given of a combination in which the monitoring data from these data transmission devices A and B are sent together in an integrated packet. If it is assumed that 400 bytes of data can be transmitted per data transmission device in the payload of the integrated packet, the data transmission device A will attempt to transmit data most efficiently in consideration of the transmittable data size. The monitoring data of 400 ms (400) can be stored in one integrated packet and transmitted for 100 ms (100) of the data transmission apparatus B. However, if each data transmission device 10 transmits data in a different time range, the data processing device 30 on the receiving side will receive the remaining 300 ms from the data transmission device B when it wants to process data within the same time range in a batch. You have to wait for the monitoring data to arrive.

  Therefore, the integrated packet generation means 223 can always receive data in a certain time range simultaneously in the data processing device 30 by transmitting the data of the data transmission device A for only 100 ms. It is possible to reduce the burden on the data processing device 30 such as stopping the processing in order to wait for the arrival of data from the data transmission device 10.

  As described above, in the data processing system 1 according to the present invention, the data processing device 30 simultaneously acquires the monitoring data acquired by the plurality of data transmission devices 10 at substantially the same time via the data storage device 20. be able to. For this reason, the data processing device 30 does not have to wait until all the monitoring data necessary for data processing is available, so that the monitoring data is analyzed with almost no delay to detect abnormalities such as suspicious persons and neglected suspicious objects. be able to. Therefore, according to the present invention, it is possible to suppress the influence of delay variation for each monitoring data to be transmitted, and to shorten the analysis processing stop time by waiting for the arrival of data from each data transmitting apparatus 10.

  The preferred embodiments of the present invention have been described above, but the present invention is not limited to these embodiments.

  In the above-described embodiment, the existence area of the data transmission apparatus 10 that is regarded as a group according to the group condition is a fixed area centered on a certain position. For example, when the data transmission apparatus 10 is movable, this movement is performed. The position and size of the group condition existence region may be dynamically changed according to the above. For example, when the data transmission device 10 is a smartphone, the group information update unit 222 updates the position of the existence area of the data transmission device 10 belonging to the same group in accordance with the position information of the smartphone that captures an image while moving. be able to. For example, when the group condition of the group information is designated as “an area within a radius of 500 m centered on the data transmission device C”, the group information updating unit 222 is based on the latest position and moving speed of the data transmission device C. The existence area can be updated as “an area within a radius of 1 km centered on 35.70 ° north latitude and 139.55 ° east longitude”. Then, the group information updating unit 222 determines whether each data transmission device 10 is within the group existing region based on the updated group existing region, so that the data transmitting device 10 has the group existing region. You may determine whether you are a member. In this case, the integrated packet generation means 223 may further add group identification information to the header portion of the integrated packet and transmit it to the data processing device 30. As a result, the data processing device 30 can simultaneously analyze the monitoring data acquired by the plurality of data transmission devices 10 existing in the vicinity of the smartphone user, and can provide a monitoring service and the like seamlessly. .

  In the above-described embodiment, the packet generation unit 124 of the data transmission device 10 has shown an example in which time information and position information are added to the packet part of the monitoring data packet. However, the present invention is not limited to this. For example, when all groups are specified as fixed group members in the group information of the group information storage unit 211, the data storage device 20 needs to use the location information of the data transmission device 10 when integrating the monitoring data. If not, the packet generation unit 124 may not add the position information to the monitoring data packet. In this case, the position detection unit 14, the position information acquisition unit 123, and the group information update unit 222 described in the above embodiment may be omitted.

DESCRIPTION OF SYMBOLS 1 Data processing system 10 Data transmitter 11 Memory | storage part 12 Control part 121 Monitoring data acquisition means 122 Time information acquisition means 123 Position information acquisition means 124 Packet generation means 13 Monitoring part 14 Position detection part 15 Communication part 20 Data storage device 21 Storage part 211 Group Information Storage Unit 212 Received Packet Storage Unit 22 Control Unit 221 Packet Reception Unit 222 Group Information Update Unit 223 Integrated Packet Generation Unit 23 Communication Unit 30 Data Processing Device 90 Communication Network

Claims (6)

A data processing system having a plurality of data transmission devices, a data storage device, and a data processing device,
The data transmission device packetizes the monitoring data acquired by monitoring the surrounding situation, transmits the monitoring data acquisition time to the header portion of the packet,
The data storage device comprises:
A receiving unit for receiving packets transmitted from the plurality of data transmitting devices;
A storage unit that stores a received packet received by the receiving unit, and group information that specifies a group of the plurality of data transmission devices;
Among the received packets, the received packet is transmitted from a data transmitting device belonging to the group specified by the group information, and is an integrated packet obtained by integrating the received packets whose acquisition time in the header part is within a predetermined period. An integrated packet generator for generating
A transmission unit for transmitting the generated integrated packet to the data processing device;
A data processing system. The data transmission device acquires position information regarding the position from which the monitoring data is acquired, and further adds to the header part and transmits the position information.
The data processing system according to claim 1, wherein the data storage device further includes a group information update unit that updates the group information based on position information added to the header unit.   The data processing system according to claim 2, wherein the group information update unit determines a period for updating the group information according to a moving speed of the data transmission device.   The integrated packet generation unit, when there is no received packet whose acquisition time is within the predetermined period, among the received packets transmitted from the data transmission device of the group specified by the group information, within the predetermined period 4. The data processing system according to claim 1, wherein information indicating that no received packet exists is included in the integrated packet. 5.   The integrated packet generation unit stores monitoring data of a received packet transmitted from the data transmitting apparatus belonging to the group specified by the group information and having the acquisition time within the predetermined period. The integrated packet is generated by sequentially integrating the divided monitoring data obtained by dividing the monitoring data of each data transmission apparatus of the group into the integrated packet number when the number of integrated packets required for the group is two or more. The data processing system according to any one of claims 4 to 5. A data processing method in a data processing system having a plurality of data transmission devices, a data storage device, and a data processing device,
The data transmission apparatus packetizes the monitoring data acquired by monitoring the surrounding situation, and includes the step of transmitting the monitoring data acquisition time in the header portion of the packet,
In the data storage device,
A receiving unit receiving packets transmitted from the plurality of data transmitting devices;
Storing a received packet received by the receiving unit and group information designating a group of the plurality of data transmitting devices; and
The integrated packet generation unit is a reception packet transmitted from a data transmission device belonging to the group specified by the group information among the reception packets, and the reception packet whose acquisition time of the header portion is within a predetermined period To generate an integrated packet,
A transmitting unit transmitting the generated integrated packet to the data processing device;
A data processing method.

Images