CN114724079A

CN114724079A - Data classification method and classification system for construction site environment monitoring data

Info

Publication number: CN114724079A
Application number: CN202210331508.4A
Authority: CN
Inventors: 李建平; 赵茜茜; 潘虹; 苏军武; 彭东
Original assignee: Individual
Current assignee: Individual
Priority date: 2022-03-30
Filing date: 2022-03-30
Publication date: 2022-07-08

Abstract

The invention provides a data classification method and a data classification system for construction site environment monitoring data, and relates to the technical field of construction site environment monitoring. In the invention, at least one construction site environment monitoring terminal device is determined from a plurality of construction site environment monitoring terminal devices and is used as a target construction site environment monitoring terminal device; for each target construction site environment monitoring terminal device, acquiring a target construction site environment monitoring video sent by the target construction site environment monitoring terminal device, and performing feature recognition processing on the target construction site environment monitoring video to obtain video feature information corresponding to the target construction site environment monitoring video; and determining data classification label information corresponding to each target construction site environment monitoring video based on the video characteristic information corresponding to each target construction site environment monitoring video. Based on the method, the problem that the data classification effect on the building site environment monitoring data is poor in the prior art can be solved.

Description

Data classification method and classification system for construction site environment monitoring data

Technical Field

The invention relates to the technical field of construction site environment monitoring, in particular to a data classification method and a data classification system for construction site environment monitoring data.

Background

In order to guarantee the requirements of safety of construction of a construction site and the like, the construction site environment is generally monitored, and the construction site environment is generally divided into a plurality of areas because the visual field in the construction site environment is generally narrow, and then a monitoring terminal is respectively deployed for each area to monitor videos. Therefore, more monitoring videos can be obtained, and the monitoring videos are stored without being classified, so that more inconvenience may exist in subsequent application. However, in the prior art, classification storage is generally performed based on the acquired time, so that a problem of poor data classification effect is easily caused.

Disclosure of Invention

In view of the above, the present invention provides a data classification method for monitoring data of a worksite environment and a classification system thereof, so as to solve the problem of poor data classification effect for the worksite environment monitoring data in the prior art.

In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:

the utility model provides a building site environment monitoring data's data classification method, is applied to building site environment monitoring server, building site environment monitoring server communication connection has a plurality of building site environment monitoring terminal equipment, a plurality of building site environment monitoring terminal equipment deploy respectively in a plurality of building site environment regions, building site environment monitoring data's data classification method includes:

determining at least one building site environment monitoring terminal device from the plurality of building site environment monitoring terminal devices as a target building site environment monitoring terminal device, wherein each target building site environment monitoring terminal device is used for monitoring the corresponding building site environment area at present to obtain a corresponding target building site environment monitoring video and sending the corresponding target building site environment monitoring video to the building site environment monitoring server, and the target building site environment monitoring video comprises a plurality of building site environment monitoring video frames;

for each target construction site environment monitoring terminal device, acquiring a target construction site environment monitoring video sent by the target construction site environment monitoring terminal device, and performing feature recognition processing on the target construction site environment monitoring video to obtain video feature information corresponding to the target construction site environment monitoring video;

and determining data classification label information corresponding to each target construction site environment monitoring video based on the video characteristic information corresponding to each target construction site environment monitoring video, wherein the data classification label information is used for performing classification storage processing on the target construction site environment monitoring video.

In some preferred embodiments, in the data classification method of the building site environment monitoring data, the step of obtaining, for each target building site environment monitoring terminal device, a target building site environment monitoring video sent by the target building site environment monitoring terminal device, and performing feature recognition processing on the target building site environment monitoring video to obtain video feature information corresponding to the target building site environment monitoring video includes:

acquiring a target construction site environment monitoring video sent by each target construction site environment monitoring terminal device;

for a target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device, screening multiple construction site environment monitoring video frames included in the target construction site environment monitoring video to obtain a target monitoring video segment corresponding to the target construction site environment monitoring video, wherein the target monitoring video segment includes at least one construction site environment monitoring video frame;

and aiming at each target construction site environment monitoring video, carrying out feature recognition processing on the target monitoring video segment corresponding to the target construction site environment monitoring video to obtain video feature information corresponding to the target construction site environment monitoring video.

In some preferred embodiments, in the data classification method of the worksite environment monitoring data, the step of, for a target worksite environment monitoring video corresponding to each target worksite environment monitoring terminal device, performing screening processing on multiple worksite environment monitoring video frames included in the target worksite environment monitoring video to obtain a target monitoring video segment corresponding to the target worksite environment monitoring video includes:

for a target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device, performing segmentation processing on the target construction site environment monitoring video to obtain a plurality of monitoring video segments corresponding to the target construction site environment monitoring video, wherein each monitoring video segment in the plurality of monitoring video segments comprises a plurality of construction site environment monitoring video frames;

calculating the similarity between every two monitoring video segments in a plurality of monitoring video segments corresponding to the target construction site environment monitoring video aiming at the target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device to obtain the segment similarity between every two monitoring video segments;

for each monitoring video segment in a plurality of monitoring video segments corresponding to the target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device, performing mean value calculation processing based on the segment similarity between the monitoring video segment and each other monitoring video segment to obtain a mean value of the similarity corresponding to the monitoring video segment;

and aiming at each target construction site environment monitoring video corresponding to the target construction site environment monitoring terminal equipment, determining a monitoring video segment in a plurality of monitoring video segments corresponding to the target construction site environment monitoring video as a target monitoring video segment corresponding to the target construction site environment monitoring video based on the similarity mean value corresponding to each monitoring video segment.

In some preferred embodiments, in the data classification method of the worksite environment monitoring data, the step of performing segmentation processing on the target worksite environment monitoring video for the target worksite environment monitoring video corresponding to each target worksite environment monitoring terminal device to obtain a plurality of monitoring video segments corresponding to the target worksite environment monitoring video includes:

for a target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device, performing similarity calculation on every two adjacent construction site environment monitoring video frames in a plurality of construction site environment monitoring video frames included in the target construction site environment monitoring video to obtain video frame similarity corresponding to every two adjacent construction site environment monitoring video frames, and determining the relative size relation between the video frame similarity and a preset video frame similarity threshold;

for a target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device, determining every two adjacent construction site environment monitoring video frames of which the corresponding video frame similarity is smaller than or equal to the video frame similarity threshold value as a construction site environment monitoring video frame combination in a plurality of construction site environment monitoring video frames included in the target construction site environment monitoring video, and obtaining at least one construction site environment monitoring video frame combination corresponding to the target construction site environment monitoring video;

aiming at each target building site environment monitoring video corresponding to the target building site environment monitoring terminal equipment, based on each building site environment monitoring video frame combination corresponding to the target building site environment monitoring video, the target building site environment monitoring video is processed in a segmented mode, a plurality of monitoring video segments corresponding to the target building site environment monitoring video are obtained, wherein two adjacent building site environment monitoring video frames included by any building site environment monitoring video frame combination in at least one building site environment monitoring video frame combination respectively belong to two adjacent monitoring video segments.

In some preferred embodiments, in the data classification method of the worksite environment monitoring data, the step of performing, for each target worksite environment monitoring video, feature recognition processing on the target monitoring video segment corresponding to the target worksite environment monitoring video to obtain video feature information corresponding to the target worksite environment monitoring video includes:

for each target construction site environment monitoring video, carrying out user identification processing on each construction site environment monitoring video frame included in the target monitoring video segment corresponding to the target construction site environment monitoring video to obtain a representative monitoring user set corresponding to the target construction site environment monitoring video;

for each target construction site environment monitoring video, carrying out duplication elimination screening processing on a representative monitoring user set corresponding to the target construction site environment monitoring video to obtain a representative monitoring user screening set corresponding to the target construction site environment monitoring video, and counting the number of users of each representative monitoring user in the representative monitoring user screening set based on the representative monitoring user set;

calculating the sum of the user statistical quantity of each representative monitoring user in a representative monitoring user screening set corresponding to each target construction site environment monitoring video to obtain the user statistical quantity and the value corresponding to the target construction site environment monitoring video;

for each target construction site environment monitoring video, respectively calculating the ratio of the user statistical quantity of each representative monitoring user in the representative monitoring user screening set corresponding to the target construction site environment monitoring video to the user statistical quantity and value corresponding to the target construction site environment monitoring video to obtain the proportionality coefficient of each representative monitoring user in the representative monitoring user screening set;

and aiming at each target construction site environment monitoring video, taking a representative monitoring user screening set corresponding to the target construction site environment monitoring video and a proportionality coefficient of each representative monitoring user in the representative monitoring user screening set as video characteristic information corresponding to the target construction site environment monitoring video.

In some preferred embodiments, in the above method for classifying data of worksite environment monitoring data, the step of determining, based on the video feature information corresponding to each target worksite environment monitoring video, data classification tag information corresponding to each target worksite environment monitoring video includes:

for each data classification label information in a plurality of data classification label information configured in advance, determining historical video feature information corresponding to historical site environment monitoring videos stored based on the data classification label information to obtain historical video feature information corresponding to the data classification label information;

and respectively calculating the feature similarity between the video feature information corresponding to the target construction site environment monitoring video and the historical video feature information corresponding to each data classification label information in the plurality of data classification label information aiming at each target construction site environment monitoring video, and determining the data classification label information corresponding to the historical video feature information corresponding to the feature similarity with the maximum value as the data classification label information corresponding to the target construction site environment monitoring video.

In some preferred embodiments, in the data classification method for worksite environment monitoring data, the step of determining at least one worksite environment monitoring terminal device from the plurality of worksite environment monitoring terminal devices as a target worksite environment monitoring terminal device includes:

acquiring historical site environment monitoring videos historically acquired by the site environment monitoring terminal equipment aiming at each site environment monitoring terminal equipment in the plurality of site environment monitoring terminal equipment, wherein the historical site environment monitoring videos comprise a plurality of frames of historical site environment monitoring video frames and are obtained by monitoring the corresponding site environment areas;

determining building site environment characteristic information corresponding to a plurality of historical building site environment monitoring videos corresponding to the plurality of building site environment monitoring terminal devices;

based on building site environment characteristic information is in determine at least one building site environment monitoring terminal equipment among a plurality of building site environment monitoring terminal equipment, as target building site environment monitoring terminal equipment, wherein, each target building site environment monitoring terminal equipment is used for being current to corresponding the building site environment region is monitored, obtains corresponding target building site environment monitoring video.

The embodiment of the invention also provides a data classification system of the building site environment monitoring data, which is applied to a building site environment monitoring server, wherein the building site environment monitoring server is in communication connection with a plurality of building site environment monitoring terminal devices, the building site environment monitoring terminal devices are respectively deployed in a plurality of building site environment areas, and the data classification system of the building site environment monitoring data comprises:

a monitoring device determining module, configured to determine at least one building site environment monitoring terminal device from the multiple building site environment monitoring terminal devices as a target building site environment monitoring terminal device, where each target building site environment monitoring terminal device is configured to monitor a corresponding building site environment area at present, obtain a corresponding target building site environment monitoring video, and send the corresponding target building site environment monitoring video to the building site environment monitoring server, where the target building site environment monitoring video includes multiple building site environment monitoring video frames;

the video characteristic determining module is used for acquiring a target construction site environment monitoring video sent by each target construction site environment monitoring terminal device and performing characteristic identification processing on the target construction site environment monitoring video to obtain video characteristic information corresponding to the target construction site environment monitoring video;

and the classification label determining module is used for determining data classification label information corresponding to each target construction site environment monitoring video based on the video characteristic information corresponding to each target construction site environment monitoring video, wherein the data classification label information is used for performing classification storage processing on the target construction site environment monitoring video.

In some preferred embodiments, in the data classification system for worksite environment monitoring data, the video feature determination module is specifically configured to:

In some preferred embodiments, in the data classification system for worksite environment monitoring data described above, the classification tag determination module is specifically configured to:

for each piece of data classification label information in a plurality of pieces of data classification label information configured in advance, determining historical video characteristic information corresponding to historical site environment monitoring videos stored on the basis of the data classification label information, and obtaining historical video characteristic information corresponding to the data classification label information;

The embodiment of the invention provides a data classification method and a classification system of construction site environment monitoring data, which can firstly determine at least one construction site environment monitoring terminal device as a target construction site environment monitoring terminal device from a plurality of construction site environment monitoring terminal devices, then can acquire a target construction site environment monitoring video sent by the target construction site environment monitoring terminal device aiming at each target construction site environment monitoring terminal device, and carry out feature recognition processing on the target construction site environment monitoring video to obtain video feature information corresponding to the target construction site environment monitoring video, so that the data classification label information corresponding to each target construction site environment monitoring video can be determined based on the video feature information corresponding to each target construction site environment monitoring video, and thus, the data classification label information is determined based on the video feature information to carry out classification storage, the monitoring videos with the same video characteristics can be stored together, so that a better classification effect is achieved in the application where the same video characteristics are required to be obtained, and the problem that the data classification effect of the monitoring data of the construction site environment is poor in the prior art is solved.

In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.

Drawings

Fig. 1 is a block diagram of a worksite environment monitoring server according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of steps involved in a method for data classification of worksite environmental monitoring data according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of modules included in a data classification system for worksite environmental monitoring data according to an embodiment of the present disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.

Thus, the following detailed description of the embodiments of the present invention, as presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.

As shown in FIG. 1, an embodiment of the present invention provides a worksite environmental monitoring server. Wherein the worksite environment monitoring server may include a memory and a processor.

In detail, the memory and the processor are electrically connected directly or indirectly to realize data transmission or interaction. For example, they may be electrically connected to each other via one or more communication buses or signal lines. The memory can have stored therein at least one software function (computer program) which can be present in the form of software or firmware. The processor may be configured to execute the executable computer program stored in the memory to implement a method of data classification of worksite environmental monitoring data provided by embodiments of the present invention (described below).

By way of example, in some possible embodiments, the Memory may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Read Only Memory (EPROM), an electrically Erasable Read Only Memory (EEPROM), and the like.

For example, in some possible embodiments, the Processor may be a general-purpose Processor including a Central Processing Unit (CPU), a Network Processor (NP), a System on Chip (SoC), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.

Also, the structure shown in fig. 1 is only an illustration, and the worksite environment monitoring server may further include more or fewer components than those shown in fig. 1, or have a different configuration from that shown in fig. 1, for example, may include a communication unit for information interaction with other devices (such as a worksite environment monitoring terminal device, etc., where the worksite environment monitoring terminal device may be a camera, etc.).

With reference to fig. 2, an embodiment of the present invention further provides a data classification method for the worksite environment monitoring data, which can be applied to the worksite environment monitoring server. Wherein the method steps defined by the flow associated with the data classification method for the worksite environment monitoring data may be implemented by the worksite environment monitoring server. And, building site environment monitoring server can the communication connection have a plurality of building site environment monitoring terminal equipment, a plurality of building site environment monitoring terminal equipment can deploy respectively in a plurality of building site environment regions. The specific process shown in FIG. 2 will be described in detail below.

And S100, determining at least one construction site environment monitoring terminal device from the plurality of construction site environment monitoring terminal devices as a target construction site environment monitoring terminal device.

In the embodiment of the present invention, the worksite environment monitoring server may determine at least one worksite environment monitoring terminal device from the plurality of worksite environment monitoring terminal devices as a target worksite environment monitoring terminal device. Each target building site environment monitoring terminal equipment is used for monitoring the corresponding building site environment region at present, obtaining corresponding target building site environment monitoring videos and sending the target building site environment monitoring videos to the building site environment monitoring server, and the target building site environment monitoring videos comprise multi-frame building site environment monitoring video frames.

And S200, acquiring a target construction site environment monitoring video sent by each target construction site environment monitoring terminal device, and performing feature recognition processing on the target construction site environment monitoring video to obtain video feature information corresponding to the target construction site environment monitoring video.

In the embodiment of the present invention, the building site environment monitoring server may obtain, for each target building site environment monitoring terminal device, a target building site environment monitoring video sent by the target building site environment monitoring terminal device, and perform feature recognition processing on the target building site environment monitoring video to obtain video feature information corresponding to the target building site environment monitoring video.

Step S300, determining data classification label information corresponding to each target construction site environment monitoring video based on the video characteristic information corresponding to each target construction site environment monitoring video.

In an embodiment of the present invention, the worksite environment monitoring server may determine, based on the video feature information corresponding to each target worksite environment monitoring video, data classification tag information corresponding to each target worksite environment monitoring video. The data classification label information is used for performing classification storage processing on the target construction site environment monitoring video.

The data classification method based on the building site environment monitoring data comprises the steps of firstly determining at least one building site environment monitoring terminal device from a plurality of building site environment monitoring terminal devices to be used as a target building site environment monitoring terminal device, then acquiring a target building site environment monitoring video sent by the target building site environment monitoring terminal device aiming at each target building site environment monitoring terminal device, and performing characteristic recognition processing on the target building site environment monitoring video to obtain video characteristic information corresponding to the target building site environment monitoring video, so that data classification label information corresponding to each target building site environment monitoring video can be determined based on the video characteristic information corresponding to each target building site environment monitoring video, and thus, the data classification label information is determined based on the video characteristic information to be classified and stored, the monitoring videos with the same video characteristics can be stored together, so that a better classification effect is achieved in the application needing to obtain the monitoring videos with the same video characteristics, and the problem that the data classification effect of the monitoring data of the construction site environment in the prior art is poor is solved.

Illustratively, in some possible embodiments, step S100 may include the following contents, such as the contents included in step S110, step S120, and step S130.

Step S110, for each of the plurality of building site environment monitoring terminal devices, obtaining a historical building site environment monitoring video historically collected by the building site environment monitoring terminal device.

In the embodiment of the present invention, the worksite environment monitoring server may obtain, for each of the plurality of worksite environment monitoring terminal devices, a historical worksite environment monitoring video historically collected by the worksite environment monitoring terminal device. The historical building site environment monitoring video comprises a plurality of frames of historical building site environment monitoring video frames and is obtained by monitoring the corresponding building site environment area.

Step S120, based on a plurality of historical building site environment monitoring videos corresponding to the plurality of building site environment monitoring terminal devices, building site environment feature information corresponding to the plurality of historical building site environment monitoring videos is determined.

In an embodiment of the present invention, the worksite environment monitoring server may determine, based on a plurality of historical worksite environment monitoring videos corresponding to the plurality of worksite environment monitoring terminal devices, worksite environment feature information corresponding to the plurality of historical worksite environment monitoring videos.

Step S130, determining at least one building site environment monitoring terminal device from the plurality of building site environment monitoring terminal devices based on the building site environment characteristic information, and using the at least one building site environment monitoring terminal device as a target building site environment monitoring terminal device.

In an embodiment of the present invention, the worksite environment monitoring server may determine, based on the worksite environment characteristic information, at least one worksite environment monitoring terminal device from the plurality of worksite environment monitoring terminal devices, as a target worksite environment monitoring terminal device. And each target building site environment monitoring terminal device is used for monitoring the corresponding building site environment area at present to obtain a corresponding target building site environment monitoring video.

Based on the above steps S110, S120, and S130, a historical site environment monitoring video historically collected by each site environment monitoring terminal device may be obtained for each site environment monitoring terminal device, and then, site environment feature information corresponding to the historical site environment monitoring videos may be determined based on a plurality of historical site environment monitoring videos corresponding to the plurality of site environment monitoring terminal devices, so that at least one site environment monitoring terminal device may be determined in the plurality of site environment monitoring terminal devices based on the site environment feature information, and the determined site environment monitoring terminal device serves as a target site environment monitoring terminal device, where each target site environment monitoring terminal device is used for monitoring a corresponding site environment area at present. So, through screening target building site environment monitoring terminal equipment in order to monitor, the quantity of the monitoring terminal equipment that is opened simultaneously can be lower to a certain extent to improve the problem that building site environment monitoring resource is easily extravagant among the prior art.

Illustratively, in some possible embodiments, step S110 may include the following:

firstly, determining whether video monitoring is required to be carried out on the plurality of construction site environment areas at present, and generating corresponding historical video acquisition notification information when video monitoring is required;

secondly, sending the historical video acquisition notification information to a target data storage server in communication connection, wherein the target data storage server is used for storing historical site environment monitoring videos collected historically by each of the plurality of site environment monitoring terminal devices, and sending the historical site environment monitoring videos collected by each of the site environment monitoring terminal devices to the site environment monitoring server after receiving the historical video acquisition notification information;

and then, acquiring historical site environment monitoring videos which are sent by the target data storage server based on the historical video acquisition notification information and collected by each site environment monitoring terminal device.

For example, in some possible embodiments, the step of determining whether video monitoring is currently required for the plurality of regions of the worksite environment, and generating corresponding historical video acquisition notification information when video monitoring is determined to be required may include the following steps:

firstly, acquiring current time information to obtain corresponding first time information, acquiring historical time information for monitoring the construction site environment region at the last time in history to obtain corresponding second time information, and calculating a time difference between the first time information and the second time information to obtain a time interval length (namely, a time length which is not monitored) corresponding to the first time information and the second time information;

secondly, determining the size relation between the time interval length and a pre-configured time length threshold (such as whether the time interval length is greater than or equal to the time length threshold);

then, if the time interval length is greater than or equal to the time interval threshold, determining whether the first time information belongs to a preset target time interval, and determining that video monitoring needs to be performed on the construction site environment area when the first time information belongs to the target time interval (for example, the first time information may be determined according to working time), and if the time interval length is less than the time interval threshold, or the first time information does not belong to the target time interval, determining that video monitoring does not need to be performed on the construction site environment area;

and finally, generating corresponding historical video acquisition notification information when the plurality of building site environment areas need to be monitored currently.

Exemplarily, in some possible embodiments, step S120 may include the following:

firstly, aiming at each historical building site environment monitoring video in a plurality of historical building site environment monitoring videos corresponding to a plurality of building site environment monitoring terminal devices, identifying and processing a plurality of frames of historical building site environment monitoring video frames included in the historical building site environment monitoring videos to obtain building site environment complexity information corresponding to the historical building site environment monitoring videos, wherein the building site environment complexity information is used for representing the environment complexity of corresponding building site environment areas in corresponding monitoring time;

secondly, aiming at each historical building site environment monitoring video in the historical building site environment monitoring videos, building site environment feature information corresponding to the historical building site environment monitoring videos is determined based on building site environment complexity information corresponding to the historical building site environment monitoring videos.

For example, in some possible embodiments, the step of identifying, for each of a plurality of historical site environment monitoring videos corresponding to the plurality of site environment monitoring terminal devices, a plurality of historical site environment monitoring video frames included in the historical site environment monitoring video to obtain the site environment complexity information corresponding to the historical site environment monitoring video may include the following steps:

firstly, for each historical building site environment monitoring video in the plurality of historical building site environment monitoring videos, performing user identification processing (identification can be performed based on a pre-trained neural network model and the like) on each frame of historical building site environment monitoring video frame included in the historical building site environment monitoring video to obtain a user identification result corresponding to the historical building site environment monitoring video;

secondly, for each historical building site environment monitoring video in the multiple historical building site environment monitoring videos, determining each other monitoring user, except for the monitoring user included in at least one pre-configured monitoring user set, corresponding to the historical building site environment monitoring video based on an identification result corresponding to the historical building site environment monitoring video to be a first monitoring user corresponding to the historical building site environment monitoring video, wherein the monitoring user set is multiple, the monitoring user sets are obtained based on classification of the monitoring users, and each monitoring user is provided with at least one user classification label (such as construction managers, actual constructors, long-term workers, temporary workers and the like), so that each monitoring user exists in at least one monitoring user set;

then, counting the number of first monitoring users corresponding to the historical construction site environment monitoring video aiming at each historical construction site environment monitoring video in the plurality of historical construction site environment monitoring videos to obtain the number of the first monitoring users corresponding to the historical construction site environment monitoring video, and determining a first complexity coefficient corresponding to the historical construction site environment monitoring video based on the number of the first monitoring users, wherein the first complexity coefficient is positively correlated with the number of the first monitoring users;

then, for each historical building site environment monitoring video in the multiple historical building site environment monitoring videos, determining each monitoring user corresponding to the historical building site environment monitoring video and belonging to the at least one monitoring user set based on the identification result corresponding to the historical building site environment monitoring video, and determining a second complexity coefficient corresponding to the historical building site environment monitoring video based on the monitoring user;

and finally, for each historical building site environment monitoring video in the plurality of historical building site environment monitoring videos, weighting calculation is carried out on the basis of the first complexity coefficient corresponding to the historical building site environment monitoring video and the second complexity coefficient corresponding to the historical building site environment monitoring video to obtain a building site environment complexity signal corresponding to the historical building site environment monitoring video.

For example, in some possible embodiments, the step of determining, for each historical site environment monitoring video of the plurality of historical site environment monitoring videos, each monitoring user belonging to the at least one monitoring user set and corresponding to the historical site environment monitoring video based on the identification result corresponding to the historical site environment monitoring video, and determining, based on the monitoring user, the second complexity coefficient corresponding to the historical site environment monitoring video may include:

firstly, respectively determining the occurrence frequency ratio of each monitoring user in the monitoring user set aiming at each monitoring user set in at least one monitoring user set, wherein the occurrence frequency ratio is determined based on the occurrence frame number of the corresponding monitoring user in the plurality of historical construction site environment monitoring videos and the occurrence frame number of each monitoring user in the corresponding monitoring user set (such as the former divided by the latter);

then, for each monitoring user in the at least one monitoring user set, counting the number of occurrence frequency ratios corresponding to the monitoring user to obtain a ratio statistical number corresponding to the monitoring user, determining a relative magnitude relation between the ratio statistical number and a pre-configured statistical number threshold, and determining the monitoring user as a second monitoring user when the ratio statistical number is greater than the statistical number threshold, or determining the monitoring user as a third monitoring user when the ratio statistical number is less than or equal to the statistical number threshold;

then, determining the ratio statistical quantity with the minimum value from the ratio statistical quantities corresponding to each second monitoring user as a statistical quantity comparison value, and calculating the average value of the occurrence frequency ratio corresponding to each third monitoring user, and determining a second monitoring user with correlation (the difference between the corresponding average values can be minimum) based on the average value and the average value of the occurrence frequency ratios corresponding to each second monitoring user, and based on the statistical number of the ratios corresponding to the second monitoring user with correlation, expanding the occurrence frequency ratio corresponding to the third monitoring user to obtain a new occurrence frequency ratio corresponding to the third monitoring user (so that the number of the new occurrence frequency ratio is the same as the statistical number of the occurrence frequency ratios corresponding to the second monitoring user with the correlation);

secondly, for each monitoring user in the at least one monitoring user set, based on the statistical quantity threshold, performing sliding window processing on occurrence frequency ratios of a plurality of sequences (which may be randomly ordered or ordered according to a certain rule, such as a classification label of a corresponding monitoring user set, such as a construction manager before an actual constructor, etc.) currently possessed by the monitoring user to obtain a plurality of ratio sliding window ordered sets corresponding to the monitoring user, and calculating set similarity between every two ratio sliding window ordered sets in the plurality of ratio sliding window ordered sets (for example, the quantity ratio of set positions where a difference between occurrence frequency ratios between the two ratio sliding window ordered sets is smaller than the threshold may be calculated), and, for each ratio sliding window ordered set corresponding to the monitoring user, calculating an average value of set similarity between the ratio sliding window ordered set and each other ratio sliding window ordered set, obtaining set representative similarity corresponding to the ratio sliding window ordered set, and determining a ratio sliding window ordered set with the largest corresponding set representative similarity from the ratio sliding window ordered sets as a target ratio sliding window ordered set corresponding to the monitoring user;

and finally, aiming at each monitoring user, determining the median value of a plurality of occurrence frequency occupation ratios included by the target occupation ratio sliding window ordered set corresponding to the monitoring user as the target occurrence frequency occupation ratio corresponding to the monitoring user, and aiming at each historical building site environment monitoring video in the plurality of historical building site environment monitoring videos, calculating the average value of the target occurrence frequency occupation ratio corresponding to each monitoring user corresponding to the historical building site environment monitoring video, and taking the average value as a second complexity coefficient corresponding to the historical building site environment monitoring video.

For example, in some possible embodiments, the step of determining, for each historical worksite environment monitoring video of the plurality of historical worksite environment monitoring videos, the worksite environment feature information corresponding to the historical worksite environment monitoring video based on the worksite environment complexity information corresponding to the historical worksite environment monitoring video may include the following steps:

firstly, calculating the similarity between every two historical building site environment monitoring videos in the multiple historical building site environment monitoring videos to obtain the video similarity corresponding to the two historical building site environment monitoring videos;

secondly, calculating the average value of the video similarity corresponding to each historical construction site environment monitoring video and each other historical construction site environment monitoring video aiming at each historical construction site environment monitoring video in the plurality of historical construction site environment monitoring videos to obtain the corresponding video similarity average value;

then, for each historical building site environment monitoring video in the historical building site environment monitoring videos, building site environment feature information corresponding to the historical building site environment monitoring video is obtained based on the building site environment complexity information corresponding to the historical building site environment monitoring video and the corresponding video similarity mean value, wherein feature values represented by the building site environment feature information are positively correlated with the building site environment complexity information and the video similarity mean value respectively.

Illustratively, in some possible embodiments, step S130 may include the following:

firstly, for each of the plurality of building site environment monitoring terminal devices, obtaining a first priority corresponding to the building site environment monitoring terminal device based on building site environment characteristic information corresponding to a historical building site environment monitoring video corresponding to the building site environment monitoring terminal device, wherein the first priority is positively correlated with a characteristic value represented by the building site environment characteristic information;

secondly, for each of the plurality of building site environment monitoring terminal devices, determining the time of the building site environment monitoring terminal device which is used as a target building site environment monitoring terminal device in the history last time to obtain corresponding historical time information, calculating a difference value between the historical time information and the current time information to obtain an idle time length corresponding to the building site environment monitoring terminal device, and determining a second priority corresponding to the building site environment monitoring terminal device based on the idle time length, wherein the second priority is positively correlated with the idle time length;

then, for each of the plurality of building site environment monitoring terminal devices, fusing the first priority corresponding to the building site environment monitoring terminal device and the second priority corresponding to the building site environment monitoring terminal device (for example, performing weighted summation calculation on the first priority and the second priority, etc.) to obtain a fusion priority corresponding to the building site environment monitoring terminal device;

and finally, determining at least one building site environment monitoring terminal device from the plurality of building site environment monitoring terminal devices as a target building site environment monitoring terminal device (such as one or more building site environment monitoring terminal devices with the highest fusion priority) based on the fusion priority corresponding to each building site environment monitoring terminal device in the plurality of building site environment monitoring terminal devices.

Illustratively, in some possible embodiments, step S200 may include the following:

firstly, acquiring a target construction site environment monitoring video sent by each target construction site environment monitoring terminal device;

secondly, screening multiple frames of building site environment monitoring video frames included by the target building site environment monitoring video aiming at the target building site environment monitoring video corresponding to each target building site environment monitoring terminal device to obtain a target monitoring video clip corresponding to the target building site environment monitoring video, wherein the target monitoring video clip comprises at least one building site environment monitoring video frame;

then, for each target construction site environment monitoring video, performing feature recognition processing on the target monitoring video segment corresponding to the target construction site environment monitoring video to obtain video feature information corresponding to the target construction site environment monitoring video.

For example, in some possible embodiments, the step of screening multiple frames of the target site environment surveillance video included in the target site environment surveillance video to obtain a target surveillance video segment corresponding to the target site environment surveillance video may include the following steps:

firstly, segmenting a target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device to obtain a plurality of monitoring video segments corresponding to the target construction site environment monitoring video, wherein each monitoring video segment in the plurality of monitoring video segments comprises a plurality of construction site environment monitoring video frames;

secondly, calculating the similarity between every two monitoring video segments in a plurality of monitoring video segments corresponding to each target construction site environment monitoring terminal device aiming at the target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device, and obtaining the segment similarity between every two monitoring video segments;

then, for each surveillance video segment in a plurality of surveillance video segments corresponding to the target site environment surveillance video corresponding to each target site environment surveillance terminal device, performing mean value calculation processing based on the segment similarity between the surveillance video segment and each other surveillance video segment to obtain a mean value of the similarity corresponding to the surveillance video segment;

and finally, for each target construction site environment monitoring video corresponding to the target construction site environment monitoring terminal equipment, determining one monitoring video segment in a plurality of monitoring video segments corresponding to the target construction site environment monitoring video as the target monitoring video segment corresponding to the target construction site environment monitoring video based on the similarity mean value corresponding to each monitoring video segment in the plurality of monitoring video segments corresponding to the target construction site environment monitoring video.

For example, in some possible embodiments, the step of performing, for a target site environment surveillance video corresponding to each target site environment surveillance terminal device, segmentation processing on the target site environment surveillance video to obtain multiple surveillance video segments corresponding to the target site environment surveillance video may include the following steps:

firstly, for a target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device, similarity calculation is carried out on every two adjacent construction site environment monitoring video frames in a plurality of construction site environment monitoring video frames included in the target construction site environment monitoring video, video frame similarity corresponding to every two adjacent construction site environment monitoring video frames is obtained, and the relative size relation between the video frame similarity and a preset video frame similarity threshold value is determined;

secondly, for a target building site environment monitoring video corresponding to each target building site environment monitoring terminal device, determining every two adjacent building site environment monitoring video frames of which the corresponding video frame similarity is smaller than or equal to the video frame similarity threshold value as a building site environment monitoring video frame combination in a plurality of building site environment monitoring video frames included in the target building site environment monitoring video, and obtaining at least one building site environment monitoring video frame combination corresponding to the target building site environment monitoring video;

then, for each target building site environment monitoring video corresponding to the target building site environment monitoring terminal device, based on each building site environment monitoring video frame combination corresponding to the target building site environment monitoring video, the target building site environment monitoring video is processed in a segmented mode, and a plurality of monitoring video segments corresponding to the target building site environment monitoring video are obtained, wherein two adjacent building site environment monitoring video frames included in any building site environment monitoring video frame combination in the at least one building site environment monitoring video frame combination respectively belong to two adjacent monitoring video segments.

For example, in some possible embodiments, the step of performing, for each target worksite environment monitoring video, feature recognition processing on the target monitoring video segment corresponding to the target worksite environment monitoring video to obtain video feature information corresponding to the target worksite environment monitoring video may include the following steps:

firstly, aiming at each target construction site environment monitoring video, carrying out user identification processing on each construction site environment monitoring video frame included in the target monitoring video segment corresponding to the target construction site environment monitoring video to obtain a representative monitoring user set corresponding to the target construction site environment monitoring video;

secondly, for each target construction site environment monitoring video, carrying out duplication elimination screening processing on a representative monitoring user set corresponding to the target construction site environment monitoring video to obtain a representative monitoring user screening set corresponding to the target construction site environment monitoring video, and counting the number of users of each representative monitoring user in the representative monitoring user screening set based on the representative monitoring user set;

then, calculating the sum of the user statistical quantity of each representative monitoring user in the representative monitoring user screening set corresponding to each target construction site environment monitoring video to obtain the user statistical quantity and the user statistical value corresponding to the target construction site environment monitoring video;

then, respectively calculating the ratio of the user statistical quantity of each representative monitoring user in the representative monitoring user screening set corresponding to the target construction site environment monitoring video to the user statistical quantity and value corresponding to the target construction site environment monitoring video aiming at each target construction site environment monitoring video, and obtaining the proportionality coefficient of each representative monitoring user in the representative monitoring user screening set;

and finally, regarding each target construction site environment monitoring video, taking a representative monitoring user screening set corresponding to the target construction site environment monitoring video and a proportionality coefficient of each representative monitoring user in the representative monitoring user screening set as video characteristic information corresponding to the target construction site environment monitoring video.

Illustratively, in some possible embodiments, step S300 may include the following:

firstly, for each data classification label information in a plurality of data classification label information configured in advance, determining historical video feature information corresponding to historical site environment monitoring videos stored based on the data classification label information to obtain historical video feature information corresponding to the data classification label information;

then, for each target worksite environment monitoring video, respectively calculating a feature similarity between the video feature information corresponding to the target worksite environment monitoring video and the historical video feature information corresponding to each data classification tag information in the plurality of data classification tag information (for example, a set overlap ratio between corresponding screening sets of representative monitoring users may be calculated, then, calculating a product of a scaling coefficient of each same representative monitoring user between the screening sets of representative monitoring users, and taking a sum of the set overlap ratio and the product as a feature similarity), and assigning a data score corresponding to the historical video feature information corresponding to the feature similarity having the maximum value.

With reference to fig. 3, an embodiment of the present invention further provides a data classification system for worksite environment monitoring data, which can be applied to the worksite environment monitoring server. Wherein the data classification system for worksite environment monitoring data may include:

In some possible implementations, the video feature determination module is specifically configured to:

for a target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device, screening multiple construction site environment monitoring video frames included in the target construction site environment monitoring video to obtain a target monitoring video clip corresponding to the target construction site environment monitoring video, wherein the target monitoring video clip comprises at least one construction site environment monitoring video frame;

In some possible embodiments, the classification label determination module is specifically configured to:

To sum up, the data classification method and the classification system for the worksite environment monitoring data provided by the present invention can determine at least one worksite environment monitoring terminal device from the multiple worksite environment monitoring terminal devices as a target worksite environment monitoring terminal device, then, for each target worksite environment monitoring terminal device, obtain a target worksite environment monitoring video sent by the target worksite environment monitoring terminal device, and perform feature recognition processing on the target worksite environment monitoring video to obtain video feature information corresponding to the target worksite environment monitoring video, so that the data classification tag information corresponding to each target worksite environment monitoring video can be determined based on the video feature information corresponding to each target worksite environment monitoring video, that is, the data classification tag information is determined based on the video feature information to perform classification storage, the monitoring videos with the same video characteristics can be stored together, so that a better classification effect is achieved in the application where the same video characteristics are required to be obtained, and the problem that the data classification effect of the monitoring data of the construction site environment is poor in the prior art is solved.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus and method embodiments described above are illustrative only, as the flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In addition, the functional modules in the embodiments of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, an electronic device, or a network device) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes. It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. The utility model provides a building site environment monitoring data's data classification method, its characterized in that is applied to building site environment monitoring server, building site environment monitoring server communication connection has a plurality of building site environment monitoring terminal equipment, a plurality of building site environment monitoring terminal equipment deploy respectively in a plurality of building site environment areas, building site environment monitoring data's data classification method includes:

2. The method for classifying data of construction site environment monitoring data according to claim 1, wherein the step of obtaining the target construction site environment monitoring video sent by the target construction site environment monitoring terminal device and performing feature recognition processing on the target construction site environment monitoring video to obtain the video feature information corresponding to the target construction site environment monitoring video for each target construction site environment monitoring terminal device comprises:

3. The data classification method for building site environment monitoring data according to claim 2, wherein the step of screening multiple building site environment monitoring video frames included in the target building site environment monitoring video for the target building site environment monitoring video corresponding to each target building site environment monitoring terminal device to obtain a target monitoring video segment corresponding to the target building site environment monitoring video comprises:

performing mean value calculation processing on each of a plurality of surveillance video segments corresponding to the target site environment surveillance video corresponding to each target site environment surveillance terminal device based on segment similarity between the surveillance video segment and each other surveillance video segment to obtain a mean value of similarity corresponding to the surveillance video segment;

4. The method for classifying the data of the monitoring data of the environment of the construction site according to claim 3, wherein the step of performing the segmented processing on the target construction site environment monitoring video for the target construction site environment monitoring video corresponding to each target construction site environment monitoring terminal device to obtain a plurality of monitoring video segments corresponding to the target construction site environment monitoring video comprises:

5. The method for classifying data of construction site environment monitoring data according to claim 2, wherein the step of performing feature recognition processing on the target monitoring video segment corresponding to the target construction site environment monitoring video for each target construction site environment monitoring video to obtain video feature information corresponding to the target construction site environment monitoring video comprises:

aiming at each target construction site environment monitoring video, carrying out duplicate removal screening processing on a representative monitoring user set corresponding to the target construction site environment monitoring video to obtain a representative monitoring user screening set corresponding to the target construction site environment monitoring video, and counting the number of users of each representative monitoring user in the representative monitoring user screening set based on the representative monitoring user set;

6. The method for data classification of worksite environment monitoring data according to claim 1, wherein the step of determining data classification label information corresponding to each target worksite environment monitoring video based on the video characteristic information corresponding to each target worksite environment monitoring video comprises:

7. The method for classifying data of construction site environment monitoring data according to any one of claims 1 to 6, wherein the step of determining at least one construction site environment monitoring terminal device among the plurality of construction site environment monitoring terminal devices as a target construction site environment monitoring terminal device comprises:

8. The utility model provides a building site environment monitoring data's data classification system, its characterized in that is applied to building site environment monitoring server, building site environment monitoring server communication connection has a plurality of building site environment monitoring terminal equipment, a plurality of building site environment monitoring terminal equipment deploy respectively in a plurality of building site environment areas, building site environment monitoring data's data classification system includes:

9. The data classification system for worksite environmental monitoring data of claim 8, wherein the video feature determination module is specifically configured to:

10. The data classification system for worksite environmental monitoring data of claim 8, wherein the classification tag determination module is specifically configured to: