CN114143497A

CN114143497A - State monitoring method, device and system for municipal administration management object and storage medium

Info

Publication number: CN114143497A
Application number: CN202010808525.3A
Authority: CN
Inventors: 孙琳
Original assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Current assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Priority date: 2020-08-12
Filing date: 2020-08-12
Publication date: 2022-03-04

Abstract

The invention discloses a method, a device and a system for monitoring the state of a municipal administration object and a storage medium. Wherein the method comprises the following steps: acquiring an image acquisition rule sent by a state monitoring platform; determining that the state of the image acquisition terminal in the moving process is matched with the image acquisition rule, and controlling the image acquisition terminal to acquire the image of the municipal administration object; and sending the image data of the municipal administration management object to a state monitoring platform. The embodiment of the invention can realize that the image acquisition terminal autonomously acquires the image of the municipal administration object in the moving process, does not need user intervention, is convenient for realizing mobile crowd sensing by using intelligent portable terminals such as smart phones and the like, does not increase the burden on time and energy for the user due to the acquisition of the image of the municipal administration object, and does not need to install monitoring equipment such as an additional sensor and the like on the municipal administration object, thereby effectively reducing the deployment cost and the subsequent maintenance cost for monitoring the municipal administration object.

Description

State monitoring method, device and system for municipal administration management object and storage medium

Technical Field

The invention relates to the field of maintenance, in particular to a method, a device and a system for monitoring the state of a municipal administration object and a storage medium.

Background

In the related art, the state of a maintenance object needs to be monitored, taking a well lid as an example, the well lid is used as an important component of an urban infrastructure, the maintenance of the well lid is related to the life and property safety of people in a city, and the urban management level is also reflected, so that effective measures are continuously taken by the related component, various potential safety hazards of the well lid are removed, and the safe operation of the well lid facility is ensured.

In the related art, manhole cover monitoring generally adopts the following two modes: manual inspection and sensor installation on the well lid. The manual inspection refers to the inspection of the well lid in the management area by a way that a professional inspector checks the well lid at regular time. The sensor is arranged on the well lid, namely the state of the well lid is sensed in real time in a mode that an acceleration sensor, a gyroscope, a communication assembly and the like are arranged on the well lid, and fine monitoring and management of the urban well lid are achieved. However, the two above-mentioned manhole cover monitoring methods still have the following problems:

1. if fixed personnel inspection mode is adopted, the labor cost is high. In addition, because the personnel quantity of patrolling and examining is limited, monitoring efficiency to extensive well lid is lower, if there is personnel's carelessness of working, can not in time be discover to lead to the relevant problem of well lid, has the potential safety hazard.

2. If the monitoring mode of installing the sensor on the well cover is adopted, the urban well cover is large in number, so that not only is the initial equipment cost and the installation cost higher, but also the continuous power supply and the maintenance of the sensor cause extremely high expenditure and high maintenance cost.

Disclosure of Invention

In view of this, embodiments of the present invention provide a method, an apparatus, a system, and a storage medium for monitoring a state of a municipal administration object, which aim to effectively reduce maintenance cost.

The technical scheme of the embodiment of the invention is realized as follows:

the embodiment of the invention provides a state monitoring method of a municipal administration management object, which is applied to an image acquisition terminal and comprises the following steps:

acquiring an image acquisition rule sent by a state monitoring platform;

determining that the state of the image acquisition terminal in the moving process is matched with the image acquisition rule, and controlling the image acquisition terminal to acquire the image of the municipal administration object;

and sending the image data of the municipal administration management object to the state monitoring platform.

The embodiment of the invention also provides a state monitoring method of the municipal administration management object, which is applied to a state monitoring platform, and the method comprises the following steps:

acquiring a monitoring request of the municipal administration management object;

generating a monitoring task based on the monitoring request, wherein the monitoring task comprises an image acquisition rule for controlling an image acquisition terminal to acquire an image of the municipal management object;

sending the monitoring task to a plurality of image acquisition terminals;

receiving image data of the municipal administration management objects sent by a plurality of image acquisition terminals;

and generating a monitoring result of the municipal administration management object based on the image data sent by the plurality of image acquisition terminals.

The embodiment of the invention also provides a state monitoring device of the municipal administration management object, which is applied to an image acquisition terminal, and the device comprises:

the first acquisition module is used for acquiring the image acquisition rule sent by the state monitoring platform;

the image acquisition module is used for determining that the state of the image acquisition terminal in the moving process is matched with the image acquisition rule and controlling the image acquisition terminal to acquire the image of the municipal administration management object;

and the first sending module is used for sending the image data of the municipal administration management object to the state monitoring platform.

The embodiment of the invention also provides a state monitoring device of the municipal administration object, which is applied to a state monitoring platform, and the device comprises:

the second acquisition module is used for acquiring the monitoring request of the municipal administration management object;

the task management module is used for generating a monitoring task based on the monitoring request, wherein the monitoring task comprises an image acquisition rule used for controlling an image acquisition terminal to acquire an image of the municipal administration management object;

the second sending module is used for sending the monitoring tasks to the plurality of image acquisition terminals;

the receiving module is used for receiving the image data of the municipal administration management object sent by the plurality of image acquisition terminals;

and the processing module is used for generating a monitoring result of the municipal administration management object based on the image data sent by the plurality of image acquisition terminals.

An embodiment of the present invention further provides an image capturing terminal, including: a processor and a memory for storing a computer program capable of running on the processor, wherein the processor, when running the computer program, is configured to perform the steps of the method described in the embodiments of the present invention on the image acquisition terminal side.

An embodiment of the present invention further provides a status monitoring platform, including: a processor and a memory for storing a computer program capable of running on the processor, wherein the processor, when running the computer program, is configured to perform the steps of the method described in the embodiments of the present invention on the side of the state monitoring platform.

The embodiment of the invention also provides a state monitoring system which comprises the state monitoring platform, wherein the state monitoring platform is in communication connection with a plurality of image acquisition terminals.

The embodiment of the invention also provides a storage medium, wherein a computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the method of any embodiment of the invention are realized.

The technical scheme provided by the embodiment of the invention is that an image acquisition terminal acquires an image acquisition rule sent by a state monitoring platform, determines that the state of the image acquisition terminal in the moving process is matched with the image acquisition rule, controls the image acquisition terminal to acquire the image of a municipal administration object and sends the image data of the municipal administration object to the state monitoring platform, can realize that the image acquisition terminal autonomously acquires the images of the municipal administration management objects in the moving process without user intervention, is convenient for realizing mobile crowd sensing by using intelligent portable terminals such as intelligent mobile phones and the like, and the collection of the images of the municipal administration objects does not increase the burden of time and energy for users, and monitoring equipment such as additional sensors and the like do not need to be arranged on the municipal administration objects, therefore, the deployment cost and the subsequent maintenance cost of municipal administration object monitoring are effectively reduced.

Drawings

FIG. 1 is a schematic structural diagram of a condition monitoring system according to an embodiment of the present invention;

FIG. 2 is a schematic flow chart of a method for monitoring the status of an image acquisition terminal according to an embodiment of the present invention;

FIG. 3 is a schematic flow chart of a method for monitoring the status of a manhole cover of an intelligent mobile phone in an application example of the present invention;

FIG. 4 is a schematic flow chart of a method for monitoring the status of a status monitoring platform according to an embodiment of the present invention;

FIG. 5 is a diagram of a street grid and image annotation in an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a condition monitoring system according to an embodiment of the present invention;

FIG. 7 is a flow chart of a status monitoring method according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a condition monitoring device according to an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of another condition monitoring device according to an embodiment of the present invention;

FIG. 10 is a schematic structural diagram of an image capturing terminal according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of a condition monitoring platform according to an embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

In the correlation technique, with the popularization of smart phones and intelligent wearable devices in users and the continuous improvement of the shooting capability of cameras, common users already have strong image acquisition and processing capabilities, and the intelligence of the internet of things is continuously developed from single intelligence to group intelligence. The Mobile Crowd Sensing (Mobile Crowd Sensing) is a new Sensing mode, various data acquisition is realized by taking a Mobile terminal of a common user as Sensing equipment, the data is gathered to a cloud, and Crowd intelligence extraction and man-made center service transmission are realized through cloud data fusion.

Along with the promotion of city infrastructure management fineness, original monitoring demand to city infrastructure such as well lid constantly increases, and there are defects such as inefficiency, with high costs, the maintenance degree of difficulty height, easily produce wrong judgement in modes such as current manpower patrolling and installing additional sensor. Based on the above, the invention provides the state monitoring method of the municipal administration object based on the internet of things and the mobile crowd sensing in various embodiments, the image acquisition terminal of the common user, such as a mobile phone, is used for automatically acquiring the image of the municipal administration object, and the state monitoring platform can know whether the municipal administration object is damaged or not in time, so that the state monitoring of the municipal administration object is realized. It should be noted that the municipal administration objects referred to in the embodiments of the present invention include, but are not limited to: manhole covers, roads, garbage bins, stop boards and the like.

Before introducing the state monitoring method of the municipal administration object in the embodiment of the invention, a monitoring system applying the state monitoring method of the municipal administration object in the embodiment of the invention is introduced. As shown in fig. 1, the monitoring system includes: the system comprises a state monitoring platform 101 and at least one image acquisition terminal 102, wherein the state monitoring platform 101 can be a cloud service management platform or a server. The state monitoring platform 101 may receive a monitoring request from an information demander (e.g., a government department or a third-party organization that performs state monitoring or management on objects such as a manhole cover), issue a monitoring task to the image acquisition terminal 102, receive image data related to monitoring of a municipal management object uploaded by the image acquisition terminal 102 based on the monitoring task, and perform monitoring of a state of the municipal management object based on the image data. The image capturing terminal 102 is a portable intelligent terminal on the user side, such as a smart phone, a smart wearable device, and the like. The image capture terminal 102 has an image capture function. In practical application, the image acquisition terminal can be combined with a mobile carrier, so that the sensing range is expanded, and the sensing efficiency is improved. For example, the mobile carrier may be a vehicle carrying a user and a smartphone, including but not limited to: cars, bicycles, motorcycles, electric vehicles, and the like. Although the mobile carrier does not directly participate in image acquisition, the sensing range can be enlarged, the sensing efficiency can be improved, and energy can be provided for the smart phone.

The following first introduces a state monitoring method of a municipal administration management object at the image acquisition terminal side in the embodiment of the present invention. As shown in fig. 2, an embodiment of the present invention provides a method for monitoring a state of a municipal administration object, which is applied to an image acquisition terminal, and the method includes:

step 201, acquiring an image acquisition rule sent by a state monitoring platform;

here, the image acquisition terminal may receive a monitoring task sent by the state monitoring platform, and acquire the image acquisition rule based on the monitoring task. The image acquisition rule is used for controlling the image acquisition terminal to autonomously acquire images of the municipal administration objects, so that the photographing process does not need manual operation of a user, namely, the image acquisition terminal can automatically acquire the images of the municipal administration objects according to the image acquisition rule sent by the state monitoring platform.

In the embodiment of the invention, the image acquisition rule comprises the following steps: the image acquisition terminal comprises a first image acquisition rule and a second image acquisition rule, wherein the first image acquisition rule is used for controlling the image acquisition terminal to acquire images of municipal administration objects in a continuous mode, and the second image acquisition rule is used for controlling the image acquisition terminal to acquire images of municipal administration objects in a trigger mode. Step 202, determining that the state of the image acquisition terminal in the moving process is matched with the image acquisition rule, and controlling the image acquisition terminal to acquire images of municipal administration objects;

here, the state of the image capture terminal during movement includes at least one of: ambient light intensity, location, moving speed, moving acceleration, direction offset and bump amount. The light intensity of the environment is used for reflecting the illumination condition of the environment where the image acquisition terminal is located, so that whether the illumination condition required by image acquisition is met or not can be judged; the position of the image acquisition terminal is used for reflecting whether the position of the image acquisition terminal is close to the area corresponding to the monitoring task; the moving speed is used for reflecting the moving speed of the moving carrier matched with the image acquisition terminal; the moving acceleration is used for reflecting the speed change trend of the moving carrier; the direction offset is used for reflecting the direction variable of the moving carrier; the bumping amount is used for reflecting the current state of the road surface, and can indirectly reflect whether road surface facilities such as well covers and the like are damaged or not. Accordingly, the image acquisition rules comprise at least: the light intensity condition and the position condition, the image acquisition rule may further include at least one of: speed condition, acceleration condition, direction offset condition and whether or not it is jerky.

In some embodiments, if the image capturing rule is a first image capturing rule for controlling the image capturing terminal to capture the image of the municipal management object in a continuous mode, the determining that the state of the image capturing terminal during the movement process matches the image capturing rule, and controlling the image capturing terminal to capture the image of the municipal management object includes:

and determining that the state of the image acquisition terminal in the moving process at least meets the light intensity condition and the position condition in the first image acquisition rule, and controlling the image acquisition terminal to continuously acquire images of the municipal administration management object at a first interval duration, wherein the moving speed of the image acquisition terminal is within a set speed threshold interval.

Here, if the image capturing rule of the monitoring task received by the image capturing terminal is the first image capturing rule, the image capturing terminal autonomously captures an image of the municipal administration object in the first mode (i.e., the continuous capturing mode) and stores captured image data related to the state of the object.

In some embodiments, if the image capturing rule is a second image capturing rule for controlling the image capturing terminal to capture an image of a municipal management object in a trigger mode, the determining that the state of the image capturing terminal during movement matches the image capturing rule, and controlling the image capturing terminal to capture the image of the municipal management object includes:

and determining that the state of the image acquisition terminal in the moving process at least meets the light intensity condition and the position condition in the second image acquisition rule, and triggering the image acquisition terminal to acquire the image of the municipal administration management object based on whether the image acquisition terminal is bumpy or not, and on one of the acceleration and the direction offset.

Here, if the image capturing rule of the monitoring task received by the image capturing terminal is the second image capturing rule, the image capturing terminal autonomously captures an image of the municipal administration object in the second mode (i.e., the trigger capturing mode) and stores image data related to the object state.

And step 203, sending the image data of the municipal administration management object to a state monitoring platform.

The image acquisition terminal sends the acquired image data of the municipal administration management object to the state monitoring platform, so that the state monitoring platform can conveniently perform centralized management on the state monitoring of the municipal administration management object. Here, the image capture terminal may transmit the image data to the status monitoring platform through a cellular network or a Wi-Fi (wireless fidelity) network.

According to the state monitoring method, the image acquisition terminal autonomously acquires the images of the municipal administration objects in the moving process, user intervention is not needed, mobile crowd sensing is conveniently achieved by using intelligent portable terminals such as mobile phones, time and energy burden cannot be added to users due to the acquisition of the images of the municipal administration objects, additional monitoring equipment such as sensors and the like do not need to be installed on the objects such as well covers and the like, and therefore deployment cost and subsequent maintenance cost of object monitoring are effectively reduced.

It should be noted that, if the collection of the image of the municipal administration object requires manual intervention of the user, a large amount of user time and energy are occupied for searching and shooting the municipal administration objects such as problem well covers, so that the user participation degree is low, and the common user does not have professional knowledge of equipment inspection, so that the fine problem is easily ignored, and the detection is missed. According to the state monitoring method of the municipal administration management object, in the process of shooting the image of the municipal administration management object, manual intervention of a user is not needed, the user does not need to have professional knowledge of routing inspection, and mobile crowd sensing is facilitated.

Here, the image capturing rule refers to a specific condition for triggering a photographing behavior when the photographing mode of the image capturing terminal is running. In some embodiments, the condition set includes fields shown in formula (1), and parameters corresponding to the fields are shown in formula (2).

< light intensity, position, velocity, time, acceleration, direction offset, bump > (1)

<L_min,[Loc],[V_min,V_max],T,A_min,Deg_min,[Toss,n,t]> (2)

The following describes the conditions related to the image acquisition rule with reference to equations (1) and (2):

the light intensity refers to the intensity of light during image acquisition, and at night, a common user mobile phone is difficult to acquire images of high-quality municipal administration management objects, so that the user needs to shoot under the condition of good illumination conditions in the daytime. Parameter L corresponding to light intensity_minThe lower limit of the light intensity value is represented, and the photographing mode can be started when the current environment illumination is detected to be sufficient and the value is higher than the lower limit.

The position is geographic information directly related to image acquisition, and the information acquisition of a local area can be efficiently realized by setting to take a picture in a certain specific geographic range, so that the occupation of excessive user resources is avoided. The location-corresponding parameter [ Loc ] is a set of coordinates for the points of the calibration range area within which the photographing can be initiated when the mobile carrier is located.

The speed is the running speed of the mobile carrier, when the mobile carrier runs at a high speed, the current road condition is possibly predicted to be better, the probability of the occurrence of objects such as abnormal well covers is relatively low, and the quality of images shot when the mobile carrier runs at a high speed is low, so that the problems of fuzziness and the like are easily caused; when the automobile runs at a low speed, the automobile possibly indicates that the current jam occurs, the distance between the automobiles is short, objects such as a well cover and a road surface are easily shielded by the front automobile, and the shot image has a large degree of redundancy. In both cases, the probability of acquiring images of high-quality municipal administration objects is low, and therefore, image capturing needs to be performed when the vehicle running speed is within a certain reasonable interval. Thus, the velocity corresponding parameter [ V ]_min,V_max]And calibrating a value interval between the minimum speed and the maximum speed, and starting an image shooting process of the municipal administration object when the speed of the moving carrier is in the interval.

The time-corresponding parameter T represents the interval duration of image acquisition in seconds (e.g., T set to 1 represents one shot at 1 second interval).

The acceleration is the degree of measuring the change of the speed of the mobile carrier, and when a user finds that the well cover is damaged in front, the road is abnormal, or a signal lamp is changed, the speed can be reduced urgently, so that the acceleration is changed. The parameter corresponding to the acceleration is the lower limit of the acceleration change, and only when the acceleration of the moving carrier is more than A_minAnd triggering the image shooting action of the municipal administration object.

The direction deviation means that the driving direction of the mobile carrier changes, and when a user finds that a broken well cover appears in the front and a road is abnormal, the user may avoid the broken well cover and the road, so that the vehicle is subjected to small-angle deviation. Thus, the parameter Deg_minThe deviation angle of the vehicle is set to be the minimum value, and the photographing is triggered only when the deviation angle of the moving carrier is detected to be larger than or equal to the value.

The jolt indicates that the current road surface state is not good, and the probability of encountering problems such as broken well covers is higher. Therefore, the parameter [ Toss, n, t ] corresponding to the bumping condition represents the triggering condition of photographing and the number and interval duration of the photographed images, wherein Toss is a boolean type and represents whether bumping occurs or not, that is, if the bumping occurs is detected by the mobile phone APP, photographing can be triggered, and n photos are continuously photographed with the interval duration of t, and n is a natural number, so that a user can timely acquire the object condition in the current road section.

It should be noted that the conditions shown in formulas (1) and (2) may be selected according to requirements to generate the image acquisition rule.

In an application example, the parameters of the first image acquisition rule include:<L_min,[Loc],[V_min,V_max],T>i.e. when the speed of travel of the moving carrier is at V, while meeting the basic light and position requirements_min,V_max]And in the interval, periodically shooting images of the municipal administration management object according to the interval duration T.

In an application example, the parameters of the second image acquisition rule include:<L_min,[Loc],A_min,Deg_min,[Toss,n,t]>that is, in the case of meeting the basic light and position requirements, image shooting of the municipal administration object is triggered according to the occurrence of acceleration, directional offset and bumping.

In practical application, the manhole cover is taken as an object, and due to the fact that great environmental differences and infrastructure construction degree differences exist in different cities, different image acquisition modes need to be set for the characteristics of the different cities and the monitoring requirements of the state of the manhole cover. For example, images can be shot in cities with poor road environment and infrastructure construction, a continuous acquisition mode can be set, and well lid images can be acquired fully. The image is shot in a city with good road environment and infrastructure construction, the trigger acquisition mode can be set, the redundancy of the image is reduced to the maximum degree, and abnormal well covers are found in time.

In some embodiments, before sending the image data of the municipal management object to the status monitoring platform, the status monitoring method further comprises:

cutting the acquired image;

performing image recognition based on the cut image, and selecting a target image containing a municipal administration object;

and carrying out privacy protection processing on the target image based on the sensitive object to obtain the image data.

The image cutting means that the image acquisition terminal cuts out regions, such as a headstock shelter or sky, of the acquired images of the municipal administration management objects, which are irrelevant to object identification, and only the images of the effective object regions are reserved, so that the storage and transmission expenses are saved, and the processing efficiency of the image identification is also improved.

Here, the image recognition based on the clipped image of the municipal administration object means that the image acquisition terminal recognizes whether the clipped image has the municipal administration object, deletes the image not including the municipal administration object, and retains the target image including the municipal administration object to perform the next privacy protection process.

Here, the privacy protection processing means that the image acquisition terminal performs fuzzy processing on sensitive information of an object such as a license plate or a pedestrian photographed in a target image, thereby realizing efficient privacy protection.

and carrying out encryption processing on the image data.

The image acquisition terminal can also encrypt image data to be sent so as to meet the requirement of information safe transmission. The encryption processing may be implemented based on digital signature, block chain technology, encryption algorithm encryption, and the like, which is not specifically limited in this embodiment of the present invention.

In the following, taking a smart phone as an example, and taking a manhole cover as an object, an example of the manhole cover state monitoring method is described, as shown in fig. 3, the manhole cover state monitoring method includes:

step 301, starting a mobile phone APP;

here, the smart phone needs to install an APP (application program) for monitoring the state of the manhole cover, and after the user starts the APP, the smart phone can receive a monitoring task issued by the task management platform (i.e., the state monitoring platform). The user can select whether to accept a certain monitoring task and agree to provide the shot image and auxiliary sensing information (such as time, position and the like) to the task management platform, so that the task management platform can monitor and analyze the state of the manhole cover.

Step 302, clicking a photographing mode by a user, and recording a photographing angle of the mobile phone by the system;

after receiving the monitoring task, the user needs to mount the smart phone on the mobile carrier, for example, mount the smart phone on a vehicle by using a mobile phone support, click a photographing mode, set an image photographing angle, and record the photographing angle by a system of the smart phone.

Step 303, judging whether an image acquisition rule is met, if so, executing step 304; if not, periodically and circularly judging whether the image acquisition rule is met;

in the moving process of the vehicle, the smart phone periodically and circularly judges whether the current state meets the image acquisition rule, if so, the step 304 is executed to trigger the camera to take a picture and store, and if not, the smart phone continuously and circularly judges whether the current state meets the image acquisition rule according to the set period.

Step 304, shooting images and recording shooting information;

here, the smartphone autonomously takes an image in the aforementioned first mode or second mode to capture a manhole cover image and records shooting information, and the shooting information may include at least one of: shooting time, shooting position, moving speed, acceleration, light intensity and the like.

Step 305, storing the image and related information;

here, the smartphone stores the photographed manhole cover image and the corresponding photographing information.

Step 306, after the user arrives at the destination, the user actively quits the photographing mode;

after the smart phone judges that the current position reaches the end point corresponding to the monitoring task, the smart phone actively exits the photographing mode, namely, the running program of the camera is closed.

Step 307, the system automatically performs image screening, performs privacy protection processing, and informs a user of shooting condition statistics;

the smart phone can carry out preliminary processing to the well lid image of shooing, for example, carry out image cutting to the well lid image, carry out image recognition based on the well lid image after cutting, select the target image that contains the well lid, it is right the target image carries out privacy protection based on sensitive object and handles to reduce the data overhead of transmitting for task management platform and the processing overhead that task management platform carries out follow-up statistical analysis. The smart phone may also count the results of the preliminary processing, such as the number of images taken, and inform the user.

Step 308, inquiring whether the user uploads an image through the current network, if not, executing step 309; if yes, go to step 310;

after finishing the preliminary processing of the well lid image, the smart phone may generate a prompt message for indicating whether the user uploads the image data through the current network, and if the user agrees, execute step 310; if the user does not agree, step 309 is performed.

Step 309, prompting the user to upload the image after follow-up;

after the network state changes, for example, after the smartphone is connected to a Wi-Fi network, the user can upload image data again until the image data corresponding to the monitoring task is uploaded to the task management platform.

Step 310, transmitting the image to a task management platform;

the smartphone may transmit the image data to the task management platform via a current network, for example, the image data after the preliminary processing is sent to the task management platform via a cellular network or a Wi-Fi network.

In step 311, a task execution is finished.

It can be understood that, in the validity period of the monitoring task, the smartphone can perform multiple image acquisitions as required to ensure the completion quality of the monitoring task.

The following describes a state monitoring method of the municipal administration management object on the side of the state monitoring platform in the embodiment of the invention. As shown in fig. 4, the method includes:

step 401, acquiring a monitoring request of a municipal administration management object;

here, the state monitoring platform may receive a monitoring request from an information demander, and the monitoring request may be a request for monitoring a municipal administration object in a specified area for a specified period of time.

Step 402, generating a monitoring task based on the monitoring request, wherein the monitoring task comprises an image acquisition rule for controlling an image acquisition terminal to acquire images of municipal administration objects;

here, the state monitoring platform converts the monitoring request into a monitoring task, and allocates the monitoring task to the corresponding image capturing terminal based on the information of the registered user, for example, the neighboring monitoring task may be allocated to the image capturing terminal corresponding to the corresponding registered user according to the location information of the registered user.

Here, the monitoring task generated by the state monitoring platform includes an image capturing rule, which may be the aforementioned first image capturing rule or the second image capturing rule.

Step 403, sending the monitoring task to a plurality of image acquisition terminals;

the state monitoring platform sends a monitoring task to the image acquisition terminal, and the image acquisition terminal can execute the image acquisition of the autonomous municipal administration management object based on an image acquisition rule carried in the monitoring task.

Step 404, receiving image data of the municipal administration management object sent by a plurality of image acquisition terminals;

the state monitoring platform receives image data and corresponding shooting information uploaded after the image acquisition terminal executes a monitoring task, for example, the shooting information includes at least one of the following: shooting time, shooting position, moving speed, acceleration, light intensity and the like.

Step 405, generating a monitoring result of the municipal administration object based on the image data sent by the plurality of image acquisition terminals.

The state monitoring platform can perform statistical analysis based on image data and shooting information uploaded by each image acquisition terminal to obtain a monitoring result of the municipal administration management object.

In some embodiments, in order to ensure efficiency and accuracy of image acquisition of the municipal management object, the state monitoring platform may intelligently determine an image acquisition mode corresponding to the image acquisition rule, so that monitoring tasks applicable to different urban environments may be generated based on the well lid monitoring request. Based on this, in some embodiments, the generating a monitoring task based on the monitoring request includes:

and determining an image acquisition rule of a monitoring task corresponding to the monitoring request based on machine learning, wherein the image acquisition rule is a first image acquisition rule used for controlling the image acquisition terminal to acquire images of the municipal administration management object in a continuous mode or a second image acquisition rule used for controlling the image acquisition terminal to acquire images of the municipal administration management object in a trigger mode.

In some embodiments, the determining, based on machine learning, the image acquisition rule of the monitoring task corresponding to the monitoring request includes:

constructing a training data set based on sample characteristic parameter values of historical monitoring tasks;

performing model training based on the training data set to obtain a classification model;

and classifying the monitoring tasks to be classified based on the classification model, and determining the image acquisition rules of the monitoring tasks to be classified.

In one application example, the image acquisition rules include: the state monitoring platform can train and generate a classification model used for determining that a monitoring task to be classified is a first image acquisition rule corresponding to the first mode or a second image acquisition rule corresponding to the second mode.

In practical application, the state monitoring platform can classify the monitoring tasks to be classified by using the historical data of state monitoring, the classification label is an image acquisition mode, the label is 0 to represent a first mode, and the label is 1 to represent a second mode. The sample feature list may be as shown in table 1, with the manhole cover as the target.

TABLE 1

The sample feature value in the embodiment of the present invention may include, but is not limited to, a parameter value corresponding to a parameter of each sample feature in the sample feature list shown in table 1. Wherein each sample feature represents a record of information when a user performs a task.

In an application example, the determining, based on machine learning, an image acquisition rule of a monitoring task corresponding to the monitoring request includes:

the method comprises the following steps: and extracting historical characteristic data and task labels to which the data belong to construct a training data set. And extracting the monitoring tasks to be issued to the image acquisition terminal, and constructing a sample set to be classified corresponding to the monitoring tasks to be classified by combining the historical data related to the tasks.

Here, the well lid count and the last cycle damage rate may be provided by the information demander, and other data may be available through the APP history of the executing task.

Here, the same user performs deduplication processing on the completely overlapped movement tracks in the same task (completely overlapping means that the tracks and the directions are completely identical, for example, if the user considers that the fixed routes going to work are completely overlapped every day, and if the tracks are the same but the directions are different between the work and the work, the tracks are not completely overlapped, and the tracks need to be divided into two sample records), and averaging processing is performed on the operation time, the vehicle average speed, the effective image rate, and the number of jolts corresponding to the completely overlapped movement tracks.

Step two: the well lid image shooting mode is established based on a training data set, and machine learning algorithms which can be adopted comprise kNN, naive Bayes, Adaboost and the like.

Step three: classifying the sample set to be classified according to the classification model to obtain an execution mode label of the monitoring task to be classified, determining an image acquisition mode of each monitoring task according to the label, and further generating a corresponding image acquisition rule.

Step four: and transmitting the monitoring task containing the image acquisition rule to an image acquisition terminal, and automatically acquiring the well lid image by the corresponding image acquisition terminal.

Step five: and updating the training data set at regular time according to various parameters (such as the number of jolts, the running time, the running track, the average speed of the vehicle, the effective image rate and the like) recorded in the task executed by the user mobile phone APP, so as to realize the optimization of the classification model.

In some embodiments, generating the monitoring result of the municipal administration object based on the image data sent by the plurality of image acquisition terminals comprises:

carrying out image recognition on the received image data, and determining the object state of the corresponding image data;

and carrying out statistical analysis based on the acquisition positions corresponding to the image data sent by different image acquisition terminals and the object state to obtain the monitoring result of the municipal administration object.

Here, the state monitoring platform may perform image recognition on image data sent by each image capturing terminal, for example, may determine an object state of an object in a received image based on an image recognition algorithm of a deep neural network, where taking a manhole cover as an example, the object state may include: whether the well lid is damaged or not can be further divided according to the damaged degree, for example, the damaged degree (for example, slight damage or serious damage) can be judged according to the damaged degree (for example, according to the damaged area).

Here, the state monitoring platform may perform statistical analysis based on the acquisition positions corresponding to the image data sent by the different image acquisition terminals and the object state, for example, perform data fusion processing on the image combination time, position and other shooting information of the effective municipal administration management object sent by each image acquisition terminal, and can implement complementation and cross validation according to the image information provided by the different image acquisition terminals through data fusion, thereby further improving the coverage of object state monitoring and improving the reliability of the monitoring result.

In an application example, taking the manhole cover as an example, the method of complementation and cross validation is as follows:

1) and dividing the coverage area of the monitoring task into grids according to streets, wherein each grid represents an atomic area.

2) Marking the position coordinates corresponding to the effective manhole cover images submitted by the image acquisition terminals and the manhole cover state judged in the image recognition as features in the grid, wherein the coordinates of the marked points represent the position of manhole cover image acquisition, and the manhole cover state can be represented by the colors or the shapes of the points. The schematic diagram is shown in fig. 5, wherein triangles represent the judged damaged well lid, and dots represent the judged normal well lid.

3) And clustering scattered points in each atomic region according to the state (such as k-means, DBSCAN algorithm and the like), wherein the obtained clustering result represents the monitoring result of the well lid state at the position, if an image does not accord with the clustering result at the position, the image is considered to be abnormal, and the abnormal result is counted in the task execution record of the user.

In some embodiments, the condition monitoring method further comprises:

and if the abnormal quantity of the image data of any image acquisition terminal, which is inconsistent with the monitoring result of the municipal administration object, reaches a preset threshold value, canceling the monitoring authority of the corresponding image acquisition terminal.

Here, if the number of anomalies in the task execution record of the monitoring task of a certain image capturing terminal reaches a preset threshold, it indicates that the image capturing terminal is unreliable (for example, the positioning information is wrong, the mobile phone is attacked by security, etc.), and then the execution of the monitoring task of the image capturing terminal is terminated, that is, the monitoring authority of the image capturing terminal is cancelled.

In some embodiments, the condition monitoring method further comprises:

and carrying out decryption processing on the received image data.

Here, when the image acquisition terminal performs encryption processing on the sent image data, the state monitoring platform needs to perform corresponding decryption processing on the received image data to meet the requirement of information security transmission, and the capability of the state monitoring platform for resisting security attacks is effectively enhanced.

In some embodiments, the condition monitoring method further comprises:

and registering and managing the image acquisition terminal.

Here, the state monitoring platform may register and manage the image capture terminals of the respective users, thereby maintaining the information list of the respective registered users on the platform side. The state monitoring platform can also realize the subdivision of users according to the analysis of user information, can realize more accurate task pushing and excitation mechanism design, and is favorable for improving the efficiency of task development.

The present invention will be described in further detail with reference to the following application examples.

As shown in fig. 6, in the present application embodiment, an object to be monitored is a manhole cover, and a state monitoring system is a manhole cover state monitoring system, and the manhole cover state monitoring system in the present application embodiment includes a task management platform 61, a user-side task execution system 62, and an information demand side business system 63. Wherein, task management platform 61 is the hub connecting information demand side service system 63 and user side task execution system 62, also is the core of well lid state monitoring system operation, and task management platform 61 includes: a first communication management module 611, a first task management module 612, a user management module 613, an incentive management module 614, a first data management module 615, and a first security assurance module 616. The user-side task execution system 62 is a main body for acquiring the state information of the manhole cover, and comprises a user mobile phone APP and a mobile carrier. Cell-phone APP includes: the mobile carrier is used for bearing the image acquisition terminal and driving the image acquisition terminal to move, and the mobile carrier can be a car, a motorcycle, a bicycle and the like. The image acquisition terminal can be a smart phone, and the smart phone runs the mobile phone APP.

The following describes the functions of the modules on the task management platform 61 side as follows:

the first communication management module 611 is a capability component of the service management platform for performing inter-system communication, and can be connected with the information demand party service system 63 and the user side mobile phone APP to implement transmission of various types of data.

The first task management module 612 is configured to generate a monitoring task that can be executed on the user side according to a well lid monitoring request of an information demand party, set a corresponding image collection rule according to a requirement of the monitoring task (corresponding parameters and values are set according to formulas (1) and (2)), and distribute the monitoring task and the image collection rule to a mobile phone APP of the user, where all well lid monitoring tasks in a platform form a task list, and fields included in the tasks in the list are shown in formula (3).

< task number, task validity period, location area, image requirement, device list, photographing rule > (3)

The task number can be a task number generated by the task management platform for the monitoring task based on a set rule, the task validity period, the position area and the image requirement can be correspondingly set based on the well lid monitoring request, the equipment list is a list of image acquisition terminals corresponding to the monitoring task, and the shooting rule is the image acquisition rule. The task management platform can count and manage the completion condition of the monitoring task, update the task information and the task state in time, and the task state can comprise unpublished, published, completed and the like.

The user management module 613 is a capability component for performing information maintenance and comprehensive management on a user who has installed the mobile phone APP, and the platform maintains an information list of all registered users, where fields in the list are shown in formula (4).

< user ID (Mobile phone number), registration time, certificate number, device List, Address List > (4)

The user management module 613 can implement user segmentation according to analysis of user information, implement more accurate task push and excitation mechanism design, and is beneficial to improving efficiency of task development.

The incentive management module 614 is a capability component for setting an incentive mechanism for a user executing a task according to the requirement of the task, the incentive method includes but is not limited to cash, points, honor and the like, and the participation will and enthusiasm of the user can be improved to the maximum extent through a reasonable incentive mechanism, so that the coverage range of the manhole cover state monitoring system is expanded.

The first data management module 615 is a capability component for performing image analysis, data fusion and statistics on the well lid images collected by the user side, performs state recognition on the collected well lid images, performs fusion processing and analyzes image data submitted by multiple users, and forms an overall perception conclusion through data statistics for feedback to an information demand party. The data management module is a core component of the task management platform for realizing the well lid state monitoring function. The first data management module 615 may be configured to execute the specific process of generating the monitoring result of the well lid state based on the image data, which is not described herein again in this embodiment of the present invention.

The first safety guarantee module 616 is a capacity component for realizing information safety protection of the well lid state monitoring system, and as the system adopts a crowd sensing mode to realize large-scale image acquisition through user equipment, the user information safety and privacy protection are of great importance, and safety protection is realized through technical means such as encryption, digital signature and block chains, so that the user information is safer, and the safety attack risk of the task management platform is also reduced.

The functions of the modules of the user-side execution system 62 are described below:

the second task management module 621 is an ability component for performing comprehensive maintenance on the task, and has a function of receiving and managing the corresponding task and acquiring the corresponding incentive according to the completion condition of the task.

The shooting management module 622 is a capability component for controlling the shooting of images when a user executes a task, after the user receives a certain task issued by the platform, the module automatically loads the image acquisition rules of the task (as shown in formulas (1) and (2)), and when the task is executed, the APP controls the image acquisition opportunity by the shooting management module 622 according to the corresponding rules, so as to realize the automatic acquisition of the well lid images.

The second data management module 623 is a capability component for comprehensively managing the images shot by the user and the background information of the images, and has functions of storing and checking the images collected by the user, counting the background information (such as image size, shooting time, shooting location, shooting angle, light intensity, driving speed, and the like), primarily processing and analyzing the images, eliminating unqualified images, and reducing the data transmission and processing overhead.

The second communication management module 624 is a capability component for performing communication connection with the platform, and realizes the transfer of various data such as images and rules.

The second security assurance module 625 is a capability component for performing information security assurance and privacy protection on the user mobile phone APP, and can realize security capabilities such as encryption.

Next, referring to fig. 7, a detailed description is given of a manhole cover state monitoring method of the manhole cover state monitoring system according to the embodiment of the present application, where as shown in fig. 7, the manhole cover state monitoring method includes:

step 701, registering a user on a platform, agreeing to receive a task and collecting an image;

the user registers to the task management platform through the image acquisition terminal, and the registration process comprises the following steps: providing identity verification information, reading information acquisition requirements, receiving privacy protection terms of the platform, and agreeing to receive well lid acquisition task information issued by the platform.

Step 702, a well lid monitoring request is provided;

the information demand side business system sends a manhole cover monitoring request to the task management platform, for example, a request for monitoring the state of the manhole cover in a specified time period in a specified area.

703, generating a monitoring task according to the well lid monitoring request;

and the task management platform selects an image acquisition mode according to the well lid monitoring request and generates a corresponding image acquisition rule.

Step 704, selecting a user, motivating, and distributing tasks;

and the task management platform selects a user for the monitoring task, sets corresponding excitation and issues the monitoring task to a corresponding image acquisition terminal.

705, receiving the task, starting a mobile phone APP when the mobile carrier runs, automatically executing the task, and performing image primary screening;

the image acquisition terminal receives the monitoring task, autonomously executes the image acquisition task based on the state of the image acquisition terminal in the moving process and the image acquisition rule, and performs primary processing such as screening, privacy protection processing and the like on the acquired image.

Step 706, submitting perception data such as images and the like;

and the image acquisition terminal uploads the image data and the shooting information after the preliminary processing to the task management platform.

Step 707, fusing and analyzing data to obtain a perception conclusion;

and the task management platform performs data fusion based on the image data and the shooting information uploaded by each image acquisition terminal, and performs statistical analysis on the fused data to obtain a monitoring result of the well lid state.

At step 708, information submission is requested.

And the task management platform generates request information based on the counted monitoring result of the well lid state, wherein the request information is response information for responding to the well lid monitoring request, and sends the request information to the information demand side business system.

In other embodiments, the image capturing terminal may also be a combination of a smart phone and other mobile terminals having an image capturing function, for example, the mobile terminal may be a car data recorder, an intelligent rearview mirror, an intelligent watch, an intelligent bracelet, an intelligent helmet, intelligent glasses, a sports camera, and the like, and for a user who is inconvenient to use the smart phone to capture an image, the image capturing terminal may also be capable of effectively using the other mobile terminals to perform an image capturing task. The user also needs to install a mobile phone APP, the mobile phone APP is connected with the mobile terminal (such as a vehicle data recorder and a motion camera), whether shooting conditions are met or not is judged through the mobile phone APP, then other mobile terminals are controlled to shoot images, and connection between the terminal and the mobile phone APP is achieved through Bluetooth or WiFi and the like. When a user executes a task, the mobile phone APP is used as a device for controlling shooting, image storage and analysis, and image collection is completed by other terminals such as a vehicle event data recorder. The expanded well lid state monitoring method can support the design of the task management platform without changing. Only need to update cell-phone APP, increase terminal management module, manage the portable terminal of image acquisition to increase in communication management module and communicate through modes such as bluetooth, wiFi and the portable terminal of image acquisition. The expanded system has stronger applicability, can support users with mobile terminals with different image acquisition to participate in the execution of tasks, increases the participation of the users, and improves the efficiency of task execution.

It is understood that the above application embodiments are exemplified by taking the manhole cover as an object. In other embodiments, the condition monitoring system may also monitor other objects, for example, it may be used in other scenarios of a smart city, such as: road state monitoring, traffic state monitoring, environmental state monitoring and the like only need to set corresponding reasonable image acquisition rules. Has strong universality and wide application prospect.

In order to implement the method for monitoring the state of the municipal administration object at the image acquisition terminal side in the embodiment of the invention, the embodiment of the invention also provides a device for monitoring the state of the municipal administration object, the device for monitoring the state corresponds to the method for monitoring the state of the municipal administration object at the image acquisition terminal side, and the steps in the method for monitoring the state of the municipal administration object at the image acquisition terminal side are also completely applicable to the embodiment of the device for monitoring the state.

As shown in fig. 8, the condition monitoring device 800 includes: a first obtaining module 801, an image collecting module 802, and a first sending module 803; the first obtaining module 801 is configured to obtain an image acquisition rule sent by the state monitoring platform; the image acquisition module 802 is configured to determine that the state of the image acquisition terminal in the moving process matches the image acquisition rule, and control the image acquisition terminal to acquire an image of a municipal administration object; the first sending module 803 is used for sending the image data of the municipal administration object to a state monitoring platform.

In some embodiments, the image acquisition rule is a first image acquisition rule, and the image acquisition module 802 is specifically configured to:

and determining that the state of the image acquisition terminal in the moving process at least meets the light intensity condition and the position condition in the first image acquisition rule, and the moving speed of the image acquisition terminal is within a set speed threshold interval, and controlling the image acquisition terminal to continuously acquire the images of the municipal administration management object at a first interval duration.

In some embodiments, the image acquisition rule is a second image acquisition rule, and the image acquisition module 802 is specifically configured to:

In some embodiments, the image acquisition module 802 triggers the image acquisition terminal to acquire the image of the municipal management object based on whether the image acquisition terminal is one of bumpy, accelerated, and directionally offset, including:

determining that the image acquisition terminal bumps, and triggering the image acquisition terminal to acquire n images of the municipal administration management object at a second interval duration, wherein n is a natural number; or,

determining that the acceleration of the image acquisition terminal reaches an acceleration condition, and triggering the image acquisition terminal to acquire at least one image of a municipal administration object;

and determining that the direction offset of the image acquisition terminal reaches a direction offset condition, and triggering the image acquisition terminal to acquire at least one image of the municipal administration object.

In some embodiments, condition monitoring device 800 further comprises: the image processing module 804 is specifically configured to:

cutting the acquired image;

In some embodiments, condition monitoring device 800 further comprises: the encryption module 805 is specifically configured to:

and carrying out encryption processing on the image data.

In practical application, the first obtaining module 801, the image acquiring module 802, the first sending module 803, the image processing module 804 and the encrypting module 805 may be implemented by a processor in the state monitoring apparatus 800. Of course, the processor needs to run a computer program in memory to implement its functions.

It is understood that the first obtaining module 801 corresponds to the aforementioned second task management module 621, the image capturing module 802 corresponds to the aforementioned shooting management module 621, the first sending module 803 corresponds to the aforementioned second communication management module 624, the image processing module 804 corresponds to the aforementioned second data management module 623, and the encryption module 805 corresponds to the aforementioned second security and security module 625.

In order to realize the state monitoring method of the municipal management object on the side of the state monitoring platform in the embodiment of the invention, the embodiment of the invention also provides a state monitoring device of the municipal management object, the state monitoring device corresponds to the state monitoring method of the municipal management object on the side of the state monitoring platform, and all the steps in the state monitoring method of the municipal management object on the side of the state monitoring platform are also completely suitable for the embodiment of the state monitoring device.

As shown in fig. 9, the condition monitoring device 900 includes: a second obtaining module 901, a task management module 902, a second sending module 903, a receiving module 904 and a processing module 905; the second obtaining module 901 is configured to obtain a monitoring request of a municipal administration management object; the task management module 902 is configured to generate a monitoring task based on the monitoring request, where the monitoring task includes an image acquisition rule for controlling an image acquisition terminal to acquire an image of a municipal management object; the second sending module 903 is configured to send the monitoring task to a plurality of image acquisition terminals; the receiving module 904 is configured to receive image data of the municipal administration management object sent by a plurality of image acquisition terminals; the processing module 905 is configured to generate a monitoring result of the municipal administration object based on the image data sent by the plurality of image acquisition terminals.

In some embodiments, the task management module 902 is specifically configured to:

and determining an image acquisition rule of a monitoring task corresponding to the monitoring request based on machine learning, wherein the image acquisition rule is a first image acquisition rule used for controlling the image acquisition terminal to acquire the images of the municipal administration management objects in a first mode or a second image acquisition rule used for controlling the image acquisition terminal to acquire the images of the municipal administration management objects in a second mode.

In some embodiments, the processing module 905 is specifically configured to:

and carrying out statistical analysis based on the acquisition positions and the states corresponding to the image data sent by different image acquisition terminals to obtain the monitoring result of the object to be monitored.

In some embodiments, the processing module 905 is further configured to:

and if the abnormal quantity that the object state of the image data of any image acquisition terminal does not accord with the monitoring result of the object reaches a preset threshold value, canceling the monitoring authority of the corresponding image acquisition terminal.

In some embodiments, condition monitoring device 900 further includes: a decryption module 906 to:

and carrying out decryption processing on the received image data.

In some embodiments, condition monitoring device 900 further includes: a user management module 907 for:

and registering and managing the image acquisition terminal.

In practical application, the second obtaining module 901, the task management module 902, the second sending module 903, the receiving module 904, the processing module 905, the decryption module 906, and the user management module 907 may be implemented by a processor in the state monitoring device 900. Of course, the processor needs to run a computer program in memory to implement its functions.

It is understood that the second obtaining module 901 and the task management module 902 correspond to the aforementioned first task management module 612, the second sending module 903 and the receiving module 904 correspond to the aforementioned first communication management module 611, the processing module 905 corresponds to the aforementioned first data management module 615, the decryption module 906 corresponds to the aforementioned first security module 616, and the user management module 907 corresponds to the aforementioned user management module 613.

It should be noted that: in the state monitoring device provided in the above embodiment, when performing state monitoring, only the division of the program modules is exemplified, and in practical applications, the processing distribution may be completed by different program modules according to needs, that is, the internal structure of the device is divided into different program modules to complete all or part of the processing described above. In addition, the state monitoring device and the state monitoring method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.

Based on the hardware implementation of the program module, in order to implement the method of the embodiment of the present invention, the embodiment of the present invention further provides an image capturing terminal. Fig. 10 shows only an exemplary structure of the image pickup terminal, not the entire structure, and a part or the entire structure shown in fig. 10 may be implemented as necessary.

As shown in fig. 10, an image capturing terminal 1000 according to an embodiment of the present invention includes: at least one processor 1001, memory 1002, a user interface 1003 and at least one network interface 1004. The various components in image capture terminal 1000 are coupled together by a bus system 1005. It will be appreciated that bus system 1005 is used to enable communications among the components of the connection. The bus system 1005 includes a power bus, a control bus, and a status signal bus, in addition to a data bus. But for the sake of clarity the various busses are labeled in figure 10 as the bus system 1005.

The user interface 1003 may include a display, a keyboard, a mouse, a trackball, a click wheel, a key, a button, a touch pad, a touch screen, or the like, among others.

The memory 1002 in the embodiments of the present invention is used to store various types of data to support the operation of the image capture terminal. Examples of such data include: any computer program for operating on an image acquisition terminal.

The condition monitoring method disclosed by the embodiment of the invention can be applied to the processor 1001, or can be realized by the processor 1001. The processor 1001 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the condition monitoring method may be implemented by integrated logic circuits of hardware or instructions in the form of software in the processor 1001. The Processor 1001 may be a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. The processor 1001 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed by the embodiment of the invention can be directly implemented by a hardware decoding processor, or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 1002, and the processor 1001 reads the information in the memory 1002 and performs the steps of the status monitoring method provided by the embodiments of the present invention in combination with the hardware thereof.

In an exemplary embodiment, the image capturing terminal may be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, Programmable Logic Devices (PLDs), Complex Programmable Logic Devices (CPLDs), FPGAs, general purpose processors, controllers, Micro Controllers (MCUs), microprocessors (microprocessors), or other electronic components for performing the aforementioned methods.

Based on the hardware implementation of the program module, and in order to implement the method according to the embodiment of the present invention, the embodiment of the present invention further provides a state monitoring platform. Fig. 11 shows only an exemplary structure of the condition monitoring platform, not the entire structure, and a part or the entire structure shown in fig. 11 may be implemented as necessary.

As shown in fig. 11, a condition monitoring platform 1100 according to an embodiment of the present invention includes: at least one processor 1101, memory 1102, a user interface 1103, and at least one network interface 1104. The various components in condition monitoring platform 1100 are coupled together by a bus system 1105. It will be appreciated that the bus system 1105 is used to enable communications among the components. The bus system 1105 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled in fig. 11 as the bus system 1105.

The user interface 1103 may include, among other things, a display, a keyboard, a mouse, a trackball, a click wheel, keys, buttons, a touch pad, or a touch screen.

Memory 1102 in embodiments of the present invention is used to store various types of data to support the operation of the condition monitoring platform. Examples of such data include: any computer program for operating on a condition monitoring platform.

The condition monitoring method disclosed by the embodiment of the invention can be applied to the processor 1101 or realized by the processor 1101. The processor 1101 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the condition monitoring method may be performed by instructions in the form of hardware, integrated logic circuits, or software in the processor 1101. The Processor 1101 described above may be a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. Processor 1101 may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed by the embodiment of the invention can be directly implemented by a hardware decoding processor, or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 1102, and the processor 1101 reads the information in the memory 1102 to complete the steps of the condition monitoring method provided by the embodiments of the present invention in conjunction with the hardware thereof.

In an exemplary embodiment, condition monitoring platform 1100 may be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general-purpose processors, controllers, MCUs, microprocessors, or other electronic components for performing the aforementioned methods.

It will be appreciated that the

memories

1002, 1102 can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The described memory for embodiments of the present invention is intended to comprise, without being limited to, these and any other suitable types of memory.

The embodiment of the present invention further provides a state monitoring system, as shown in fig. 1, the state monitoring system includes a state monitoring platform 101, and the state monitoring platform 101 is in communication connection with at least one image acquisition terminal 102. The image capturing terminal 102 may be the image capturing terminal 1000 shown in fig. 10, the state monitoring platform 101 may be the state monitoring platform 1100 shown in fig. 11, and the state monitoring method of the state monitoring system may refer to the foregoing method embodiments, which are not described herein again.

In an exemplary embodiment, an embodiment of the present invention further provides a storage medium, that is, a computer storage medium, which may specifically be a computer-readable storage medium, for example, including a memory 1002 storing a computer program, where the computer program is executable by a processor 1001 of the image capturing terminal 1000, so as to complete the steps described in the method for monitoring the state of the image capturing terminal 1000 side in the embodiment of the present invention; as another example, a memory 1102 storing a computer program may be included, and the computer program may be executed by a processor 1101 of the state monitoring platform 1100 to complete the steps of the state monitoring method on the state monitoring platform 1100 side according to the embodiment of the present invention. The computer readable storage medium may be a ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface Memory, optical disk, or CD-ROM, among others.

It should be noted that: "first," "second," and the like are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.

In addition, the technical solutions described in the embodiments of the present invention may be arbitrarily combined without conflict.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A state monitoring method of a municipal administration management object is applied to an image acquisition terminal, and comprises the following steps:

acquiring an image acquisition rule sent by a state monitoring platform;

2. The method of claim 1,

the image acquisition rule is a first image acquisition rule, the state of the image acquisition terminal in the moving process is determined to be matched with the image acquisition rule, and the image acquisition terminal is controlled to acquire the image of the municipal administration management object, and the method comprises the following steps:

determining that the state of the image acquisition terminal in the moving process at least meets the light intensity condition and the position condition in the first image acquisition rule, and the moving speed of the image acquisition terminal is within a set speed threshold interval, and controlling the image acquisition terminal to continuously acquire the images of the municipal administration management object at a first interval duration; or,

the image acquisition rule is a second image acquisition rule, the state of the image acquisition terminal in the moving process is determined to be matched with the image acquisition rule, and the image acquisition terminal is controlled to acquire the image of the municipal administration management object, and the method comprises the following steps:

3. The method of claim 2, wherein triggering the image acquisition terminal to acquire the image of the municipally managed object based on whether the image acquisition terminal is one of bumpy, accelerated, and directionally offset comprises:

determining that the acceleration of the image acquisition terminal reaches an acceleration condition, and triggering the image acquisition terminal to acquire at least one image of the municipal administration object; or,

and determining that the direction offset of the image acquisition terminal reaches a direction offset condition, and triggering the image acquisition terminal to acquire at least one image of the municipal administration management object.

4. The method of claim 1, wherein prior to sending the image data of the municipally managed object to a status monitoring platform, the method further comprises:

cutting the acquired image;

performing image recognition based on the cut image, and selecting a target image containing the municipal administration object;

5. The method of claim 1, wherein prior to sending the image data of the municipally managed object to a status monitoring platform, the method further comprises:

and carrying out encryption processing on the image data.

6. A state monitoring method of municipal administration objects is applied to a state monitoring platform, and comprises the following steps:

sending the monitoring task to a plurality of image acquisition terminals;

7. The method of claim 6, wherein generating a monitoring task based on the monitoring request comprises:

and determining an image acquisition rule of a monitoring task corresponding to the monitoring request based on machine learning, wherein the image acquisition rule is a first image acquisition rule used for controlling the image acquisition terminal to acquire the images of the municipal administration management object in a first mode or a second image acquisition rule used for controlling the image acquisition terminal to acquire the images of the municipal administration management object in a second mode.

8. The method of claim 7, wherein determining the image acquisition rule of the monitoring task corresponding to the monitoring request based on machine learning comprises:

9. The method of claim 6, wherein the generating of the monitoring result of the municipal administration object based on the image data sent by the plurality of image acquisition terminals comprises:

and carrying out statistical analysis based on the acquisition positions corresponding to the image data and the object states sent by different image acquisition terminals to obtain the monitoring result of the municipal administration object.

10. The method of claim 9, further comprising:

11. The method of claim 6, further comprising:

and carrying out decryption processing on the received image data.

12. The method of claim 6, further comprising:

and registering and managing the image acquisition terminal.

13. A state monitoring device of municipal administration object, characterized in that, is applied to image acquisition terminal, the device includes:

14. A condition monitoring device for municipal administration objects, applied to a condition monitoring platform, comprising:

15. An image capture terminal, comprising: a processor and a memory for storing a computer program capable of running on the processor, wherein,

the processor, when executing the computer program, is adapted to perform the steps of the method of any of claims 1 to 5.

16. A condition monitoring platform, comprising: a processor and a memory for storing a computer program capable of running on the processor, wherein,

the processor, when executing the computer program, is adapted to perform the steps of the method of any of claims 6 to 12.

17. A condition monitoring system comprising a condition monitoring platform according to claim 16, said condition monitoring platform being communicatively connected to a plurality of image capture terminals according to claim 15.

18. A storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, performs the steps of the method of any one of claims 1 to 12.