CN215871468U - Operation site digital supervision system based on intelligent robot dog - Google Patents

Abstract

The utility model discloses an operation site digital monitoring system based on an intelligent mechanical dog, which organically combines the intelligent mechanical dog and an edge calculation host, adapts to operation sites under various complex conditions by using the movement capability and obstacle avoidance capability of the intelligent mechanical dog, and can automatically judge whether monitoring is needed or not or whether movement is needed under the condition that some abnormal conditions of the on-site operation conditions are identified, so that the monitoring angle and position are adjusted timely, and better monitoring and identification effects are achieved. The intelligent robot dog and each intelligent safety tool realize real-time communication, constantly monitor the working condition of on-site workers, and reduce the safety accidents caused by uncertain factors such as nonstandard operation, damage of the tool and the tool, accidental hidden danger and the like. The edge calculation host is associated with various field video equipment, so that the optimal angle and position for identifying the violation are automatically selected, and the accuracy of violation identification is improved.

Description

Operation site digital supervision system based on intelligent robot dog

Technical Field

The utility model belongs to the technical field of intelligent monitoring, and particularly relates to an operation site digital supervision system based on an intelligent robot dog.

Background

As a super-huge type national key backbone enterprise which is related to national economic life lines and national energy safety, a national network company has increasingly complex power grid structures, new equipment and new technology are widely applied, the operation and maintenance of a power grid and construction tasks are heavy, nearly 3 thousands of work items per week are provided, more than 40 thousands of field personnel, more operating personnel, more professional cooperation, various safety risks and accident hidden dangers are interwoven and superposed, the difficulty of safety control is high, the traditional safety control mode and capacity cannot follow the requirements of new development, and higher requirements are provided for safety technological innovation.

At present, around intelligent safety management and control, the prior art mainly carries out technical innovation from a platform end and a field end, implements remote monitoring and field management and control through an information system platform and an intelligent safety terminal, but the remote safety monitoring is limited by a network channel and the field operation scale, and has restrictions on timeliness and effectiveness, while the intelligent safety terminals represented by intelligent safety tools, safety robots and wearable equipment are various in types, but lack effective integration, and cannot form the resultant force of management and control fields.

Therefore, how to solve the above-mentioned drawbacks of the prior art becomes the direction of efforts of those skilled in the art.

SUMMERY OF THE UTILITY MODEL

The utility model aims to provide an operation site digital monitoring system based on an intelligent robot dog, which realizes site operation monitoring based on the intelligent robot dog, and the intelligent robot dog technology belongs to the field of robot technology, not only has the advantages that a common robot faces sudden dangerous situations and reduces personal casualties, but also has more excellent motility, stability and expansibility, is more suitable for rugged and uneven road conditions, and meets the control requirements of remote sites. In addition, the intelligent machine dog carrying the edge calculation host is the brain for intelligently processing the field violation conditions, the edge calculation is a new technology, has the characteristics of low time delay, high reliability, massive connection and the like, is initiated at the edge side, so that faster service response is generated, and the field real-time service requirements are met. The intelligent robot dog is used for on-site safety control by relying on edge calculation, functions of effectively associating background data and integrating front-end equipment are achieved, a carried intelligent algorithm is combined, the center of gravity of safety control work falls on the site and falls into one line, problems and defects of a platform end and a site end can be effectively solved, network bandwidth pressure is greatly reduced, background workload is reduced, safety control dead angles are reduced, safety control resultant force of various intelligent terminals can be gathered, digital safety control level of an operation site is improved practically, and the defects of the prior art can be completely solved.

The purpose of the utility model is realized by the following technical scheme:

a digital safety supervision system of an operation site based on an intelligent robot dog comprises the intelligent robot dog, a handheld terminal, an intelligent safety tool and a monitoring center; the intelligent robot dog is provided with a monitoring camera and is internally provided with an edge calculation host; the intelligent safety tool is communicated with the robot dog and transmits data to the robot dog; the handheld terminal is communicated with the robot dog, and the robot dog, the handheld terminal and the monitoring center are communicated; the intelligent safety tool comprises an intelligent safety belt, an intelligent safety cap, an electronic fence, a movable cloth control ball and an intelligent grounding wire; the electronic fence comprises a fixed support, a stand column, a horizontal cross rod, a battery module, a wireless charging module, an infrared transmitting module, an infrared receiving plate, a temperature and humidity sensor, a communication unit, a control chip, a warning lamp, an active RFID (radio frequency identification), an antenna, a sound box and a camera, wherein the battery module is arranged on the fixed support, the wireless charging module is configured on the battery module, the stand column is arranged on the battery module, the infrared receiving plate, the infrared transmitting module, the temperature and humidity sensor, the communication unit and the control chip are mounted on the stand column, the infrared transmitting module is rotatably connected to the stand column, the horizontal cross rod is fixed at the top end of the stand column, the warning lamp is mounted at one end of the horizontal cross rod, the active RFID is mounted at the other end of the horizontal cross rod, the sound box and the antenna are arranged on the horizontal cross rod, the camera is fixed on the sound box, and the battery module, the wireless charging module, the infrared transmitting module, the infrared receiving plate, the battery module, and the battery module, the battery module are mounted on the battery module, and the battery module, the battery module, Temperature and humidity sensor, communication unit, warning light, active RFID, antenna, stereo set and camera all with control chip electricity federation, communication unit and edge calculation host computer and surveillance center wireless connection.

Further, the smart machine dog has four legs, and each leg has a hip joint, a knee joint, and an ankle joint.

Furthermore, a power supply, a call module, an SOS distress module and a control chip are arranged in the intelligent safety helmet, a camera and a lighting lamp are arranged on the front face of the intelligent safety helmet, the power supply, the call module, the SOS distress module, the lighting lamp and the camera are all connected with the control chip, and the control chip is connected with the edge computing host and the monitoring center through a wireless module.

Furthermore, the brim top surface of intelligent safety helmet corresponds and is equipped with conversation button, SOS button, the button of shooing, illumination button and volume adjustment button.

Furthermore, the intelligent safety belt comprises a belt main body, a first belt, a second belt, leg belts, braces and a belt hanging rope, wherein the first belt is connected to one end of the belt main body, the other end of the belt main body is connected with the belt buckle and the second belt, the leg belts are respectively connected to two ends below the belt main body, the braces and the belt hanging rope are connected to the middle position above the belt main body, the belt hanging rope is provided with a detection module for hanging high, the belt hanging rope and the belt main body are connected at a tension sensor, the braces and the belt main body are connected at a tension sensor, the leg belts and the belt main body are connected at a tension sensor, and a control box is fixed on the belt main body.

Further, hang high detection module including the casing, install liquid detection tube, pilot lamp, alarm module and communication module in the casing.

Compared with the prior art, the utility model has the beneficial effects that:

1. the intelligent mechanical dog and the edge computing host are organically combined, the motion capability and the obstacle avoidance capability of the intelligent mechanical dog are applied to adapt to operation sites under various complex conditions, and meanwhile, under the condition that some abnormal conditions of site operation conditions are identified, the whole set of system can automatically judge whether monitoring is needed or not or whether movement is needed or not, so that the monitoring angle and position are adjusted timely, and a better monitoring and identification effect is achieved;

2. the intelligent robot dog and each intelligent safety tool realize real-time communication, constantly monitors the working condition of field workers, and reduces safety accidents caused by uncertain factors such as nonstandard operation, damage of the tool and the tool, accidental hidden danger and the like;

drawings

FIG. 1 is a block diagram of the overall architecture of the present invention;

FIG. 2 is a schematic diagram of a smart robot dog according to the present invention;

FIG. 3 is a schematic diagram of a smart robot dog tour route;

FIG. 4 is a block diagram of a workflow of a smart machine dog;

fig. 5 is a schematic structural view of an electronic fence;

FIG. 6 is a schematic diagram of the field operation of the electronic fence;

FIG. 7 is a block diagram of the structure of a video analysis algorithm of the present invention;

fig. 8 is a schematic structural diagram of the smart seat belt;

fig. 9 is a schematic structural diagram of the intelligent safety helmet.

Detailed Description

The utility model will be further described with reference to specific embodiments and the accompanying drawings.

As shown in fig. 1 to 9, a digital safety supervision system for a working site based on a smart machine dog includes the smart machine dog, a handheld terminal, a smart safety tool, and a monitoring center.

The intelligent safety tool is communicated with the robot dog and transmits data to the robot dog; the handheld terminal is communicated with the robot dog, and the robot dog, the handheld terminal and the monitoring center are communicated.

Intelligent machine dog includes head 1, truck 2, four shank 3 and flexible afterbody 4, 2 both ends of truck correspond installation head 1 and flexible afterbody 4, and 2 below of truck set up four shank 3, every shank 3 all has hip joint 5, knee joint 6 and ankle joint 7. The trunk 2 is provided with a flexible spine 8, a flexible cable 9, a servo motor 10 and a detachable edge calculation host 11. The flexible cable 9 is respectively connected with the servo motor 10 and the four legs 3, and the servo motor 10 adjusts the contraction tension degree of the flexible cable 9 through positive and negative rotation and speed change so as to achieve the purpose of controlling the movement of the four legs 3. The intelligent robot dog uses 16 servo motors 10 in total to achieve 16 degrees of freedom, and the output ends of the servo motors 10 are respectively connected to the head 1, the flexible spine 8, the flexible tail 4, and hip joints 5, knee joints 6 and ankle joints 7 of four legs 3. Each leg of the intelligent robot dog has 3 degrees of freedom, and the total number of degrees of freedom is 12. The joint is composed of a high-power direct current motor, a precise speed reducing mechanism and an absolute rotary encoder, can provide strong joint power, good force control performance and high-precision angle feedback information, can meet the requirements of various high dynamic motion control and gait planning development, and comprises the following steps: crawling, walking, running and jumping, etc.

The intelligent robot dog comprises a motion control unit, a detection unit, an information output module, a communication module, a positioning navigation module, a power supply module and a control unit, and the motion control unit, the detection unit, the information output module, the communication module, the positioning navigation module and the power supply module are respectively in two-way communication with the control unit.

The detection unit comprises an infrared sensor, an electric quantity sensor and a voice recognition unit, the infrared sensor is installed on the top surface of the head, the electric quantity sensor is installed on the position, close to the flexible tail, of the top surface of the trunk, and the voice recognition unit is installed on the top surface of the trunk. The information output module comprises a voice output unit and an image output unit, wherein the voice output unit is arranged on two sides of the head, the image output unit is arranged on the top surface of the head, and the image output unit is an LED liquid crystal display screen, so that intelligent man-machine interaction is realized.

Communication module includes wireless unit and cell-phone the control unit, and wherein wireless unit includes wireless antenna to the setting is in flexible afterbody, and the one end and the trunk of this flexible afterbody are connected, and the on & off switch is installed to the other end, and cell-phone the control unit is installed and is close to the position of flexible afterbody at the trunk top surface, realizes reliable radio communication, can use terminal remote control machinery dog.

The positioning navigation module comprises a visual unit and an ultrasonic detection unit, wherein the visual unit and the ultrasonic detection unit are both arranged on the front end face of the head, and an illuminating lamp is further arranged on the front end face of the head. The positioning navigation module and the control unit are in two-way communication and are uniformly controlled by the control unit, so that the position of the intelligent robot dog is detected in real time and locked. The vision unit adopts a monitoring camera.

The edge computing host has various information and data ubiquitous access capabilities, on one hand, the edge computing host is associated with a background database and receives various information such as operation plans, operation personnel, safety tools and the like related to field operation on line, on the other hand, the edge computing host integrates field intelligent terminal information and receives information such as various field devices, sensors, video images and personnel positioning in real time, can carry various intelligent algorithms and realize functions such as field operation management and control, violation identification, risk prompt and the like, and the edge computing host integrates various functions and is carried on the inner side of the body of the mechanical dog.

The edge calculation host is loaded with a violation identification algorithm (namely a video analysis algorithm) based on image identification, and the edge calculation host is associated with various field video devices to control the intelligent robot dog to automatically select the optimal angle and position for identifying the violation, so that the accuracy of violation identification is improved.

The violation type and the violation precision identified by the intelligent robot dog are shown in the following table:

the working process of the intelligent robot dog is as follows:

the robot dog is placed on an operation site, the system automatically starts a monitoring camera and a scene recognition program after the robot dog is started, the distance measurement and image recognition are carried out on the area, the direction, the environment and the terrain where the operating personnel and equipment are located, and a preset patrol route is generated.

The intelligent robot dog rounds the operation work area and makes a tour periodically around a circle. 4-6 monitoring points are arranged on the tour route, and stay for a period of time (5-10 minutes) at each monitoring point. The distance between the monitoring point and the working area is 5-15 meters, and the automatic judgment is carried out according to the terrain conditions of the site.

And during the residence of the monitoring point, the camera is aligned to the working area, and the artificial intelligence-based violation identification algorithm is operated to perform video monitoring on the operation site. If the violation is found, the automatic sounding reminding is carried out.

When the worker is untimely after breaking rules and regulations, the worker is focused and tracked, the current patrol route is adjusted, the worker is properly close to the worker to track and monitor, and the reminding strength is increased.

If the intelligent robot dog meets an obstacle in the moving process, the obstacle is automatically avoided, and the obstacle is bypassed to reach the next monitoring point.

The intelligent safety tool comprises an intelligent safety belt, an intelligent safety cap, an electronic fence, a movable cloth control ball and an intelligent grounding wire.

The intelligent safety belt is characterized in that modules such as a tension sensor, a low hanging height detector, a battery and communication are additionally arranged on the traditional safety belt, so that the functions of tension detection, low hanging height detection and wireless data transmission are realized. The high-fall protection device can be widely applied to the fields of construction foundation construction, operation inspection, rural power grids and the like which need high-place operation in power production operation, and can improve the high-fall protection effect. The communication module communicates with an edge computing host. The intelligent safety belt is in the prior art, and the specific structure is not described in detail herein.

The functions are as follows:

detection for low hanging height: whether the waistband of the safety belt is low and hung high is detected, and an alarm signal is sent to remind an operator to correct the waistband when the waistband is detected to be low and hung high. The detection module for low hanging height comprises a liquid detection tube, an indicator light and an alarm module. The liquid detection tube is provided with a height detector based on atmospheric pressure detection in the safety belt waistband and the backup rope, and when the safety belt waistband is hung high, an alarm sound is played to prompt a user.

And (3) tension detection: tension sensors are arranged at the intersection of a hanging rope of a safety belt and the waist belt, a hook of a safety belt backup rope and the intersection of a leg belt of the safety belt and the waist belt and are used for detecting the tension value of the safety belt in the using process of a person, and on the one hand, the detection for low hanging height is started when the tension value is detected, so that the detection signal for low hanging height is prevented from being mistakenly reported; and secondly, if an abnormally large tension value (over 50kg) is detected, indicating that the personnel fall dangerous situation occurs, sending alarm information and sending the alarm information to the background management system.

The intelligent safety helmet comprises a helmet shell and an illuminating lamp located on the outer side of the helmet shell, a power supply module is arranged on the helmet shell, a near-electricity alarm module, a camera, a voice talkback module, a positioning module and a control module which are connected with the power supply module are embedded in the shell, the power supply module, the electricity alarm module, the camera, the voice talkback module and the positioning module are respectively connected with the control module, and the control module is in data communication with a background command center through a wireless communication network. The camera communicates with the edge computing host, and the intelligent safety helmet is the prior art.

The related functions include:

live video: when workers need illumination supplement, the built-in image acquisition unit of the camera can be turned on, the image acquisition unit acquires the surrounding environment of the safety helmet in a full-time mode and transmits acquired data to the control module in real time, the control module is connected to a background or a mobile terminal through an internet network, the camera is turned off and turned on, and the background commander can check the working progress of the workers conveniently;

and (3) near electric detection: wear intelligent safety helmet when staff's staff, work at the electric field during operation, if meet the place ahead electric field abnormal change, nearly electric alarm device samples to surrounding environment power frequency electric field, if sampling result analysis obtains power frequency electric field output standard working strength value, then can send out the police dispatch newspaper.

And voice talkback: backstage staff accessible pronunciation talkback the module and carry out data communication with the field work personnel, and pronunciation talkback the module and include miniature headset, miniature headset for the better speech signal of staff, improve work efficiency.

Personnel positioning: the working personnel can point corresponding positioning modules including a GPS/Beidou navigation positioning unit and a communication unit on the mobile phone terminal, record the positions of the working personnel in real time and send position information to the background command center in real time through the communication module; the background command center carries out track statistics on the position information, and background workers can know the working state of field workers in time conveniently.

The electronic fence comprises a fixing support 21, a stand column 22, a horizontal cross bar 23, a battery module 24, a wireless charging module 25, an infrared emission module 26, an infrared receiving board 27, a temperature and humidity sensor 28, a communication unit 29, a control chip 30, a warning lamp 31, an active RFID32, an antenna 33, a sound box 34 and a camera 35. A battery module 24 is arranged on the fixed bracket 21, a wireless charging module 25 is arranged on the battery module 24, the battery module 25 is provided with a column 22, the column 22 is provided with an infrared receiving plate 27, an infrared transmitting module 26, a temperature and humidity sensor 28, a communication unit 29 and a control chip 30, the infrared emission module 26 is rotatably connected to the upright post 22, the horizontal cross bar 23 is fixed at the top end of the upright post 22, one end of the horizontal cross bar 22 is provided with the warning lamp 31, the other end is provided with the active RFID32, a sound box 34 and an antenna 33 are arranged on the horizontal cross bar 23, a camera 35 is fixed on the sound box 34, the battery module 24, the wireless charging module 25, the infrared emission module 26, the infrared receiving board 27, the temperature and humidity sensor 28, the communication unit 29, the warning lamp 31, the active RFID32, the antenna 33, the sound box 34 and the camera 35 are all electrically connected with the control chip 30, and the communication unit 29 is wirelessly connected with the edge computing host and the monitoring center.

The camera 35 is used for collecting real-time working image data of a site, uploading the data to the edge computing host and the monitoring center through the communication unit, and is used for carrying out behavior violation identification on the site working personnel by the intelligent machine dog and the background. For the on-site violation operation behaviors, the violation personnel is reminded in time through the sound box, and the unmanned monitoring on-site operation can be realized. This fence passes through infrared emission module, infrared receiving board to establish virtual warning fence, can establish multiform form operation region, this fence is through rotating infrared emission module in order to adjust the angle between infrared emission module and the infrared receiving board. In addition, the warning light is designed on the electronic fence to flash at all times so as to prompt non-workers not to enter the operation area. The active RFID reading module is used for realizing remote identification of personal information (unit, team, name and the like) of the operator. The battery module is used for supplying power to all units of the device, and when the electric quantity of the storage battery is insufficient, the battery energy can be supplemented through the wireless charging module. And a temperature and humidity sensor is introduced for acquiring the temperature and humidity of the field operation environment in real time, and data are acquired in real time and uploaded to the background monitoring center through the wireless module.

Referring to fig. 6, when the working area is rectangular, the electronic fences A, B, C, D are respectively disposed at four corners of the rectangle, and the angle between the infrared emission module and the infrared receiving board is adjusted to 90 degrees. As can be seen from the figure, when a person passes between the electronic fences A and B, the body blocks the infrared rays emitted by the electronic fence A, so that the infrared receiving plate of the electronic fence B cannot receive the corresponding infrared rays, and then the sound is triggered to give out a voice alarm to remind a worker of exceeding the operation range. In order to reserve a normal operation channel for operators, the channel shielding between the electronic fences C, D is realized by closing the infrared emission module of the electronic fence C and the infrared receiving plate of the electronic fence D, and an alarm signal is not sent out by mistake.

Referring to fig. 8, the intelligent safety belt includes a belt main body 41, a first belt 42, a second belt 43, leg straps 44, a back strap 45 and a belt hanging rope 46, one end of the belt main body 41 is connected to the first belt 42, the other end of the belt main body is connected to a belt buckle 47 and the second belt 43, the two ends of the lower portion of the belt main body 41 are respectively connected to the leg straps 44, the middle position of the upper portion of the belt main body is connected to the back strap 45 and the belt hanging rope 46, a detection module 48 for low hanging height is arranged on the belt hanging rope 46, a tension sensor is installed at the connection position of the belt hanging rope 46 and the belt main body 41, a tension sensor is installed at the connection position of the back strap 45 and the belt main body 41, a tension sensor is installed at the connection position of the leg straps 44 and the belt main body 41, and a control box 49 is fixed on the belt main body 41.

The low hang-up detection module 48 includes a housing with a liquid detection tube, an indicator light, an alarm module, and a communication module mounted therein. The liquid detection tube is a height detector based on atmospheric pressure detection, and when the safety belt waistband is hung high, an alarm module plays an alarm sound to prompt a user. The tension sensor is used for detecting the tension value of the safety belt in the using process of a person, and on one hand, the low-hanging-height detection is started when the tension value is detected, so that the detection signal for the low-hanging-height is prevented from being mistakenly reported; and secondly, if an abnormally large tension value (over 50kg) is detected, indicating that the personnel fall dangerous situation occurs, sending alarm information and sending the alarm information to the background management system.

The tension sensor and the communication module are connected with the control box, and the control box is in wireless connection with the edge calculation host and the monitoring center.

Referring to fig. 9, a power supply, a call module, a near-electricity alarm device, a positioning module, an SOS distress module and a control chip are arranged in the intelligent safety helmet 50, a camera 51 and an illuminating lamp 52 are arranged on the front face of the intelligent safety helmet 50, the power supply, the call module, the near-electricity alarm device, the positioning module, the SOS distress module, the illuminating lamp and the camera are all connected with the control chip, and the control chip is connected with an edge computing host and a monitoring center through a wireless module.

The top surface of the brim of the intelligent safety helmet 50 is correspondingly provided with a call key 53, an SOS key 54, a photographing key 55, an illumination key 56 and a volume adjusting key 57.

When the worker needs illumination supplement, the illuminating lamp can be turned on through the illuminating key; can control the switch of camera through the button of shooing, the camera carries out the full-time condition collection to safety helmet surrounding environment to in real time with data acquisition send to control chip, control chip passes through internet network connection to machine dog, surveillance center or mobile terminal.

And (3) near electric detection: wear intelligent safety helmet when staff's staff, work at the electric field during operation, if meet the place ahead electric field abnormal change, nearly electric alarm device samples to surrounding environment power frequency electric field, if sampling result analysis obtains power frequency electric field output standard working strength value, then can send out the police dispatch newspaper.

And voice talkback: background staff's accessible conversation module carries out data communication with the field work personnel, and the conversation module includes miniature headset, for the better speech signal of staff, improves work efficiency.

Personnel positioning: through the positioning module, a monitoring person can record the position of the worker in real time at the mobile terminal of the mobile phone, and the control chip sends the real-time position information to the monitoring center; the monitoring center carries out track statistics on the position information, and background workers can know the working state of field workers in time conveniently.

The movable type distribution control ball and the intelligent grounding wire are both in the prior art and are not described again.

The intelligent safety tool can be communicated with the edge computing host on the intelligent robot dog, so that on-site real-time monitoring is realized.

The intelligent robot dog carries out distance measurement and image recognition on the region, the direction, the environment and the terrain where the operating personnel and equipment are located, and generates a preset patrol route, wherein 4-6 monitoring points are arranged on the patrol route, and the distance between each monitoring point and a working region is 5-15 m. The intelligent robot dog carries out video monitoring on a working area along a tour route, transmits a monitoring image to the edge calculation host for analysis and judgment, and the edge calculation host correspondingly controls the behavior of the intelligent robot dog according to the analysis and judgment result, and simultaneously receives data transmitted by each intelligent safety tool and outputs the result after the data is analyzed and judged by the edge calculation host.

The intelligent robot dog meets the obstacle in the moving process and automatically avoids the obstacle.

The intelligent robot dog snapshotts a picture through the monitoring camera and transmits the picture to the edge computing host, and the edge computing host analyzes the picture by adopting a video analysis algorithm, and the method comprises the following steps:

A. after the picture is input, the picture is firstly input into a scene identification module to judge whether the picture is an indoor scene or an outdoor scene, and the scene identification module judges whether the current input picture is an indoor scene or an outdoor scene according to the IP address of the camera and the video stream number;

B. dividing the function items, and putting the pictures into different target detection modules according to the complexity of target detection; specifically, after the image is input, the image enters a target detection module at the same time, detection items related to product functions are classified, and for the detection items with dense targets to be detected and more overlapped targets of various types, an FPN + Faster RCNN detection algorithm with better precision and stronger robustness is selected; and for the detection items with dispersed targets to be detected and less overlapped targets, a YOLO V5 lightweight detection algorithm is adopted. Therefore, the detection precision of the more complex detection items can be ensured, and the detection speed of the more simple detection items can be improved;

C. detecting the central position and the size of a target of the picture sent into the target detection module, and extracting the picture of the target type needing to be refined and classified;

D. respectively sending the single label or the multiple labels of the classification task to a target identification module or a multiple label classification module; the target identification module adopts two identification models, namely ShuffleNet V2 and EfficientNet, and the target identification module carries out fine identification on functions related to the comparison details of the personnel and the scene.

In the fast RCNN and YOLO V5 detection algorithms, the position regression branch and the recognition branch are coupled in one

The feature network is shared, and the recognition types are more, so the recognition precision is lower. In order to improve the accuracy of identification, the functions related to the comparative details of personnel and scenes are finely identified, and for simpler classification tasks such as color classification of safety helmets, a lightweight classification model ShuffleNet V2 is adopted for identification; for more complicated classification tasks, such as classification of ladder carrying conditions, EfficientNet is adopted for identification;

E. and sending the obtained target center position, size, target type, whole scene type and human body key point into a function logic judgment module, and judging the function and outputting the result. The input information of the function logic judgment module is the position, motion state, identity information, action behavior, clothes wearing and the like of a worker, the position, type information, placement state and the like of field equipment, the position, type information, running state and the like of field facilities, a large number of complex identification function items are split into combined logic of basic information by combining the information, and then the basic information and the logic are combined to judge each identification function item.

For example: the identification function item of the unmanned staircase with people working in the insulating ladder can be split into the combinational logic of insulating ladder detection and personnel detection, so that the output of related detection and identification results is as follows: the type is the position of the detection result of the insulating ladder, and the type is the position of the detection result of the person. According to the relative position of the insulating ladder and the personnel, the fact that the person works on the insulating ladder is judged, if no personnel support the insulating ladder, and finally 'the insulating ladder is unmanned when the person works' is output.

And C, if the picture size is too small or too fuzzy, performing super-resolution reconstruction or controlling and adjusting the monitoring camera.

The edge calculation host comprises a negative sample library, a target is found to be a negative sample after being detected, and the negative sample library module clears the abnormal result of the negative sample with higher recall rate. And adding a negative sample library for the repeated and continuous samples, extracting sample characteristics through a lightweight network, sending the sample characteristics into the characteristic library, and sending the detection results into the negative sample characteristic library for comparison, thereby eliminating repeated false alarms. Extracting features of the detection result image through ShuffleNet, and calculating the similarity of the detection result image and the features of the image in the negative sample library, wherein the calculation formula is as follows:

wherein, F_delTo detect the resulting image features, F_negNegative sample library image features, inner product, modulo (second norm) operation. If the following conditions are satisfied:

θ＞θ_th

wherein, theta_thIs a set similarity threshold. The detection result is a false alarm and is removed from the result.

The video analysis algorithm can complete intelligent video analysis of multifunctional items under different hardware computing resource conditions in a complex scene, and meanwhile, can rapidly learn a changed application scene and rapidly correct an abnormal result of a new environment. The algorithm is constructed in an early stage based on the python language, and image preprocessing, deep learning algorithm and subsequent logic processing of the algorithm are realized. And performing corresponding model transformation on the algorithm deployment according to the requirements of the actual server and the edge computing equipment, and performing model deployment after the transformation. According to the actual detection requirement, aiming at solving the actual problem, in the aspect of the model training efficiency, 10 ten thousand material trainings can be completed within 48 hours.

The edge calculation host can adaptively select a corresponding target detection algorithm according to the complexity of target detection, so that the detection performance can be maintained while the calculation amount is reduced.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the utility model, various features of the utility model are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the utility model as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the utility model and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

It should be noted that the above-mentioned embodiments illustrate rather than limit the utility model, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The utility model may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the utility model, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.

Claims (6)

1. The utility model provides an operation scene digital supervisory systems based on intelligent machine dog which characterized in that: the intelligent robot dog monitoring system comprises an intelligent robot dog, a handheld terminal, an intelligent safety tool and a monitoring center;

the intelligent robot dog is provided with a monitoring camera and is internally provided with an edge calculation host;

the intelligent safety tool is communicated with the robot dog and transmits data to the robot dog;

the handheld terminal is communicated with the robot dog, and the robot dog, the handheld terminal and the monitoring center are communicated;

the intelligent safety tool comprises an intelligent safety belt, an intelligent safety cap, an electronic fence, a movable cloth control ball and an intelligent grounding wire;

the electronic fence comprises a fixed support, a stand column, a horizontal cross rod, a battery module, a wireless charging module, an infrared transmitting module, an infrared receiving plate, a temperature and humidity sensor, a communication unit, a control chip, a warning lamp, an active RFID (radio frequency identification), an antenna, a sound box and a camera, wherein the battery module is arranged on the fixed support, the wireless charging module is configured on the battery module, the stand column is arranged on the battery module, the infrared receiving plate, the infrared transmitting module, the temperature and humidity sensor, the communication unit and the control chip are mounted on the stand column, the infrared transmitting module is rotatably connected to the stand column, the horizontal cross rod is fixed at the top end of the stand column, the warning lamp is mounted at one end of the horizontal cross rod, the active RFID is mounted at the other end of the horizontal cross rod, the sound box and the antenna are arranged on the horizontal cross rod, the camera is fixed on the sound box, and the battery module, the wireless charging module, the infrared transmitting module, the infrared receiving plate, the battery module, and the battery module, the battery module are mounted on the battery module, and the battery module, the battery module, Temperature and humidity sensor, communication unit, warning light, active RFID, antenna, stereo set and camera all with control chip electricity federation, communication unit and edge calculation host computer and surveillance center wireless connection.

2. A smart machine dog-based job site digital surveillance system according to claim 1, wherein: the smart robot dog has four legs, and each leg has a hip joint, a knee joint, and an ankle joint.

3. A smart machine dog-based job site digital surveillance system according to claim 1, wherein: the intelligent safety helmet is internally provided with a power supply, a call module, an SOS distress module and a control chip, a camera and a lighting lamp are arranged on the front face of the intelligent safety helmet, the power supply, the call module, the SOS distress module, the lighting lamp and the camera are all connected with the control chip, and the control chip is connected with an edge computing host and a monitoring center through a wireless module.

4. A smart machine dog-based job site digital surveillance system according to claim 3, wherein: the intelligent safety helmet is characterized in that a call key, an SOS key, a photographing key, an illumination key and a volume adjusting key are correspondingly arranged on the top surface of the brim of the intelligent safety helmet.

5. A smart machine dog-based job site digital surveillance system according to claim 1, wherein: the intelligent safety belt comprises a belt main body, a first belt, a second belt, leg belts, braces and a belt hanging rope, wherein the first belt is connected to one end of the belt main body, the other end of the belt main body is connected with a belt buckle and the second belt, the leg belts are respectively connected to two ends below the belt main body, the braces and the belt hanging rope are connected to the middle position of the upper portion of the belt main body, a detection module for low hanging height is arranged on the belt hanging rope, a tension sensor is installed at the joint of the belt hanging rope and the belt main body, the tension sensor is installed at the joint of the braces and the belt main body, the tension sensor is installed at the joint of the leg belts and the belt main body, and a control box is fixed on the belt main body.

6. A smart machine dog-based job site digital surveillance system according to claim 5, wherein: the low hanging height detection module comprises a shell, and a liquid detection tube, an indicator light, an alarm module and a communication module are arranged in the shell.

Images