CN211207134U

CN211207134U - Mixed reality motor monitoring system based on 5G

Info

Publication number: CN211207134U
Application number: CN201922205776.8U
Authority: CN
Inventors: 陈大为; 钱雨广; 梁淑婷
Original assignee: Guangdong Jianmian Intelligent Technology Co ltd
Current assignee: Guangdong Jianmian Intelligent Technology Co ltd
Priority date: 2019-12-11
Filing date: 2019-12-11
Publication date: 2020-08-07
Anticipated expiration: 2029-12-11

Abstract

The utility model provides a mixed reality motor monitoring system based on 5G, which comprises a motor, an internet of things monitoring system, a video monitoring system, a 5G module, a data processing server, a fault alarm module and mixed reality equipment; the 5G module is in communication connection with the Internet of things monitoring system, the video monitoring system, the data processing server and the mixed reality equipment respectively; the data processing server is connected with the fault alarm module; the Internet of things monitoring system is used for acquiring parameter indexes related to motor operation and sending the parameter indexes to the data processing server through the 5G module; the video monitoring system is used for acquiring the field video information of the motor and sending the field video information to the data processing server through the 5G module; the intelligent and efficient motor monitoring and overhauling can be realized.

Description

Mixed reality motor monitoring system based on 5G

Technical Field

The utility model belongs to the technical field of 5G, especially, relate to a mixed reality motor monitoring system based on 5G.

Background

In a large-scale ore factory, a large number of large-scale high-power motors are used for ore conveying, production of a production line, machine transmission, pressurization, hydraulic pressure and the like, the motors are generally large in load, severe in working environment and prone to failure, when the motors fail, the whole production line and the whole machine are prone to stop running, people and fire accidents are prone to occurring in scenes with severe working environments, and serious loss is brought to producers.

Therefore, the maintenance of the motor is daily basic work, and most of the maintenance work of the motor at present adopts a manual inspection mode to detect the fault of the motor, the mode needs a large amount of manpower resources to monitor and maintain the motor, the efficiency is low, the fault of the motor cannot be found in time, and then rescue measures are taken, so that economic loss is caused;

aiming at motor fault maintenance, a manufacturer encounters a fault in the aspect of using a motor, the traditional method is that a technician of the manufacturer needs to go to a field for maintenance or make an after-sales service call, the motor needs to be sent to an after-sales maintenance point or a manufacturer for providing special after-sales service when the after-sales service is adopted, the time is usually long after the time, the fault is probably a very simple small problem, the manufacturer can maintain the motor by the manufacturer, therefore, the maintenance personnel can not remotely check the motor fault, no monitoring equipment can reflect the condition of the motor by using a mixed reality technology at present, the time cost for solving the fault is increased, and the production efficiency is influenced.

SUMMERY OF THE UTILITY MODEL

In view of this, the utility model aims at providing a mixed reality motor monitoring system based on 5G can realize that intelligent efficient motor control overhauls.

In order to achieve the above purpose, the technical scheme of the utility model is that: a mixed reality motor monitoring system based on 5G comprises a motor, an internet of things monitoring system, a video monitoring system, a 5G module, a data processing server, a fault alarm module and mixed reality equipment; the 5G module is in communication connection with the Internet of things monitoring system, the video monitoring system, the data processing server and the mixed reality equipment respectively; the data processing server is connected with the fault alarm module;

the Internet of things monitoring system is used for acquiring parameter indexes related to motor operation and sending the parameter indexes to the data processing server through the 5G module;

the video monitoring system is used for acquiring the field video information of the motor and sending the field video information to the data processing server through the 5G module.

Furthermore, the internet of things monitoring system comprises a sensor group module, an AI edge calculation module and a first 5G module; the AI edge calculation module is respectively connected with the sensor group module and the first 5G module.

Further, the sensor group module comprises one or more combinations of an electricity metering sensor, a temperature sensor, a humidity sensor, a rotating speed sensor, a vibration sensor, a sound sensor, a toxic gas sensor and a smoke sensor.

Further, the AI edge calculation module comprises a single chip microcomputer or an ARM processor.

Further, the video monitoring system comprises front-end video monitoring equipment and an unmanned aerial vehicle.

Furthermore, front-end video monitoring equipment includes the AI camera, the AI camera embeds by video acquisition module, video analysis module, front-end machine vision identification module and second 5G module.

Furthermore, the unmanned aerial vehicle is internally provided with a video acquisition unit, a front-end machine vision identification unit, a GPS map navigation unit, a flight data processing unit, a 5G or WIFI wireless unit.

Further, the mixed reality device includes mixed reality glasses.

Further, the monitoring and displaying device is connected with the data processing server.

Further, the system also comprises a manual operation interface connected with the data processing server.

The utility model has the advantages that: parameter indexes related to the operation of the motor and field video information of the motor are respectively obtained through an internet of things monitoring system and a video monitoring system, the collected information is respectively sent to a data processing server through a 5G module, the data processing server analyzes, calculates and counts the received information, the data information with problems is sent to a fault alarm system, and the fault alarm system sends alarm information; the monitoring personnel can know the fault occurrence of the motor at the first time through the alarm information, and then take rescue measures in time. In addition, the motor field can be checked and analyzed through the virtual reality equipment and the augmented reality equipment, the virtual reality equipment and the augmented reality equipment interact data with the data processing server through 5G communication, real-time display is carried out after 3D processing and rendering, maintenance personnel can see the field condition of the motor only through the mixed reality equipment, repair suggestions can be directly given after the maintenance personnel judge problems remotely, each step can be pointed out on a three-dimensional virtual entity, maintenance time is further shortened, and maintenance efficiency is greatly improved.

Drawings

Fig. 1 is the utility model relates to a mixed reality motor monitoring system's schematic structure based on 5G.

Fig. 2 is another schematic structural diagram of the mixed reality motor monitoring system based on 5G of the present invention.

Fig. 3 is a schematic structural diagram of the internet of things monitoring system of the present invention.

Fig. 4 is a schematic structural diagram of the AI camera of the present invention.

Fig. 5 is the utility model discloses an unmanned aerial vehicle's structural schematic.

Fig. 6 is a schematic diagram of the gesture recognition of real-time motor monitoring of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings in conjunction with the following embodiments. It should be emphasized that the following description is merely exemplary in nature and is not intended to limit the scope of the invention or its application.

Referring to fig. 1, the technical solution of the present invention is: a mixed reality motor monitoring system based on 5G comprises a motor, an internet of things monitoring system 10, a video monitoring system 20, a 5G module 30, a data processing server 50, a fault alarm module 60 and mixed reality equipment 40; the 5G module 30 is in communication connection with the internet of things monitoring system 10, the video monitoring system 20, the data processing server 50, and the mixed reality device 40, respectively; the data processing server 50 is connected with the fault alarm module 60; the internet of things monitoring system 10 is configured to obtain a parameter index related to motor operation, and send the parameter index to the data processing server 50 through the 5G module 30; the video monitoring system 20 is configured to obtain field video information of the motor, and send the field video information to the data processing server 50 through the 5G module 30.

In this embodiment, the parameter indexes related to the operation of the motor and the field video information of the motor are respectively obtained by the internet of things monitoring system 10 and the video monitoring system 20, and the collected information is respectively sent to the data processing server 50 through the 5G module 30, the data processing server 50 analyzes, calculates and counts the received information, and sends the data information with problems to the fault alarm system, and the fault alarm system further sends alarm information; the monitoring personnel can know the fault occurrence of the motor at the first time through the alarm information, and then take rescue measures in time. In addition, the motor field can be checked and analyzed through the virtual reality device and the augmented reality device, the mixed reality device 40 interacts data with the data processing server 50 through 5G communication, and real-time display is carried out after 3D processing and rendering, so that maintenance personnel can see the field situation of the motor only by using the mixed reality device 40, repair suggestions can be directly given after the maintenance personnel remotely judge problems, each step can be pointed out on a three-dimensional virtual entity, maintenance time is shortened, and maintenance efficiency is greatly improved.

Specifically, the data processing server 50 is provided with related application programs therein, and can implement functions such as 3D environment image processing, 3D image model processing, video feature extraction, voice recognition processing, gesture recognition processing, face recognition processing, map navigation service, data storage, and data synthesis. The 3D environment image processing is to process the panoramic environment image by using a structured light technique, a visual scanning technique, a motion control technique, a 3D reconstruction technique, and a point cloud processing technique on video image data acquired by the video monitoring system 20 and the mixed reality device 40; the image model environment is superposed, the 3D environment image is processed and then superposed with the data and the specific image model environment to form a virtual full-environment 3D scene; the video feature extraction is to extract all features to be recognized, including the actual physical signs and sizes of the motor, the vibration index during running, face feature recognition, posture feature recognition and gesture feature recognition; the voice recognition processing is to process the sound information collected from the on-site internet of things monitoring system 10, the mixed reality device 40 and the video monitoring system 20, recognize the noise index of the on-site operation of the motor, recognize the sound sent by the on-site internet of things monitoring system 10, the mixed reality device 40 and the video monitoring system 20, convert the sound into various corresponding instructions, and convert the sound into corresponding instructions after extracting the video characteristics; in the gesture recognition processing, the gesture action is recognized through an advanced gesture video recognition algorithm on the video image data acquired by the video monitoring system 20 and the mixed reality device 40; the gesture recognition processing is to recognize human gesture actions through a video image gesture recognition algorithm according to video image data collected by the video monitoring system 20 and the mixed reality device 40; in the face recognition processing, the face features are recognized through a face feature recognition algorithm of the video image according to the video image data collected by the video monitoring system 20 and the mixed reality device 40, and maintenance authorities of various levels are provided for operation, monitoring and maintenance personnel; the electric performance parameters of the motor are processed, and the electric performance parameters of the motor are changed into visual data through calculation, analysis, statistics and conversion and are easily superposed on a 3D (three-dimensional) field video image; the map navigation service provides navigation service for the unmanned aerial vehicle 22, and the unmanned aerial vehicle 22 acquires the motor installation position, the structures of factories and workshops, the flight path, the position, the positioning information, the preset path plan, the navigation data and the like from the navigation service; the data synthesis is to fuse, superpose and synthesize the video image data collected by the video monitoring system 20 and the mixed reality device 40, various feature data and instructions extracted after identification and data after processing to form a virtual full-scene 3D scene, and further add real-time video image visible real scene parameter labels to the virtual full-scene 3D scene; the data storage, the stored characteristic data, the data comprising the actual physical signs and the size of the motor, the vibration index during running, the face characteristic recognition, the posture characteristic recognition, the gesture specific film recognition and the like are convenient to query, count, compare and the like, and basic data are provided for big data analysis and application.

When the video monitoring system 20 collects the face information, the face information is sent to the data processing server 50, the face information can be preset in the data processing server 50, and the data processing server 50 does not start the fault alarm module 60 to alarm and remind only under the face authorization condition, so that the aim of alarming and reminding when unauthorized people enter a motor working area is achieved, and the illegal intrusion of irrelevant people is prevented in time. Specifically, the video monitoring system 20 may only perform face acquisition and send the acquired face information to the data processing server 50 for recognition processing.

By using the 5G module 30 to connect a 5G wireless network, functions of large bandwidth (eMBB), large-scale connection (mtc), ultra-low latency and high reliability (uR LL C) can be realized.

In particular, the fault alarm module 60 may be an audible and visual alarm.

Mixed reality equipment 40 can be mixed reality glasses, and after the user wore mixed reality glasses, above all information will be through 5G WIFI simultaneously send mixed reality glasses on, the user can directly see all information of fault point directly on mixed reality glasses.

Referring to fig. 6, the mixed reality monitoring picture is composed of a real video image as a background, a virtual motor model, and all the monitored data in a superimposed manner; the monitoring picture is composed of a panoramic 3D modeling video image, a motor model, all data which can be monitored, and a superposition; by identifying the running state of the hand, the real-time page turning, forward and backward direction display and 360-degree panoramic model display of the left and right sides of the video image are realized.

Further, the internet of things monitoring system 10 includes a sensor group module 11, an AI edge calculation module 12, and a first 5G module 13; the AI edge calculation module 12 is connected to the sensor group module 11 and the first 5G module 13, respectively.

In this embodiment, the sensor group module 11 is disposed on the motor and used for collecting operation parameters of the motor, such as current and voltage, temperature, humidity, vibration and sound, and the sensor group module 11 detects the environmental parameters of the motor in time and alarms in time when exceeding a predetermined value, so that a monitoring person can find the motor to break down and maintain the motor in time. The AI edge calculation module 12 collects, counts, analyzes and calculates various parameter indexes of the motor, monitors all the indexes, automatically controls the actual operation of the motor according to the monitored data, such as the timing start and stop of the motor, the automatic adjustment of steering and rotating speed, the synchronous operation with various devices and the like, when the parameter indexes of the motor exceed the normal set values, the AI edge calculation module 12 automatically adjusts, and simultaneously sends alarm information to the data processing server 50 through the first 5G module 13, and the data processing server 50 controls the fault alarm module 60 to alarm, thereby ensuring the normal operation of the motor. Specifically, the AI edge calculation module 12 may be a single chip microcomputer or an arm (advanced riscmachine) processor.

Referring to fig. 3, the sensor module 11 further includes one or more combinations of a coulometric sensor, a temperature sensor, a humidity sensor, a rotational speed sensor, a vibration sensor, a sound sensor, a toxic gas sensor, and a smoke sensor.

In this embodiment, through carrying out real time monitoring to the parameter of motor operation, can also monitor the important parameter of motor operational environment in addition, can remind the environmental condition that monitoring personnel were located at present motor, if exceed the predetermined value then report to the police through alarm module for monitoring personnel in time take the maintenance safeguard measure, will lose the reduction. The electric quantity metering sensor can detect parameters such as current, voltage and power of the motor, the temperature sensor can detect temperature rise of a rotor in the electronic device, the humidity sensor can detect humidity of the environment around the motor, the toxic gas sensor can detect whether toxic gas exists around the motor, and monitoring personnel can take protection measures before entering a motor operation area according to the toxic gas detected by the toxic gas sensor so as to ensure personal safety; the smoke sensor can detect the surrounding smoke concentration and alarm the fire accident in time.

Further, the video surveillance system 20 includes a front-end video surveillance device and a drone 22.

Referring to fig. 4, further, the front-end video monitoring device includes an AI camera 21, and a video capture module 211, a video analysis module 212, a front-end machine vision recognition module 213, and a second 5G module 214 are built in the AI camera 21.

In this embodiment, an AI algorithm is built in the AI camera 21, and video acquisition is performed on a real-time environment of the motor through the video acquisition module 211, for example, a transmission shaft of the motor, which is connected with an external machine to operate, is broken during operation, the video acquisition module 211 acquires a field image video through a high-speed and accurate 3D structured light imaging system, and after the collection of the broken picture of the external transmission shaft of the motor is completed, the video analysis module 212 analyzes the acquired field image video and scans the surface profile of an object to form point cloud data; carrying out intelligent analysis processing on the point cloud data, and carrying out AI algorithm and identifying the designated image and video; the characteristics of the designated object are rapidly identified directly through a video image algorithm by a front-end machine vision identification module 213; further, the fault condition that the external transmission shaft of the motor is broken is timely sent to the data processing server 50 through the second 5G module 214, and the data processing server 50 controls the fault alarm module 60 to alarm; the monitoring is more intelligent, and the sensor is combined, so that the place which is difficult to detect by the sensor can be realized through the front-end video monitoring equipment.

Referring to fig. 5, the unmanned aerial vehicle 22 is provided with a video acquisition unit 224, a front-end machine vision recognition unit 225, a GPS map navigation unit 221, a flight data processing unit 222, a 5G or WIFI wireless unit 223.

In this embodiment, the video monitoring system 20 may also include the unmanned aerial vehicle 22, wherein the front-end machine vision recognition unit 225 is respectively connected to the video acquisition unit 224, the GPS map navigation unit 221, the 5G or the WIFI wireless unit 223; flight data processing unit 222 is connected with 5G or WIFI wireless unit 223. Before the unmanned aerial vehicle 22 collects video data, the unmanned aerial vehicle 22 is controlled to reach a position where a video is to be collected, the video data is collected at the current position, then the unmanned aerial vehicle 22 sends the currently positioned video data to the data processing server, the data processing server further analyzes the video data to obtain a current accurate position, the accurate position is sent to the unmanned aerial vehicle 22, and the unmanned aerial vehicle 22 carries out fixed-point shooting; the video acquisition unit 224 of the unmanned aerial vehicle 22 acquires a field image video by a high-speed and accurate 3D structured light imaging system installed on the unmanned aerial vehicle 22; then, through the front-end machine vision recognition unit 225, after the unmanned aerial vehicle 22 video image is collected, the characteristics of the designated object are rapidly recognized directly through a video image algorithm; during the flight process of the unmanned aerial vehicle 22, the flight data processing unit 222 processes data such as three-dimensional space coordinates, yaw angle, roll angle, pitch angle, speed and acceleration of the unmanned aerial vehicle 22, and controls the pose and flight planning of the unmanned aerial vehicle 22, so that the unmanned aerial vehicle 22 flies normally. WIFI/5G module carries on wireless WIFI/5G module on by unmanned aerial vehicle 22, through wireless WIFI/5G module, carries out wireless interaction with all data of gathering such as video acquisition unit 224, front end machine vision identification unit 225, GPS map navigation unit 221, flight data processing unit 222 and data processing server 50, realizes remote control unmanned aerial vehicle 22 flight work.

Referring to fig. 2, further, a monitoring display device 70 connected to the data processing server 50 is further included.

Specifically, the monitoring display device 70 may be an L ED display screen, which provides a visual real-time monitoring display screen for the background and the monitoring center.

Referring to fig. 2, further, a manual operation interface 80 connected to the data processing server 50 is further included.

Specifically, the manual operation interface 80 provides manual operation for the operation panel of manual intervention, such as system setting, monitoring parameter adjustment, scene setting, 3D virtual parameter setting, unmanned aerial vehicle 22 navigation flight parameter setting, display effect setting, and is convenient for the monitoring operator to operate.

The above-mentioned embodiments only represent some embodiments of the present invention, and the description thereof is specific and detailed, but not to be construed as limiting the scope of the present invention. It should be noted that, for those skilled in the art, without departing from the spirit of the present invention, several variations and modifications can be made, which are within the scope of the present invention. Therefore, the protection scope of the present invention should be subject to the appended claims.

Claims

1. A mixed reality motor monitoring system based on 5G is characterized by comprising a motor, an internet of things monitoring system, a video monitoring system, a 5G module, a data processing server, a fault alarm module and mixed reality equipment; the 5G module is in communication connection with the Internet of things monitoring system, the video monitoring system, the data processing server and the mixed reality equipment respectively; the data processing server is connected with the fault alarm module;

2. The 5G-based mixed reality motor monitoring system according to claim 1, wherein the internet of things monitoring system comprises a sensor group module, an AI edge calculation module and a first 5G module; the AI edge calculation module is respectively connected with the sensor group module and the first 5G module.

3. The 5G-based mixed reality motor monitoring system of claim 2, wherein the sensor group module comprises one or more combinations of a coulometric sensor, a temperature sensor, a humidity sensor, a rotational speed sensor, a vibration sensor, a sound sensor, a toxic gas sensor, a smoke sensor.

4. The 5G-based mixed reality motor monitoring system of claim 2, wherein the AI edge calculation module comprises a single chip microcomputer or an ARM processor.

5. The 5G-based mixed reality motor monitoring system of claim 1, wherein the video monitoring system comprises a front-end video monitoring device and a drone.

6. The 5G-based mixed reality motor monitoring system according to claim 5, wherein the front-end video monitoring device comprises an AI camera, and a video acquisition module, a video analysis module, a front-end machine vision recognition module and a second 5G module are arranged in the AI camera.

7. The 5G-based mixed reality motor monitoring system according to claim 5, wherein a video acquisition unit, a front-end machine vision recognition unit, a GPS map navigation unit, a flight data processing unit, a 5G or WIFI wireless unit are built in the unmanned aerial vehicle.

8. The 5G-based mixed reality motor monitoring system of claim 1, wherein the mixed reality device comprises mixed reality glasses.

9. The 5G-based mixed reality motor monitoring system according to any one of claims 1 to 8, further comprising a monitoring display device connected with the data processing server.

10. The 5G-based mixed reality motor monitoring system of any one of claims 1 to 8, further comprising a human interface connected to the data processing server.