CN113873205B - Robot monitoring system and method - Google Patents
Robot monitoring system and method Download PDFInfo
- Publication number
- CN113873205B CN113873205B CN202111212396.2A CN202111212396A CN113873205B CN 113873205 B CN113873205 B CN 113873205B CN 202111212396 A CN202111212396 A CN 202111212396A CN 113873205 B CN113873205 B CN 113873205B
- Authority
- CN
- China
- Prior art keywords
- module
- server
- robot
- image
- communication module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 91
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000004891 communication Methods 0.000 claims abstract description 115
- 238000012545 processing Methods 0.000 claims description 35
- 230000011664 signaling Effects 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 abstract description 10
- 230000000694 effects Effects 0.000 abstract description 3
- 238000005286 illumination Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 238000009529 body temperature measurement Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000002789 length control Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000000576 supplementary effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
- Alarm Systems (AREA)
Abstract
The application provides a robot monitoring system and method. The system comprises: a robot end and a server end; the robot end comprises an infrared camera, a conventional camera, a multi-port forwarding module and a robot end 5G communication module; the server side comprises a server side 5G communication module and a server. According to the robot monitoring system, the infrared camera, the conventional camera, the multi-port forwarding module and the robot 5G communication module are arranged in the robot end, and the server 5G communication module and the server are arranged in the server end, so that the effect of effectively detecting a living body under the conditions of sufficient light and insufficient light is achieved; meanwhile, the transmission speed of the infrared image and the conventional image is improved by using 5G communication, and the definition of the transmitted infrared image and conventional image is ensured.
Description
Technical Field
The application relates to the technical field of security monitoring, in particular to a robot monitoring system and a robot monitoring method.
Background
Security monitoring is an important ring in security systems, and besides the monitoring equipment at a fixed position, the security monitoring task of a special area needs to be completed by the support of movable monitoring equipment.
At present, the movable monitoring equipment is mainly completed by using a robot monitoring system, and the current robot monitoring system can realize the tasks of movable monitoring, obstacle recognition, face recognition and the like.
However, the current robot monitoring system only considers the condition of sufficient illumination, and can not execute life body identification under the condition of insufficient illumination and can not perform temperature measurement; in addition, most of current robot monitoring uses a 4G network, so that the transmission speed of the monitored image is limited.
Disclosure of Invention
The application provides a robot monitoring system and a robot monitoring method, which are used for solving the problems that a living body cannot be identified under the condition that the existing robot monitoring system is insufficient in relighting and the transmission speed of a monitoring image is low.
In a first aspect, the present application provides a robotic monitoring system comprising: a robot end and a server end; the robot end comprises an infrared camera, a conventional camera, a multi-port forwarding module and a robot end 5G communication module; the server side comprises a server side 5G communication module and a server; the infrared camera is in communication connection with the multiport forwarding module and is used for acquiring infrared images and sending the infrared images to the multiport forwarding module; the conventional camera is in communication connection with the multiport forwarding module, and is used for acquiring conventional images and sending the conventional images to the multiport forwarding module; the multi-port forwarding module is also connected with the robot end 5G communication module and is used for sending the infrared images and the conventional images to the robot end 5G communication module; the server side 5G communication module is connected with the robot side 5G communication module and is used for receiving the infrared image and the conventional image sent by the robot side 5G communication module and sending the infrared image and the conventional image to the server; the server is connected with the client and is used for processing the infrared image and the conventional image to obtain an image monitoring result and sending the image monitoring result to the client.
In one possible implementation, the robot end further includes: a voice module; the voice module is connected with the multiport forwarding module and is used for receiving external sound, obtaining sound information according to the external sound and sending the sound information to the multiport forwarding module; the multi-port forwarding module is used for sending the sound information to the robot end 5G communication module, the robot end 5G communication module is used for sending the sound information to the server end 5G communication module, the server end 5G communication module is used for sending the sound information to the server, the server is used for analyzing the sound information to obtain a sound monitoring result, and the sound monitoring result is sent to the client.
In one possible implementation manner, the robot end further comprises a virtual private network VPN module of the robot end, and the server end further comprises a server end VPN module; correspondingly, the server-side 5G communication module is connected with the robot-side 5G communication module to receive the infrared image and the normal image and send the infrared image and the normal image to the server, and includes: the server-side 5G communication module is connected with the server-side VPN module, the server-side VPN module is connected with the robot-side VPN module, and the robot-side VPN module is connected with the robot-side 5G communication module; the robot end 5G communication module sends the infrared image and the conventional image to the robot end VPN module, the robot end VPN module encrypts the infrared image and the conventional image to obtain the encrypted infrared image and the encrypted conventional image, the encrypted infrared image and the encrypted conventional image are sent to the server end VPN module, and the server end VPN module decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image and sends the infrared image and the conventional image to the server.
In one possible implementation, the robot end further includes: a driving module and a processing module; the processing module is in communication connection with the multiport forwarding module and the driving module, the server is further used for receiving instructions sent by the client, the instructions are sequentially sent to the processing module through the server-side 5G communication module, the robot-side 5G communication module and the multiport forwarding module, and the processing module obtains control signals according to the instructions and sends the control signals to the driving module so as to control the movement of the robot-side.
In one possible implementation, the server includes: one or more of a voice server, a streaming media server, and a signaling forwarding server.
In one possible implementation, a conventional camera includes: hemispherical cameras and/or gun cameras.
In a second aspect, the present application provides a robot monitoring method, including: the robot monitoring system applied to the first aspect includes: the infrared camera collects infrared images and sends the infrared images to the multiport forwarding module; the conventional camera collects conventional images and sends the conventional images to the multiport forwarding module; the multiport forwarding module sends the infrared image and the conventional image to the robot end 5G communication module; the server side 5G communication module receives the infrared image and the conventional image sent by the robot side 5G communication module and sends the infrared image and the conventional image to the server; the server processes the infrared image and the conventional image to obtain an image monitoring result, and sends the image monitoring result to the client.
In one possible implementation, the robot end further includes: the voice module is connected with the multiport forwarding module, and the method further comprises the steps of: the voice module receives external sound, obtains sound information according to the external sound, and sends the sound information to the multiport forwarding module; the multi-port forwarding module is used for sending the sound information to the robot end 5G communication module, the robot end 5G communication module is used for sending the sound information to the server end 5G communication module, the server end 5G communication module is used for sending the sound information to the server, the server is used for analyzing the sound information to obtain a sound monitoring result, and the sound monitoring result is sent to the client.
In one possible implementation manner, the robot end further comprises a robot end VPN module, and the server end further comprises a server end VPN module; the server-side 5G communication module is connected with the server-side VPN module, the server-side VPN module is connected with the robot-side VPN module, and the robot-side VPN module is connected with the robot-side 5G communication module; the method further comprises the steps of: the robot end 5G communication module sends the infrared image and the conventional image to the robot end VPN module, the robot end VPN module encrypts the infrared image and the conventional image to obtain the encrypted infrared image and the encrypted conventional image, the encrypted infrared image and the encrypted conventional image are sent to the server end VPN module, and the server end VPN module decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image and sends the infrared image and the conventional image to the server.
In one possible implementation, the robot end further includes: the processing module is in communication connection with the multiport forwarding module and the driving module; the method further comprises the steps of: the server receives the instruction sent by the client, and sends the instruction to the processing module sequentially through the server-side 5G communication module, the robot-side 5G communication module and the multiport forwarding module, and the processing module obtains a control signal according to the instruction and sends the control signal to the driving module so as to control the movement of the robot-side.
According to the robot monitoring system, the infrared camera, the conventional camera, the multiport forwarding module and the robot 5G communication module are arranged in the robot end, the server 5G communication module and the server are arranged in the server end, and the infrared camera enables the robot monitoring system to identify a living body in a no-illumination environment, so that the effect of effectively detecting the living body under the conditions of sufficient light and insufficient light is achieved; meanwhile, the transmission speed of the infrared image and the conventional image is improved by using 5G communication, and the definition of the transmitted infrared image and conventional image is ensured.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
Fig. 1 is a schematic diagram of a system architecture of a robot monitoring system according to an embodiment of the present application;
fig. 2 is a second schematic system architecture diagram of the robot monitoring system according to the embodiment of the present application;
fig. 3 is a schematic diagram of a system architecture of a robot monitoring system according to an embodiment of the present application.
Reference numerals:
a robot monitoring system-100;
server-side-101;
robot end-102;
a server-1011;
a voice server-10111;
streaming media server-10112;
a signaling forwarding server-10113;
server side 5G communication module-1012;
robot end 5G communication module-10201;
multiport forwarding module-10202;
an infrared camera-10203;
conventional camera-10204;
speech module-10205;
robot-end VPN module-10206;
server-side VPN module-1013;
a drive module-10207;
processing module-10208;
sensor-10209;
lighting module-10210.
Specific embodiments thereof have been shown by way of example in the drawings and will herein be described in more detail. These drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.
At present, security monitoring can be realized by using a fixed-point installation camera or adopting a method for deploying robot monitoring, and because the robot monitoring can realize mobile monitoring, the defect of fixed monitoring range of the fixed-point installation camera is overcome, but the living body cannot be distinguished in the environment lacking illumination in the current robot monitoring, and meanwhile, the current robot monitoring uses 4G to transmit images, so that the image transmission speed and the data transmission range of the current robot monitoring are limited.
According to the robot monitoring system, the 5G communication module and the infrared camera are added into the robot monitoring system, so that the data transmission speed of the robot end and the server end in the robot monitoring system is improved, and the robot monitoring system can detect a living body under the condition of no illumination.
The following describes the technical solutions of the present application and how the technical solutions of the present application solve the above technical problems in detail with specific embodiments. The following embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Fig. 1 is a schematic diagram of a system architecture of a robot monitoring system according to an embodiment of the present application.
For convenience of explanation, only relevant portions of the present application are shown, as shown in fig. 1, a robot monitoring system 100 provided in an embodiment of the present application includes: a server side 101 and a robot side 102. The server side 101 includes a server 1011 and a server side 5G communication module 1012. The robotic end 102 includes a robotic end 5G communication module 10201, a multiport forwarding module 10202, an infrared camera 10203, and a conventional camera 10204.
The infrared camera 10203 is in communication connection with the multiport forwarding module 10202, and the infrared camera 10203 is used for acquiring infrared images and sending the infrared images to the multiport forwarding module 10202. The conventional camera 10204 is communicatively connected to the multiport forwarding module 10202, and the conventional camera 10204 is configured to collect conventional images and send the conventional images to the multiport forwarding module 10202. The multi-port forwarding module 10202 is further connected to the robot-side 5G communication module 10201, and the multi-port forwarding module 10202 is configured to send the infrared image and the regular image to the robot-side 5G communication module 10201. The server-side 5G communication module 1012 is connected to the robot-side 5G communication module 10201, and is configured to receive the infrared image and the regular image sent by the robot-side 5G communication module 10201, and send the infrared image and the regular image to the server 1011. The server 1011 is connected with the client, and is used for processing the infrared image and the conventional image to obtain an image monitoring result, and sending the image monitoring result to the client.
The server 1011 may be a single server, a cluster formed by a plurality of servers, or any device capable of processing a conventional image and an infrared image, which is not particularly limited in the embodiment of the present application. Conventional imagery may include panoramic video and photographs and conventional video and photographs, the format and size of the video and pictures being selectable as desired. The multiport forwarding module 10202 may include a multiport repeater (HUB), and in particular may include a combination of one or more of a passive multiport repeater, an active multiport repeater, and an intelligent multiport repeater. The infrared camera 10203 and the conventional camera 10204 may be one or more, and the present application is not limited thereto. The infrared image and the conventional image are processed, including face recognition, mask recognition, gender recognition, age recognition, behavior recognition, body temperature detection, people flow statistics, gender proportion statistics and/or face ratio peering. The client may be a server, a display, a personal computer, a notebook computer, or any other computing device having networking capabilities.
As can be seen from the description of the above embodiments, by providing an infrared camera in a robot monitoring system, the robot monitoring system can recognize a living body in a non-illumination environment; the multiport repeater is used in the robot monitoring system, so that the work of other lines is not influenced when a certain line in the network fails, and the stability of the robot monitoring system is improved; the robot end 5G communication module and the server end 5G communication module are used, so that the speed of data transmission is ensured, and the monitoring image is not blocked and the resolution is not reduced; and the server is connected with the client, so that the image monitoring result obtained by processing the server can be sent to the client to finish the delivery of the image monitoring result.
In one possible implementation, the server 1011 may also send control information to the robot side 102 through the server side 5G communication module 1012. The control information may include camera focal length control information, camera angle control information, and the like.
Fig. 2 is a second schematic system architecture diagram of the robot monitoring system according to the embodiment of the present application. Referring to fig. 2, as an alternative embodiment of the present application, the robot end 102 further includes: a speech module 10205. The voice module 10205 is connected with the multiport forwarding module 10202, and is configured to receive external sound, obtain sound information according to the external sound, and send the sound information to the multiport forwarding module 10202. The multiport forwarding module 10202 sends the sound information to the robot side 5G communication module 10201, the robot side 5G communication module 10201 sends the sound information to the server side 5G communication module 1012, the server side 5G communication module 1012 sends the sound information to the server 1011, the server 1011 analyzes the sound information to obtain a sound monitoring result, and the sound monitoring result is sent to the client.
Where the speech module 10205 includes one or more of a loudspeaker, a microphone, and a sound card, analyzing the sound information may include analyzing the sound location, converting the sound to text, analyzing the type of sound source (e.g., whether the analysis is ambient noise or a human spoken language), and/or analyzing the sound intensity. The sound monitoring results may include noise reduced sounds, sounds highlighting human voices, sound types, and/or words into which the sounds are converted, etc.
As can be seen from the description of the above embodiments, by adding a voice module in the robot monitoring system, the monitoring of the sound in the environment can be achieved, and the comprehensiveness of the monitoring information can be increased.
In one possible implementation, the voice module may further receive a voice signal transmitted by the client through the server 101, and output a sound corresponding to the voice signal according to the voice signal. The sound signal may be an analog signal or a digital signal, and the sound corresponding to the sound signal may be a warning sound, a voice, or the like, so that the server side 101 controls the robot side 102 to emit a sound to the outside.
With continued reference to fig. 2, as an alternative embodiment of the present application, the robot side 102 further includes a robot side VPN (virtual private network ) module 10206, and the server side 101 further includes a server side VPN module 1013. Accordingly, the server-side 5G communication module 1012 is connected to the robot-side 5G communication module 10201 to receive the infrared image and the regular image, and send the infrared image and the regular image to the server 1011, including: the server-side 5G communication module 1012 is connected to the server-side VPN module 1013, the server-side VPN module 1013 is connected to the robot-side VPN module 10206, and the robot-side VPN module 10206 is connected to the robot-side 5G communication module 10201. The robot-side 5G communication module 10201 sends an infrared image and a normal image to the robot-side VPN module 10206, the robot-side VPN module 10206 encrypts the infrared image and the normal image to obtain an encrypted infrared image and an encrypted normal image, and sends the encrypted infrared image and the encrypted normal image to the server-side VPN module 1013, and the server-side VPN module 1013 decrypts the encrypted infrared image and the encrypted normal image to obtain an infrared image and a normal image, and sends the infrared image and the encrypted normal image to the server 1011.
The server-side VPN module 1013 and the robot-side VPN module 10206 may include a router VPN and a switch VPN, and may further include a software VPN.
As can be seen from the description of the above embodiments, by setting the server-side VPN module and the robot-side VPN module, encrypted transmission of the infrared image and the conventional image can be achieved, and security of the system is increased.
With continued reference to fig. 2, as an alternative embodiment of the present application, the robotic end 102 further includes: a drive module 10207 and a processing module 10208. The processing module 10208 is in communication connection with the multi-port forwarding module 10202 and the driving module 10207, the server 1011 is further configured to receive an instruction sent by the client, and send the instruction to the processing module 10208 sequentially through the server 5G communication module 1012, the robot 5G communication module 10201 and the multi-port forwarding module 10202, and the processing module 10208 obtains a control signal according to the instruction, and sends the control signal to the driving module 10207 to control the movement of the robot 102.
The drive module 10207 may include, among other things, a combination of various ones of an engine, an electric motor, a power source, wheels, tracks, and a transmission. The processing module 10208 may include a combination of one or more of a processor, artificial intelligence hardware (e.g., TX 2), and a computer, and the control signals may include steering and inspection of the robot end, etc.
As can be seen from the description of the above embodiments, by adding the driving module and the processing module to the robot monitoring system, the movement of the robot and the movement control of the robot from the client through the server can be achieved.
In one possible implementation manner, the processing module 10208 may be further configured to draw and edit a map of an area where the robot is located, identify a face in a conventional image, identify a living body in an infrared image, identify a gesture, and reply according to sounds in the above embodiment, and send a snapshot instruction to the conventional camera 10204 and the infrared camera 10203 according to the face, the living body, and the gesture, where the conventional camera 10204 and the infrared camera 10203 take a photograph according to the snapshot instruction, and send the photographed image to the server 1011 sequentially through the multiport forwarding module 10202, the robot 5G communication module 10201, the robot VPN module 10206, the server VPN module 1013, and the server 5G communication module 1012.
With continued reference to fig. 2, as an alternative embodiment of the present application, the robotic end 102 may also include a sensor 10209; the sensor 10209 is connected with the multiport forwarding module connection 10202. The sensor 10209 detects the environment in real time and obtains the environment information, the environment information is input into the server side 101 through the multiport forwarding module 10202 and the robot side 5G communication module 10201 in sequence, the server side 101 screens the environment information to obtain screened environment information, and the screened environment information is sent to the client side.
Wherein the sensor comprises a photosensitive sensor, an acceleration sensor, a gas sensor, a chemical sensor and/or the like.
As can be seen from the description of the above embodiments, adding a sensor at the robot end can increase the robot end detectable content, for example: smoke, robot acceleration, etc., and in the field where recognition is difficult using only a camera, the sensor can have a supplementary effect.
With continued reference to fig. 2, as an alternative embodiment of the present application, the robotic end 102 may also include an illumination module 10210; the illumination module 10210 is connected to the processing module 10208.
The lighting module 10210 may include LEDs (Light-Emitting Diode Light, light emitting diodes), incandescent lamps, etc., and may further include a motor, and the number of LED lamps, incandescent lamps, and the number of motors are not limited in this application.
The processing module 10208 sends switch control information to the lighting module 10210 to control the lighting module 10210 to turn on and off. The processing module 10208 sends steering information to the lighting module 10210 to control the orientation of the lighting module 10210.
As can be seen from the description of the above embodiments, by adding the illumination module, illumination can be provided for the robot end, and the light source can be provided under the condition of insufficient light or no light, so as to assist the conventional camera to work; a warning effect may also be provided to the outside.
Fig. 3 is a schematic diagram of a system architecture of a robot monitoring system according to an embodiment of the present application. Referring to fig. 3, as an alternative embodiment of the present application, a server 1011 includes: one or more of a voice server 10111, a streaming server 10112, and a signaling forwarding server 10113.
The voice server 10111 is used for processing the voice information in the above embodiment to obtain a voice monitoring result, and is also used for realizing voice intercom between the robot end and the client end after identifying specific voice information. The streaming media server 10112 is used for compressing and segmenting the infrared image and the conventional image sent by the robot end 102, and has the functions of live video, video on demand, storage and the like. The signaling forwarding server 10113 is configured to forward the control information and the sound signal sent by the client in the above embodiment to the robot 102.
As can be seen from the description of the above embodiments, the voice server, the streaming media server and the signaling forwarding server are different in labor division, so that when a system fails, the system is easier to locate the failure, and the failure is convenient to repair.
As an alternative embodiment of the present application, conventional camera 10204 includes: hemispherical cameras and/or gun cameras.
The hemispherical camera comprises a CCD (charge coupled device image sensor, charge Coupled Device) sensor, an aperture, a zoom lens, a spherical cover and a camera bracket, and the angle variable range of the hemispherical camera is larger than that of a gun-type camera. The gun-type camera is different from the hemispherical camera in appearance, and also comprises a CCD sensor, an aperture, a zoom lens and a camera bracket, wherein the focal length variable range of the gun-type camera is larger than that of the hemispherical camera. The number of hemispherical cameras and/or gun-type cameras is not limited.
As can be seen from the description of the above embodiments, by combining the hemispherical camera and/or the gun-type camera, flexible control of the focal length and the shooting angle can be achieved, so that the image is clearer and the angle is more flexible.
The embodiment of the application also provides a robot monitoring method, which is applied to the robot monitoring system provided by any one of the embodiments, and comprises the following steps: the infrared camera 10203 collects infrared images and sends the infrared images to the multiport forwarding module 10202; the conventional camera 10204 collects conventional images and sends the conventional images to the multiport forwarding module 10202; the multiport forwarding module 10202 sends the infrared image and the conventional image to the robot end 5G communication module 10201; the server-side 5G communication module 1012 receives the infrared image and the regular image transmitted by the robot-side 5G communication module 10201, and transmits the infrared image and the regular image to the server 1011; the server 1011 processes the infrared image and the normal image to obtain an image monitoring result, and transmits the image monitoring result to the client.
In one possible implementation, the robot end 102 further includes: the voice module 10205, the voice module 10205 being connected with the multiport forwarding module 10202, the method further comprising: the voice module 10205 receives the external sound, obtains sound information according to the external sound, and sends the sound information to the multiport forwarding module 10202; the multiport forwarding module 10202 sends the sound information to the robot side 5G communication module 10201, the robot side 5G communication module 10201 sends the sound information to the server side 5G communication module 1012, the server side 5G communication module 1012 sends the sound information to the server 1011, the server 1011 analyzes the sound information to obtain a sound monitoring result, and the sound monitoring result is sent to the client.
In one possible implementation, the robot side 102 further includes a robot side VPN module 10206, and the server side 101 further includes a server side VPN module 1013; the server-side 5G communication module 1012 is connected with the server-side VPN module 1013, the server-side VPN module 1013 is connected with the robot-side VPN module 10201, and the robot-side VPN module 10206 is connected with the robot-side 5G communication module 10201; the method further comprises the steps of: the robot-side 5G communication module 10201 sends an infrared image and a normal image to the robot-side VPN module 10206, the robot-side VPN module 10206 encrypts the infrared image and the normal image to obtain an encrypted infrared image and an encrypted normal image, and sends the encrypted infrared image and the encrypted normal image to the server-side VPN module 1013, and the server-side VPN module 1013 decrypts the encrypted infrared image and the encrypted normal image to obtain an infrared image and a normal image, and sends the infrared image and the encrypted normal image to the server 1011.
In one possible implementation, the robotic end 102 further includes: the driving module 10207 and the processing module 10208, the processing module 10208 is communicatively connected with both the multi-port forwarding module 10202 and the driving module 10207, the method further comprises: the server 1011 receives the instruction sent by the client, and sends the instruction to the processing module 10208 sequentially through the server-side 5G communication module 1012, the robot-side 5G communication module 10201 and the multiport forwarding module 10202, and the processing module 10208 obtains a control signal according to the instruction and sends the control signal to the driving module 10207 to control the movement of the robot-side 102.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It is to be understood that the present application is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (6)
1. A robotic monitoring system, comprising:
a robot end and a server end;
the robot end comprises an infrared camera, a conventional camera, a multi-port forwarding module and a robot end 5G communication module; the server side comprises a server side 5G communication module and a server;
the infrared camera is in communication connection with the multi-port forwarding module, and is used for acquiring infrared images and sending the infrared images to the multi-port forwarding module;
the conventional camera is in communication connection with the multi-port forwarding module, and is used for acquiring conventional images and sending the conventional images to the multi-port forwarding module;
the multi-port forwarding module is also connected with the robot end 5G communication module and is used for sending the infrared image and the conventional image to the robot end 5G communication module;
the server-side 5G communication module is connected with the robot-side 5G communication module and is used for receiving the infrared image and the conventional image sent by the robot-side 5G communication module and sending the infrared image and the conventional image to the server;
the server is connected with the client and is used for processing the infrared image and the conventional image to obtain an image monitoring result and sending the image monitoring result to the client;
the robot end further includes: a voice module;
the voice module is connected with the multi-port forwarding module and is used for receiving external sound, obtaining sound information according to the external sound and sending the sound information to the multi-port forwarding module;
the multiport forwarding module sends the sound information to the robot end 5G communication module, the robot end 5G communication module sends the sound information to the server end 5G communication module, the server end 5G communication module sends the sound information to the server, the server analyzes the sound information to obtain a sound monitoring result, and the sound monitoring result is sent to the client;
the robot end further comprises a Virtual Private Network (VPN) module of the robot end, and the server end further comprises a VPN module of the server end;
the server-side 5G communication module is connected with the server-side VPN module, the server-side VPN module is connected with the robot-side VPN module, and the robot-side VPN module is connected with the robot-side 5G communication module;
the robot end 5G communication module sends the infrared image and the conventional image to the robot end VPN module, the robot end VPN module encrypts the infrared image and the conventional image to obtain an encrypted infrared image and an encrypted conventional image, the encrypted infrared image and the encrypted conventional image are sent to the server end VPN module, and the server end VPN module decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image and sends the infrared image and the conventional image to the server.
2. The robotic monitoring system as set forth in claim 1, wherein the robotic end further comprises:
a driving module and a processing module;
the processing module is in communication connection with the multi-port forwarding module and the driving module, the server is further used for receiving the instruction sent by the client, and sequentially sending the instruction to the processing module through the server-side 5G communication module, the robot-side 5G communication module and the multi-port forwarding module, and the processing module obtains a control signal according to the instruction and sends the control signal to the driving module so as to control the movement of the robot-side.
3. The robot monitoring system of claim 1, wherein the server comprises:
one or more of a voice server, a streaming media server, and a signaling forwarding server.
4. The robotic monitoring system of claim 1, wherein the conventional camera comprises:
hemispherical cameras and/or gun cameras.
5. A robot monitoring method applied to the robot monitoring system according to claim 1, the method comprising:
the infrared camera collects infrared images and sends the infrared images to the multiport forwarding module;
the conventional camera collects conventional images and sends the conventional images to the multiport forwarding module;
the multiport forwarding module sends the infrared image and the conventional image to the robot end 5G communication module;
the server-side 5G communication module receives the infrared image and the conventional image sent by the robot-side 5G communication module and sends the infrared image and the conventional image to the server;
the server processes the infrared image and the conventional image to obtain an image monitoring result, and sends the image monitoring result to a client;
the robot end further includes: a voice module connected to the multiport forwarding module, the method further comprising:
the voice module receives external sound, obtains sound information according to the external sound, and sends the sound information to the multiport forwarding module;
the multiport forwarding module sends the sound information to the robot end 5G communication module, the robot end 5G communication module sends the sound information to the server end 5G communication module, the server end 5G communication module sends the sound information to the server, the server analyzes the sound information to obtain a sound monitoring result, and the sound monitoring result is sent to the client;
the robot end further comprises a robot end VPN module, and the server end further comprises a server end VPN module; the server-side 5G communication module is connected with the server-side VPN module, the server-side VPN module is connected with the robot-side VPN module, and the robot-side VPN module is connected with the robot-side 5G communication module; the method further comprises the steps of:
the robot end 5G communication module sends the infrared image and the conventional image to the robot end VPN module, the robot end VPN module encrypts the infrared image and the conventional image to obtain an encrypted infrared image and an encrypted conventional image, the encrypted infrared image and the encrypted conventional image are sent to the server end VPN module, and the server end VPN module decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image and sends the infrared image and the conventional image to the server.
6. The method of claim 5, wherein the robotic end further comprises: the processing module is in communication connection with the multiport forwarding module and the driving module; the method further comprises the steps of:
the server receives the instruction sent by the client, and sends the instruction to the processing module sequentially through the server-side 5G communication module, the robot-side 5G communication module and the multi-port forwarding module, and the processing module obtains a control signal according to the instruction and sends the control signal to the driving module so as to control the movement of the robot-side.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111212396.2A CN113873205B (en) | 2021-10-18 | 2021-10-18 | Robot monitoring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111212396.2A CN113873205B (en) | 2021-10-18 | 2021-10-18 | Robot monitoring system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113873205A CN113873205A (en) | 2021-12-31 |
| CN113873205B true CN113873205B (en) | 2023-12-22 |
Family
ID=79000183
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111212396.2A Active CN113873205B (en) | 2021-10-18 | 2021-10-18 | Robot monitoring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113873205B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101362330A (en) * | 2008-09-27 | 2009-02-11 | 公安部上海消防研究所 | Anti-terrorist explosive-removal robot with multi-degree of freedom and large load manipulator |
| CN203276840U (en) * | 2013-06-14 | 2013-11-06 | 深圳市聚电数码科技有限公司 | Vehicular network multimedia terminal |
| CN104284136A (en) * | 2013-07-07 | 2015-01-14 | 上海科宇营销策划有限公司 | Movable monitoring robot |
| CN106303369A (en) * | 2015-05-12 | 2017-01-04 | 上海移柯通信技术股份有限公司 | Safety defense monitoring system and control method thereof |
| CN109951690A (en) * | 2019-04-28 | 2019-06-28 | 公安部第一研究所 | Robot body security system and method based on camera shooting array image analysis |
| KR20190090745A (en) * | 2019-07-02 | 2019-08-02 | 엘지전자 주식회사 | Communication robot and method for operating the same |
| KR20190109338A (en) * | 2019-09-06 | 2019-09-25 | 엘지전자 주식회사 | Robot control method and robot |
| CN110601358A (en) * | 2019-08-06 | 2019-12-20 | 广东电网有限责任公司 | Power grid intelligent robot remote dispatching monitoring system |
| CN111063051A (en) * | 2019-12-20 | 2020-04-24 | 深圳市优必选科技股份有限公司 | Communication system of inspection robot |
| CN111469109A (en) * | 2020-04-28 | 2020-07-31 | 深圳供电局有限公司 | Inspection robot system |
| CN112223268A (en) * | 2020-09-29 | 2021-01-15 | 北京海益同展信息科技有限公司 | Robot control device and robot |
| CN112388629A (en) * | 2020-09-09 | 2021-02-23 | 北京潞电电气设备有限公司 | Tunnel robot inspection system and method based on 5G data transmission |
| CN212990169U (en) * | 2020-07-20 | 2021-04-16 | 中国联合网络通信集团有限公司 | Inspection robot and inspection system |
| CN112822447A (en) * | 2021-01-07 | 2021-05-18 | 云南电网有限责任公司电力科学研究院 | Robot remote monitoring video transmission method and system based on 5G network |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021211724A1 (en) * | 2020-04-14 | 2021-10-21 | Netmotion Software, Inc. | Mobile management system |
-
2021
- 2021-10-18 CN CN202111212396.2A patent/CN113873205B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101362330A (en) * | 2008-09-27 | 2009-02-11 | 公安部上海消防研究所 | Anti-terrorist explosive-removal robot with multi-degree of freedom and large load manipulator |
| CN203276840U (en) * | 2013-06-14 | 2013-11-06 | 深圳市聚电数码科技有限公司 | Vehicular network multimedia terminal |
| CN104284136A (en) * | 2013-07-07 | 2015-01-14 | 上海科宇营销策划有限公司 | Movable monitoring robot |
| CN106303369A (en) * | 2015-05-12 | 2017-01-04 | 上海移柯通信技术股份有限公司 | Safety defense monitoring system and control method thereof |
| CN109951690A (en) * | 2019-04-28 | 2019-06-28 | 公安部第一研究所 | Robot body security system and method based on camera shooting array image analysis |
| KR20190090745A (en) * | 2019-07-02 | 2019-08-02 | 엘지전자 주식회사 | Communication robot and method for operating the same |
| CN110601358A (en) * | 2019-08-06 | 2019-12-20 | 广东电网有限责任公司 | Power grid intelligent robot remote dispatching monitoring system |
| KR20190109338A (en) * | 2019-09-06 | 2019-09-25 | 엘지전자 주식회사 | Robot control method and robot |
| CN111063051A (en) * | 2019-12-20 | 2020-04-24 | 深圳市优必选科技股份有限公司 | Communication system of inspection robot |
| CN111469109A (en) * | 2020-04-28 | 2020-07-31 | 深圳供电局有限公司 | Inspection robot system |
| CN212990169U (en) * | 2020-07-20 | 2021-04-16 | 中国联合网络通信集团有限公司 | Inspection robot and inspection system |
| CN112388629A (en) * | 2020-09-09 | 2021-02-23 | 北京潞电电气设备有限公司 | Tunnel robot inspection system and method based on 5G data transmission |
| CN112223268A (en) * | 2020-09-29 | 2021-01-15 | 北京海益同展信息科技有限公司 | Robot control device and robot |
| CN112822447A (en) * | 2021-01-07 | 2021-05-18 | 云南电网有限责任公司电力科学研究院 | Robot remote monitoring video transmission method and system based on 5G network |
Non-Patent Citations (1)
| Title |
|---|
| 应用于非常规场景巡检的第一视觉5G智能机器人;谢小明;;自动化与信息工程(04);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113873205A (en) | 2021-12-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109040709B (en) | Video monitoring method and device, monitoring server and video monitoring system | |
| CN1849613A (en) | Apparatus and method for feature recognition | |
| CN109376601B (en) | Object tracking method based on high-speed ball, monitoring server and video monitoring system | |
| CN109089087B (en) | Multi-channel audio-video linkage device | |
| JP2013525831A (en) | Remote gaze control system and method | |
| KR102472369B1 (en) | Object tracking system based on sound source asking for emegency help and tracking method using the same | |
| CN113240053A (en) | Camera detection method and device, storage medium and electronic equipment | |
| US20220353410A1 (en) | Apparatus and method for remote image capture with automatic subject selection | |
| CN106764964A (en) | Intelligent monitoring LED and its control method | |
| KR101542713B1 (en) | Parkng management system and method thereof | |
| KR102658704B1 (en) | Information processing device, information processing method and information processing system | |
| CN113873205B (en) | Robot monitoring system and method | |
| KR101556076B1 (en) | Parking integration management system and method of managing aparking using the same | |
| KR102490671B1 (en) | Parking management system using moving type shooting robot and method for controlling the same | |
| EP3937479A1 (en) | Photographing apparatus, photographing method, and storage medium having program stored therein | |
| JP6641448B2 (en) | Surveillance camera system | |
| JP2004153674A (en) | Camera apparatus | |
| CN115118913A (en) | Projection video conference system and projection video method | |
| CN206459158U (en) | Intelligent monitoring LED | |
| JP3762745B2 (en) | Object identification system, light emitting device, and detection device | |
| KR20200115723A (en) | Apparatus for monitoring video, apparatus for analyzing video and learning methods thereof | |
| US20240179392A1 (en) | Photographing apparatus, photographing method, and storage medium having program stored therein | |
| KR102486110B1 (en) | Ultra low illuminance camera minutely adapting to change of illuminance | |
| JP2019192969A (en) | Imaging apparatus, imaging system, and street light | |
| EP4115797A1 (en) | Image capture systems and methods for identifying abnormalities using multispectral imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |