CN113873205A - Robot monitoring system and method - Google Patents
Robot monitoring system and method Download PDFInfo
- Publication number
- CN113873205A CN113873205A CN202111212396.2A CN202111212396A CN113873205A CN 113873205 A CN113873205 A CN 113873205A CN 202111212396 A CN202111212396 A CN 202111212396A CN 113873205 A CN113873205 A CN 113873205A
- Authority
- CN
- China
- Prior art keywords
- module
- server
- robot
- image
- communication module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 91
- 238000000034 method Methods 0.000 title claims abstract description 28
- 238000004891 communication Methods 0.000 claims abstract description 115
- 238000012545 processing Methods 0.000 claims description 35
- 230000033001 locomotion Effects 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 6
- 230000011664 signaling Effects 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 abstract description 12
- 230000000694 effects Effects 0.000 abstract description 3
- 238000005286 illumination Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 6
- 230000001133 acceleration Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000002789 length control Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
- Alarm Systems (AREA)
Abstract
The application provides a robot monitoring system and method. The system comprises: a robot end and a server end; the robot end comprises an infrared camera, a conventional camera, a multi-port forwarding module and a robot end 5G communication module; the server side comprises a server side 5G communication module and a server. According to the system, the robot monitoring system provided by the application, the infrared camera, the conventional camera, the multi-port forwarding module and the robot end 5G communication module are arranged in the robot end, and the server end 5G communication module and the server are arranged in the server end, so that the effect of effectively detecting the living body under the conditions of sufficient light and insufficient light is achieved; meanwhile, the transmission speed of the infrared images and the conventional images is improved by using 5G communication, and the definition of the transmitted infrared images and the conventional images is ensured.
Description
Technical Field
The application relates to the technical field of security monitoring, in particular to a robot monitoring system and method.
Background
The security monitoring is an important ring in a security system, and besides the monitoring equipment at a fixed position, the security monitoring task of a special area is completed by the support of movable monitoring equipment.
At present, movable monitoring equipment is mainly completed by using a robot monitoring system, and the current robot monitoring system can realize tasks such as mobile monitoring, obstacle recognition, face recognition and the like.
However, the current design of the robot monitoring system only considers the condition of sufficient illumination condition, and cannot perform the identification of the living body and measure the temperature under the condition of insufficient illumination; in addition, most of the current robot monitoring uses 4G network, which limits the transmission speed of the monitoring image.
Disclosure of Invention
The application provides a robot monitoring system and a method, which are used for solving the problems that a life body cannot be identified under the condition that the illumination of the current robot monitoring system is insufficient, and the transmission speed of a monitoring image is low.
In a first aspect, the present application provides a robot monitoring system, comprising: a robot end and a server end; the robot end comprises an infrared camera, a conventional camera, a multi-port forwarding module and a robot end 5G communication module; the server side comprises a server side 5G communication module and a server; the infrared camera is in communication connection with the multi-port forwarding module and is used for collecting infrared images and sending the infrared images to the multi-port forwarding module; the conventional camera is in communication connection with the multi-port forwarding module and is used for acquiring a conventional image and sending the conventional image to the multi-port forwarding module; the multi-port forwarding module is also connected with the robot end 5G communication module and is used for sending the infrared images and the conventional images to the robot end 5G communication module; the server end 5G communication module is connected with the robot end 5G communication module and is used for receiving the infrared image and the conventional image sent by the robot end 5G communication module and sending the infrared image and the conventional image to the server; the server is connected with the client and used for processing the infrared images and the conventional images to obtain image monitoring results and sending the image monitoring results to the client.
In a possible implementation manner, the robot end further includes: a voice module; the voice module is connected with the multi-port forwarding module and used for receiving external sound, obtaining sound information according to the external sound and sending the sound information to the multi-port forwarding module; the multiport forwarding module sends sound information to the robot end 5G communication module, the robot end 5G communication module sends the sound information to the server end 5G communication module, the server end 5G communication module sends the sound information to the server, and the server analyzes the sound information to obtain a sound monitoring result and sends the sound monitoring result to the client.
In a possible implementation manner, the robot end further includes a robot end virtual private network VPN module, and the server end further includes a server end VPN module; correspondingly, server end 5G communication module is connected with robot end 5G communication module to receive infrared image and conventional image, and send infrared image and conventional image to the server, include: the server end 5G communication module is connected with the server end VPN module, the server end VPN module is connected with the robot end VPN module, and the robot end VPN module is connected with the robot end 5G communication module; the robot end 5G communication module sends the infrared image and the conventional image to the robot end VPN module, the robot end VPN module encrypts the infrared image and the conventional image to obtain an encrypted infrared image and an encrypted conventional image, the encrypted infrared image and the encrypted conventional image are sent to the server end VPN module, and the server end VPN module decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image and sends the infrared image and the conventional image to the server.
In one possible implementation, the robot end further includes: the device comprises a driving module and a processing module; the processing module is in communication connection with the multi-port forwarding module and the driving module, the server is further used for receiving the instruction sent by the client, the instruction is sent to the processing module through the server-side 5G communication module, the robot-side 5G communication module and the multi-port forwarding module in sequence, the processing module obtains a control signal according to the instruction, and sends the control signal to the driving module so as to control the movement of the robot side.
In one possible implementation, the server includes: one or more of a voice server, a streaming media server, and a signaling forwarding server.
In one possible implementation, a conventional camera includes: a dome camera and/or a gun-type camera.
In a second aspect, the present application provides a robot monitoring method, including: the robot monitoring system applied to the first aspect includes: the infrared camera collects infrared images and sends the infrared images to the multi-port forwarding module; the conventional camera collects a conventional image and sends the conventional image to the multi-port forwarding module; the multi-port forwarding module sends the infrared image and the conventional image to the robot end 5G communication module; the server end 5G communication module receives the infrared image and the conventional image sent by the robot end 5G communication module and sends the infrared image and the conventional image to the server; the server processes the infrared image and the conventional image to obtain an image monitoring result, and sends the image monitoring result to the client.
In a possible implementation manner, the robot end further includes: the voice module is connected with the multi-port forwarding module, and the method further comprises the following steps: the voice module receives external sound, obtains sound information according to the external sound and sends the sound information to the multi-port forwarding module; the multiport forwarding module sends sound information to the robot end 5G communication module, the robot end 5G communication module sends the sound information to the server end 5G communication module, the server end 5G communication module sends the sound information to the server, and the server analyzes the sound information to obtain a sound monitoring result and sends the sound monitoring result to the client.
In a possible implementation manner, the robot end further includes a robot end VPN module, and the server end further includes a server end VPN module; the server end 5G communication module is connected with the server end VPN module, the server end VPN module is connected with the robot end VPN module, and the robot end VPN module is connected with the robot end 5G communication module; the method further comprises the following steps: the robot end 5G communication module sends the infrared image and the conventional image to the robot end VPN module, the robot end VPN module encrypts the infrared image and the conventional image to obtain an encrypted infrared image and an encrypted conventional image, the encrypted infrared image and the encrypted conventional image are sent to the server end VPN module, and the server end VPN module decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image and sends the infrared image and the conventional image to the server.
In one possible implementation, the robot end further includes: the system comprises a driving module and a processing module, wherein the processing module is in communication connection with both a multi-port forwarding module and the driving module; the method further comprises the following steps: the server receives the instruction sent by the client, the instruction is sent to the processing module through the server end 5G communication module, the robot end 5G communication module and the multi-port forwarding module in sequence, the processing module obtains a control signal according to the instruction, and the control signal is sent to the driving module to control the movement of the robot end.
According to the robot monitoring system, the infrared camera, the conventional camera, the multi-port forwarding module and the robot end 5G communication module are arranged in the robot end, the server end 5G communication module and the server are arranged in the server end, and the robot monitoring system can identify the living body in a non-illumination environment through the infrared camera, so that the effect of effectively detecting the living body under the conditions of sufficient light and insufficient light is achieved; meanwhile, the transmission speed of the infrared images and the conventional images is improved by using 5G communication, and the definition of the transmitted infrared images and the conventional images is ensured.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
Fig. 1 is a first schematic diagram of a system architecture of a robot monitoring system according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a system architecture of a robot monitoring system according to an embodiment of the present disclosure;
fig. 3 is a third schematic diagram of a system architecture of a robot monitoring system according to an embodiment of the present application.
Reference numerals:
robot monitoring system-100;
a server-101;
a robot end-102;
a server-1011;
a voice server-10111;
streaming media server-10112;
signaling forwarding server-10113;
a server-side 5G communication module-1012;
the robot end 5G communication module-10201;
a multi-port forwarding module-10202;
infrared camera-10203;
conventional camera-10204;
voice module-10205;
a robot end VPN module-10206;
a server-side VPN module-1013;
a drive module-10207;
processing module-10208;
sensor-10209;
lighting module-10210.
With the above figures, there are shown specific embodiments of the present application, which will be described in more detail below. These drawings and written description are not intended to limit the scope of the inventive concepts in any manner, but rather to illustrate the inventive concepts to those skilled in the art by reference to specific embodiments.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
At present, a fixed-point installation camera can be used or a method for monitoring a deployment robot is adopted to realize security monitoring, and because the robot monitoring can realize mobile monitoring, the defect that the monitoring range of the fixed-point installation camera is fixed is overcome, however, the current robot monitoring cannot distinguish a living body in an environment lacking illumination, and meanwhile, the current robot monitoring uses 4G transmission images, so that the image transmission speed and the data transmission range of the current robot monitoring are limited.
In order to solve the technical problem, the application provides a robot monitoring system, and a 5G communication module and an infrared camera are added into the robot monitoring system, so that the data transmission speed of a robot end and a server end in the robot monitoring system is increased, and the robot monitoring system can detect a living body under the condition of no illumination.
The following describes the technical solutions of the present application and how to solve the above technical problems with specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Fig. 1 is a first schematic system architecture diagram of a robot monitoring system according to an embodiment of the present disclosure.
For convenience of explanation, only relevant parts of the present application are shown, and as shown in fig. 1, a robot monitoring system 100 provided in an embodiment of the present application includes: a server side 101 and a robot side 102. The server side 101 includes a server 1011 and a server side 5G communication module 1012. The robot side 102 includes a robot side 5G communication module 10201, a multi-port relay module 10202, an infrared camera 10203, and a conventional camera 10204.
The server 1011 may be a single server, a cluster composed of multiple servers, or any device capable of processing a conventional image and an infrared image, which is not particularly limited in this embodiment of the application. The conventional images can include panoramic videos and photos and conventional videos and photos, and the formats and sizes of the videos and the photos can be selected according to needs. The multi-port forwarding module 10202 may include a multi-port repeater (HUB), and in particular may include a combination of one or more of a passive multi-port repeater, an active multi-port repeater, and an intelligent multi-port repeater. One or more of infrared camera 10203 and conventional camera 10204 may be provided, as the present application is not limited in this respect. And processing the infrared images and the conventional images, wherein the processing comprises face recognition, mask recognition, gender recognition, age recognition, behavior recognition, body temperature detection, pedestrian volume statistics, gender ratio statistics and/or face ratio equivalence. The client may be a server, a display, a personal computer, a laptop computer, or any other computing device with networking capabilities.
As can be seen from the description of the above embodiments, by providing an infrared camera in the robot monitoring system, the robot monitoring system can identify a living body in a non-illumination environment; the multi-port transponder is used in the robot monitoring system, so that the work of other lines is not influenced when a certain line in a network fails, and the stability of the robot monitoring system is improved; the robot-end 5G communication module and the server-end 5G communication module are used, so that the data transmission speed is ensured, and the monitoring image is not blocked and the resolution is not reduced; and because the server is connected with the client, the image monitoring result processed by the server can be sent to the client, and the delivery of the image monitoring result is completed.
In one possible implementation, the server 1011 may also send control information to the robot 102 through the server-side 5G communication module 1012. The control information may include camera focal length control information, camera angle control information, and the like.
Fig. 2 is a schematic diagram of a system architecture of a robot monitoring system according to an embodiment of the present disclosure. Referring to fig. 2, as an alternative embodiment of the present application, the robot end 102 further includes: a voice module 10205. The voice module 10205 is connected to the multiport forwarding module 10202, and is configured to receive external sound, obtain sound information according to the external sound, and send the sound information to the multiport forwarding module 10202. The multi-port forwarding module 10202 sends the sound information to the robot end 5G communication module 10201, the robot end 5G communication module 10201 sends the sound information to the server end 5G communication module 1012, the server end 5G communication module 1012 sends the sound information to the server 1011, and the server 1011 analyzes the sound information to obtain a sound monitoring result and sends the sound monitoring result to the client.
The voice module 10205 includes one or more of a microphone, and a sound card, and analyzing the sound information may include analyzing the sound location, converting the sound into text, analyzing the type of sound source (e.g., analyzing whether it is ambient noise or spoken language by a human), and/or analyzing the sound intensity. The sound monitoring result may include noise-reduced sound, voice highlighting human voice, type of sound and/or text into which the sound is converted, and the like.
From the description of the above embodiments, it can be known that the monitoring of the sound in the environment can be realized by adding the voice module in the robot monitoring system, and the comprehensiveness of the monitoring information is increased.
In a possible implementation manner, the voice module may further receive a sound signal transmitted by the client through the server 101, and output a sound corresponding to the sound signal according to the sound signal. The sound signal may be an analog signal or a digital signal, and the sound corresponding to the sound signal may be a warning sound or a voice, so that the server 101 controls the robot 102 to make a sound to the outside.
With continued reference to fig. 2, as an alternative embodiment of the present application, the robot end 102 further includes a robot VPN (Virtual Private Network) module 10206, and the server end 101 further includes a server VPN module 1013. Accordingly, the server-side 5G communication module 1012 is connected to the robot-side 5G communication module 10201 to receive the infrared image and the normal image, and transmits the infrared image and the normal image to the server 1011, including: the server-side 5G communication module 1012 is connected to the server-side VPN module 1013, the server-side VPN module 1013 is connected to the robot-side VPN module 10206, and the robot-side VPN module 10206 is connected to the robot-side 5G communication module 10201. The robot end 5G communication module 10201 sends the infrared image and the conventional image to the robot end VPN module 10206, the robot end VPN module 10206 encrypts the infrared image and the conventional image to obtain an encrypted infrared image and an encrypted conventional image, and sends the encrypted infrared image and the encrypted conventional image to the server end VPN module 1013, and the server end VPN module 1013 decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image, and sends the infrared image and the conventional image to the server 1011.
The server-side VPN module 1013 and the robot-side VPN module 10206 may include a router-type VPN, a switch-type VPN, and a software VPN.
As can be seen from the description of the above embodiments, by setting the server-side VPN module and the robot-side VPN module, encrypted transmission of the infrared image and the conventional image can be achieved, and the security of the system is increased.
With continued reference to fig. 2, as an alternative embodiment of the present application, the robot end 102 further includes: a drive module 10207 and a processing module 10208. The processing module 10208 is in communication connection with both the multi-port forwarding module 10202 and the driving module 10207, the server 1011 is further configured to receive an instruction sent by the client, send the instruction to the processing module 10208 sequentially through the server end 5G communication module 1012, the robot end 5G communication module 10201 and the multi-port forwarding module 10202, and the processing module 10208 obtains a control signal according to the instruction and sends the control signal to the driving module 10207 to control the movement of the robot end 102.
The drive module 10207 may include a combination of various ones of an engine, a motor, a power source, wheels, a track, and a transmission, among others. The processing module 10208 may include a combination of one or more of a processor, artificial intelligence hardware (e.g., TX2), and a computer, and the control signals may include steering and routing inspection at the robot end, etc.
As can be seen from the description of the above embodiments, by adding the driving module and the processing module to the robot monitoring system, the movement of the robot and the movement control of the robot from the client to the server can be realized.
In a possible implementation manner, the processing module 10208 may further be configured to draw and edit a map of an area where the robot is located, recognize a human face in a conventional image in real time, recognize a living body in an infrared image, recognize a gesture, and reply according to the sound in the foregoing embodiment, and may send a snapshot instruction to the conventional camera 10204 and the infrared camera 10203 according to the human face, the living body, and the gesture, where the conventional camera 10204 and the infrared camera 10203 shoot according to the snapshot instruction, and send the shot images to the server 1011 sequentially through the multi-port forwarding module 10202, the robot-side 5G communication module 10201, the robot-side VPN module 10206, the server-side VPN module 1013, and the server-side 5G communication module 1012.
With continued reference to fig. 2, as an alternative embodiment of the present application, the robot end 102 may further include a sensor 10209; the sensor 10209 is coupled to a multi-port forwarding module connection 10202. The sensor 10209 detects an environment in real time to obtain environment information, the environment information is sequentially input into the server 101 through the multi-port forwarding module 10202 and the robot end 5G communication module 10201, the server 101 screens the environment information to obtain screened environment information, and the screened environment information is sent to the client.
The sensor includes a photosensitive sensor, an acceleration sensor, a gas sensor, a chemical sensor, and/or the like.
From the above description of the embodiments, it can be seen that adding a sensor at the robot end can increase the detectable content at the robot end, for example: smoke, robot acceleration, etc. sensors can provide complementary effects in areas that are difficult to identify using only cameras.
With continued reference to fig. 2, as an alternative embodiment of the present application, the robot end 102 may further include an illumination module 10210; the lighting module 10210 is coupled to the processing module 10208.
The lighting module 10210 may include LEDs (Light-Emitting diodes), incandescent lamps, and motors, and the number of the LEDs, the incandescent lamps, and the number of the motors are not limited in this application.
The processing module 10208 transmits switch control information to the lighting module 10210 to control the lighting module 10210 to be turned on and off. The processing module 10208 sends steering information to the lighting module 10210 to control the orientation of the lighting module 10210.
As can be seen from the description of the above embodiments, by adding the illumination module, illumination can be provided for the robot end, and a light source can be provided under the condition of insufficient light or no light at all to assist the operation of the conventional camera; and a warning effect can be provided for the outside.
Fig. 3 is a third schematic diagram of a system architecture of a robot monitoring system according to an embodiment of the present application. Referring to fig. 3, as an alternative embodiment of the present application, the server 1011 includes: one or more of a voice server 10111, a streaming server 10112, and a signaling relay server 10113.
The voice server 10111 is configured to process the voice information in the foregoing embodiment to obtain a voice monitoring result, and is further configured to implement voice intercom between the robot and the client after recognizing the specific voice information. The streaming media server 10112 is configured to compress and segment infrared images and conventional images sent by the robot 102, and perform functions such as live video broadcasting, on-demand broadcasting, and storage. The signaling transfer server 10113 is configured to transfer the control information and the sound signals sent by the client in the above embodiments to the robot 102.
It can be known from the description of the above embodiment that the voice server, the streaming media server and the signaling forwarding server are different in division of labor, and when a system fails, the failure is more easily located, and the failure repair is facilitated.
As an alternative embodiment of the present application, the conventional camera 10204 includes: a dome camera and/or a gun-type camera.
The hemispherical camera comprises a Charge Coupled Device (CCD) sensor, an aperture, a zoom lens, a dome cover and a camera support, and the angle variable range of the hemispherical camera is larger than that of a gun-shaped camera. The gun-shaped camera is different from the hemispherical camera in appearance and also comprises a CCD sensor, an aperture, a zoom lens and a camera support, and the focal length variable range of the camera is larger than that of the hemispherical camera. The number of dome cameras and/or gun type cameras is not limited.
From the above description of the embodiments, it can be known that the combination of the dome camera and/or the gun camera can realize the flexible control of the focal length and the shooting angle, so that the image is clearer and the angle is more flexible.
An embodiment of the present application further provides a robot monitoring method, which is applied to the robot monitoring system provided in any of the embodiments, and includes: the infrared camera 10203 collects infrared images and sends the infrared images to the multi-port forwarding module 10202; the conventional camera 10204 collects a conventional image and sends the conventional image to the multi-port forwarding module 10202; the multi-port forwarding module 10202 sends the infrared image and the conventional image to the robot end 5G communication module 10201; the server-side 5G communication module 1012 receives the infrared image and the conventional image sent by the robot-side 5G communication module 10201, and sends the infrared image and the conventional image to the server 1011; the server 1011 processes the infrared image and the conventional image to obtain an image monitoring result, and sends the image monitoring result to the client.
In a possible implementation manner, the robot end 102 further includes: the voice module 10205, the voice module 10205 connected to the multi-port forwarding module 10202, the method further comprising: the voice module 10205 receives external sound, obtains sound information according to the external sound, and sends the sound information to the multiport forwarding module 10202; the multi-port forwarding module 10202 sends the sound information to the robot end 5G communication module 10201, the robot end 5G communication module 10201 sends the sound information to the server end 5G communication module 1012, the server end 5G communication module 1012 sends the sound information to the server 1011, and the server 1011 analyzes the sound information to obtain a sound monitoring result and sends the sound monitoring result to the client.
In one possible implementation, the robot end 102 further includes a robot-end VPN module 10206, and the server end 101 further includes a server-end VPN module 1013; the server end 5G communication module 1012 is connected to the server end VPN module 1013, the server end VPN module 1013 is connected to the robot end VPN module 10201, and the robot end VPN module 10206 is connected to the robot end 5G communication module 10201; the method further comprises the following steps: the robot end 5G communication module 10201 sends the infrared image and the conventional image to the robot end VPN module 10206, the robot end VPN module 10206 encrypts the infrared image and the conventional image to obtain an encrypted infrared image and an encrypted conventional image, and sends the encrypted infrared image and the encrypted conventional image to the server end VPN module 1013, and the server end VPN module 1013 decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image, and sends the infrared image and the conventional image to the server 1011.
In one possible implementation, the robot end 102 further includes: a driver module 10207 and a processing module 10208, the processing module 10208 communicatively coupled to both the multi-port forwarding module 10202 and the driver module 10207, the method further comprising: the server 1011 receives the instruction sent by the client, and sends the instruction to the processing module 10208 through the server end 5G communication module 1012, the robot end 5G communication module 10201 and the multi-port forwarding module 10202 in sequence, and the processing module 10208 obtains a control signal according to the instruction and sends the control signal to the driving module 10207 to control the movement of the robot end 102.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (10)
1. A robot monitoring system, comprising:
a robot end and a server end;
the robot end comprises an infrared camera, a conventional camera, a multi-port forwarding module and a robot end 5G communication module; the server end comprises a server end 5G communication module and a server;
the infrared camera is in communication connection with the multi-port forwarding module and is used for collecting infrared images and sending the infrared images to the multi-port forwarding module;
the conventional camera is in communication connection with the multi-port forwarding module and is used for acquiring a conventional image and sending the conventional image to the multi-port forwarding module;
the multi-port forwarding module is also connected with the robot end 5G communication module and is used for sending the infrared image and the conventional image to the robot end 5G communication module;
the server end 5G communication module is connected with the robot end 5G communication module and is used for receiving the infrared image and the conventional image sent by the robot end 5G communication module and sending the infrared image and the conventional image to the server;
the server is connected with the client and used for processing the infrared images and the conventional images to obtain image monitoring results and sending the image monitoring results to the client.
2. The robot monitoring system of claim 1, wherein the robot end further comprises: a voice module;
the voice module is connected with the multi-port forwarding module and used for receiving external sound, obtaining sound information according to the external sound and sending the sound information to the multi-port forwarding module;
the multiport forwarding module sends the sound information to the robot end 5G communication module, the robot end 5G communication module sends the sound information to the server end 5G communication module, the server end 5G communication module sends the sound information to the server, and the server analyzes the sound information to obtain a sound monitoring result and sends the sound monitoring result to the client.
3. The robot monitoring system of claim 1, wherein the robot end further comprises a robot end Virtual Private Network (VPN) module, and the server end further comprises a server end VPN module;
the server end 5G communication module is connected with the server end VPN module, the server end VPN module is connected with the robot end VPN module, and the robot end VPN module is connected with the robot end 5G communication module;
the robot end 5G communication module sends the infrared image and the conventional image to the robot end VPN module, the robot end VPN module encrypts the infrared image and the conventional image to obtain an encrypted infrared image and an encrypted conventional image, sends the encrypted infrared image and the encrypted conventional image to the server end VPN module, and the server end VPN module decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image and sends the infrared image and the conventional image to the server.
4. A robot monitoring system according to any of claims 1 to 3, characterized in that the robot end further comprises:
the device comprises a driving module and a processing module;
the processing module is in communication connection with the multi-port forwarding module and the driving module, the server is further used for receiving the instruction sent by the client, the instruction is sent to the processing module sequentially through the server-side 5G communication module, the robot-side 5G communication module and the multi-port forwarding module, and the processing module obtains a control signal according to the instruction and sends the control signal to the driving module so as to control the movement of the robot side.
5. A robot monitoring system according to any of claims 1 to 3, characterized in that the server comprises:
one or more of a voice server, a streaming media server, and a signaling forwarding server.
6. A robotic surveillance system as claimed in any one of claims 1 to 3, wherein the conventional camera comprises:
a dome camera and/or a gun-type camera.
7. A robot monitoring method applied to the robot monitoring system according to claim 1, comprising:
the infrared camera collects infrared images and sends the infrared images to the multi-port forwarding module;
the conventional camera collects a conventional image and sends the conventional image to the multi-port forwarding module;
the multi-port forwarding module sends the infrared image and the conventional image to the robot end 5G communication module;
the server-side 5G communication module receives the infrared image and the conventional image sent by the robot-side 5G communication module and sends the infrared image and the conventional image to the server;
and the server processes the infrared image and the conventional image to obtain an image monitoring result and sends the image monitoring result to the client.
8. The method of claim 7, wherein the robotic end further comprises: a voice module connected to the multi-port forwarding module, the method further comprising:
the voice module receives external sound, obtains sound information according to the external sound, and sends the sound information to the multi-port forwarding module;
the multiport forwarding module sends the sound information to the robot end 5G communication module, the robot end 5G communication module sends the sound information to the server end 5G communication module, the server end 5G communication module sends the sound information to the server, and the server analyzes the sound information to obtain a sound monitoring result and sends the sound monitoring result to the client.
9. The method of claim 7, wherein the robot side further comprises a robot side VPN module, and the server side further comprises a server side VPN module; the server end 5G communication module is connected with the server end VPN module, the server end VPN module is connected with the robot end VPN module, and the robot end VPN module is connected with the robot end 5G communication module; the method further comprises the following steps:
the robot end 5G communication module sends the infrared image and the conventional image to the robot end VPN module, the robot end VPN module encrypts the infrared image and the conventional image to obtain an encrypted infrared image and an encrypted conventional image, sends the encrypted infrared image and the encrypted conventional image to the server end VPN module, and the server end VPN module decrypts the encrypted infrared image and the encrypted conventional image to obtain the infrared image and the conventional image and sends the infrared image and the conventional image to the server.
10. The method of any of claims 7 to 9, wherein the robotic end further comprises: the processing module is in communication connection with both the multi-port forwarding module and the driving module; the method further comprises the following steps:
the server receives the instruction sent by the client and sends the instruction to the processing module sequentially through the server-side 5G communication module, the robot-side 5G communication module and the multi-port forwarding module, and the processing module obtains a control signal according to the instruction and sends the control signal to the driving module so as to control the motion of the robot side.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111212396.2A CN113873205B (en) | 2021-10-18 | 2021-10-18 | Robot monitoring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111212396.2A CN113873205B (en) | 2021-10-18 | 2021-10-18 | Robot monitoring system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113873205A true CN113873205A (en) | 2021-12-31 |
| CN113873205B CN113873205B (en) | 2023-12-22 |
Family
ID=79000183
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111212396.2A Active CN113873205B (en) | 2021-10-18 | 2021-10-18 | Robot monitoring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113873205B (en) |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101362330A (en) * | 2008-09-27 | 2009-02-11 | 公安部上海消防研究所 | Anti-terrorist explosive-removal robot with multi-degree of freedom and large load manipulator |
| CN203276840U (en) * | 2013-06-14 | 2013-11-06 | 深圳市聚电数码科技有限公司 | Vehicular network multimedia terminal |
| CN104284136A (en) * | 2013-07-07 | 2015-01-14 | 上海科宇营销策划有限公司 | Movable monitoring robot |
| CN106303369A (en) * | 2015-05-12 | 2017-01-04 | 上海移柯通信技术股份有限公司 | Safety defense monitoring system and control method thereof |
| CN109951690A (en) * | 2019-04-28 | 2019-06-28 | 公安部第一研究所 | Robot body security system and method based on camera shooting array image analysis |
| KR20190090745A (en) * | 2019-07-02 | 2019-08-02 | 엘지전자 주식회사 | Communication robot and method for operating the same |
| KR20190109338A (en) * | 2019-09-06 | 2019-09-25 | 엘지전자 주식회사 | Robot control method and robot |
| CN110601358A (en) * | 2019-08-06 | 2019-12-20 | 广东电网有限责任公司 | Power grid intelligent robot remote dispatching monitoring system |
| CN111063051A (en) * | 2019-12-20 | 2020-04-24 | 深圳市优必选科技股份有限公司 | Communication system of inspection robot |
| CN111469109A (en) * | 2020-04-28 | 2020-07-31 | 深圳供电局有限公司 | Inspection robot system |
| CN112223268A (en) * | 2020-09-29 | 2021-01-15 | 北京海益同展信息科技有限公司 | Robot control device and robot |
| CN112388629A (en) * | 2020-09-09 | 2021-02-23 | 北京潞电电气设备有限公司 | Tunnel robot inspection system and method based on 5G data transmission |
| CN212990169U (en) * | 2020-07-20 | 2021-04-16 | 中国联合网络通信集团有限公司 | Inspection robot and inspection system |
| CN112822447A (en) * | 2021-01-07 | 2021-05-18 | 云南电网有限责任公司电力科学研究院 | Robot remote monitoring video transmission method and system based on 5G network |
| US20210320871A1 (en) * | 2020-04-14 | 2021-10-14 | Netmotion Software, Inc. | Mobile management system |
-
2021
- 2021-10-18 CN CN202111212396.2A patent/CN113873205B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101362330A (en) * | 2008-09-27 | 2009-02-11 | 公安部上海消防研究所 | Anti-terrorist explosive-removal robot with multi-degree of freedom and large load manipulator |
| CN203276840U (en) * | 2013-06-14 | 2013-11-06 | 深圳市聚电数码科技有限公司 | Vehicular network multimedia terminal |
| CN104284136A (en) * | 2013-07-07 | 2015-01-14 | 上海科宇营销策划有限公司 | Movable monitoring robot |
| CN106303369A (en) * | 2015-05-12 | 2017-01-04 | 上海移柯通信技术股份有限公司 | Safety defense monitoring system and control method thereof |
| CN109951690A (en) * | 2019-04-28 | 2019-06-28 | 公安部第一研究所 | Robot body security system and method based on camera shooting array image analysis |
| KR20190090745A (en) * | 2019-07-02 | 2019-08-02 | 엘지전자 주식회사 | Communication robot and method for operating the same |
| CN110601358A (en) * | 2019-08-06 | 2019-12-20 | 广东电网有限责任公司 | Power grid intelligent robot remote dispatching monitoring system |
| KR20190109338A (en) * | 2019-09-06 | 2019-09-25 | 엘지전자 주식회사 | Robot control method and robot |
| CN111063051A (en) * | 2019-12-20 | 2020-04-24 | 深圳市优必选科技股份有限公司 | Communication system of inspection robot |
| US20210320871A1 (en) * | 2020-04-14 | 2021-10-14 | Netmotion Software, Inc. | Mobile management system |
| CN111469109A (en) * | 2020-04-28 | 2020-07-31 | 深圳供电局有限公司 | Inspection robot system |
| CN212990169U (en) * | 2020-07-20 | 2021-04-16 | 中国联合网络通信集团有限公司 | Inspection robot and inspection system |
| CN112388629A (en) * | 2020-09-09 | 2021-02-23 | 北京潞电电气设备有限公司 | Tunnel robot inspection system and method based on 5G data transmission |
| CN112223268A (en) * | 2020-09-29 | 2021-01-15 | 北京海益同展信息科技有限公司 | Robot control device and robot |
| CN112822447A (en) * | 2021-01-07 | 2021-05-18 | 云南电网有限责任公司电力科学研究院 | Robot remote monitoring video transmission method and system based on 5G network |
Non-Patent Citations (1)
| Title |
|---|
| 谢小明;: "应用于非常规场景巡检的第一视觉5G智能机器人", 自动化与信息工程, no. 04 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113873205B (en) | 2023-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109040709B (en) | Video monitoring method and device, monitoring server and video monitoring system | |
| CN109571468B (en) | Security inspection robot and security inspection method | |
| CN106791710B (en) | Target detection method and device and electronic equipment | |
| EP2478464B1 (en) | Saccadic dual-resolution video analytics camera | |
| WO2020057355A1 (en) | Three-dimensional modeling method and device | |
| CN108700889B (en) | Control method, remote monitoring equipment, remote controller, server and streaming media server | |
| CN109376601B (en) | Object tracking method based on high-speed ball, monitoring server and video monitoring system | |
| KR101120131B1 (en) | Intelligent Panorama Camera, Circuit and Method for Controlling thereof, and Video Monitoring System | |
| CN1849613A (en) | Apparatus and method for feature recognition | |
| US10914960B2 (en) | Imaging apparatus and automatic control system | |
| JP2020500391A (en) | Method and system for detecting raised objects present in a parking lot | |
| CN111251307B (en) | Voice acquisition method and device applied to robot and robot | |
| CN111708042A (en) | Robot method and system for pedestrian trajectory prediction and following | |
| JP2021536069A (en) | Signal indicator status detection method and device, operation control method and device | |
| KR20200119409A (en) | Apparatus and method for reading licence plate | |
| KR20220048200A (en) | Fence monitoring system | |
| CN114554093B (en) | Image acquisition system and target tracking method | |
| Premachandra et al. | A hybrid camera system for high-resolutionization of target objects in omnidirectional Images | |
| US20200125879A1 (en) | Apparatus and method for capturing flying objects | |
| CN113873205A (en) | Robot monitoring system and method | |
| JP2012054689A (en) | Visible light data processing device, visible light communication system, visible light data processing method, and program thereof | |
| KR102490671B1 (en) | Parking management system using moving type shooting robot and method for controlling the same | |
| CN112131915B (en) | Face attendance system, camera and code stream equipment | |
| CN114821544A (en) | Perception information generation method and device, vehicle, electronic equipment and storage medium | |
| JP6641448B2 (en) | Surveillance camera system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |