CN111031252A - Monitoring system and augmented reality AR terminal - Google Patents

Monitoring system and augmented reality AR terminal Download PDF

Info

Publication number
CN111031252A
CN111031252A CN201911399354.7A CN201911399354A CN111031252A CN 111031252 A CN111031252 A CN 111031252A CN 201911399354 A CN201911399354 A CN 201911399354A CN 111031252 A CN111031252 A CN 111031252A
Authority
CN
China
Prior art keywords
information
module
camera
cloud server
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911399354.7A
Other languages
Chinese (zh)
Inventor
陈文博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Dahua Technology Co Ltd
Original Assignee
Zhejiang Dahua Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Dahua Technology Co Ltd filed Critical Zhejiang Dahua Technology Co Ltd
Priority to CN201911399354.7A priority Critical patent/CN111031252A/en
Publication of CN111031252A publication Critical patent/CN111031252A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/52—Network services specially adapted for the location of the user terminal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30—Services specially adapted for particular environments, situations or purposes
    • H04W4/38—Services specially adapted for particular environments, situations or purposes for collecting sensor information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/70—Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Emergency Management (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Alarm Systems (AREA)

Abstract

The invention discloses a monitoring system and an Augmented Reality (AR) terminal, wherein the system comprises: the system comprises a cloud server, a client and a camera; the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module; the intelligent analysis module determines crowd density and traffic flow situation according to the received image and sends the crowd density and the traffic flow situation to the cloud server; and the cloud server sends the temperature and humidity, the crowd density and the traffic situation to the client. In the embodiment of the invention, the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module; the temperature and humidity sensor collects the temperature and humidity in the environment, the intelligent analysis module determines the crowd density and the traffic situation according to the image, and then the temperature and humidity, the crowd density and the traffic situation are sent to the client through the cloud server; tourists and managers can acquire temperature and humidity, crowd density and traffic situation through the client, so that effective and accurate reference data are provided for trip or scenic spot management.

Description

Monitoring system and augmented reality AR terminal
Technical Field
The invention relates to the technical field of video monitoring, in particular to a monitoring system and an Augmented Reality (AR) terminal.
Background
In recent years, with the improvement of living standard and consumption capability of people, every time during national legal holidays, hot scenic spots show the situation that visitors are full, and meanwhile, visitors continuously go forward. Before tourists travel, the tourists can only check the local weather forecast, and the local weather forecast is taken as the weather condition of the local scenic spot, which is obviously inaccurate for the scenic spot with the most measured climate change. In addition, visitors cannot know the pedestrian volume of the scenic spot before starting, and when the pedestrian volume of the scenic spot is too much under the condition of bad weather, the experience and safety of the visitors are affected, and great pressure can be brought to public security of the scenic spot. At present, a technical scheme capable of providing travel reference for tourists does not exist.
Disclosure of Invention
The embodiment of the invention provides a monitoring system and an Augmented Reality (AR) terminal, which are used for providing a technical scheme capable of providing travel reference for tourists.
An embodiment of the present invention provides a monitoring system, where the system includes: the system comprises a cloud server, a client and a camera installed in a monitoring area; the cloud server is respectively connected with the client and the camera;
the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module; the image acquisition module is connected with the intelligent analysis module;
the temperature and humidity sensor is used for collecting temperature and humidity in an environment and sending the temperature and humidity to the cloud server;
the image acquisition module is used for acquiring images and sending the images to the intelligent analysis module;
the intelligent analysis module is used for determining crowd density information and traffic situation information of the monitored area according to the received image and sending the crowd density information and the traffic situation information to the cloud server;
the cloud server is used for sending the received temperature and humidity, the received crowd density information and the received traffic situation information to the client;
and the client is used for displaying the temperature and humidity, the crowd density information and the traffic situation information.
Further, the camera further includes: an alarm prompt module; the alarm prompting module is connected with the intelligent analysis module;
the intelligent analysis module is further used for sending first indication information to the alarm prompt module according to the received image under the condition that the first alarm rule is judged to be triggered;
and the alarm prompting module is used for outputting first alarm information when the first indication information is received.
Further, the camera further includes: a microphone; the microphone is connected with the intelligent analysis module;
the microphone is used for collecting the sound of the monitoring area and sending the sound to the intelligent analysis module;
the intelligent analysis module is further used for sending second indication information to the alarm prompt module according to the received sound under the condition that the second alarm rule is judged to be triggered;
and the alarm prompt module is used for outputting second alarm information when the second indication information is received.
Further, the camera further includes: an alarm linkage module; the alarm linkage module is respectively connected with the alarm prompt module and the intelligent analysis module;
the intelligent analysis module is specifically configured to send the first indication information or the second indication information to the alarm linkage module;
and the alarm linkage module is used for sending the first indication information or the second indication information to the alarm prompt module.
Further, the alarm linkage module is further configured to send third indication information to the cloud server when the first indication information or the second indication information is received;
the cloud server is further used for sending the third indication information to the client;
and the client is also used for displaying alarm prompt information when receiving the third indication information.
Further, the alarm linkage module is further configured to send the third indication information to the cloud server and send the first position information of the camera to which the third indication information belongs;
the cloud server is further used for sending the first location information to the client;
the client is also used for displaying the alarm prompt information and the position information.
Further, the camera further includes: a positioning module; the positioning module is connected with the alarm linkage module;
and the alarm linkage module is used for acquiring the first position information output by the positioning module.
Further, the number of the cameras is at least two;
the client is also used for receiving the target face image and sending the target face image to the cloud server;
the cloud server is further used for sending the target face image to each camera;
the intelligent analysis module in each camera is used for determining a target image containing the target face image through a face recognition algorithm and acquiring the acquisition time information of the target image;
the intelligent analysis module in each camera is used for sending the acquisition time information of the target image and the second position information of the camera to which the intelligent analysis module belongs to the cloud server;
the cloud server is further used for determining path information of the personnel corresponding to the target face image according to the received acquisition time information of each target image and the second position information of the camera; sending the path information to the client;
the client is also used for displaying the path information.
Further, the system further comprises: a panoramic camera; the panoramic camera is connected with the cloud server;
the panoramic camera is used for acquiring panoramic images and sending the panoramic images to the cloud server;
the cloud server is used for sending the panoramic image and the second position information of each camera to the client;
and the client is used for adding a camera identifier in the panoramic image according to the second position information, and acquiring and displaying an image acquired by the camera corresponding to the identifier through the cloud server when an instruction of selecting the identifier by a user is received.
Further, the panoramic camera, the cloud server, the client and the at least two cameras all comprise a communication module.
On the other hand, the embodiment of the invention provides an Augmented Reality (AR) terminal, wherein the AR terminal is used for receiving and displaying the temperature and humidity, the crowd density information and the traffic situation information which are sent by a cloud server; and the temperature and humidity, the crowd density information and the traffic situation information are sent to the cloud server by the cameras in the monitoring area.
The embodiment of the invention provides a monitoring system and an Augmented Reality (AR) terminal, wherein the system comprises: the system comprises a cloud server, a client and a camera installed in a monitoring area; the cloud server is respectively connected with the client and the camera; the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module; the image acquisition module is connected with the intelligent analysis module; the temperature and humidity sensor is used for collecting temperature and humidity in an environment and sending the temperature and humidity to the cloud server; the image acquisition module is used for acquiring images and sending the images to the intelligent analysis module; the intelligent analysis module is used for determining crowd density and traffic flow situation according to the received image and sending the crowd density and the traffic flow situation to the cloud server; the cloud server is used for sending the received temperature and humidity, crowd density and traffic situation to the client; and the client is used for displaying the temperature and humidity, the crowd density and the traffic situation.
In the embodiment of the present invention, the monitoring system includes: the system comprises a cloud server, a client and a camera installed in a monitoring area; the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module; the temperature and humidity sensor collects the temperature and humidity in the environment, the intelligent analysis module determines the crowd density and the traffic situation according to the image, and then the temperature and humidity, the crowd density and the traffic situation are sent to the client through the cloud server; tourists and managers can acquire temperature and humidity, crowd density and traffic situation through the client, so that effective and accurate reference data are provided for trip or scenic spot management.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a monitoring system provided in embodiment 1 of the present invention;
fig. 2 is a schematic structural diagram of a monitoring system according to embodiment 2 of the present invention;
fig. 3 is a schematic structural diagram of a monitoring system according to embodiment 3 of the present invention;
fig. 4 is a schematic structural diagram of a monitoring system according to embodiment 4 of the present invention;
fig. 5 is a schematic structural diagram of a monitoring system according to embodiment 5 of the present invention;
fig. 6 is a schematic structural diagram of a monitoring system according to embodiment 7 of the present invention;
fig. 7 is a schematic view of a panoramic image provided in embodiment 7 of the present invention;
fig. 8 is a schematic structural diagram of a monitoring system according to embodiment 8 of the present invention;
fig. 9 is a configuration diagram of a monitoring system provided in the embodiment of the present invention;
fig. 10 is a configuration diagram of a main part of a video camera provided in the embodiment of the present invention;
fig. 11 is a schematic diagram of processing data inside a camera according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the attached drawings, and it should be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1:
fig. 1 is a schematic structural diagram of a monitoring system according to an embodiment of the present invention, where the monitoring system includes: a cloud server 11, a client 12, and a camera 13 installed in a monitoring area; the cloud server 11 is respectively connected with the client 12 and the camera 13;
the camera 13 comprises a temperature and humidity sensor 131, an image acquisition module 132 and an intelligent analysis module 133; the image acquisition module 132 is connected with the intelligent analysis module 133;
the temperature and humidity sensor 131 is configured to collect temperature and humidity in an environment and send the temperature and humidity to the cloud server 11;
the image acquisition module 132 is configured to acquire an image and send the image to the intelligent analysis module 133;
the intelligent analysis module 133 is configured to determine crowd density information and traffic situation information of the monitored area according to the received image, and send the crowd density information and the traffic situation information to the cloud server 11;
the cloud server 11 is configured to send the received temperature and humidity, the received crowd density information, and the received traffic situation information to the client 12;
and the client 12 is used for displaying the temperature and humidity, the crowd density information and the traffic situation information.
As shown in fig. 1, a monitoring system provided in an embodiment of the present invention includes a cloud server, a client, and a camera; the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module. The cloud server is respectively connected with the client and the camera.
The cameras are mounted within a surveillance area, which may be a scenic spot. It should be noted that a plurality of cameras may be arranged according to the needs of the monitored area, and the number, model, and the like of the cameras are not limited in the embodiment of the present invention. The camera supports 2K/4K and above ultrahigh definition resolution image acquisition. Each camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module.
Temperature and humidity in the environment can be collected in real time by a temperature and humidity sensor in the camera, and the collected temperature and humidity is sent to the cloud server.
The image acquisition module in the camera can acquire images and send the images to the intelligent analysis module, and the intelligent analysis module carries out intelligent analysis on the received images to acquire crowd density information and traffic situation information in a scene. The intelligent analysis module can determine the number of people and the number of vehicles in the image according to a face recognition algorithm, a vehicle recognition algorithm and the like. In addition, the intelligent analysis module can also predict the number of people and the number of vehicles according to an intelligent algorithm, for example, predict the number of people and the number of vehicles after 10 minutes according to the current number of people and the number of vehicles. The crowd density information includes the number of people included in the image and the predicted number of people, and the traffic situation information includes the number of vehicles included in the image and the predicted number of vehicles. After the intelligent analysis module determines the crowd density and the traffic situation, the crowd density and the traffic situation are sent to the cloud server.
After the cloud server receives the temperature and humidity sent by the temperature and humidity sensor and the crowd density information and the traffic situation information sent by the intelligent analysis module, the temperature and humidity, the crowd density information and the traffic situation information are sent to the client. The client may be a PC terminal, a mobile terminal, an AR terminal, or the like. The client comprises a display screen, and the temperature and humidity, the crowd density information and the traffic situation information are displayed on the display screen.
In the embodiment of the invention, after the client receives the temperature and humidity sent by the cloud server, the temperature and humidity can be counted by day, month, year and the like to be made into a temperature and humidity report or curve for display. Or, the cloud server may perform statistics on days, months, years and the like to make a temperature and humidity report or curve, and then send the temperature and humidity report or curve to the client for display. When a plurality of cameras are arranged in the monitoring area, a temperature and humidity report or curve collected by each camera is made.
In the embodiment of the present invention, the monitoring system includes: the system comprises a cloud server, a client and a camera installed in a monitoring area; the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module; the temperature and humidity sensor collects the temperature and humidity in the environment, the intelligent analysis module determines the crowd density and the traffic situation according to the image, and then the temperature and humidity, the crowd density and the traffic situation are sent to the client through the cloud server; tourists and managers can acquire temperature and humidity, crowd density and traffic situation through the client, so that effective and accurate reference data are provided for trip or scenic spot management.
Example 2:
on the basis of the above embodiment, in the embodiment of the present invention, as shown in fig. 2, the camera further includes: an alarm prompt module 134; the alarm prompting module is connected with the intelligent analysis module;
the intelligent analysis module is further used for sending first indication information to the alarm prompt module according to the received image under the condition that the first alarm rule is judged to be triggered;
and the alarm prompt module is used for outputting first alarm information when the first indication information is received.
In the embodiment of the invention, the intelligent analysis module can judge whether to trigger the first alarm rule according to the received image. Wherein the first alarm rule may be that a guest enters a danger area. Or guests entering other sensitive areas, etc. Specifically, the intelligent analysis module can identify a dangerous area or a sensitive area in the image, when the dangerous area or the sensitive area is identified, the first alarm rule is determined to be triggered, and at the moment, the intelligent analysis module sends first indication information to the alarm prompt module. The alarm prompting module receives the first indication information and outputs first alarm information. The first alarm information may be a voice prompt information, such as a voice prompt of "you have entered a dangerous area" is sent out, or an alarm prompt is given by flashing lights in combination with an alarm prompt sound, such as receiving the first indication information, flashing a red light while accompanying a "buzzing" alarm sound. In the embodiment of the invention, the first alarm information is not specifically limited, as long as the function of prompting the tourist can be achieved.
In the embodiment of the invention, when the intelligent analysis module judges that the first alarm rule is triggered, the intelligent analysis module sends the first indication information to the alarm prompt module, and the alarm prompt module outputs the first alarm information when receiving the first indication information. Therefore, the tourist can be warned to enter a dangerous area or a sensitive area, so that the tourist can leave quickly, and the safety of the tourist is ensured.
Example 3:
on the basis of the above embodiment, in the embodiment of the present invention, as shown in fig. 3, the camera further includes: a microphone 135; the microphone is connected with the intelligent analysis module;
the microphone is used for collecting the sound of the monitoring area and sending the sound to the intelligent analysis module;
the intelligent analysis module is further used for sending second indication information to the alarm prompt module according to the received sound under the condition that the second alarm rule is judged to be triggered;
and the alarm prompt module is used for outputting second alarm information when receiving the second indication information.
In the embodiment of the invention, the camera further comprises a microphone, and the microphone is used for collecting sound information in the environment and transmitting the sound information to the intelligent analysis module. And the intelligent analysis module judges whether to trigger a second alarm rule according to the received sound. Specifically, the intelligent analysis module may pre-store a target sound capable of triggering the second alarm rule, match the pre-stored target sound after receiving the sound transmitted by the microphone, determine whether the matching is successful, and determine to trigger the second alarm rule if the matching is successful. For example, the prestored target sound is a "life saving" sound, when the microphone collects a person to shout "life saving", the collected sound is sent to the intelligent analysis module, the intelligent analysis module matches the collected sound "life saving" with the prestored target sound "life saving", and the matching is successful, at this time, it is determined that the second alarm rule is triggered, and second indication information is sent to the alarm prompting module. And after receiving the second indication information, the alarm prompt module outputs second alarm information. The second alarm information may be voice prompt information, for example, a voice prompt of "asking for help" is sent out, or an alarm prompt is given by combining flashing of light and an alarm prompt sound, for example, when the second indication information is received, the flashing of the yellow light is accompanied by a "buzzing" alarm sound. In the embodiment of the invention, the two alarm messages are not specifically limited, as long as the function of prompting the person to ask for help can be achieved. In general, the second alarm information is different from the first alarm information.
Example 4:
on the basis of the above embodiment, in the embodiment of the present invention, as shown in fig. 4, the camera further includes: an alarm linkage module 136; the alarm linkage module is respectively connected with the alarm prompt module and the intelligent analysis module;
the intelligent analysis module is specifically used for sending first indication information or second indication information to the alarm linkage module;
and the alarm linkage module is used for sending the first indication information or the second indication information to the alarm prompt module.
In the embodiment of the invention, when the intelligent analysis module judges that the first alarm rule is triggered according to the received image, the intelligent analysis module sends first indication information to the alarm linkage module, and the alarm linkage module sends the first indication information to the alarm prompt module. And when the intelligent analysis module judges that a second alarm rule is triggered according to the received sound, the intelligent analysis module sends second indication information to the alarm linkage module, and the alarm linkage module sends the second indication information to the alarm prompt module.
The alarm linkage module is further used for sending third indication information to the cloud server when the first indication information or the second indication information is received;
the cloud server is further used for sending the third indication information to a client;
and the client is also used for displaying alarm prompt information when receiving the third indication information.
In the embodiment of the invention, after receiving the first indication information or the second indication information, the alarm linkage module sends third indication information to the cloud server, the cloud server forwards the third indication information to the client, and the client displays the alarm prompt information after receiving the third indication information, wherein the alarm prompt information can be character information. Specifically, the third indication information may carry the first indication information or the second indication information, and when the third indication information carries the first indication information, the client may display text information of "triggering the first alarm rule", or text information of "someone enters a dangerous area or a sensitive area". When the third indication information carries the second indication information, the client may display text information of "triggering the second alarm rule", or text information of "people seeking help". In addition, the client can display the alarm prompt information and simultaneously display image information acquired by a camera to which the alarm linkage module sending the third indication information belongs and output sound output by a microphone of the camera. In the embodiment of the invention, the monitoring area management personnel can see the dangerous situation on site in time through the alarm prompt information displayed by the client, the image information displayed by the client and the output sound, thereby taking measures in time and further ensuring the safety of tourists.
Example 5:
on the basis of the foregoing embodiments, in an embodiment of the present invention, the alarm linkage module is further configured to send third indication information to the cloud server and send first position information of a camera to which the alarm linkage module belongs;
the cloud server is further used for sending the position first position information to a client;
the client is further used for displaying alarm prompt information and the first position information.
As shown in fig. 5, the camera further includes: a positioning module 137; the positioning module is connected with the alarm linkage module;
and the alarm linkage module is used for acquiring the first position information output by the positioning module.
In the embodiment of the invention, the camera further comprises a positioning module, the positioning module is used for acquiring first position information of the camera to which the positioning module belongs, the positioning module sends the first position information of the camera to which the positioning module belongs to the alarm linkage module, the alarm linkage module is further used for sending the first position information of the camera to which the positioning module belongs to the cloud server when sending third indication information to the cloud server, and the cloud server sends the third indication information and the first position information to the client. And the client displays alarm prompt information and the first position information. And the monitoring area manager can more intuitively and accurately identify the specific dangerous position by checking the first position information and take rescue measures in time.
Example 6:
on the basis of the above embodiments, in the embodiment of the present invention, the number of the cameras is at least two;
the client is also used for receiving the target face image and sending the target face image to the cloud server;
the cloud server is further used for sending the target face image to each camera;
the intelligent analysis module in each camera is used for determining a target image containing the target face image through a face recognition algorithm and acquiring the acquisition time information of the target image;
the intelligent analysis module in each camera is used for sending the acquisition time information of the target image and the second position information of the camera to which the intelligent analysis module belongs to the cloud server;
the cloud server is further used for determining path information of the personnel corresponding to the target face image according to the received acquisition time information of each target image and the second position information of the camera; sending the path information to the client;
the client is also used for displaying the path information.
In the embodiment of the invention, when the general direction of a certain person in a scenic spot needs to be searched, a user can input a target face image of the person needing to be searched from a client, the client receives the target face image and then sends the target face image to the cloud server, and the target face image is forwarded to each camera through the cloud server.
And the intelligent analysis module in each camera determines each face image according to each image acquired by the camera per se through a face recognition algorithm, matches each face image with the target face image, and takes the image containing the target face image as the target image when the matching is successful. Since each acquired image has time stamp information, that is, acquisition time information of the image, the acquisition time information of the target image can be acquired after the target image is determined. If the target image does not exist in the image acquired by a certain camera, the situation shows that the person needing to be searched does not pass through the area monitored by the camera.
After the acquisition time information of the target image and the second position information of the camera to which the intelligent analysis module belongs are determined, the acquisition time information of the target image and the second position information of the camera to which the intelligent analysis module belongs are sent to the cloud server, and the cloud server determines the path information of the person corresponding to the target face image according to the received acquisition time information of each target image and the received second position information of the camera. Specifically, the path information of the person corresponding to the target face image is determined according to the sequence of the acquisition time information of each target image and the second position information of the camera. After determining the path information of the personnel, the cloud server sends the path information to the client; the client displays the path information.
In addition, in the embodiment of the present invention, after the acquisition time information of each target image and the second position information of the camera are received by the cloud server, the acquisition time information of each target image and the second position information of the camera may also be sent to the client, and the client determines and displays the path information of the person corresponding to the target face image.
In the embodiment of the invention, the intelligent analysis module in each camera determines a target image containing a target face image through a face recognition algorithm and acquires the acquisition time information of the target image; sending the acquisition time information of the target image and the second position information of the camera to which the target image belongs to a cloud server; the cloud server determines path information of personnel corresponding to the target face image according to the received acquisition time information of each target image and the second position information of the camera; sending the path information to a client; and the client displays the path information. Therefore, the monitoring system provided by the embodiment of the invention is convenient for searching after personnel are lost.
Example 7:
on the basis of the foregoing embodiments, in an embodiment of the present invention, as shown in fig. 6, the system further includes: a panoramic camera 14; the panoramic camera is connected with the cloud server;
the panoramic camera is used for acquiring panoramic images and sending the panoramic images to the cloud server;
the cloud server is used for sending the panoramic image and the second position information of each camera to the client;
and the client is used for adding a camera identifier in the panoramic image according to the second position information, and acquiring and displaying an image acquired by the camera corresponding to the identifier through the cloud server when an instruction of selecting the identifier by a user is received.
In the embodiment of the invention, the monitoring system also comprises a panoramic camera, and the panoramic camera is used for acquiring panoramic images and sending the panoramic images to a cloud server connected with the panoramic camera. The cloud server sends the panoramic image and the second position information of each camera to the client. The client adds a camera identifier in the panoramic image according to the second location information. As shown in fig. 7, in the panoramic image captured by the panoramic camera, five camera identifiers are added to the panoramic image according to the second position information of each camera. When the client receives an instruction of selecting the identifier by the user, the camera corresponding to the selected identifier is determined according to the selected identifier, and then the image acquired by the camera corresponding to the identifier is acquired through the cloud server and displayed. Therefore, the real-time image collected by the camera can be displayed in the panoramic image in a picture-in-picture mode by selecting the identifier, and the user experience is improved.
Example 8:
on the basis of the above embodiments, in the embodiment of the present invention, as shown in fig. 8, the panoramic camera, the cloud server, the client, and at least two cameras all include the communication module 15. Of which only one is shown in fig. 8.
The communication module in the embodiment of the invention includes but is not limited to a 4G and 5G mobile communication module. The data interaction is carried out among the panoramic camera, the cloud server, the client and at least two cameras through the communication module. The ultrahigh-resolution camera is combined with 5G mobile network communication, so that real-time return of the ultrahigh-definition video is realized.
Fig. 9 is a configuration diagram of a monitoring system according to an embodiment of the present invention, and as shown in fig. 9, the monitoring system includes a plurality of cameras, a cloud server and a client, where the cloud server is the cloud server platform shown in fig. 9, and the client includes the PC terminal, the mobile client, the back-end large screen and the storage server shown in fig. 9.
Fig. 10 is a configuration diagram of a main part of a camera according to an embodiment of the present invention, and as shown in fig. 10, the camera includes a lens, a filter switcher ICR, a 2K/4K or higher resolution image sensor, i.e., an image acquisition module, a main control chip SOC, a temperature and humidity sensor, a GPS/beidou module, i.e., a positioning module, a 5G/4G mobile communication module, an AI intelligent analysis algorithm module, an intercom and alarm linkage module, i.e., a microphone, an alarm prompt module, an alarm linkage module, and a video output interface.
Fig. 11 is a schematic view of processing data inside a camera according to an embodiment of the present invention, as shown in fig. 11, after a video image and temperature and humidity sensor data are acquired by the camera, the main control chip SOC controls the intelligent analysis module to perform intelligent processing such as face detection, face recognition, passenger flow statistics, crowd density, traffic situation, and the like, and then the intelligent processing is transmitted to the cloud server through the 5G/4G mobile communication module.
In addition, the embodiment of the invention provides an Augmented Reality (AR) terminal, wherein the AR terminal is used for receiving and displaying the temperature and humidity, the crowd density information and the traffic situation information which are sent by a cloud server; and the temperature and humidity, the crowd density information and the traffic situation information are sent to the cloud server by the cameras in the monitoring area.
The embodiment of the invention provides a monitoring system and an Augmented Reality (AR) terminal, wherein the system comprises: the system comprises a cloud server, a client and a camera installed in a monitoring area; the cloud server is respectively connected with the client and the camera; the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module; the image acquisition module is connected with the intelligent analysis module; the temperature and humidity sensor is used for collecting temperature and humidity in an environment and sending the temperature and humidity to the cloud server; the image acquisition module is used for acquiring images and sending the images to the intelligent analysis module; the intelligent analysis module is used for determining crowd density and traffic flow situation according to the received image and sending the crowd density and the traffic flow situation to the cloud server; the cloud server is used for sending the received temperature and humidity, crowd density and traffic situation to the client; and the client is used for displaying the temperature and humidity, the crowd density and the traffic situation.
In the embodiment of the present invention, the monitoring system includes: the system comprises a cloud server, a client and a camera installed in a monitoring area; the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module; the temperature and humidity sensor collects the temperature and humidity in the environment, the intelligent analysis module determines the crowd density and the traffic situation according to the image, and then the temperature and humidity, the crowd density and the traffic situation are sent to the client through the cloud server; tourists and managers can acquire temperature and humidity, crowd density and traffic situation through the client, so that effective and accurate reference data are provided for trip or scenic spot management.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. A monitoring system, the system comprising: the system comprises a cloud server, a client and a camera installed in a monitoring area; the cloud server is respectively connected with the client and the camera;
the camera comprises a temperature and humidity sensor, an image acquisition module and an intelligent analysis module; the image acquisition module is connected with the intelligent analysis module;
the temperature and humidity sensor is used for collecting temperature and humidity in an environment and sending the temperature and humidity to the cloud server;
the image acquisition module is used for acquiring images and sending the images to the intelligent analysis module;
the intelligent analysis module is used for determining crowd density information and traffic situation information of the monitored area according to the received image and sending the crowd density information and the traffic situation information to the cloud server;
the cloud server is used for sending the received temperature and humidity, the received crowd density information and the received traffic situation information to the client;
and the client is used for displaying the temperature and humidity, the crowd density information and the traffic situation information.
2. The system of claim 1, wherein the camera further comprises: an alarm prompt module; the alarm prompting module is connected with the intelligent analysis module;
the intelligent analysis module is further used for sending first indication information to the alarm prompt module according to the received image under the condition that the first alarm rule is judged to be triggered;
and the alarm prompting module is used for outputting first alarm information when the first indication information is received.
3. The system of claim 2, wherein the camera further comprises: a microphone; the microphone is connected with the intelligent analysis module;
the microphone is used for collecting the sound of the monitoring area and sending the sound to the intelligent analysis module;
the intelligent analysis module is further used for sending second indication information to the alarm prompt module according to the received sound under the condition that the second alarm rule is judged to be triggered;
and the alarm prompt module is used for outputting second alarm information when the second indication information is received.
4. The system of claim 3, wherein the camera further comprises: an alarm linkage module; the alarm linkage module is respectively connected with the alarm prompt module and the intelligent analysis module;
the intelligent analysis module is specifically configured to send the first indication information or the second indication information to the alarm linkage module;
and the alarm linkage module is used for sending the first indication information or the second indication information to the alarm prompt module.
5. The system of claim 4, wherein the alarm linkage module is further configured to send third indication information to the cloud server when the first indication information or the second indication information is received;
the cloud server is further used for sending the third indication information to the client;
and the client is also used for displaying alarm prompt information when receiving the third indication information.
6. The system of claim 5, wherein the alarm linkage module is further configured to send the third indication information to the cloud server and send the first position information of the corresponding camera;
the cloud server is further used for sending the first location information to the client;
the client is further used for displaying the alarm prompt information and the first position information.
7. The system of claim 6, wherein the camera further comprises: a positioning module; the positioning module is connected with the alarm linkage module;
and the alarm linkage module is used for acquiring the first position information output by the positioning module.
8. The system of claim 1, wherein the number of cameras is at least two;
the client is also used for receiving the target face image and sending the target face image to the cloud server;
the cloud server is further used for sending the target face image to each camera;
the intelligent analysis module in each camera is used for determining a target image containing the target face image through a face recognition algorithm and acquiring the acquisition time information of the target image;
the intelligent analysis module in each camera is used for sending the acquisition time information of the target image and the second position information of the camera to which the intelligent analysis module belongs to the cloud server;
the cloud server is further used for determining path information of the personnel corresponding to the target face image according to the received acquisition time information of each target image and the second position information of the camera; sending the path information to the client;
the client is also used for displaying the path information.
9. The system of claim 8, wherein the system further comprises: a panoramic camera; the panoramic camera is connected with the cloud server;
the panoramic camera is used for acquiring panoramic images and sending the panoramic images to the cloud server;
the cloud server is used for sending the panoramic image and the second position information of each camera to the client;
and the client is used for adding a camera identifier in the panoramic image according to the second position information, and acquiring and displaying an image acquired by the camera corresponding to the identifier through the cloud server when an instruction of selecting the identifier by a user is received.
10. An Augmented Reality (AR) terminal is characterized in that the AR terminal is used for receiving and displaying temperature and humidity, crowd density information and traffic situation information sent by a cloud server; and the temperature and humidity, the crowd density information and the traffic situation information are sent to the cloud server by the cameras in the monitoring area.
CN201911399354.7A 2019-12-30 2019-12-30 Monitoring system and augmented reality AR terminal Pending CN111031252A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911399354.7A CN111031252A (en) 2019-12-30 2019-12-30 Monitoring system and augmented reality AR terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911399354.7A CN111031252A (en) 2019-12-30 2019-12-30 Monitoring system and augmented reality AR terminal

Publications (1)

Publication Number Publication Date
CN111031252A true CN111031252A (en) 2020-04-17

Family

ID=70196075

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911399354.7A Pending CN111031252A (en) 2019-12-30 2019-12-30 Monitoring system and augmented reality AR terminal

Country Status (1)

Country Link
CN (1) CN111031252A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112468768A (en) * 2020-10-22 2021-03-09 江西裕丰智能农业科技有限公司 AR intelligent terminal based on panoramic video stream

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060104320A (en) * 2005-03-30 2006-10-09 한국전자금융 주식회사 Security monitoring system and method using the network camera
CN201315654Y (en) * 2008-08-25 2009-09-23 云南正卓信息技术有限公司 Special SkyEyes** intelligent monitoring system for prison
CN101795395A (en) * 2009-02-04 2010-08-04 深圳市先进智能技术研究所 System and method for monitoring crowd situation
CN102724480A (en) * 2012-06-07 2012-10-10 深圳市鼎盛威电子有限公司 3G (the 3rd generation telecommunication) real-time video monitoring system
CN103049734A (en) * 2011-10-12 2013-04-17 杜惠红 Method and system for finding person in public place
CN205232356U (en) * 2015-11-17 2016-05-11 高新兴科技集团股份有限公司 Augmented reality monitored control system based on mobile terminal
CN106375721A (en) * 2016-09-14 2017-02-01 重庆邮电大学 Smart video monitoring system based on cloud platform
CN106534779A (en) * 2016-10-28 2017-03-22 安徽三实信息技术服务有限公司 Intelligent monitoring system for early warning of security of scenic spot
CN106844492A (en) * 2016-12-24 2017-06-13 深圳云天励飞技术有限公司 A kind of method of recognition of face, client, server and system
CN106934970A (en) * 2017-03-30 2017-07-07 安徽森度科技有限公司 A kind of public place abnormal behaviour early warning system
JP2018002037A (en) * 2016-07-06 2018-01-11 株式会社日立製作所 Congestion rate predicting system and method
CN108334995A (en) * 2018-03-21 2018-07-27 四川爱非客网络科技有限公司 A kind of scenic spot passenger flow estimation system based on big data
CN108363435A (en) * 2017-12-28 2018-08-03 杭州电子科技大学 A kind of pig house environment remote monitoring system and method
CN108965810A (en) * 2018-07-23 2018-12-07 广州市高科通信技术股份有限公司 Intensive place intelligent monitoring dispatching management information system and method
CN110069710A (en) * 2019-04-15 2019-07-30 四川工商职业技术学院 A kind of visualization travel information service terminal and system
AU2019100806A4 (en) * 2019-07-24 2019-08-29 Dynamic Crowd Measurement Pty Ltd Real-Time Crowd Measurement And Management Systems And Methods Thereof

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060104320A (en) * 2005-03-30 2006-10-09 한국전자금융 주식회사 Security monitoring system and method using the network camera
CN201315654Y (en) * 2008-08-25 2009-09-23 云南正卓信息技术有限公司 Special SkyEyes** intelligent monitoring system for prison
CN101795395A (en) * 2009-02-04 2010-08-04 深圳市先进智能技术研究所 System and method for monitoring crowd situation
CN103049734A (en) * 2011-10-12 2013-04-17 杜惠红 Method and system for finding person in public place
CN102724480A (en) * 2012-06-07 2012-10-10 深圳市鼎盛威电子有限公司 3G (the 3rd generation telecommunication) real-time video monitoring system
CN205232356U (en) * 2015-11-17 2016-05-11 高新兴科技集团股份有限公司 Augmented reality monitored control system based on mobile terminal
JP2018002037A (en) * 2016-07-06 2018-01-11 株式会社日立製作所 Congestion rate predicting system and method
CN106375721A (en) * 2016-09-14 2017-02-01 重庆邮电大学 Smart video monitoring system based on cloud platform
CN106534779A (en) * 2016-10-28 2017-03-22 安徽三实信息技术服务有限公司 Intelligent monitoring system for early warning of security of scenic spot
CN106844492A (en) * 2016-12-24 2017-06-13 深圳云天励飞技术有限公司 A kind of method of recognition of face, client, server and system
CN106934970A (en) * 2017-03-30 2017-07-07 安徽森度科技有限公司 A kind of public place abnormal behaviour early warning system
CN108363435A (en) * 2017-12-28 2018-08-03 杭州电子科技大学 A kind of pig house environment remote monitoring system and method
CN108334995A (en) * 2018-03-21 2018-07-27 四川爱非客网络科技有限公司 A kind of scenic spot passenger flow estimation system based on big data
CN108965810A (en) * 2018-07-23 2018-12-07 广州市高科通信技术股份有限公司 Intensive place intelligent monitoring dispatching management information system and method
CN110069710A (en) * 2019-04-15 2019-07-30 四川工商职业技术学院 A kind of visualization travel information service terminal and system
AU2019100806A4 (en) * 2019-07-24 2019-08-29 Dynamic Crowd Measurement Pty Ltd Real-Time Crowd Measurement And Management Systems And Methods Thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112468768A (en) * 2020-10-22 2021-03-09 江西裕丰智能农业科技有限公司 AR intelligent terminal based on panoramic video stream

Similar Documents

Publication Publication Date Title
US11100332B2 (en) Investigation assist system and investigation assist method
CN105849790B (en) Road condition information acquisition method
WO2020015242A1 (en) Video application and early warning scheduling system platform based on three-dimensional map
CN109362038A (en) The method and system of guest flow statistics analysis and service based on WiFi probe
US20040105005A1 (en) Networked camera system and a monitoring method thereof
JP6099833B1 (en) Image processing apparatus, image processing system, and image processing method
US11887453B2 (en) Luminaire network with sensors
CN104574251A (en) Intelligent public safety information system and application method
KR101514696B1 (en) Safety Accident Management System Of Bridge
US8907818B2 (en) Bus stop and system providing travel information in relation to buses
CN110148272B (en) Monitoring method and monitoring device for fire fighting access and fire fighting access system
CN107274003A (en) A kind of wisdom fire-fighting management system and its control method
KR102197704B1 (en) Augmented Reality Based Parking Guidance System in Indoor Parking Lot
CN110648528A (en) Wisdom highway management system
CN111325954B (en) Personnel loss early warning method, device, system and server
KR20160099931A (en) Disaster preventing and managing method for the disaster harzard and interest area
CN105072425A (en) Video monitoring method and video monitoring device
US20200387716A1 (en) Automated surveillance system and method therefor
JP2005086626A (en) Wide area monitoring device
WO2019099321A1 (en) Collaborative media collection analysis
US11846941B2 (en) Drone graphical user interface
CN108254542A (en) A kind of cloud storage cloud identification intelligent alcohol detection system with communication module
CN111031252A (en) Monitoring system and augmented reality AR terminal
JP2021039485A (en) Collection method
KR20150140485A (en) Integrated control system using cctv camera

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200417

RJ01 Rejection of invention patent application after publication