WO2020151425A1 - 3d实景视觉监控的切换展示方法及系统 - Google Patents

3d实景视觉监控的切换展示方法及系统 Download PDF

Info

Publication number
WO2020151425A1
WO2020151425A1 PCT/CN2019/126936 CN2019126936W WO2020151425A1 WO 2020151425 A1 WO2020151425 A1 WO 2020151425A1 CN 2019126936 W CN2019126936 W CN 2019126936W WO 2020151425 A1 WO2020151425 A1 WO 2020151425A1
Authority
WO
WIPO (PCT)
Prior art keywords
monitoring
scene
real
environment
alarm signal
Prior art date
Application number
PCT/CN2019/126936
Other languages
English (en)
French (fr)
Inventor
李新福
Original Assignee
广东康云科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东康云科技有限公司 filed Critical 广东康云科技有限公司
Publication of WO2020151425A1 publication Critical patent/WO2020151425A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/156—Mixing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268—Signal distribution or switching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the invention relates to the field of security monitoring, in particular to a switching display method and system for 3D real scene visual monitoring.
  • Security system (referred to as security system, Security System) is the use of audio and video, infrared, detection, microwave, control, communication and other scientific technologies, using various security products and equipment to provide people with a safe living and working environment
  • the system achieves the effects of pre-warning, post-event control and processing, and protects the personal, life and property safety inside and outside buildings (buildings, communities, factories).
  • the narrowly defined security system is the Intruder Alarm System, which is divided into three parts: front-end alarm probes (including infrared detectors, microwave detectors, vibration cables, fences, opposite beams, emergency buttons, window magnets, smoke Sensor, temperature sensor, etc.), transmission part (including power line and signal line, transmission equipment) and alarm host.
  • Security systems in a broad sense include closed-circuit television monitoring system (CCTV System), access control system (Access Control System) and anti-theft alarm system (Intruder Alarm System).
  • the traditional security system generally uses CCTV to capture the video of the surveillance area.
  • security monitoring technology fails to combine 3D models and video streams to display the location of abnormal situations in a comprehensive and real-time manner, and most of them can only manually switch to the location of the abnormal situation after the alarm signal is triggered, which is low in intelligence. .
  • the purpose of the present invention is to provide a comprehensive, real-time and intelligent 3D real-scene visual monitoring switching display method and system.
  • the switching display method of 3D real scene visual monitoring includes the following steps:
  • the alarm signal switch to the alarm signal source in the 3D real-scene monitoring scene for display, wherein the 3D real-scene monitoring scene dynamically displays the video stream of the monitoring area in the 3D model of the monitoring environment.
  • the step of constructing a 3D real-life surveillance scene according to the three-dimensional data of the surveillance environment and the acquired video stream specifically includes:
  • the obtained video stream is superimposed on the 3D model of the monitoring environment, so as to obtain the superimposed 3D model as a 3D real monitoring scene.
  • the step of generating a 3D model of the monitoring environment and corresponding links according to the three-dimensional data of the monitoring environment specifically includes:
  • the intelligent processing includes model repair, editing, cropping, surface reduction, mold reduction, compression, material processing, texture processing, lighting processing, and compression rendering;
  • the step of constructing a 3D real-life surveillance scene according to the three-dimensional data of the surveillance environment and the acquired video stream also specifically includes:
  • step of obtaining the alarm signal is specifically:
  • step of switching to the alarm signal source in the 3D real-view monitoring scene to display according to the alarm signal is specifically as follows:
  • the alarm signal locate the position of the alarm signal source in the 3D real scene monitoring scene, and switch the lens to the positioned position for display.
  • the switching display system for 3D real-scene visual monitoring including:
  • the first obtaining module is used to obtain an alarm signal
  • the switching display module is used to switch to the alarm signal source in the 3D real-scene monitoring scene for display according to the alarm signal, wherein the 3D real-scene monitoring scene dynamically displays the video stream of the monitoring area in the 3D model of the monitoring environment.
  • the second acquisition module is used to acquire three-dimensional data of the monitoring environment
  • the third acquisition module is used to acquire the video stream of the surveillance area of the surveillance environment
  • the building module is used to construct a 3D real-life surveillance scene based on the 3D data of the surveillance environment and the acquired video stream.
  • the switching display system for 3D real-scene visual monitoring including:
  • At least one memory for storing programs
  • At least one processor is configured to execute the program to implement the switching display method for 3D real-scene visual monitoring of the present invention.
  • the switching display method and system for 3D real scene visual monitoring of the present invention can automatically switch to the alarm signal source in the 3D real scene monitoring scene for display after obtaining the alarm signal, eliminating the need for manual switching process, and more Timely and highly intelligent; through the 3D real-life monitoring scene based on the 3D model and video stream, a comprehensive and real-time display of the alarm signal source is realized.
  • FIG. 1 is a flowchart of a switching display method for 3D real scene visual monitoring according to an embodiment of the present invention.
  • first, second, third, etc. may be used in this disclosure to describe various elements, these elements should not be limited to these terms. These terms are only used to distinguish elements of the same type from each other.
  • first element may also be referred to as the second element, and similarly, the second element may also be referred to as the first element.
  • second element may also be referred to as the first element.
  • the use of any and all examples or exemplary language (“such as”, “such as”, etc.) provided herein is only intended to better illustrate the embodiments of the present invention, and unless otherwise required, will not impose limitations on the scope of the present invention .
  • the embodiment of the present invention discloses a switching display method for 3D real scene visual monitoring, which includes the following steps:
  • the alarm signal switch to the alarm signal source in the 3D real-scene monitoring scene for display, wherein the 3D real-scene monitoring scene dynamically displays the video stream of the monitoring area in the 3D model of the monitoring environment.
  • the alarm signal may be an acousto-optic signal, an image signal, etc., which may be acquired by an acousto-optic sensor, an image sensor, etc. in the monitoring environment.
  • the monitoring environment refers to the environment of security monitoring scenarios, such as a certain building, a certain community, etc.
  • the 3D model of the monitoring environment can be obtained by scanning, three-dimensional reconstruction and other processing of the monitoring environment, which can reflect the spatial information of the entire monitoring environment.
  • the video stream of the monitored area can be obtained through a video capture device such as CCTV installed in a certain monitored area, which can reflect the real-time information of the monitored area.
  • this embodiment constructs a 3D real-life monitoring scene through the 3D model of the monitoring environment and the video stream of the monitoring area, which can perform comprehensive and comprehensive monitoring of any monitoring area in the monitoring environment (including the alarm signal source area where abnormal conditions occur).
  • Real-time monitoring and display at the same time, after the alarm signal is obtained, it can automatically switch to the alarm signal source in the 3D real scene monitoring scene for display, eliminating the need for manual switching process, more timely and highly intelligent.
  • the three-dimensional data of the monitoring environment can be two-dimensional images, point cloud data of the monitoring environment, etc., which can be collected by manual or automatic scanning devices (such as cameras, automatic scanning robots, etc.).
  • the video stream of the monitoring area can be obtained through one or more video stream capturing devices.
  • the monitoring area can be preset according to the actual needs of security monitoring. For example, according to the requirements of security monitoring, a building has 32 security monitoring areas, and video stream capture devices can be set up in these 32 areas (such as corridors, corners, etc.) for real-time monitoring.
  • the step of constructing a 3D real-life surveillance scene based on the three-dimensional data of the surveillance environment and the acquired video stream specifically includes:
  • the obtained video stream is superimposed on the 3D model of the monitoring environment, so as to obtain the superimposed 3D model as a 3D real monitoring scene.
  • the 3D model of the monitoring environment can be displayed on a PC screen, a tablet computer (such as an IPAD) screen, a smartphone screen, or a browser.
  • the user only needs to access it through the corresponding link (such as URL link), which saves the process of loading the APP, which is more efficient and more convenient.
  • the 3D model of the monitoring environment is a virtual model, which allows users to browse or watch 360 degrees without blind spots, and can provide an immersive roaming experience service.
  • the 3D model of the monitoring environment is a 3D model of a certain building, and the user can access the 3D model only by entering the link corresponding to the 3D model in the browser, etc., so as to move forward, backward, and upward in the 3D model (such as moving from the 1st floor of the building to the 3rd floor, etc.), downgrade roaming experience operation.
  • the surveillance area of the security scene can be set in advance, after generating a 3D model of the surveillance environment, you only need to find the surveillance area in the 3D model and superimpose the real-time video stream captured by the video stream capture device on this area.
  • Continuous playback can dynamically display the 3D video stream of the monitoring area in the 3D model, which overcomes the defect that the 3D models obtained by traditional 3D scanning modeling technology are static, and truly realizes the real 3D monitoring of security monitoring scenes. Users can access the 3D model of the monitoring environment and the 3D video stream dynamically played or displayed in the 3D model through the link corresponding to the 3D model.
  • the present invention can truly realize the integration of the 3D model and the real-time video stream. Seam fusion, no matter how the environment changes and the angle changes, the real-time video stream can be viewed in the 3D model (that is, the real-time video stream is directly integrated into the 3D model, rather than simply fitting), regardless of the environment (such as The influence of the change of the scene) and the change of the angle.
  • this embodiment can obtain a 3D model of the security monitoring environment through 3D modeling, which facilitates users to roam the entire space of the security monitoring environment through the corresponding link; through real-time video captured by the monitoring area Stream is integrated into the 3D model of the security monitoring environment to realize the real 3D monitoring of the security monitoring scene, which meets the high requirements of security monitoring; at the same time, it also truly realizes the seamless integration of the 3D model and the real-time video stream, independent of the environment (such as the impact of the change of the scene and the change of the angle, the real-time video stream can still be viewed in the 3D model after the change of the environment or the angle.
  • the step of generating a 3D model of the monitoring environment and corresponding links according to the three-dimensional data of the monitoring environment specifically includes:
  • the intelligent processing includes model repair, editing, cropping, surface reduction, mold reduction, compression, material processing, texture processing, lighting processing, and compression rendering;
  • intelligent processing can automatically perform model repair, cropping, surface reduction, mold reduction, compression, material processing, texture processing, lighting processing, and compression rendering on the scanned three-dimensional data through AI algorithms, with a high degree of intelligence.
  • Intelligent processing can be realized through a background server or an application program set on a computing device.
  • the computing device may be, but not limited to, devices such as smart phones, tablet computers, notebook computers, smart watches, smart TVs, and computers.
  • the step of constructing a 3D real-world surveillance scene based on the three-dimensional data of the surveillance environment and the acquired video stream also specifically includes:
  • the superimposed 3D model and the corresponding link can be shared to attract more attention. For example, share the superimposed 3D model and the corresponding link to the Weibo client, WeChat client, and Facebook client (Facebook).
  • the step of obtaining an alarm signal is specifically:
  • a monitoring point is a point in the monitoring area, and its real-time video stream can be captured by CCTV and other equipment.
  • the step of switching to the alarm signal source in the 3D real-view monitoring scene to display according to the alarm signal is specifically as follows:
  • the alarm signal locate the position of the alarm signal source in the 3D real scene monitoring scene, and switch the lens to the positioned position for display.
  • the location of the alarm signal source can be found in the 3D real-life monitoring scene first, and then the camera can be automatically switched to the located alarm signal source for display.
  • the monitoring area can be set in advance, so the location of the alarm signal source can be quickly located according to the monitoring area of or near the sensor used to obtain the alarm signal.
  • the alarm signal is an audible alarm signal
  • the source of the audible alarm signal is the corner of the first floor corridor
  • the monitoring area to which the sound alarm signal source belongs is the first floor corridor
  • Step 1 Scan the 3D data of the building with indoor scanners and other equipment and upload the scanned 3D data to the back-end server;
  • Step 2 Capture the real-time video streams of the corners of the first corridor of the building and the first corridor of the building through CCTV and other devices and upload them to the background server;
  • Step 3 The background server calculates the 3D model of the building and the corresponding link according to the scanned 3D data
  • Step 4 The back-end server displays the 3D model of the building, and plays the corresponding real-time video stream on the first corridor in the 3D model of the building;
  • Step 5 After the background server obtains the sound alarm signal at the corner of the corridor on the 1st floor at a certain moment through the sound sensor, it locates the sound alarm signal source at the corner of the corridor on the 1st floor, and then moves the camera directly to the 1st floor At the corner of the corridor, combined with the real-time video stream played in the first corridor for display.
  • the embodiment of the present invention also discloses a switching display system for 3D real scene visual monitoring, including:
  • the first obtaining module is used to obtain an alarm signal
  • the switching display module is configured to switch to the alarm signal source in the 3D real-scene monitoring scene for display according to the alarm signal, wherein the 3D real-scene monitoring scene dynamically displays the video stream of the monitoring area in the 3D model of the monitoring environment.
  • the second acquisition module is used to acquire three-dimensional data of the monitoring environment
  • the third acquisition module is used to acquire the video stream of the surveillance area of the surveillance environment
  • the building module is used to construct a 3D real-world surveillance scene based on the three-dimensional data of the surveillance environment and the acquired video stream.
  • the embodiment of the present invention also discloses a switching display system for 3D real scene visual monitoring, including:
  • At least one memory for storing programs
  • At least one processor is configured to execute the program to implement the switching display method for 3D real-scene visual monitoring of the present invention.
  • the embodiments of the present invention can be realized or implemented by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable memory.
  • the method can be implemented in a computer program using standard programming techniques-including a non-transitory computer readable storage medium configured with a computer program, where the storage medium so configured allows the computer to operate in a specific and predefined manner-according to the specific
  • Each program can be implemented in a high-level process or object-oriented programming language to communicate with the computer system. However, if necessary, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.
  • the processes (or variants and/or combinations thereof) described herein can be executed under the control of one or more computer systems configured with executable instructions, and can be used as codes that are executed collectively on one or more processors (such as , Executable instructions, one or more computer programs, or one or more applications), implemented by hardware or a combination thereof.
  • the computer program includes a plurality of instructions executable by one or more processors.
  • the method can be implemented in any type of computing platform that is operably connected to a suitable computing platform, including but not limited to personal computers, minicomputers, main frames, workstations, networks or distributed computing environments, separate or integrated computers Platform, or communication with charged particle tools or other imaging devices, etc.
  • Aspects of the present invention can be implemented by machine-readable codes stored on non-transitory storage media or devices, whether removable or integrated into computing platforms, such as hard disks, optical reading and/or writing storage media, RAM, ROM, etc., so that they can be read by a programmable computer, and when the storage medium or device is read by the computer, it can be used to configure and operate the computer to perform the processes described herein.
  • machine-readable code or part thereof, can be transmitted through a wired or wireless network.
  • machine-readable media include instructions or programs that implement the steps described above in combination with a microprocessor or other data processors
  • the invention described herein includes these and other different types of non-transitory computer-readable storage media.
  • the present invention also includes the computer itself.
  • a computer program can be applied to input data to perform the functions described herein, thereby transforming the input data to generate output data that is stored in non-volatile memory.
  • the output information can also be applied to one or more output devices such as displays.
  • the converted data represents physical and tangible objects, including specific visual depictions of physical and tangible objects generated on the display.

Abstract

本发明公开了一种3D实景视觉监控的切换展示方法及系统，方法包括：获取警报信号；根据警报信号切换至3D实景监控场景内的警报信号源进行展示，其中，所述3D实景监控场景在监控环境的3D模型内动态展示监控区域的视频流。系统包括第一获取模块和切换展示模块。本发明在获取警报信号后，能自动切换至3D实景监控场景内的警报信号源进行展示，省去了手动切换过程，更加及时且智能化程度高；通过基于3D模型和视频流的3D实景监控场景，实现了对警报信号源的全面和实时显示。本发明可广泛应用于安防监控领域。

Description

3D实景视觉监控的切换展示方法及系统 技术领域
本发明涉及安防监控领域，尤其是3D实景视觉监控的切换展示方法及系统。
背景技术
安全防范系统(简称安防系统，Security System)就是利用音视频、红外、探测、微波、控制、通信等多种科学技术、采用各种安防产品和设备，给人们提供一个安全的生活和工作环境的系统，达到事先预警、事后控制和处理的效果，保护建筑(大厦、小区、工厂)内外人身及生命财产安全。
狭义的安全防范系统就是防盗报警系统(Intruder Alarm System)，分为三部分构成：前端报警探头(包括红外探测器、微波探测器、震动电缆、围栏、对射、紧急按钮、窗门磁、烟感、温感等)、传输部分(包括电源线和信号线、传输设备)和报警主机组成。广义的安全防范系统包括闭路电视监控系统(CCTV System)、门禁系统(Access Control System)和防盗报警系统(Intruder Alarm System)。传统的安全防范系统一般通过CCTV来捕捉监控区域的视频。
随着安防安保监控技术的不断进步，人们对安防安保监控技术提出了新要求，需要在安防安保监控环境(如某栋楼的空间，可包含多个楼层和多个监控点或监控区域)出现异常情况(如某个监控区域内出现人的尖叫声等)时能及时切换至异常情况的出现地点并报警，以便于快速进行响应。目前安防安保监控技术未能结合3D模型和视频流来对异常情况的出现地点进行全面和实时的展示，且大多只能在报警信号被触发后手动切换至异常情况的出现地点，智能化程度低。
发明内容
为解决上述技术问题，本发明的目的在于：提供一种全面、实时和智能的3D实景视觉监控的切换展示方法及系统。
本发明一方面所采取的技术方案是：
3D实景视觉监控的切换展示方法，包括以下步骤：
获取警报信号；
根据警报信号切换至3D实景监控场景内的警报信号源进行展示，其中，所述3D实景监控场景在监控环境的3D模型内动态展示监控区域的视频流。
进一步，还包括以下步骤：
获取监控环境的三维数据；
获取监控环境的监控区域的视频流；
根据监控环境的三维数据和获取的视频流构建3D实景监控场景。
进一步，所述根据监控环境的三维数据和获取的视频流构建3D实景监控场景这一步骤，具体包括：
根据监控环境的三维数据生成监控环境的3D模型和对应的链接；
将获取的视频流叠加到监控环境的3D模型上，从而得到叠加后的3D模型作为3D实景监控场景。
进一步，所述根据监控环境的三维数据生成监控环境的3D模型和对应的链接这一步骤，具体包括：
根据监控环境的三维数据进行智能处理，得到监控环境的3D模型，所述智能处理包括模型修复、剪辑、裁剪、减面、减模、压缩、处理材质、处理贴图、处理灯光和压缩渲染；
根据监控环境的3D模型生成对应的链接；
存储生成的链接。
进一步，所述根据监控环境的三维数据和获取的视频流构建3D实景监控场景这一步骤，还具体包括：
将叠加后的3D模型和对应的链接进行分享和展示。
进一步，所述获取警报信号这一步骤，具体为：
获取监控环境内一个或多个监控点的声音信号、图像信号和光信号中的至少一种作为警报信号。
进一步，所述根据警报信号切换至3D实景监控场景内的警报信号源进行展示这一步骤，具体为：
根据警报信号定位警报信号源在3D实景监控场景内的位置，并将镜头切换至定位的位置进行展示。
本发明另一方面所采取的技术方案是：
3D实景视觉监控的切换展示系统，包括：
第一获取模块，用于获取警报信号；
切换展示模块，用于根据警报信号切换至3D实景监控场景内的警报信号源进行展示，其中，所述3D实景监控场景在监控环境的3D模型内动态展示监控区域的视频流。
进一步，还包括：
第二获取模块，用于获取监控环境的三维数据；
第三获取模块，用于获取监控环境的监控区域的视频流；
构建模块，用于根据监控环境的三维数据和获取的视频流构建3D实景监控场景。
本发明另一方面所采取的技术方案是：
3D实景视觉监控的切换展示系统，包括：
至少一个存储器，用于存储程序；
至少一个处理器，用于执行所述程序以实现本发明所述的3D实景视觉监控的切换展示方法。
本发明的有益效果是：本发明3D实景视觉监控的切换展示方法及系统，在获取警报信号后，能自动切换至3D实景监控场景内的警报信号源进行展示，省去了手动切换过程，更加及时且智能化程度高；通过基于3D模型和视频流的3D实景监控场景，实现了对警报信号源的全面和实时显示。
附图说明
图1为本发明实施例3D实景视觉监控的切换展示方法的流程图。
具体实施方式
以下将结合实施例和附图对本发明的构思、具体结构及产生的技术效果进行清楚、完整的描述，以充分地理解本发明的目的、方案和效果。
需要说明的是，如无特殊说明，当某一特征被称为“固定”、“连接”在另一个特征，它可以直接固定、连接在另一个特征上，也可以间接地固定、连接在另一个特征上。此外，本公开中所使用的上、下、左、右等描述仅仅是相对于附图中本公开各组成部分的相互位置关系来说的。在本公开中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式，除非上下文清楚地表示其他含义。此外，除非另有定义，本文所使用的所有的技术和科学术语与本技术领域的技术人员通常理解的含义相同。本文说明书中所使用的术语只是为了描述具体的实施例，而不是为了限制本发明。本文所使用的术语“和/或”包括一个或多个相关的所列项目的任意的组合。
应当理解，尽管在本公开可能采用术语第一、第二、第三等来描述各种元件，但这些元件不应限于这些术语。这些术语仅用来将同一类型的元件彼此区分开。例如，在不脱离本公开范围的情况下，第一元件也可以被称为第二元件，类似地，第二元件也可以被称为第一元件。本文所提供的任何以及所有实例或示例性语言(“例如”、“如”等)的 使用仅意图更好地说明本发明的实施例，并且除非另外要求，否则不会对本发明的范围施加限制。
如图1所示，本发明实施例公开了一种3D实景视觉监控的切换展示方法，包括以下步骤：
获取警报信号；
根据警报信号切换至3D实景监控场景内的警报信号源进行展示，其中，所述3D实景监控场景在监控环境的3D模型内动态展示监控区域的视频流。
具体地，警报信号可以是声光信号、图像信号等，其可以通过监控环境内的声光传感器、图像传感器等获取。
监控环境是指安防安保监控场景的环境，如某栋大楼、某个小区等。
监控环境的3D模型可以通过对监控环境进行扫描、三维重建等处理后得到，能反映整个监控环境的空间信息。
监控区域的视频流可以通过安装在某个监控区域的CCTV等视频捕捉装置获取，其能反映监控区域的实时信息。
由上述内容可见，本实施例通过监控环境的3D模型和监控区域的视频流构建了3D实景监控场景，能对监控环境内的任意监控区域(包括发生异常情况的警报信号源区域)进行全面和实时的监控与展示；同时在获取警报信号后，能自动切换至3D实景监控场景内的警报信号源进行展示，省去了手动切换过程，更加及时且智能化程度高。
进一步作为优选的实施方式，还包括以下步骤：
获取监控环境的三维数据；
获取监控环境的监控区域的视频流；
根据监控环境的三维数据和获取的视频流构建3D实景监控场景。
具体地，监控环境的三维数据可以是二维的图像、监控环境的点云数据等，其可通过各手动或自动的扫描设备(如相机、自动扫描机器人等)来采集。
具体地，监控区域的视频流可以通过一个或多个视频流捕捉装置来获取。监控区域可根据安防安保监控的实际需要而预先设定。例如，根据安防安保监控的要求，某栋楼的安防监控区域共32个，可分别在这32个区域(如楼道、拐角处等)分别设置视频流捕捉装置来进行实时监控。
进一步作为优选的实施方式，所述根据监控环境的三维数据和获取的视频流构建3D实景监控场景这一步骤，具体包括：
根据监控环境的三维数据生成监控环境的3D模型和对应的链接；
将获取的视频流叠加到监控环境的3D模型上，从而得到叠加后的3D模型作为3D实景监控场景。
具体地，监控环境的3D模型可展示在PC电脑屏、平板电脑(如IPAD)屏、智能手机屏或浏览器上。用户只需通过相应的链接(如URL链接)进行访问即可，省去了装载APP的过程，效率更高且更加方便。
优选地，监控环境的3D模型是虚拟的模型，可供用户进行360度无死角的浏览或观看，而且可以提供沉浸式漫游体验服务。例如监控环境的3D模型为某栋楼的3D模型，用户只需通过在浏览器等中输入该3D模型对应的链接即可访问该3D模型，从而在该3D模型中进行前进、后退、向上(如由该栋楼的第1层移动到第3层等)、向下等漫游体验操作。
由于安防安保场景的监控区域可以预先设定，所以生成监控环境的3D模型后，只需通过在该3D模型中找出监控区域并将视频流捕捉装置采集的实时视频流视叠加在该区域进行持续播放，即可在3D模型内动态展示监控区域的3D视频流，克服了传统3D扫描建模技术得到的3D模型都是静态的缺陷，真正实现了安防安保监控场景的实景3D监控。用户通过3D模型对应的链接即可访问监控环境的3D模型以及在3D模型内动态播放或展示的3D视频流。此外，与在3D模型上直接贴合上一个透明视频的简单贴合方案不同的是，由于集成到3D模型中的视频流是实时视频流，本发明可真正实现3D模型与实时视频流的无缝融合，不论环境如何改变和角度如何改变都能在3D模型中观看到该实时视频流(即实时视频流是直接融合到3D模型中的，而不是简单的贴合)，不受环境(如场景)的改变和角度的改变的影响。
由上述内容可见，本实施例能通过3D建模得到安防安保监控环境的3D模型，方便了用户通过对应的链接对安防安保监控环境的整个空间进行沉浸式漫游；通过将监控区域捕捉的实时视频流集成到安防安保监控环境的3D模型内实现了安防安保监控场景的实景3D监控，满足了安防安保监控的高要求；同时也真正实现3D模型与实时视频流的无缝融合，不受环境(如场景)的改变和角度的改变的影响，在环境改变或角度改变后仍能在3D模型中观看到该实时视频流。
进一步作为优选的实施方式，所述根据监控环境的三维数据生成监控环境的3D模型和对应的链接这一步骤，具体包括：
根据监控环境的三维数据进行智能处理，得到监控环境的3D模型，所述智能处理 包括模型修复、剪辑、裁剪、减面、减模、压缩、处理材质、处理贴图、处理灯光和压缩渲染；
根据监控环境的3D模型生成对应的链接；
存储生成的链接。
具体地，智能处理可通过AI算法自动对扫描的三维数据进行模型修复、裁剪、减面、减模、压缩、处理材质、处理贴图、处理灯光和压缩渲染等处理，智能化程度高。
智能处理可以通过后台服务器或设置在计算设备上的应用程序来实现。优选地，计算设备可以是但不限于智能手机、平板电脑、笔记本电脑、智能手表、智能电视、计算机等设备。
进一步作为优选的实施方式，所述根据监控环境的三维数据和获取的视频流构建3D实景监控场景这一步骤，还具体包括：
将叠加后的3D模型和对应的链接进行分享和展示。
具体地，可以分享叠加后的3D模型及对应的链接，以吸引更多的关注。比如将叠加后的3D模型及对应的链接分享至微博客户端、微信客户端和脸书客户端(Facebook)等。
进一步作为优选的实施方式，所述获取警报信号这一步骤，具体为：
获取监控环境内一个或多个监控点的声音信号、图像信号和光信号中的至少一种作为警报信号。
具体地，监控点为监控区域内的点，其实时视频流可被CCTV等设备捕捉到。
进一步作为优选的实施方式，所述根据警报信号切换至3D实景监控场景内的警报信号源进行展示这一步骤，具体为：
根据警报信号定位警报信号源在3D实景监控场景内的位置，并将镜头切换至定位的位置进行展示。
具体地，可先在3D实景监控场景内中找出警报信号源的位置，后续即可将镜头自动切换至定位的警报信号源进行展示。监控区域是可以预先设定的，故定位时可以根据用于获取警报信号的传感器所属或附近的监控区域来快速定位出警报信号源的位置。
以监控环境为某栋楼，警报信号为声音警报信号，声音警报信号源为1楼楼道的拐角，声音警报信号源所属的监控区域为1楼楼道，基于本发明的3D实景视觉监控的切换展示方法，本具体实施例的实现过程如下：
步骤1：通过室内扫描仪等设备扫描该栋楼的三维数据并将扫描的三维数据上传给 后台服务器；
步骤2：通过CCTV等装置捕捉该栋楼1楼道和该栋楼1楼道拐角的实时视频流并上传给后台服务器；
步骤3：后台服务器根据扫描的三维数据计算得到该栋楼的3D模型和对应的链接；
步骤4：后台服务器展示该栋楼的3D模型，并在该栋楼的3D模型内1楼道处播放对应的实时视频流；
步骤5：后台服务器通过声音传感器在某一时刻获取到1楼楼道的拐角处的声音警报信号后，定位出声音警报信号源的位置为1楼楼道的拐角处，然后将镜头直接移动到1楼楼道的拐角处，并结合1楼道处播放的实时视频流进行展示。
与图1的方法相对应，本发明实施例还公开了一种3D实景视觉监控的切换展示系统，包括：
第一获取模块，用于获取警报信号；
切换展示模块，用于根据警报信号切换至3D实景监控场景内的警报信号源进行展示，其中，所述3D实景监控场景在监控环境的3D模型内动态展示监控区域的视频流。
上述方法实施例中的内容均适用于本系统实施例中，本系统实施例所具体实现的功能与上述方法实施例相同，并且达到的有益效果与上述方法实施例所达到的有益效果也相同。
进一步作为优选的实施方式，还包括：
第二获取模块，用于获取监控环境的三维数据；
第三获取模块，用于获取监控环境的监控区域的视频流；
构建模块，用于根据监控环境的三维数据和获取的视频流构建3D实景监控场景。
与图1的方法相对应，本发明实施例还公开了一种3D实景视觉监控的切换展示系统，包括：
至少一个存储器，用于存储程序；
至少一个处理器，用于执行所述程序以实现本发明所述的3D实景视觉监控的切换展示方法。
上述方法实施例中的内容均适用于本系统实施例中，本系统实施例所具体实现的功能与上述方法实施例相同，并且达到的有益效果与上述方法实施例所达到的有益效果也相同。
应当认识到，本发明的实施例可以由计算机硬件、硬件和软件的组合、或者通过存 储在非暂时性计算机可读存储器中的计算机指令来实现或实施。所述方法可以使用标准编程技术-包括配置有计算机程序的非暂时性计算机可读存储介质在计算机程序中实现，其中如此配置的存储介质使得计算机以特定和预定义的方式操作——根据在具体实施例中描述的方法和附图。每个程序可以以高级过程或面向对象的编程语言来实现以与计算机系统通信。然而，若需要，该程序可以以汇编或机器语言实现。在任何情况下，该语言可以是编译或解释的语言。此外，为此目的该程序能够在编程的专用集成电路上运行。
此外，可按任何合适的顺序来执行本文描述的过程的操作，除非本文另外指示或以其他方式明显地与上下文矛盾。本文描述的过程(或变型和/或其组合)可在配置有可执行指令的一个或多个计算机系统的控制下执行，并且可作为共同地在一个或多个处理器上执行的代码(例如，可执行指令、一个或多个计算机程序或一个或多个应用)、由硬件或其组合来实现。所述计算机程序包括可由一个或多个处理器执行的多个指令。
进一步，所述方法可以在可操作地连接至合适的任何类型的计算平台中实现，包括但不限于个人电脑、迷你计算机、主框架、工作站、网络或分布式计算环境、单独的或集成的计算机平台、或者与带电粒子工具或其它成像装置通信等等。本发明的各方面可以以存储在非暂时性存储介质或设备上的机器可读代码来实现，无论是可移动的还是集成至计算平台，如硬盘、光学读取和/或写入存储介质、RAM、ROM等，使得其可由可编程计算机读取，当存储介质或设备由计算机读取时可用于配置和操作计算机以执行在此所描述的过程。此外，机器可读代码，或其部分可以通过有线或无线网络传输。当此类媒体包括结合微处理器或其他数据处理器实现上文所述步骤的指令或程序时，本文所述的发明包括这些和其他不同类型的非暂时性计算机可读存储介质。当根据本发明所述的方法和技术编程时，本发明还包括计算机本身。
计算机程序能够应用于输入数据以执行本文所述的功能，从而转换输入数据以生成存储至非易失性存储器的输出数据。输出信息还可以应用于一个或多个输出设备如显示器。在本发明优选的实施例中，转换的数据表示物理和有形的对象，包括显示器上产生的物理和有形对象的特定视觉描绘。
以上是对本发明的较佳实施进行了具体说明，但本发明并不限于所述实施例，熟悉本领域的技术人员在不违背本发明精神的前提下还可做作出种种的等同变形或替换，这些等同的变形或替换均包含在本申请权利要求所限定的范围内。

Claims (10)

  1. 3D实景视觉监控的切换展示方法，其特征在于：包括以下步骤：
    获取警报信号；
    根据警报信号切换至3D实景监控场景内的警报信号源进行展示，其中，所述3D实景监控场景在监控环境的3D模型内动态展示监控区域的视频流。
  2. 根据权利要求1所述的3D实景视觉监控的切换展示方法，其特征在于：还包括以下步骤：
    获取监控环境的三维数据；
    获取监控环境的监控区域的视频流；
    根据监控环境的三维数据和获取的视频流构建3D实景监控场景。
  3. 根据权利要求2所述的3D实景视觉监控的切换展示方法，其特征在于：所述根据监控环境的三维数据和获取的视频流构建3D实景监控场景这一步骤，具体包括：
    根据监控环境的三维数据生成监控环境的3D模型和对应的链接；
    将获取的视频流叠加到监控环境的3D模型上，从而得到叠加后的3D模型作为3D实景监控场景。
  4. 根据权利要求3所述的3D实景视觉监控的切换展示方法，其特征在于：所述根据监控环境的三维数据生成监控环境的3D模型和对应的链接这一步骤，具体包括：
    根据监控环境的三维数据进行智能处理，得到监控环境的3D模型，所述智能处理包括模型修复、剪辑、裁剪、减面、减模、压缩、处理材质、处理贴图、处理灯光和压缩渲染；
    根据监控环境的3D模型生成对应的链接；
    存储生成的链接。
  5. 根据权利要求3所述的3D实景视觉监控的切换展示方法，其特征在于：所述根据监控环境的三维数据和获取的视频流构建3D实景监控场景这一步骤，还具体包括：
    将叠加后的3D模型和对应的链接进行分享和展示。
  6. 根据权利要求1所述的3D实景视觉监控的切换展示方法，其特征在于：所述获取警报信号这一步骤，具体为：
    获取监控环境内一个或多个监控点的声音信号、图像信号和光信号中的至少一种作为警报信号。
  7. 根据权利要求1所述的3D实景视觉监控的切换展示方法，其特征在于：所述根据警报信号切换至3D实景监控场景内的警报信号源进行展示这一步骤，具体为：
    根据警报信号定位警报信号源在3D实景监控场景内的位置，并将镜头切换至定位 的位置进行展示。
  8. 3D实景视觉监控的切换展示系统，其特征在于：包括：
    第一获取模块，用于获取警报信号；
    切换展示模块，用于根据警报信号切换至3D实景监控场景内的警报信号源进行展示，其中，所述3D实景监控场景在监控环境的3D模型内动态展示监控区域的视频流。
  9. 根据权利要求8所述的3D实景视觉监控的切换展示系统，其特征在于：还包括：
    第二获取模块，用于获取监控环境的三维数据；
    第三获取模块，用于获取监控环境的监控区域的视频流；
    构建模块，用于根据监控环境的三维数据和获取的视频流构建3D实景监控场景。
  10. 3D实景视觉监控的切换展示系统，其特征在于：包括：
    至少一个存储器，用于存储程序；
    至少一个处理器，用于执行所述程序以实现如权利要求1-7任一项所述的3D实景视觉监控的切换展示方法。
PCT/CN2019/126936 2019-01-23 2019-12-20 3d实景视觉监控的切换展示方法及系统 WO2020151425A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910065045.XA CN109889777A (zh) 2019-01-23 2019-01-23 3d实景视觉监控的切换展示方法及系统
CN201910065045.X 2019-01-23

Publications (1)

Publication Number Publication Date
WO2020151425A1 true WO2020151425A1 (zh) 2020-07-30

Family

ID=66926634

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/126936 WO2020151425A1 (zh) 2019-01-23 2019-12-20 3d实景视觉监控的切换展示方法及系统

Country Status (2)

Country Link
CN (1) CN109889777A (zh)
WO (1) WO2020151425A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109905664A (zh) * 2019-01-23 2019-06-18 广东康云科技有限公司 实景3d智能视觉监控系统及方法
CN109889777A (zh) * 2019-01-23 2019-06-14 广东康云科技有限公司 3d实景视觉监控的切换展示方法及系统
CN110310306A (zh) * 2019-05-14 2019-10-08 广东康云科技有限公司 基于实景建模与智能识别的目标跟踪方法、系统及介质
CN110311468A (zh) * 2019-06-26 2019-10-08 广东康云科技有限公司 变电站三维实景异常监控方法、系统、装置及存储介质
CN111696204A (zh) * 2020-05-06 2020-09-22 广东康云科技有限公司 一种可视化调度方法、系统、装置及存储介质
CN112182286B (zh) * 2020-09-04 2022-11-18 中国电子科技集团公司电子科学研究院 一种基于三维实景地图的智能视频管控方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103716586A (zh) * 2013-12-12 2014-04-09 中国科学院深圳先进技术研究院 一种基于三维空间场景的监控视频融合系统和方法
CN104618694A (zh) * 2015-03-02 2015-05-13 国家电网公司 一种机房三维动态监测的方法及系统
US20150381948A1 (en) * 2014-04-10 2015-12-31 Smartvue Corporation Systems and Methods for Automated Cloud-Based Analytics for Security Surveillance Systems with Mobile Input Capture Devices
CN109085966A (zh) * 2018-06-15 2018-12-25 广东康云多维视觉智能科技有限公司 一种基于云计算的三维展示系统及方法
CN109889777A (zh) * 2019-01-23 2019-06-14 广东康云科技有限公司 3d实景视觉监控的切换展示方法及系统
CN109905664A (zh) * 2019-01-23 2019-06-18 广东康云科技有限公司 实景3d智能视觉监控系统及方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10751609B2 (en) * 2016-08-12 2020-08-25 Zero Latency PTY LTD Mapping arena movements into a 3-D virtual world
CN107038754A (zh) * 2017-03-15 2017-08-11 武汉华安科技股份有限公司 一种基于三维实景的智慧园区管理系统及方法
CN107170033A (zh) * 2017-04-12 2017-09-15 青岛市光电工程技术研究院 基于激光雷达技术的智慧城市3d实景地图系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103716586A (zh) * 2013-12-12 2014-04-09 中国科学院深圳先进技术研究院 一种基于三维空间场景的监控视频融合系统和方法
US20150381948A1 (en) * 2014-04-10 2015-12-31 Smartvue Corporation Systems and Methods for Automated Cloud-Based Analytics for Security Surveillance Systems with Mobile Input Capture Devices
CN104618694A (zh) * 2015-03-02 2015-05-13 国家电网公司 一种机房三维动态监测的方法及系统
CN109085966A (zh) * 2018-06-15 2018-12-25 广东康云多维视觉智能科技有限公司 一种基于云计算的三维展示系统及方法
CN109889777A (zh) * 2019-01-23 2019-06-14 广东康云科技有限公司 3d实景视觉监控的切换展示方法及系统
CN109905664A (zh) * 2019-01-23 2019-06-18 广东康云科技有限公司 实景3d智能视觉监控系统及方法

Also Published As

Publication number Publication date
CN109889777A (zh) 2019-06-14

Similar Documents

Publication Publication Date Title
WO2020151425A1 (zh) 3d实景视觉监控的切换展示方法及系统
WO2020151428A1 (zh) 实景3d智能视觉监控系统及方法
WO2020228769A1 (zh) 一种基于变电站的3d实景巡视方法、系统和存储介质
US9854206B1 (en) Privacy-aware indoor drone exploration and communication framework
US20180270427A1 (en) System and method for creating metadata model to improve multi-camera production
US20130021433A1 (en) Overview configuration and control method for ptz cameras
US20170337747A1 (en) Systems and methods for using an avatar to market a product
US20170169614A1 (en) Hybrid reality based object interaction and control
US10270959B1 (en) Creating preview images for controlling pan and tilt cameras
CN111448568B (zh) 基于环境的应用演示
CN112835304B (zh) 展厅控制方法及系统、控制终端、后台服务器和中控主机
WO2020228768A1 (zh) 一种3d智能教育监控方法、系统和存储介质
WO2020211431A1 (zh) 应用于园区的资源信息处理管理系统
WO2020151255A1 (zh) 一种基于移动终端的展示控制系统及方法
KR102249498B1 (ko) 이벤트 검색 장치 및 시스템
US20220070412A1 (en) Communication terminal, image communication system, method of displaying image, and recording medium
EP3398029B1 (en) Intelligent smart room control system
US20180213185A1 (en) Method and system for monitoring a scene based on a panoramic view
CN111064947A (zh) 基于全景的视频融合方法、系统、装置和存储介质
KR102527771B1 (ko) Tof 카메라와 디지털 트윈기술을 이용한 독거노인 행동관찰 및 이상행위 모니터링 시스템 및 방법
WO2020151429A1 (zh) 一种机器狗系统及其实现方法
CN111064946A (zh) 基于室内场景的视频融合方法、系统、装置和存储介质
JP2023063251A (ja) ビデオストリームを送信するための方法およびシステム
US11627318B2 (en) Method and system for producing streams of image frames
JP6004978B2 (ja) 被写体画像抽出装置および被写体画像抽出・合成装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19912049

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19912049

Country of ref document: EP

Kind code of ref document: A1