CN112950773A

CN112950773A - Data processing method and device based on building information model and processing server

Info

Publication number: CN112950773A
Application number: CN202110375667.XA
Authority: CN
Inventors: 何祥伟
Original assignee: Wanyi Technology Co Ltd
Current assignee: Shenzhen Wanyi Digital Technology Co ltd
Priority date: 2021-04-07
Filing date: 2021-04-07
Publication date: 2021-06-11

Abstract

The embodiment of the application discloses a data processing method and device based on a building information model and a processing server, wherein the method comprises the following steps: acquiring BIM data of a building information model; performing three-dimensional visualization on the target building structure according to the BIM data to display a three-dimensional building model; acquiring first data and second data of a target event occurring for a target building structure; determining the event type of the target event according to the first data, and determining a component corresponding to the event type of the target event from the BIM data to obtain a target component; determining a corresponding target coordinate of the occurrence point of the target event in a coordinate system of the three-dimensional building module according to the second data; and displaying the target component at the target coordinate of the three-dimensional building model, thereby realizing real-time remote visual monitoring of the events of the building structure of the monitored area through data processing, and ensuring that a user can timely know and process the events.

Description

Data processing method and device based on building information model and processing server

Technical Field

The application relates to the technical field of computer data processing, in particular to a data processing method and device based on a building information model and a processing server.

Background

The Building Information Modeling (BIM) is a datamation tool applied to engineering design, construction and management, and can take various related Information data of a Building engineering project as a model base, accurately record geometric Information and non-geometric Information of Building components in detail and display a three-dimensional model, thereby having the advantages of improving production efficiency, saving cost, shortening construction period and the like.

Because the areas where building structures such as residential buildings, office buildings, construction sites, schools and the like are located may have the occurrence of events such as fire, article theft, high-altitude object throwing, pedestrian falling, construction maintenance and the like, how to use the BIM technology to perform real-time remote visual monitoring on the building structures in the areas is convenient for users to timely respond to the occurring events, and further consideration is needed.

Disclosure of Invention

The embodiment of the application provides a data processing method and device based on a building information model and a processing server, so that the real-time remote visual monitoring of events occurring in building structures in a monitored area is expected to be realized through data processing, and a user is ensured to know and process the occurring events in time.

In a first aspect, an embodiment of the present application provides a data processing method based on a building information model, including:

acquiring BIM data of a building information model, wherein the BIM data comprises members of the BIM for modeling a target building structure located in a monitoring area;

performing three-dimensional visualization on the target building structure according to the BIM data to display a three-dimensional building model;

acquiring first data and second data of a target event occurring aiming at the target building structure, wherein the first data is used for representing image information or voice information collected aiming at the target event detection, and the second data is used for representing position information of an occurrence place of the target event;

determining the event type of the target event according to the first data, and determining a component corresponding to the event type of the target event from the BIM data to obtain a target component;

determining a corresponding target coordinate of the occurrence point of the target event in a coordinate system of the three-dimensional building module according to the second data;

displaying the target member at the target coordinates of the three-dimensional architectural model.

In a second aspect, an embodiment of the present application provides a data processing apparatus based on a building information model, the apparatus including a processing unit, configured to:

In a third aspect, an embodiment of the present application provides a processing server, including a processor, a memory and a communication interface, where the memory stores one or more programs, and the one or more programs are executed by the processor, and the one or more programs are used to execute the instructions of the steps in the first aspect of the embodiment of the present application.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, and the computer program is operable to cause a computer to perform some or all of the steps described in the first aspect of the embodiments of the present application.

In a fifth aspect, the present application provides a computer program product, where the computer program product includes a computer program operable to cause a computer to perform some or all of the steps described in the first aspect of the present application. The computer program product may be a software installation package.

It can be seen that, in the embodiment of the application, firstly, the three-dimensional visual modeling is performed on the overall building layout of the target building structure located in the monitoring area through the acquired BIM data, so that the building structure of the monitoring area is remotely visually displayed in real time through the BIM technology. Secondly, the event type of the target event is determined by detecting the acquired image information or voice information aiming at the target event, and a component corresponding to the event type of the target event is determined from the BIM data to obtain a target component. And finally, determining a target coordinate corresponding to the occurrence point of the target event in a coordinate system of the three-dimensional building module according to the position information of the occurrence point of the target event, and displaying the target member at the target coordinate of the three-dimensional building model, so that the member corresponding to the event type of the event is displayed to a user on the coordinate corresponding to the three-dimensional building model, and further, the real-time remote visual monitoring of the event occurring in the building structure of the monitored area is realized through data processing, and the user can be ensured to know and process the occurring event in time.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It is to be expressly understood that the drawings described below are only illustrative of some embodiments of the invention. It is also possible for a person skilled in the art to derive other figures from these figures without inventive effort.

FIG. 1 is a block diagram of a data processing system according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a processing server according to an embodiment of the present application;

FIG. 3 is a schematic flow chart of a data processing method based on a building information model according to an embodiment of the present application;

FIG. 4 is a block diagram of functional units of a data processing apparatus based on a building information model according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of another processing server provided in an embodiment of the present application.

Detailed Description

In order to better understand the technical solutions of the present application, the following description is given for clarity and completeness in conjunction with the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the description of the embodiments of the present application without inventive step, are within the scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, software, product, or apparatus that comprises a list of steps or elements is not limited to those listed but may include other steps or elements not listed or inherent to such process, method, product, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

Before describing the technical solutions of the embodiments of the present application, the following describes related concepts, data processing systems, processing servers, terminal devices, and the like, which may be related to the present application.

The data processing system of the embodiment of the application may specifically include a processing server, a BIM management server, a terminal device, a sound collection device, an image collection device, and the like. The processing server can communicate with the terminal equipment through a wireless network, the processing server can communicate with the BIM management server through the wireless network or a wired network, the processing server can communicate with the sound acquisition equipment through the wireless network or the wired network, and the processing server can communicate with the image acquisition equipment through the wireless network or the wired network.

Specifically, the wireless network may include a mobile cellular network (such as a fourth generation 4G or fifth generation 5G mobile communication network), a satellite communication network (NTN), an internet of things (IOT), a vehicle networking (V2X), a Wireless Local Area Network (WLAN), a Wide Area Network (WAN), a Bluetooth (BT), a wireless fidelity (Wi-Fi), a Zigbee (short range), a Near Field Communication (NFC), an Ultra Wideband (UWB), a visible light communication (light fidelity, LiFi), an infrared technology (IR), and the like; the wired network may be a network constructed by a serial transmission interface data line, an asynchronous transmission interface (e.g., RS-232) data line, a Universal Serial Bus (USB) data line, and the like.

(1) Processing server

The processing server may be a software and hardware unit configured to perform real-time monitoring on an event occurring in a building structure of the monitored area, perform three-dimensional visual display on the building structure of the monitored area, and display a component corresponding to the event type to a user on a coordinate corresponding to the visual three-dimensional building model.

It should be noted that the processing server in the embodiment of the present application may be a Software As A Service (SAAS) platform. In addition, the processing server of the embodiment of the application can autonomously perform three-dimensional visual display on the building structure of the monitored area, and can also perform three-dimensional visual display on the building structure of the monitored area through the control terminal device. Similarly, the processing server in the embodiment of the application may autonomously display the component corresponding to the event type to the user on the coordinate corresponding to the visual three-dimensional building model, and may display the component corresponding to the event type to the user on the coordinate corresponding to the visual three-dimensional building model through the control terminal device, which is not particularly limited in this regard.

The processing server can establish the BIM through a level of detail (LOD) technology, so that the modeling accuracy of the BIM is improved.

The processing server may carry a phantom engine 4 (UE 4), perform rendering processing on the BIM model by using the UE4 to obtain a high-definition building model, and add an interaction function to the high-definition building model by using the UE4 to obtain a three-dimensional building model. For example, the above-described interactive functions may include moving, zooming, switching the view angle, and the like of the three-dimensional architectural model.

The processing server in the embodiment of the present application may be various cloud servers, internet of things servers, web servers, application servers, load balancers (Nginx), data center devices, Personal Computers (PCs), computing devices, network devices in a 5G system, network devices in a Public Land Mobile Network (PLMN) for future evolution, and the like, which are used to provide a data processing function based on a building information model, and is not particularly limited in this respect.

(2) BIM management server

The BIM management server may be a software and hardware unit for storing and managing various engineering drawings for the building structure, building the engineering drawings to obtain BIM data, and providing the BIM data to the processing server.

It should be noted that the processing server in the embodiment of the present application may be a Software As A Service (SAAS) platform.

The BIM management server can create a basic building model, namely a BIM model according to engineering drawings. The engineering drawings may include Computer Aided Design (CAD) drawings for parking lot Modeling, Building Information Modeling (BIM) drawings, and the like. It should be noted that the engineering drawing may refer to an executable file generated by BIM software, and the BIM software may include AutoCAD, Revit Structure, ArchiCAD, Bentley System, Tekla Structure, Digital Project, and the like.

The BIM management server can identify the engineering drawing and carry out component processing on each area in the engineering drawing so as to obtain BIM data containing geometric information and non-geometric information of various components.

The BIM management server can classify, store and manage geometric information and non-geometric information of various components in the BIM data, so that the efficiency of retrieving and searching the BIM data by classes of the processing server is improved.

The BIM management server in the embodiment of the present application may be various cloud servers for providing BIM data, internet of things servers, data center equipment, Personal Computers (PCs), computing equipment, network equipment in a 5G system, network equipment in a Public Land Mobile Network (PLMN) for future evolution, and the like.

It should be noted that the processing server and the BIM management server in the embodiment of the present application may be integrated in the same software and hardware unit to implement the corresponding functions, or may be used as separate software and hardware units to implement the corresponding functions respectively. The processing server and the BIM management server in the embodiment of the present application may be integrated in a Software As A Service (SAAS) platform to implement the corresponding functions described above.

(3) Terminal device

The terminal device may be a device for performing three-dimensional visual display on the building structure of the monitored area according to the BIM data sent by the processing server, and displaying the component corresponding to the event type to the user on the coordinates corresponding to the visual three-dimensional building model.

The terminal device may install a client (such as an application program, a browser, and the like) communicating with the processing server, so as to display the three-dimensional building model and display the member corresponding to the event type on the coordinates corresponding to the three-dimensional building model through the client.

Specifically, the terminal device in the embodiment of the present application may be a handheld device, an in-vehicle device, a wearable device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, or other devices connected to a wireless modem, or may be various specific User Equipment (UE), a mobile phone (smart phone), a smart watch, a notebook computer, a Personal Digital Assistant (PDA), a Personal Computer (PC), or the like, which is not limited specifically.

(4) Sound collection device

The sound collection device may be a hardware unit for real-time sound or voice collection of events occurring in the building structure of the monitored area. It should be noted that, the sound collection device can fully sense events occurring in the building structure, so that the purpose of monitoring the building structure of the monitoring area more accurately and effectively can be achieved, and the area monitoring efficiency is improved.

The sound collection equipment can be installed in a monitoring area or in a building structure of the monitoring area, collects voice information aiming at an occurred event, and uploads the voice information to the processing server.

For example, the sound collecting device can collect voice information such as "fire fighting", "robbery", "thief catching", "safety attention", "life saving" and the like sent out in or around the building structure.

The sound collection equipment can collect voice information of a certain event in the building structure of the monitoring area and upload the voice information to the processing server. The processing server can identify the event type of the event through the voice information, and display the member corresponding to the event type to the user on the coordinate corresponding to the three-dimensional building model, so that the real-time visual monitoring of the event of the building structure of the monitored area is realized, and the user can be ensured to know and process the event in time.

The sound collection device of the embodiment of the present application may include a sound sensor, a microphone, a sound pickup, and the like.

(5) Image acquisition device

The image capture device may be a hardware unit for real-time image frame or video capture of events occurring in the building structure of the monitored area. It should be noted that, the image acquisition device can fully sense events occurring in the building structure, so that the purpose of monitoring the building structure of the monitoring area more accurately and effectively can be achieved, and the area monitoring efficiency is improved.

The image acquisition equipment can be installed in a monitoring area or in a building structure of the monitoring area, acquires image information according to an occurred event, and uploads the image information to the processing server.

The image acquisition device can acquire image frames of certain events in building structures of the monitored area and upload the image frames to the processing server. The processing server can identify the event type of the event through the image frame, and display the component corresponding to the event type to the user on the coordinate corresponding to the three-dimensional building model, so that the real-time visual monitoring of the event of the building structure of the monitored area is realized, and the user can be ensured to know and process the event in time.

The image acquisition equipment of the embodiment of the application can comprise various cameras and the like.

As described above, the data processing system 10 illustratively includes the processing server 110, the BIM management server 120, the terminal device 130, the sound collection device 140, and the image collection device 150, as shown in fig. 1.

An example of a possible architecture of the processing server is described below, with reference to fig. 2. Fig. 2 is a schematic structural diagram of a processing server according to an embodiment of the present application. The processing server 200 may include a processor 210, a communication module 220, a power management module 230, and a storage module 240. The processor 210 is connected to and controls the communication module 220, the power management module 230, and the storage module 240 in the form of corresponding buses. The processor 210 is a control center of the processing server 200, and is connected to each module in the processing server 200 through various interfaces and lines.

Specifically, the processor 210 calls the data stored in the storage module 240 by running or executing the software programs and/or modules in the storage module 240 to perform various data processing functions (such as BIM data, first data, second data, etc.) of the processing server 200 and monitor the overall operation of the processing server 200.

Optionally, the processor 210 may include a Central Processing Unit (CPU), a Digital Signal Processor (DSP), a neural-Network Processing Unit (NPU), a Graphic Processor (GPU), an Image Signal Processor (ISP), an application-specific integrated circuit (ASIC), a Field Programmable Gate Array (FPGA), a Micro Control Unit (MCU), a single chip microcomputer (single chip microcomputer), or a single chip Microcomputer (MCU).

Specifically, the communication module 220 may implement functions such as a 2G mobile communication network, a 3G mobile communication network, a 4G mobile communication network, a 5G mobile communication network, an internet of vehicles communication network, and an internet of things communication network to receive and transmit wireless mobile network data, and may also provide channel spectrum resources of 2.4GHz and 5GHz to receive and transmit network data.

Optionally, the communication module 220 is configured to send information or a control command to a terminal device, a sound collection device, an image collection device, or the like.

Specifically, the power management module 230 may include a power management chip and may provide functions of power conversion, distribution, detection, management, and the like for the processing server 200.

In particular, the memory module 240 may be used to store software programs and/or modules, and may include a program storage area and a data storage area. The storage program area may be used to store an operating system or a software program required by at least one function, and the software program required by the at least one function may be used to perform a data processing function based on a building information model in the embodiment of the present application; the storage data area may be used to store data and the like required to perform the data processing function based on the building information model in the embodiment of the present application.

In addition, the processing server of the embodiment of the present application may include a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on top of the operating system layer. The hardware layer may include hardware such as a CPU, a Memory Management Unit (MMU), and a memory (also referred to as a storage).

In particular, the memory may be used to store software programs and/or modules, and may include a program storage area and a data storage area. The storage program area may be used to store an operating system or a software program required by at least one function, and the software program required by the at least one function may be used to perform a data processing function based on a building information model in the embodiment of the present application; the storage data area may be used to store data and the like required for data processing based on the building information model in the embodiment of the present application.

Further, the operating system may be any one or more computer operating systems that implement business processes via processes. Such as a Linux operating system, a Unix operating system, an Android operating system, an iOS operating system, or a Windows operating system, among others.

Furthermore, a graphic engine, BIM software, GIS software and the like can be operated on the application layer. Therefore, the processing server can process the BIM data through a graphic engine, BIM software and GIS software running on the application layer.

It should be noted that the embodiment of the present application does not particularly limit the specific structure of the execution subject of the data processing method based on the building information model, as long as communication can be performed by running the program recorded with the code of the method provided by the embodiment of the present application and the method provided by the embodiment of the present application. For example, the execution main body of the method provided in the embodiment of the present application may be a processing server, or may be a functional module capable of calling a program and executing the program in the processing server, and the like, which is not particularly limited.

In conjunction with the above description, the steps performed by the data processing method based on the building information model will be described below from the perspective of a method example, please refer to fig. 3. Fig. 3 is a schematic flowchart of a data processing method based on a building information model according to an embodiment of the present application, where the method includes:

s302, obtaining BIM data of the building information model.

The BIM data may include, among other things, components of a BIM model used to model a target building structure located in a monitored area.

It should be noted that, in the embodiment of the present application, all building structures in a monitoring area can be fully covered by the internet of things communication technology. In addition, the BIM modeling can be carried out on the target building structure located in the monitoring area through the acquired BIM data so as to obtain the BIM model of the target building structure, so that the overall layout and the like of the target building structure can be obtained through the BIM model, and the building structure can be remotely and visually displayed in real time through the BIM technology.

Specifically, the target building structure may include a commercial building, a residential building, an office building, a construction site, a school, and the like.

In particular, the BIM data may include geometric and non-geometric information for various types of components.

It should be noted that the geometric information may be used to indicate the geometric shape characteristic and the spatial position characteristic of the component; the non-geometric information may be used to indicate information and attributes of the component other than geometric information, such as component identification Information (ID), component material, component color, performance index, construction record, and the like.

In addition, the components of the embodiments of the present application may also be referred to as primitives, and the primitives are basic units constituting a building model, which may be divided into model primitives, annotation primitives, reference primitives, and view primitives.

The model primitives may include body primitives and building block primitives. The body primitives may be used to represent body members in an actual building, such as walls, floors, roofs, stairs, etc., and the parameters of the body primitives may be preset by the BIM software. The member elements are the most basic elements in building project modeling, constitute structures in actual construction, such as beams, columns, trusses, steel bars and the like, and the parameters of the member elements can be set by users.

The annotation primitive may be view-specific, being displayed only in the view in which it is located; can be used to add dimension labels, text annotations, marks, symbols or icons, etc. to the view, as well as detailed information to the graphics generated by the model geometry, etc.

The fiducial primitives can be used to provide a framework for placement and positioning of model primitives, such as axis meshes, elevations, reference planes, and the like.

The view primitives are view representations generated based on the BIM file, and each view can set the visibility, level of detail, and scale of the building blocks it displays, as well as the range of views that the view can display, such as floor plan, elevation, cut-away, three-dimensional, detail, list, and the like.

In one possible example, obtaining building information model BIM data may include: and acquiring BIM data obtained by componentizing the engineering drawing of the target building structure from the BIM management server.

It should be noted that the BIM management server according to the embodiment of the present application may store and manage various engineering drawings (e.g., engineering drawings of a target building structure), perform component processing on the engineering drawings to obtain BIM data having geometric information and non-geometric information of various components, and provide the BIM data to the processing server. The engineering drawing may include a CAD drawing, a BIM drawing, etc. for modeling the target building Structure, and the engineering drawing may refer to an executable file generated by BIM software, and the BIM software may include AutoCAD, review Structure, ArchiCAD, Bentley System, Tekla Structure, Digital Project, etc. Therefore, the BIM management server can be introduced to store, manage and identify the engineering drawing of the building structure in the monitoring area, and the management and processing efficiency of the BIM data is effectively improved.

Specifically, acquiring the BIM data obtained by componentizing the engineering drawing of the target building structure from the BIM management server may include: sending data request information to a BIM management server, wherein the data request information is used for requesting the BIM management server to issue an engineering drawing aiming at a target building structure for componentization so as to obtain BIM data; BIM data from a BIM management server is received.

Therefore, the processing server sends the data request information to the BIM management server to realize the acquisition of the BIM data.

And S304, carrying out three-dimensional visualization on the target building structure according to the BIM data so as to display a three-dimensional building model.

It can be understood that the user can be ensured to visually check the whole building layout of the target building structure by displaying the three-dimensional building model of the target building structure, so that the target building structure is remotely and visually monitored, and the monitoring efficiency is improved.

S306, acquiring first data and second data of a target event which occurs aiming at the target building structure.

Wherein the first data may be used to represent image information or voice information acquired for target event detection; the second data may be used to represent location information of the place of occurrence of the target event.

Specifically, the target event can be a fire, an article theft, an aerial object, a pedestrian falling, a construction maintenance and other events. It can be understood that when a fire, an article theft, a high altitude object, etc. occurs in a certain floor of the target building structure, image information or voice information corresponding to the above events can be collected. Or, when an event such as a pedestrian falling, construction maintenance, or the like occurs around the target building structure, image information or voice information corresponding to the event may be collected, which is not particularly limited.

In one possible example, obtaining first and second data for a target event occurring with respect to a target building structure may include: receiving image information or voice information acquired by data acquisition equipment installed in a monitoring area aiming at target event detection to obtain first data; and receiving first equipment identification information from the data acquisition equipment, and retrieving second data from a third preset mapping relation according to the first equipment identification information, wherein the third preset mapping relation is used for indicating the mapping relation between the equipment identification information and the position information.

It should be noted that, first, the data acquisition device of the embodiment of the present application may include an image acquisition device and/or a sound acquisition device, and the data acquisition device itself stores unique device identification Information (ID). The sound collection equipment can be installed in a monitoring area or in a building structure of the monitoring area, collects voice information aiming at an occurred event, and uploads the voice information to the processing server. The image acquisition device can be installed in a monitoring area or in a building structure of the monitoring area, acquires image information according to an occurred event, and uploads the image information to the processing server.

Then, the processing server can identify the event type of the event through the voice information or the image information, and display the component corresponding to the event type to the user on the coordinate corresponding to the three-dimensional building model, so that the event occurring in the building structure of the monitored area can be visually displayed in real time, and the user can be ensured to know and process the occurring event in time.

Finally, because a large number of data acquisition devices are distributed in the monitoring area of the embodiment of the application and are respectively installed at different positions to achieve comprehensive coverage of the monitoring area, and each data acquisition device stores unique device identification information, when a certain data acquisition device detects that a target event occurs, the data acquisition device can send the device identification information (namely, the first device identification information) stored by the data acquisition device to the processing server, then the processing server searches the installed position of the data acquisition device according to the mapping relationship between the device identification information and the position information, and finally the position is used as the occurrence place of the target event to obtain second data.

S308, determining the event type of the target event according to the first data, and determining a component corresponding to the event type of the target event from the BIM data to obtain a target component.

It should be noted that, first, the processing server in the embodiment of the present application may determine the event type of the target event by performing image recognition or voice recognition on the first data, and then display the component (i.e., the target component) corresponding to the event type of the target event to the user on the coordinate (i.e., the target coordinate) corresponding to the three-dimensional building model, so as to ensure that the user knows the event type and the position of the occurrence location of the target event occurring in the target building structure in the monitored area in time, and further perform corresponding processing operations such as notification, troubleshooting, and warning on the target event quickly.

Secondly, the event types of the events occurring in the building structure of the monitoring area of the embodiment of the present application may include "fire", "article theft", "high altitude object throwing", "pedestrian falling", "elevator failure", "construction repair", and the like. Meanwhile, events can be classified into different levels according to factors such as the type, the nature, the severity, the controllability and the influence range of the events, that is, the event types of different events have different levels. For example, "fire" may have a higher level of security than other event types.

Finally, the target component may include an icon, text note or indicia, etc. corresponding to the target event. It will be appreciated that the target members of embodiments of the present application may belong to the annotation primitives described above.

In one possible example, if the first data includes image information, determining an event type of the target event from the first data may include: determining a target area on the image information, wherein the target area is used for framing and selecting the imaging of a target event on the image information; extracting characteristic points in the target area to obtain characteristic vectors; inputting the feature vector into a pre-trained event classification model to obtain a first parameter value, wherein the first parameter value is used for representing the probability that the event type of the target event is the first event type; and if the first parameter value is larger than a first preset threshold value, taking the event type of the target event as the first event type.

It should be noted that, in addition to the imaging of the target event, the imaging of the surrounding environment of the target event is also included in the image information, so in order to improve the accuracy and efficiency of image recognition, in the embodiment of the present application, a target region on the image information is extracted (or detected), then feature points in the target region are extracted to obtain a feature vector, and finally the feature vector is input into a pre-trained event classification model to obtain a probability size that the event type of the target event is the first event type, so that the event type of the target event is determined according to the probability size.

Specifically, determining the target area on the image frame may include: a target region on the image frame is determined by a target detection algorithm.

It should be noted that the object detection is defined to identify which objects are present in the image frame and the positions (coordinate positions) of the objects. Wherein it is required to identify which objects may be set by the user, and the coordinate positions of the objects are represented by polar coordinates (xmin, ymin, xmax, ymax) or center point coordinates (x _ center, y _ center, w, h). Therefore, the target area may be regarded as a border (bounding box) in the target detection algorithm, and the border may be a border after a border-box regression (bounding-box regression) or a real (ground route) border.

In addition, the target detection algorithm may include a one-stage detection algorithm and a two-stage detection algorithm. The single detection algorithm may include a single-shot multi-box detector (SSD), a look-once (yoly look once) algorithm, and the like; the double detection algorithm may include a region-based convolutional neural network (R-CNN), fast R-CNN (fast R-CNN), faster R-CNN (fast R-CNN), region-based full convolutional network (R-FCN), and the like.

Specifically, the event classification model may include a bayesian classifier, a support vector machine, a random forest classifier, a K-nearest neighbor (KNN) classifier, a convolutional neural network, and the like.

In one possible example, if the first data includes voice information, determining an event type of the target event from the first data may include: performing text conversion operation on the voice information to obtain text information; extracting word vectors in the text information to obtain a word vector matrix; inputting the word vector matrix into a pre-trained keyword recognition model to obtain a target keyword; and retrieving the event type of the target event from the first preset mapping relation as a second event type according to the target keyword, wherein the first preset mapping relation is used for representing the mapping relation between the keyword and the event type.

It should be noted that the processing server may perform text conversion operation on the voice information to obtain text information, extract word vectors in the text information through natural language processing to obtain a word vector matrix, and finally input the word vector matrix into a pre-trained keyword recognition model to obtain target keywords, so as to ensure that the recognized target keywords are more accurate, and further determine the event type of the target event through the target keywords. In addition, the target keywords may include "fire fighting", "robbery", "thief catching", "attention to security", "life saving", and the like.

Specifically, the keyword recognition model may include a bayesian classifier, a support vector machine, a random forest classifier, a KNN classifier, a fastText model, a TextCNN model, a TextRNN model, and the like.

Specifically, extracting the word vector in the text information to obtain a word vector matrix may include: and inputting the text information into a pre-trained word vector model to obtain a word vector matrix. Wherein the word vector model may include one of: one-hot model, bag of words (BOW) model, continuous bag of words (CBOW) model, and continuous Skip grammar (Skip-Gram) model.

In one possible example, determining a component corresponding to the event type of the target event from the BIM data to obtain a target component may include: retrieving the first component identification information from a second preset mapping relation according to the event type of the target event, wherein the second preset mapping relation is used for indicating the mapping relation between the event type and the component identification information; the first component identification information is matched with the non-geometric information of each component in the BIM data to obtain a target component.

It should be noted that, because the event types may include various classifications such as "fire", "article theft", "high altitude object throwing", "pedestrian falling", "elevator failure", "construction maintenance", and the like, in the embodiment of the present application, corresponding component identifiers may be established for different event types to obtain a second preset mapping relationship, so that first component identifier information corresponding to the event type of the target event is retrieved through the second preset mapping relationship, and then a target component corresponding to the first component identifier information is matched from the BIM data, so that a component corresponding to the event type of the target event is determined from the BIM data through the second preset mapping relationship, and further, the component retrieval efficiency is improved.

In addition, since the non-geometric information of the component may be used to indicate information and attributes of the component other than the geometric information, such as component identification Information (ID), component material, component color, performance index, construction record, and the like, the embodiment of the present application may perform matching of the component identification information through the non-geometric information of the component.

And S310, determining a corresponding target coordinate of the occurrence point of the target event in the coordinate system of the three-dimensional building module according to the second data.

It should be noted that, the processing server in the embodiment of the present application may determine, according to the position information of the occurrence location of the target event, a target coordinate corresponding to the occurrence location of the target event in the coordinate system of the three-dimensional building module, so as to accurately display the occurrence location of the event in the building structure of the monitored area in real time.

And S312, displaying the target component at the target coordinate of the three-dimensional building model.

It can be understood that the user can know the event type of the occurred event in time through the displayed target member, and know the incident location of the occurred event through the target coordinate where the target member is located, thereby being beneficial to ensuring that the user can timely perform corresponding processing operations such as notification, troubleshooting, warning and the like on the occurred event.

In one possible example, the target member is displayed in a color corresponding to an event type of the target event in the three-dimensional building model.

It is understood that after S312, the method further includes: and displaying the target component in the three-dimensional building model according to the color corresponding to the event type of the target event.

It should be noted that, since the event types of different events in the embodiment of the present application have different levels, for example, "fire" may have a higher security level than other event types, displaying the target component in the three-dimensional building model according to the color corresponding to the event type of the target event may be beneficial to improving the user to directly and intuitively know the severity, controllability, and influence range of the event that occurs through the difference of the color, and improving the monitoring efficiency.

The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that, in order to implement the above functions, the processing server includes a corresponding hardware structure and/or software module for performing each function. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiment of the present application, the processing server may be divided into the functional units according to the above method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the units in the embodiment of the present application is illustrative, and is only one division of the logic functions, and there may be another division in actual implementation.

In the case of an integrated unit, fig. 4 presents a block diagram of the functional units of a data processing device based on a building information model. The data processing apparatus 400 based on the building information model includes: a processing unit 420 and a communication unit 430. Processing unit 420 is used to control and manage the actions of the processing server, e.g., processing unit 420 is used to support the processing server in performing some or all of the steps in FIG. 3, as well as other processes for the techniques described herein. The communication unit 430 is used to support communication between the processing server and other devices. The building information model-based data processing apparatus 400 may further include a storage unit 410 for storing program codes and data of the building information model-based data processing apparatus 400.

The processing unit 420 may be, among other things, a processor or controller, such as a CPU, general purpose processor, DSP, ASIC, FPGA, transistor logic, hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the embodiments disclosed herein. Additionally, processing unit 420 may also be a combination that performs computing functions, including one or more of a combination of microprocessors, a DSP, and a microprocessor. The communication unit 430 may be a communication interface, a transceiver, a transceiving circuit, and the like. The storage unit 410 may be a memory. When the processing unit 420 is a processor, the communication unit 430 is a communication interface, and the storage unit 410 is a memory, the data processing apparatus 400 based on the building information model according to the embodiment of the present application may be a processing server shown in fig. 5.

Specifically, the processing unit 420 is configured to perform any one of the steps performed by the processing server in the above method embodiments, and when performing data transmission such as sending, the communication unit 430 is optionally invoked to complete the corresponding operation. The details will be described below.

The processing unit 420 is configured to: acquiring BIM data of a building information model, wherein the BIM data comprises members of the BIM for modeling a target building structure located in a monitoring area; performing three-dimensional visualization on the target building structure according to the BIM data to display a three-dimensional building model; acquiring first data and second data of a target event occurring aiming at a target building structure, wherein the first data is used for representing image information or voice information collected aiming at the target event detection, and the second data is used for representing position information of an occurrence place of the target event; determining the event type of the target event according to the first data, and determining a component corresponding to the event type of the target event from the BIM data to obtain a target component; determining a corresponding target coordinate of the occurrence point of the target event in a coordinate system of the three-dimensional building module according to the second data; the target member is displayed at target coordinates of the three-dimensional building model.

It should be noted that, for specific implementation of each operation performed by the data processing apparatus 400 based on the building information model, reference may be made to the corresponding description of the method embodiment shown in fig. 3, and details are not described herein again.

In one possible example, if the first data includes image information, the processing unit 420 is specifically configured to, in terms of determining the event type of the target event according to the first data: determining a target area on the image information, wherein the target area is used for framing and selecting the imaging of a target event on the image information; extracting characteristic points in the target area to obtain characteristic vectors; inputting the feature vector into a pre-trained event classification model to obtain a first parameter value, wherein the first parameter value is used for representing the probability that the event type of the target event is the first event type; and if the first parameter value is larger than a first preset threshold value, taking the event type of the target event as the first event type.

In one possible example, if the first data includes voice information, in terms of determining the event type of the target event according to the first data, the processing unit 420 is specifically configured to: performing text conversion operation on the voice information to obtain text information; extracting word vectors in the text information to obtain a word vector matrix; inputting the word vector matrix into a pre-trained keyword recognition model to obtain a target keyword; and retrieving the event type of the target event from the first preset mapping relation as a second event type according to the target keyword, wherein the first preset mapping relation is used for representing the mapping relation between the keyword and the event type.

In one possible example, in determining a component corresponding to the event type of the target event from the BIM data to obtain the target component, the processing unit 420 is specifically configured to: retrieving the first component identification information from a second preset mapping relation according to the event type of the target event, wherein the second preset mapping relation is used for indicating the mapping relation between the event type and the component identification information; the first component identification information is matched with the non-geometric information of each component in the BIM data to obtain a target component.

In one possible example, in obtaining the building information model BIM data, the processing unit 420 is specifically configured to: and acquiring BIM data obtained by componentizing the engineering drawing of the target building structure from the BIM management server.

In one possible example, in obtaining the first data and the second data for the target event occurring for the target building structure, the processing unit 420 is specifically configured to: receiving image information or voice information acquired by data acquisition equipment installed in a monitoring area aiming at target event detection to obtain first data; and receiving first equipment identification information from the data acquisition equipment, and retrieving second data from a third preset mapping relation according to the first equipment identification information, wherein the third preset mapping relation is used for indicating the mapping relation between the equipment identification information and the position information.

A schematic structural diagram of another processing server provided in the embodiment of the present application is described below, as shown in fig. 5. The processing server 500 includes a processor 510, a memory 520, a communication interface 530, and at least one communication bus for connecting the processor 510, the memory 520, and the communication interface 530.

The processor 510 may be one or more central processing units CPU. In the case where the processor 510 is a CPU, the CPU may be a single core CPU or a multi-core CPU. The Memory 520 includes, but is not limited to, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM), or a portable Read-Only Memory (CD-ROM), and the Memory 520 is used for storing related instructions and data. Communication interface 530 is used to receive and transmit data.

The processor 510 in the processing server 500 is configured to read one or more programs 521 stored in the memory 520 for performing the following steps: acquiring BIM data of a building information model, wherein the BIM data comprises members of the BIM for modeling a target building structure located in a monitoring area; performing three-dimensional visualization on the target building structure according to the BIM data to display a three-dimensional building model; acquiring first data and second data of a target event occurring aiming at a target building structure, wherein the first data is used for representing image information or voice information collected aiming at the target event detection, and the second data is used for representing position information of an occurrence place of the target event; determining the event type of the target event according to the first data, and determining a component corresponding to the event type of the target event from the BIM data to obtain a target component; determining a corresponding target coordinate of the occurrence point of the target event in a coordinate system of the three-dimensional building module according to the second data; the target member is displayed at target coordinates of the three-dimensional building model.

It should be noted that, for specific implementation of each operation performed by the processing server 500, reference may be made to the corresponding description of the method embodiment shown in fig. 3, and details are not described here again.

Embodiments of the present application also provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, the computer program being operable to cause a computer to perform part or all of the steps of any of the methods as set forth in the above method embodiments.

Embodiments of the present application also provide a computer program product, where the computer program product includes a computer program operable to cause a computer to perform part or all of the steps of any one of the methods as described in the above method embodiments. The computer program product may be a software installation package.

For simplicity of description, each of the above method embodiments is described as a series of combinations of operations. Those skilled in the art should appreciate that the present application is not limited by the order of acts described, as some steps in the embodiments of the present application may occur in other orders or concurrently. Moreover, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that acts and modules referred to are not necessarily required to implement the embodiments of the application.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in the present application, it should be understood by those skilled in the art that the described apparatus can be implemented in other ways. It will be appreciated that the above described apparatus embodiments are merely illustrative. For example, the division of the modules is only one logical function division, and actually, there may be another division manner. That is, multiple modules or components may be combined or integrated into another software, and some features may be omitted or not implemented. In addition, the shown or discussed mutual coupling, direct coupling or communication connection and the like can be an indirect coupling or communication connection through some interfaces, devices, modules or units, and can also be an electric or other form.

The above modules or units, if implemented in the form of software functions and sold or used as independent products, may be stored in a computer-readable storage medium. It will be appreciated that the solution of the present application (which form a part of or all or part of the prior art) may be embodied in the form of a computer software product. The computer software product is stored in a memory and includes several instructions for causing a computer device (personal computer, server, network device, etc.) to perform all or part of the steps of the embodiments of the present application. The computer-readable storage medium may be stored in various memories such as a usb disk, a ROM, a RAM, a removable hard disk, a magnetic disk, or an optical disk.

While the embodiments of the present application have been described in detail, it should be understood by those skilled in the art that the embodiments of the present application are only used for assisting understanding of the core concept of the technical solutions of the present application, and therefore, the embodiments of the present application may be changed in terms of the specific implementation and the application scope. The contents described in the present specification should not be construed as limiting the scope of the present application. In addition, any modification, equivalent replacement, improvement and the like made on the basis of the technical solutions of the embodiments of the present application should be included in the protection scope of the embodiments of the present application.

Claims

1. A data processing method based on a building information model is characterized by comprising the following steps:

2. The method of claim 1, wherein if the first data comprises image information, the determining the event type of the target event according to the first data comprises:

determining a target area on the image information, the target area being used for framing imaging of the target event on the image information;

extracting characteristic points in the target area to obtain a characteristic vector;

inputting the feature vector into a pre-trained event classification model to obtain a first parameter value, wherein the first parameter value is used for representing the probability that the event type of the target event is a first event type;

and if the first parameter value is larger than a first preset threshold value, taking the event type of the target event as the first event type.

3. The method of claim 1, wherein if the first data comprises voice information, the determining the event type of the target event according to the first data comprises:

performing text conversion operation on the voice information to obtain text information;

extracting word vectors in the text information to obtain a word vector matrix;

inputting the word vector matrix into a pre-trained keyword recognition model to obtain a target keyword;

and retrieving the event type of the target event from a first preset mapping relation as a second event type according to the target keyword, wherein the first preset mapping relation is used for representing the mapping relation between the keyword and the event type.

4. The method according to any one of claims 1 to 3, wherein the determining a component corresponding to the event type of the target event from the BIM data to obtain a target component comprises:

retrieving first component identification information from a second preset mapping relation according to the event type of the target event, wherein the second preset mapping relation is used for indicating the mapping relation between the event type and the component identification information;

matching the first component identification information with non-geometric information of each component in the BIM data to obtain the target component.

5. The method according to any one of claims 1 to 4, wherein the obtaining building information model BIM data comprises:

acquiring the BIM data obtained by componentizing the engineering drawing of the target building structure from a BIM management server.

6. The method of any one of claims 1-5, wherein said obtaining first and second data for a target event occurring with respect to the target building structure comprises:

receiving image information or voice information acquired by data acquisition equipment installed in the monitoring area aiming at the target event detection to obtain the first data;

and receiving first equipment identification information from the data acquisition equipment, and retrieving the second data from a third preset mapping relation according to the first equipment identification information, wherein the third preset mapping relation is used for indicating the mapping relation between the equipment identification information and the position information.

7. The method according to any one of claims 1 to 6, wherein the target member is displayed in the three-dimensional building model in a color corresponding to an event type of the target event.

8. A data processing apparatus based on a building information model, the apparatus comprising a processing unit configured to:

9. A processing server comprising a processor, a memory and a communication interface, the memory storing one or more programs, and the one or more programs being executable by the processor, the one or more programs including instructions for performing the steps in the method of any of claims 1-7.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program is operable to cause a computer to perform the method according to any one of claims 1-7.