CN113423002A - Fusion display method and device based on Internet of things data and BIM model - Google Patents

Fusion display method and device based on Internet of things data and BIM model Download PDF

Info

Publication number
CN113423002A
CN113423002A CN202110727744.3A CN202110727744A CN113423002A CN 113423002 A CN113423002 A CN 113423002A CN 202110727744 A CN202110727744 A CN 202110727744A CN 113423002 A CN113423002 A CN 113423002A
Authority
CN
China
Prior art keywords
bim
internet
data
things
video stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110727744.3A
Other languages
Chinese (zh)
Other versions
CN113423002B (en
Inventor
姚莉
张玮
施海熔
陆啸宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Yuchuang Engineering Consulting Co ltd
Original Assignee
Shanghai Yuchuang Engineering Consulting Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Yuchuang Engineering Consulting Co ltd filed Critical Shanghai Yuchuang Engineering Consulting Co ltd
Priority to CN202110727744.3A priority Critical patent/CN113423002B/en
Publication of CN113423002A publication Critical patent/CN113423002A/en
Application granted granted Critical
Publication of CN113423002B publication Critical patent/CN113423002B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application relates to the technical field of internet, in particular to a fusion display method and device based on internet of things data and a BIM (building information modeling), comprising the following steps: the server side renders the BIM corresponding to the request instruction sent by the user side, acquires component information according to a rendering result and generates a BIM video stream; embedding component information in a video stream and then sending the video stream to a user side; the user side acquires Internet of things data required by displaying the BIM from the Internet of things; and fusing the BIM model video stream embedded with the component information and the data of the Internet of things and then displaying the fused BIM model video stream. According to the method, the component information of the BIM model is embedded into the video stream, the Internet of things data and the BIM model are fused at the user side according to the component information to complete the mode of model display, the cloud rendering server only renders an independent model, and the Internet of things data is not rendered, so that the rendering pressure of the cloud rendering server is reduced, the real-time property of cloud rendering is enhanced, delay is reduced, and user experience is improved.

Description

Fusion display method and device based on Internet of things data and BIM model
Technical Field
The application relates to the technical field of internet, in particular to a fusion display method and device based on internet of things data and a BIM (building information modeling).
Background
The BIM (building Information modeling) technology is a datamation tool applied to building design, construction and management, the BIM comprises a three-dimensional model of a building and Information of building components, and the building Information data are shared and transmitted in the whole life cycle process of project planning, operation and maintenance, so that the purposes of work cooperation, work efficiency improvement, construction period shortening and cost reduction are achieved.
The information of building components (such as doors, windows, motors and water pumps) in the BIM is relatively static, such as materials, models, positions and other information, and the dynamic information of the building components, such as the states of the doors, indoor temperature, working power of the motors and the like, can be acquired by combining the BIM with the IoT technology of the Internet of things. BIM and IoT integration are key foundations constituting the digital twin of buildings.
In the application process of the BIM technology, the BIM needs to be rendered, so that a three-dimensional model of a building can be seen on a user terminal, and compared with a local rendering technology at a user side, a cloud rendering technology becomes a development trend. With the introduction of the internet of things IoT, users want to see dynamic data of model components while seeing a BIM three-dimensional model. For example, see the temperature value in the room, the operating power of the motor, etc.
The existing fusion display method of the data of the internet of things and the BIM model is characterized in that when a cloud rendering server receives a request of a user, the BIM model and the data of the internet of things are rendered and calculated together, the data are transmitted to the user side through a network after being subjected to video coding, and the data are decoded and displayed at the user side, so that the fusion display of the data of the internet of things and the BIM model is realized.
However, since the internet of things data and the BIM model are subjected to rendering calculation through the cloud rendering server, the working pressure of the cloud rendering server is increased, the real-time performance of cloud rendering is reduced, the display delay condition occurs, and the user experience is reduced.
Disclosure of Invention
In order to solve the problems, the application provides a fusion display method and device based on internet of things data and a BIM model, and the technical problems that in the related art, due to the fact that the internet of things data and the BIM model are subjected to rendering calculation through a cloud rendering server, working pressure of the cloud rendering server is high, and display is delayed are solved.
In a first aspect, the application provides a fusion display method based on internet of things data and a BIM model, and the method includes:
the server receives a request instruction sent by a user side, wherein the request instruction comprises a BIM (building information modeling) model requested by the user;
the server side renders a BIM model requested by a user to obtain a rendering result;
the server side obtains component information corresponding to all components to be added with the data of the Internet of things in the BIM according to the rendering result;
the server side generates a BIM video stream according to the rendering result;
the server side embeds the component information in the BIM video stream;
the server side sends the BIM video stream embedded with the component information to the client side;
the user side acquires Internet of things data corresponding to the component information from the Internet of things;
and the user side fuses the BIM video stream embedded with the component information and the data of the Internet of things and displays the video stream.
In some embodiments, the obtaining, by the server, component information corresponding to all components to which the internet of things data is to be added in the BIM model according to the rendering result includes:
the server side determines all components to be added with the data of the Internet of things in the BIM;
and the server side extracts the component information from the rendering result according to the determined components.
In some embodiments, the part information includes a part ID, a part coordinate position, and a part display size of each part in the BIM model.
In some embodiments, the server embeds the building information in the BIM model video stream, including:
the server adds a TS data packet with the component information in the BIM video stream; and the Packet Head of the TS Data Packet comprises a newly added PID field, and the Packet Data of the TS Data Packet comprises the component information.
In some embodiments, the displaying, by the user end, the BIM model video stream embedded with the component information after being fused with the internet of things data includes:
and the user side fuses the BIM model video stream embedded with the component information and the data of the Internet of things through a screen menu type OSD (on screen display) and displays the video stream.
In a second aspect, a fusion display device based on internet of things data and a BIM model, the device includes:
a server side and a user side;
wherein, the server side includes:
the receiving unit is used for receiving a request instruction sent by a user side, wherein the request instruction comprises a BIM (building information modeling) model requested by the user;
the rendering unit is used for rendering the BIM requested by the user to obtain a rendering result;
the extraction unit is used for obtaining component information corresponding to all components to be added with the data of the Internet of things in the BIM according to the rendering result;
the generating unit is used for generating a BIM (building information modeling) video stream according to the rendering result;
an embedding unit for embedding the building block information in the BIM model video stream;
the sending unit is used for sending the BIM model video stream embedded with the component information to a user side;
the user side includes:
the acquisition unit is used for acquiring the Internet of things data corresponding to the component information from the Internet of things;
and the fusion unit is used for fusing and displaying the BIM model video stream embedded with the member information and the data of the Internet of things.
In some embodiments, the extraction unit includes:
the determining unit is used for determining all components to be added with the data of the Internet of things in the BIM;
a processing unit for extracting the building block information from the rendering result according to the determined building block.
In some embodiments, the part information includes a part ID, a part coordinate position, and a part display size of each part in the BIM model.
In some embodiments, the embedding unit is configured to add TS packets with the building block information to the BIM model video stream; and the Packet Head of the TS Data Packet comprises a newly added PID field, and the Packet Data of the TS Data Packet comprises the component information.
In some embodiments, the fusion unit is configured to fuse the BIM model video stream embedded with the component information and the data of the internet of things by using an on-screen menu adjustment OSD, and display the fused BIM model video stream.
The application provides a fusion display method and device based on Internet of things data and a BIM model, and the fusion display method and device comprise the following steps: the server receives a request instruction sent by a user side, wherein the request instruction comprises a BIM (building information modeling) model requested by the user; rendering the BIM requested by the user to obtain a rendering result; obtaining component information corresponding to all components to be added with the data of the Internet of things in the BIM according to the rendering result; generating a BIM model video stream according to the rendering result; embedding the building block information in the BIM model video stream; sending the BIM video stream embedded with the component information to a user side; the user side acquires Internet of things data corresponding to the component information from the Internet of things; and fusing the BIM video stream embedded with the component information with the Internet of things data and then displaying the fused BIM video stream. According to the method, the component information of the BIM model is embedded into the video stream, the Internet of things data and the BIM model are fused at the user side according to the component information to complete the mode of model display, the cloud rendering server only renders an independent model, and the Internet of things data is not rendered, so that the rendering pressure of the cloud rendering server is reduced, the real-time property of cloud rendering is enhanced, delay is reduced, and user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flowchart of a fusion display method based on internet of things data and a BIM model according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram comparing a prior art scheme with a scheme of the present application provided by an example of the present application;
fig. 3 is a schematic diagram illustrating a relationship among an ES stream, a PES stream, and a TS stream according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a TS packet according to an embodiment of the present application;
fig. 5 is a schematic diagram of a PAT table and a PMT table provided in an embodiment of the present application;
fig. 6 is a schematic diagram of a fusion display effect of internet of things data and a BIM model provided in an embodiment of the present application;
fig. 7 is a schematic view of a reduced fusion display effect of internet of things data and a BIM model according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of a fusion display device based on internet of things data and a BIM model according to an embodiment of the present application.
Detailed Description
The following detailed description will be provided with reference to the accompanying drawings and embodiments, so that how to apply the technical means to solve the technical problems and achieve the corresponding technical effects can be fully understood and implemented. The embodiments and various features in the embodiments of the present application can be combined with each other without conflict, and the formed technical solutions are all within the scope of protection of the present application.
According to the background technology, the data of the internet of things and the BIM model are subjected to rendering calculation through the cloud rendering server, so that the working pressure of the cloud rendering server is increased, the real-time performance of cloud rendering is reduced, the display delay condition is generated, and the user experience is reduced.
In view of this, the application provides a fusion display method and device based on internet of things data and a BIM model, and the technical problems of high working pressure and display delay of a cloud rendering server in the related art due to the fact that the internet of things data and the BIM model are rendered and calculated through the cloud rendering server are solved.
Example one
Fig. 1 is a schematic flow chart of a fusion display method based on internet of things data and a BIM model provided in an embodiment of the present application, and as shown in fig. 1, the method includes:
s101, a server receives a request instruction sent by a user side, wherein the request instruction comprises a BIM (building information modeling) model requested by the user;
s102, the service end renders the BIM model requested by the user to obtain a rendering result;
s103, the server side obtains component information corresponding to all components to be added with the data of the Internet of things in the BIM according to the rendering result;
s104, the server side generates a BIM model video stream according to the rendering result;
s105, the server side embeds the component information into the BIM video stream;
s106, the server side sends the BIM video stream embedded with the component information to a user side;
s107, the user side acquires Internet of things data corresponding to the component information from the Internet of things;
and S108, the user side fuses the BIM video stream embedded with the component information and the data of the Internet of things and displays the video stream.
It should be noted that, the server in the present application is a cloud rendering server, and the BIM model can be rendered at the cloud end, as shown in fig. 2, the existing scheme is a schematic diagram compared with the present application scheme, and the existing cloud rendering scheme is that the cloud rendering server obtains the internet of things data, renders the internet of things data together with the BIM model, and transmits the internet of things data to the client end through the network for display, so that the workload of rendering calculation is increased.
According to the scheme, the data of the internet of things is acquired by the user side, the BIM is only rendered by the cloud rendering server, the rendered BIM and the data of the internet of things are displayed after being fused at the user side, in order to achieve fusion display, the BIM is rendered by the server side, component information corresponding to all components to be added with the data of the internet of things is acquired from an obtained rendering result, the component information is embedded into a video stream generated after the BIM is rendered, the component information is transmitted to the user side through a network, the user side acquires the data of the internet of things corresponding to the component information from the internet of things, the ID, the coordinate position and the size of the component in the component information are combined, OSD superposition fusion is conducted, and finally, the data of the internet of things is displayed in real time at the corresponding component.
According to the method, the component information of the BIM model is embedded into the video stream, the Internet of things data and the BIM model are fused at the user side according to the component information to complete the mode of model display, the cloud rendering server only renders an independent model, and the Internet of things data is not rendered, so that the rendering pressure of the cloud rendering server is reduced, the real-time property of cloud rendering is enhanced, delay is reduced, and user experience is improved.
In some embodiments, the obtaining, by the server, component information corresponding to all components to which the internet of things data is to be added in the BIM model according to the rendering result includes:
the server side determines all components to be added with the data of the Internet of things in the BIM;
and the server side extracts the component information from the rendering result according to the determined components.
It should be noted that, the BIM model is rendered in a two-dimensional view angle, as shown in fig. 6 and 7, the view angle is a view angle displayed to a user, and a plane of the view angle is equivalent to a video picture, so that when it is determined that the BIM model is rendered in the two-dimensional view angle by establishing a two-dimensional rectangular coordinate system according to the resolution of the video picture, an x coordinate and a y coordinate of each component in a video resolution coordinate system are used as position information of the component, and a display size of the component is determined by a coordinate point of the component in the video resolution coordinate system, and then a component ID is determined according to a component requiring additive networking data, so as to extract a component ID, a component coordinate position and a component display size of the component for fusion display from a component rendering result of adding the networking data as required.
In some embodiments, the part information includes a part ID, a part coordinate position, and a part display size of each part in the BIM model.
In particular, the component coordinate position format is a position x coordinate and a position y coordinate in a resolution-based coordinate system of the video frame.
In some embodiments, the server embeds the building information in the BIM model video stream, including:
the server adds TS data packets with the component information in the BIM video stream; and the Packet Head of the TS Data Packet comprises a newly added PID field, and the Packet Data of the TS Data Packet comprises the component information.
In the video stream of the present application, an MPEG-2 standard ts (transport stream) encapsulation format is taken as an example, and the component ID, the component coordinate position, and the component display size are increased based on the encapsulation format.
Among them, the MPEG-2 standard TS format package is divided into an ES stream, a PES stream, and a TS stream. Fig. 3 is a schematic diagram showing the relationship among the ES stream, the PES stream, and the TS stream.
The ES Stream (Elementary Stream) is composed of three parts, namely, an image data Stream encoded by an MPEG-2 video encoder, a sound data Stream encoded by an MPEG-2 video encoder, and other encoded data streams.
A PES Stream (Packetized Elementary Stream) is a data Stream formed by processing an ES Stream by a PES packetizer, and in this process, operations such as packetizing, adding header information to the ES Stream are completed, and usually I, P, B is a complete frame, which is a PES packet.
The TS stream is composed of TS packets with fixed length, the length of each TS packet is 188 bytes, the TS packets are re-packed into one PES packet, and the packet header information of the PES packet still exists in the TS packets.
As shown in fig. 4, the TS Packet structure is schematically illustrated, wherein the TS Packet is divided into a Packet Head and a Packet Data, a PID field in the Packet Head is a unique identifier in the TS stream, and the content of the Packet Data is determined by the PID.
When PID is 0, Packet Data is referred to as PAT Table (Program Association Table) and PID number of PMT Table (Program Map Table) corresponding to video content number.
When the value of the PID is the PID number corresponding to a certain PMT table, it indicates that Packet Data is the PMT table corresponding to a certain content serial number, and is used for indicating the PID number corresponding to the video, audio and Data TS related to the content.
Specifically, as shown in fig. 5, a PAT table and a PMT table are schematic diagrams.
Wherein the TS packet shown in fig. 4 is a newly added TS packet containing the component information, and then the related information is added to the PMT table shown in fig. 5 to realize embedding the component information in the video stream.
As shown in fig. 4, the component ID contained in one frame in the video content, the component coordinate positions, i.e., position x and position y, and the component display size are contained in Packet Data of a TS Packet containing component information.
Where multiple building blocks may be included in a frame, multiple TS packets may be required for presentation.
In some embodiments, the displaying, by the user end, the BIM model video stream embedded with the component information after being fused with the internet of things data includes:
and the user side fuses the BIM model video stream embedded with the component information and the data of the Internet of things through a screen menu type OSD (on screen display) and displays the video stream.
It should be noted that, the video stream is encoded when the video stream is transmitted, and the video stream is correspondingly decoded after the video stream is received at the user terminal.
It should be further noted that On Screen Display (OSD) is applied to a CRT/LCD Display, and some special characters or graphics are generated in the Screen of the Display, so that the user can obtain some information Display modes. It is commonly found on the display screen of a household tv or a PC, and when a user operates the tv to change channels or adjust the volume and image quality, a predetermined position on the tv screen displays some special characters and graphics. The BIM video stream embedded with the building block information is subjected to fusion display by utilizing the characteristic.
In the application, the user side displays real-time data acquired by the data of the internet of things to the corresponding position of the corresponding component according to the ID, the coordinate and the size of the component information, and fusion display of the data of the internet of things and the BIM is achieved.
As shown in fig. 6, which is a schematic view of a fusion display effect of internet of things data and a BIM model in another embodiment of the present application, it can be seen from fig. 6 that the internet of things data is displayed at a corresponding position above a corresponding component, and the position and the size of the internet of things data displayed by the OSD technology are displayed according to a preset relative position and a preset display mode based on the position x coordinate and the position y coordinate of the component in a video resolution coordinate system and the size of the component, that is, the display position of the internet of things data is in the same video resolution coordinate system as the component, and in fig. 6, for example, the internet of things data is displayed above the corresponding component by an indication line. Other display modes can be selected, and the corresponding relation between the data of the internet of things and the member can be marked.
It should be further noted that, in the present application, the whole process from receiving the user instruction to rendering the BIM model to generate the video stream to fusing and displaying the internet of things data and the BIM model to the user through the OSD technology is performed in real time, the user may send a control instruction in a manner of, for example, zooming by a roller, pressing a left key to rotate the model, and the displayed model and the internet of things data displayed in the model may be changed accordingly.
For example, if the user sends a command for model reduction through the wheel, taking the internet of things data "water works" in fig. 6 as an example, the server generates a rendering command after receiving the user command, performs a corresponding real-time BIM model rendering work, and at the same time, component information in the model changes accordingly due to the reduction of the model, for example, a component corresponding to the water works in the model will be reduced, the size of the component will change, i.e., reduced, and at the same time, the coordinates of the component in the video resolution coordinate system will change, i.e., the position of the component will change, so that new component information is embedded in the video stream and sent to the client, and the position and size of the internet of things data display implemented by the OSD technology are displayed according to a preset relative position and display manner based on the position x coordinate and the position y coordinate of the component in the video resolution coordinate system and the size of the component, when the position and the size of the component are reduced, the synchronous Internet of things data 'water works' corresponding to the component are correspondingly changed in position and size, and then OSD fusion display is carried out according to a preset display mode, wherein the component ID is not changed, so that the name 'water works' confirmed according to the component ID is not changed. Therefore, the process of fusing the display models in real time according to the user instruction is completed.
As shown in fig. 7, a schematic diagram of a fusion display effect of the internet of things data and the BIM model after being reduced is shown.
In summary, the embodiment of the present application provides a fusion display method based on internet of things data and a BIM model, including: the server receives a request instruction sent by a user side, wherein the request instruction comprises a BIM (building information modeling) model requested by the user; rendering the BIM requested by the user to obtain a rendering result; obtaining component information corresponding to all components to be added with the data of the Internet of things in the BIM according to the rendering result; generating a BIM model video stream according to the rendering result; embedding the building block information in the BIM model video stream; sending the BIM video stream embedded with the component information to a user side; the user side acquires Internet of things data corresponding to the component information from the Internet of things; and fusing the BIM video stream embedded with the component information with the Internet of things data and then displaying the fused BIM video stream. According to the method, the component information of the BIM model is embedded into the video stream, the Internet of things data and the BIM model are fused at the user side according to the component information to complete the mode of model display, the cloud rendering server only renders an independent model, and the Internet of things data is not rendered, so that the rendering pressure of the cloud rendering server is reduced, the real-time property of cloud rendering is enhanced, delay is reduced, and user experience is improved.
Example two
Based on the fusion display method based on the internet of things data and the BIM model disclosed in the embodiment of the present invention, fig. 8 specifically discloses a fusion display device based on the internet of things data and the BIM model, which applies the fusion display method based on the internet of things data and the BIM model.
As shown in fig. 8, an embodiment of the present invention discloses a fusion display device based on internet of things data and a BIM model, and the fusion display device includes:
a server 810 and a client 820;
wherein the server 810 comprises:
the receiving unit 811 receives a request instruction sent by a user terminal, wherein the request instruction comprises a BIM (building information modeling) model requested by the user;
a rendering unit 812, configured to render the BIM model requested by the user to obtain a rendering result;
the extracting unit 813 is configured to obtain component information corresponding to all components to be added with the internet of things data in the BIM model according to the rendering result;
a generating unit 814, configured to generate a BIM model video stream according to the rendering result;
an embedding unit 815 for embedding the building information in the BIM model video stream;
a sending unit 816, configured to send the BIM model video stream embedded with the component information to a user side;
the user terminal 820 includes:
an obtaining unit 821, configured to obtain internet of things data corresponding to the component information from the internet of things;
and the fusion unit 822 is configured to fuse the BIM model video stream embedded with the component information with the internet of things data and display the fused video stream.
In some embodiments, the extraction unit 813 includes:
the determining unit is used for determining all components to be added with the data of the Internet of things in the BIM;
a processing unit for extracting the building block information from the rendering result according to the determined building block.
In some embodiments, the part information includes a part ID, a part coordinate position, and a part display size of each part in the BIM model.
In some embodiments, the embedding unit 814 is configured to add TS packets with the building block information to the BIM model video stream; and the Packet Head of the TS Data Packet comprises a newly added PID field, and the Packet Data of the TS Data Packet comprises the component information.
In some embodiments, the fusion unit 822 is configured to fuse the BIM model video stream embedded with the building information and the internet of things data through an on-screen menu type adjustment OSD, and display the fused video stream.
For a specific working process and a corresponding embodiment explanation of the server 810, the receiving unit 811, the rendering unit 812, the extracting unit 813, the generating unit 814, the embedding unit 815, the sending unit 816, the user terminal 820, the obtaining unit 821 and the fusing unit 822 in the fusion display device based on the internet of things data and the BIM model disclosed in the above embodiment of the present invention, reference may be made to corresponding contents in the fusion display method based on the internet of things data and the BIM model disclosed in the above embodiment of the present invention, and details are not repeated here.
To sum up, the embodiment of the present application provides a fuse display device based on thing networking data and BIM model, includes: the server receives a request instruction sent by a user side, wherein the request instruction comprises a BIM (building information modeling) model requested by the user; rendering the BIM requested by the user to obtain a rendering result; obtaining component information corresponding to all components to be added with the data of the Internet of things in the BIM according to the rendering result; generating a BIM model video stream according to the rendering result; embedding the building block information in the BIM model video stream; sending the BIM video stream embedded with the component information to a user side; the user side acquires Internet of things data corresponding to the component information from the Internet of things; and fusing the BIM video stream embedded with the component information with the Internet of things data and then displaying the fused BIM video stream. According to the method, the component information of the BIM model is embedded into the video stream, the Internet of things data and the BIM model are fused at the user side according to the component information to complete the mode of model display, the cloud rendering server only renders an independent model, and the Internet of things data is not rendered, so that the rendering pressure of the cloud rendering server is reduced, the real-time property of cloud rendering is enhanced, delay is reduced, and user experience is improved.
In the embodiments provided in the present application, it should be understood that the disclosed method can be implemented in other ways. The above-described method embodiments are merely illustrative.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Although the embodiments disclosed in the present application are described above, the above descriptions are only for the convenience of understanding the present application, and are not intended to limit the present application. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims.

Claims (10)

1. A fusion display method based on Internet of things data and a BIM (building information modeling) model is characterized by comprising the following steps:
the server receives a request instruction sent by a user side, wherein the request instruction comprises a BIM (building information modeling) model requested by the user;
the server side renders a BIM model requested by a user to obtain a rendering result;
the server side obtains component information corresponding to all components to be added with the data of the Internet of things in the BIM according to the rendering result;
the server side generates a BIM video stream according to the rendering result;
the server side embeds the component information in the BIM video stream;
the server side sends the BIM video stream embedded with the component information to the client side;
the user side acquires Internet of things data corresponding to the component information from the Internet of things;
and the user side fuses the BIM video stream embedded with the component information and the data of the Internet of things and displays the video stream.
2. The method according to claim 1, wherein the server obtains component information corresponding to all components to which the data of the internet of things is to be added in the BIM model according to the rendering result, and the method comprises the following steps:
the server side determines all components to be added with the data of the Internet of things in the BIM;
and the server side extracts the component information from the rendering result according to the determined components.
3. The method of claim 1, wherein the part information includes a part ID, a part coordinate position, and a part display size for each part in the BIM model.
4. The method according to claim 1, wherein the server embeds the building information in the BIM model video stream, including:
the server adds a TS data packet with the component information in the BIM video stream; and the Packet Head of the TS Data Packet comprises a newly added PID field, and the Packet Data of the TS Data Packet comprises the component information.
5. The method according to claim 1, wherein the displaying, by the user end, the BIM model video stream embedded with the component information after being fused with the internet of things data comprises:
and the user side fuses the BIM model video stream embedded with the component information and the data of the Internet of things through a screen menu type OSD (on screen display) and displays the video stream.
6. A fusion display device based on data of the Internet of things and a BIM model is characterized by comprising:
a server side and a user side;
wherein, the server side includes:
the receiving unit is used for receiving a request instruction sent by a user side, wherein the request instruction comprises a BIM (building information modeling) model requested by the user;
the rendering unit is used for rendering the BIM requested by the user to obtain a rendering result;
the extraction unit is used for obtaining component information corresponding to all components to be added with the data of the Internet of things in the BIM according to the rendering result;
the generating unit is used for generating a BIM (building information modeling) video stream according to the rendering result;
an embedding unit for embedding the building block information in the BIM model video stream;
the sending unit is used for sending the BIM model video stream embedded with the component information to a user side;
the user side includes:
the acquisition unit is used for acquiring the Internet of things data corresponding to the component information from the Internet of things;
and the fusion unit is used for fusing and displaying the BIM model video stream embedded with the member information and the data of the Internet of things.
7. The apparatus of claim 6, wherein the extraction unit comprises:
the determining unit is used for determining all components to be added with the data of the Internet of things in the BIM;
a processing unit for extracting the building block information from the rendering result according to the determined building block.
8. The apparatus of claim 6, wherein the part information includes a part ID, a part coordinate position, and a part display size of each part in the BIM model.
9. The apparatus according to claim 6, wherein the embedding unit is configured to add TS packets with the building information to the BIM model video stream; and the Packet Head of the TS Data Packet comprises a newly added PID field, and the Packet Data of the TS Data Packet comprises the component information.
10. The apparatus of claim 6, wherein the merging unit is configured to merge the BIM model video stream embedded with the component information with the IOT data through an OSD (on-screen-menu-type) for display.
CN202110727744.3A 2021-06-29 2021-06-29 Fusion display method and device based on Internet of things data and BIM model Active CN113423002B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110727744.3A CN113423002B (en) 2021-06-29 2021-06-29 Fusion display method and device based on Internet of things data and BIM model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110727744.3A CN113423002B (en) 2021-06-29 2021-06-29 Fusion display method and device based on Internet of things data and BIM model

Publications (2)

Publication Number Publication Date
CN113423002A true CN113423002A (en) 2021-09-21
CN113423002B CN113423002B (en) 2023-05-23

Family

ID=77717094

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110727744.3A Active CN113423002B (en) 2021-06-29 2021-06-29 Fusion display method and device based on Internet of things data and BIM model

Country Status (1)

Country Link
CN (1) CN113423002B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115914526A (en) * 2023-01-09 2023-04-04 中建三局信息科技有限公司 BIM (building information modeling) model visualization method, device, equipment and medium based on cloud rendering

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107038554A (en) * 2017-03-30 2017-08-11 浙江精工钢结构集团有限公司 Steel construction BIM informatization management methods and system based on Cloud Server
CN107193911A (en) * 2017-05-14 2017-09-22 北京比目鱼工程咨询有限公司 A kind of three-dimensional visualization engine and WEB application routine call method based on BIM models
CN108074274A (en) * 2017-12-26 2018-05-25 深圳拎得清软件有限公司 BIM model real-time rendering method and devices based on browser
CN108520342A (en) * 2018-03-23 2018-09-11 中建三局第建设工程有限责任公司 Platform of internet of things management method based on BIM and its system
CN108615143A (en) * 2018-06-12 2018-10-02 湖南建工集团有限公司 Device and method based on BIM models Yu O&M information exchange in intelligent building management
CN109492070A (en) * 2018-11-06 2019-03-19 深圳航天智慧城市系统技术研究院有限公司 A kind of city macroscopic view scene three-dimensional visualization plateform system
CN110414792A (en) * 2019-06-28 2019-11-05 万翼科技有限公司 Component centralized procurement management system and Related product based on BIM and big data
CN110751712A (en) * 2019-10-22 2020-02-04 中设数字技术股份有限公司 Online three-dimensional rendering technology and system based on cloud platform
US20200057824A1 (en) * 2018-08-20 2020-02-20 Sri International Machine learning system for building renderings and building information modeling data
CN112053130A (en) * 2020-09-04 2020-12-08 清远蓄能发电有限公司 Pumped storage power station integrated management method, platform, system, equipment and medium
CN112560137A (en) * 2020-12-04 2021-03-26 武汉光谷信息技术股份有限公司 Multi-model fusion method and system based on smart city
CN112669428A (en) * 2021-01-06 2021-04-16 南京亚派软件技术有限公司 BIM (building information modeling) model rendering method based on server and client cooperation

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107038554A (en) * 2017-03-30 2017-08-11 浙江精工钢结构集团有限公司 Steel construction BIM informatization management methods and system based on Cloud Server
CN107193911A (en) * 2017-05-14 2017-09-22 北京比目鱼工程咨询有限公司 A kind of three-dimensional visualization engine and WEB application routine call method based on BIM models
CN108074274A (en) * 2017-12-26 2018-05-25 深圳拎得清软件有限公司 BIM model real-time rendering method and devices based on browser
CN108520342A (en) * 2018-03-23 2018-09-11 中建三局第建设工程有限责任公司 Platform of internet of things management method based on BIM and its system
CN108615143A (en) * 2018-06-12 2018-10-02 湖南建工集团有限公司 Device and method based on BIM models Yu O&M information exchange in intelligent building management
US20200057824A1 (en) * 2018-08-20 2020-02-20 Sri International Machine learning system for building renderings and building information modeling data
CN109492070A (en) * 2018-11-06 2019-03-19 深圳航天智慧城市系统技术研究院有限公司 A kind of city macroscopic view scene three-dimensional visualization plateform system
CN110414792A (en) * 2019-06-28 2019-11-05 万翼科技有限公司 Component centralized procurement management system and Related product based on BIM and big data
CN110751712A (en) * 2019-10-22 2020-02-04 中设数字技术股份有限公司 Online three-dimensional rendering technology and system based on cloud platform
CN112053130A (en) * 2020-09-04 2020-12-08 清远蓄能发电有限公司 Pumped storage power station integrated management method, platform, system, equipment and medium
CN112560137A (en) * 2020-12-04 2021-03-26 武汉光谷信息技术股份有限公司 Multi-model fusion method and system based on smart city
CN112669428A (en) * 2021-01-06 2021-04-16 南京亚派软件技术有限公司 BIM (building information modeling) model rendering method based on server and client cooperation

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
宋雪飞: "基于物联网和BIM技术的塔吊实时交互安全监控平台设计", 《建筑施工》 *
王亭等: "基于BIM与IoT数据的交互方法", 《计算机工程与设计》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115914526A (en) * 2023-01-09 2023-04-04 中建三局信息科技有限公司 BIM (building information modeling) model visualization method, device, equipment and medium based on cloud rendering

Also Published As

Publication number Publication date
CN113423002B (en) 2023-05-23

Similar Documents

Publication Publication Date Title
CN101345865B (en) Image transmitting apparatus, image transmitting method, receiving apparatus, and image transmitting system
EP3050302B1 (en) A server for providing a graphical user interface to a client and a client
JP5121935B2 (en) Apparatus and method for providing stereoscopic 3D video content for LASeR-based terminals
TWI674797B (en) Methods and apparatus for spherical region presentation
US9894391B2 (en) Distribution management apparatus, distribution method, and program
EP3627439A1 (en) Method and device for processing media data
JP2020503792A (en) Information processing method and apparatus
US9723337B2 (en) Distribution control system and distribution system
US20200026418A1 (en) Method and device for sharing position
US20140280722A1 (en) Distribution control system, distribution system, distribution control method, and computer-readable storage medium
WO2012006919A1 (en) Method, terminal and system for subtitle transmission in remote presentation
CN104243920A (en) Image stitching method and device based on basic stream video data packaging
WO2014113684A1 (en) System, apparatus and method for sharing a screen having multiple visual components
CN112653913A (en) Screen projection method and device, client device and readable storage medium
CN113423002B (en) Fusion display method and device based on Internet of things data and BIM model
JP2014049865A (en) Monitor camera system
KR20200020913A (en) Method and apparatus for processing media information
KR102153611B1 (en) Multimedia system information exchange mechanism and network transmission method
WO2024041239A1 (en) Data processing method and apparatus for immersive media, device, storage medium, and program product
TW202249493A (en) Anchoring a scene description to a user environment for streaming immersive media content
WO2023062271A1 (en) A method, an apparatus and a computer program product for video coding
CN109660595B (en) Remote operation method and device for real-time street view
US20120019621A1 (en) Transmission of 3D models
CN114173156A (en) Video transmission method, electronic device, and storage medium
CN113436320B (en) 3D model generation system and method based on IFC model file

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant