TWI709940B - Graphical supervision management method - Google Patents

Abstract

A graphical supervision and management method that uses webGL to provide a graphical platform, wirelessly connects various components through the Internet of Things system of the LORA communication protocol, and uses a personal wearable detector to achieve overall monitoring of the construction work. Personnel and even the surrounding areas of the construction site are within the monitoring scope of the present invention, and can grasp the occurrence of all conditions. Through the application of construction site informatization and intelligent construction technology, and the refined management and control of construction, it can effectively reduce construction costs and improve the decision-making ability of construction sites. And management efficiency, and can reduce the probability of disasters; thereby, the present invention has the effects of safety, visualization, high efficiency, low cost, and high transparency, and can realize a new type of construction site digitization, refinement and intelligence Visual supervisory management mode.

Description

Graphical supervision management method

The present invention relates to a graphical supervision and management method, especially to a new type of visual supervision and management mode that can realize a digital, refined and intelligent construction site. In particular, it refers to the use of webGL to provide a graphical platform through the LORA communication protocol The Internet of Things system wirelessly connects various components, which can effectively reduce construction costs, improve the decision-making ability and management efficiency of the construction site, and reduce the probability of disasters.

Construction site hazards often cause heavy casualties. Therefore, there are quite strict regulations on the management of personnel entering and exiting the construction site, especially when working in confined spaces. However, the current technology is still at the stage of setting up ordinary signs and working on paper. Once a construction site hazard occurs, it is often impossible to clearly understand the number and names of the injured, let alone the physiological signals of the personnel. In addition, at present, it is not possible to grasp the changes in the surrounding environment of the construction site, such as heavy rain and flooding or earthquakes, which often cause major disasters.

Traditionally, when entering and exiting the construction site (especially in construction industry or fixed equipment), the industrial safety personnel will install a notice board at the entrance and exit. There are many types of billboards, the most common of which is passive written billboards: traditional billboard stickers, acrylic, optional aluminum panels and other materials write a notice and post it at the entrance of the construction site. This kind of sign is quite cheap, but it lacks real-time information update, and lacks the management of personnel entry and exit. It has very low protection for construction personnel and does not have active warning and notification functions in the face of emergency.

In view of the fact that passive billboards cannot provide real-time data updates, and they have no integrated personnel to locate key communication equipment, communication protocols and management systems and other mobile alarm management technologies, they cannot identify the number and location of the construction personnel, and fail to connect to environmental or physiological signals. Shortcomings such as the inability to immediately generate warning and identification signals after an accident (for example, a fall) occurs. Therefore, ordinary users cannot meet the needs of users in actual use, and better solutions are still needed in this field to develop overall monitoring to improve the management efficiency of the supervision process.

The main purpose of the present invention is to overcome the above-mentioned problems encountered by the prior art and provide a method that can achieve overall monitoring of construction site engineering operations. The construction personnel and even the peripheral area of the construction site are within the monitoring scope of the present invention and can grasp all conditions. Through the application of site information, smart construction technology, and refined construction management, it can effectively reduce construction costs, improve construction site decision-making capabilities and management efficiency, and reduce the probability of disasters, thereby ensuring safety, visualization, and With high efficiency, low cost, and high transparency, it can realize a graphical supervision management method of a new visual supervision management mode of digitalization, refinement and intelligence on the construction site.

In order to achieve the above objectives, the present invention is a graphical supervision and management method, which is used to automatically and extensively provide graphical resource monitoring through the Internet of Things. A visual remote management of a construction site is suitable for a management system and image processing module. Groups, wearable detectors, environment detectors, vehicle detectors, emergency notification devices, IoT systems, and supervision devices of the icon platform. The method includes at least the following steps: a personnel detection step: each construction worker They are all wearing a wearable detector. The wearable detector is used to perform on-site check-in of the worker, and detect the worker’s temperature, heartbeat and human body motion information, and generate information about the worker The detection signal is transmitted to the Internet of Things system, where the detection signal includes the temperature (temp), pulse (Pulse), acceleration (G) of displacement and positioning signal of the construction worker; an environment detection step: from at least one The environmental detector detects an environmental information in a monitoring area and transmits it to the Internet of Things system, and the environmental information is associated with a water level detection value and a rain detection in the monitoring area Value, an inclination (incline) detection value, and a vibration (vibration) detection value; a vehicle detection step: the vehicle detector tracks and controls the access control data of vehicles entering and exiting a construction site area and the construction site area For the dynamic data in the vehicle, each vehicle is equipped with a radio frequency identification tag with identification data to monitor and track the access control data and dynamic data of the vehicle equipped with the radio frequency identification tag in real time and transmit it to the Internet of Things system; an Internet of Things processing step : The Internet of Things system processes and analyzes the communication traffic and network traffic of the wearable detectors, the environment detector, the vehicle detector, and the emergency announcing device, and is measured according to the environment detector At least one kind of environmental information is calculated and when an emergency status message is generated, the emergency annunciator is activated to send an emergency notification signal, and a message program is used to transmit the emergency status message to the outside. The Internet of Things system will obtain the construction personnel The detection signal, the environmental information, the access control data and dynamic data of the vehicle, and the emergency notification signal are transmitted to the icon platform; a project management step: the management system processes the site management operations to generate a project The construction information is passed to the icon platform, where the construction information includes work order, construction timeline, public works negotiation and communication, on-site equipment inventory (inventory), and on-site equipment regular maintenance inspection single; An image recognition step: the image processing module adjusts an original image captured by an image capturing module around a construction site to generate a corrected image, and generates an image recognition data based on the corrected image and transmits it to the image Display platform, where the image recognition data includes the number of people or vehicles around the construction site, a construction site electronic fence intrusion detection, and a disaster identification; and a graphical step: the graphic platform uses the WebGL drawing standard to receive The construction personnel’s detection signal, the environmental information, the access control data and dynamic data of the vehicle, the emergency notification signal, the construction information of the project, and the image identification data are visually programmed in a 3D model, and finally Graphical representations are presented on the web and mobile devices.

In the foregoing embodiment of the present invention, the management system integrates a dispatch unit, a construction operation unit, a notice unit, an equipment database, and an equipment maintenance unit. In the above embodiment of the present invention, the wearable detector has a radio frequency identification (RFID) element and at least one physiological detection element.

In the above embodiment of the present invention, the physiological detection element includes an integrated thermometer, a multi-axis accelerometer, a global positioning system (GPS), and an optical sensor.

In the above embodiment of the present invention, the image processing module includes a feature recognition unit, an image recognition unit, and an environment recognition unit.

In the above embodiment of the present invention, the image capture module includes a camera (carear) and a video recording device (Network video recorder, NVR).

In the above embodiment of the present invention, the emergency announcing device is selected from the group consisting of a light indicator and an audible indicator.

In the above embodiment of the present invention, the message program is a short message service message (SMS) program, LINE, WHATSAPP, SKYPE, instant messaging program, WeChat, Twitter Send at least one of TWITTER or email program.

In the above embodiment of the present invention, the icon platform, the wearable detectors, the environment detector, the vehicle detector, and the emergency announcing device are wirelessly connected to the Internet of Things system with a long The distance low power transmission protocol and the Internet of Things system receive and transmit signals.

In the above embodiment of the present invention, the long-distance low-power transmission protocol is a LoRa communication protocol.

In the above embodiment of the present invention, the wearable detector further includes a trigger feedback element. When the Internet of Things system generates the emergency state message, the trigger feedback element will be activated to send a vibration notification to the constructor.

In the above-mentioned embodiment of the present invention, an augmented reality step is further included. An augmented reality image is generated from the graphical platform, and the Internet of Things system is used with an augmented reality (Augmented Reality , AR) communication with the visualization device, the augmented reality visualization device receives and displays the augmented reality image.

In the foregoing embodiment of the present invention, the augmented reality imaging device is a head-mounted display.

In the above-mentioned embodiment of the present invention, the scope of the monitoring area is 50% to 80% radially spreading outward with the construction site area as the center.

In the above embodiment of the present invention, the reading range of the vehicle detector is within 2 meters.

In the above embodiment of the present invention, the graphic platform is provided with a communication unit, which can transmit graphics to the web and mobile devices by at least one of Wi-Fi, Ethernet, 4G, 5G, or wireless satellite communication.

100‧‧‧Supervision device

1‧‧‧Management System

11‧‧‧Working Unit

12‧‧‧Construction operation unit

13‧‧‧Announcement Unit

14‧‧‧Equipment Database

15‧‧‧Equipment Maintenance Unit

2‧‧‧Image Processing Module

21‧‧‧Feature Recognition Unit

22‧‧‧Image recognition unit

23‧‧‧Environmental Identification Unit

3‧‧‧Wearable detector

31‧‧‧Radio Frequency Identification Components

32: Physiological detection element

321: Clinical Thermometer

322: Multi-axis accelerometer

323: Global Positioning System

324: Optical Sensor

4: Environmental detector

5: Vehicle detector

6: Emergency notification device

61: light indicator

62: auditory indicator

7: IoT system

8: Graphical platform

81: Communication unit

9: Image capture module

91: camera

92: video equipment

10: Augmented reality imaging device

s11~s18: steps

Figure 1 is a schematic flow diagram of the graphical supervision and management method of the present invention.

Figure 2 is a block diagram of the supervision device of the present invention.

Please refer to "Figure 1 and Figure 2", which are respectively a schematic diagram of the process of the graphical supervision management method of the present invention and a block diagram of the supervision device of the present invention. As shown in the figure: the present invention is a graphical supervision and management method, which is used to automatically and extensively provide graphical resource monitoring through the Internet of Things. Visual remote management of a construction site is suitable for a supervision device 100. The supervision device 100 It includes a management system 1, an image processing module 2, a number of wearable detectors 3, at least one environmental detector 4, a vehicle detector 5, an emergency notification device 6, an Internet of Things system 7, and a The platform 8 is shown in the figure.

The aforementioned management system 1 integrates a dispatch unit 11, a construction operation unit 12, a notice unit 13, an equipment database 14, and an equipment maintenance unit 15.

The image processing module 2 includes a feature recognition unit 21, an image recognition unit 22, and an environment recognition unit 23, and the image processing module 2 is connected to an image capture module 9, the image capture module 9 including A video camera (carear) 91 and a network video recorder (NVR) 92.

Each of the wearable detectors 3 has a radio frequency identification (RFID) element 31 and at least one physiological detection element 32. The physiological detection element 32 includes an integrated thermometer 321, a multi-axis accelerometer 322, and a global positioning system (GPS). ) 323, and an optical sensor 324.

The at least one environment detector 4 is arranged in a monitoring area, the vehicle detector 5 is arranged in a construction site area, and the monitoring area is extended radially outwardly with the construction site area as the center. Between %~80%.

The emergency annunciator 6 is selected from the group consisting of a light indicator 61 and an audible indicator 62.

The icon platform 8 is connected to the management system 1 and the image processing module 2, and is provided with a communication unit 81 that can transmit external information, and the icon platform 8, the wearable detectors 3, and the environment The detector 4, the vehicle detector 5, and the emergency annunciator 6 are wirelessly connected to the Internet of Things system 7, and communicate with the Internet of Things system 7 through a long-distance low-power transmission protocol, such as the LoRa communication protocol. The reception and transmission of signals.

The present invention uses the above-mentioned supervision device 100 to implement a graphical supervision management method, which at least includes the following steps:

Personnel detection step s11: each wearable detector 3 is worn on a construction worker, the RFID element 31 is used to call the worker on-site, and the physiological detection element 32 is used to detect the The construction personnel’s temperature, heartbeat and human body motion information generate detection signals about the construction personnel and transmit them to the IoT system 7. The detection signals include the construction personnel’s body temperature (temp) and pulse (Pulse), To understand the vital signs of the user; the acceleration of displacement (G) to observe whether the user may fall or fall down due to the instantaneous height difference; and the positioning signal to monitor the user's range of motion and current position.

Environment detection step s12: at least one environment detector 4 detects an environment information in the monitoring area and transmits it to the IoT system 7, and the environment information is related to a water level in the monitoring area Detection values, such as the water level of rivers and seas, High tide and low tide; a rain detection value to prevent instant heavy rain; an incline detection value to observe the slope state of the hillside; and a vibration detection value to monitor whether there is ground near the construction site shock.

Vehicle detection step s13: The vehicle detector 5 uses GPS and RFID technology to track and control the access control data of vehicles entering and leaving the construction site area and the dynamic data located in the construction site area. Each vehicle is equipped with an identification data The radio frequency identification tag is used to monitor and track the access control data and dynamic data of the vehicle equipped with the radio frequency identification tag in real time, so as to control the entry and exit of the construction site and the range of activities of only vehicles related to the construction work of the construction site, and the access control data of this vehicle and The dynamic data is transferred to the IoT system 7. The reading range of the vehicle detector 5 is within 2 meters.

Internet of Things processing step s14: The Internet of Things system 7 processes and analyzes the traffic and network traffic of the wearable detectors 3, the environment detector 4, the vehicle detector 5, and the emergency announcing device 6 , And according to at least one of the environmental information measured by the environmental detector 4, such as the rainfall detection value or the vibration detection value, during the calculation, if a disaster such as heavy rain or earthquake is confirmed, an emergency status message is generated and the emergency is activated The annunciator 6 sends out an emergency notification signal, flashing, beeping or voice broadcast, reminding the construction personnel to withdraw from the construction site, and using a message program to transmit the emergency status message to a monitoring terminal, the Internet of Things The system 7 transmits the detection signal of the construction worker, the environmental information, the access control data and dynamic data of the vehicle, and the emergency notification signal to the icon platform 8. The message program is sent by at least one of the short message service message (SMS) program, LINE, WHATSAPP, SKYPE, instant messaging program, WeChat, Twitter, or email program.

Project management step s15: the management system 1 uses the dispatch unit 11 and the construction The work industry unit 12, the notice unit 13, the equipment database 14, and the equipment maintenance unit 15 perform site management operations on the construction site, and after processing, generate a piece of construction information and transmit it to the icon platform 8, wherein the project The construction information includes work order, construction timeline, public works negotiation and communication, inventory of on-site equipment (inventory), and inspection list for regular maintenance of on-site equipment before the construction site.

Image recognition step s16: The image capturing module 9 captures an original image through the camera 91 and its recording equipment 92 around a construction site, and the image processing module 2 receives the original image and passes through the feature recognition unit 21, The image recognition unit 22 and the environment recognition unit 23 are adjusted to generate a calibrated image, and an image recognition data is generated based on the calibrated image and transmitted to the icon platform 8, wherein the image recognition data includes people or people around the construction site The number of vehicles; a construction site electronic fence intrusion detection to prevent construction workers or other suspicious persons from accidentally entering dangerous or restricted areas; and a disaster identification, such as fire identification.

Graphical step s17: The graphic platform 8 uses the WebGL drawing standard to receive the detection signal of the construction worker, the environmental information, the access control data and dynamic data of the vehicle, the emergency notification signal, the construction information, Perform 3D model visual programming with the image recognition data to generate a visual graphic structure, and transmit the graphic by at least one communication unit of Wi-Fi, Ethernet, 4G, 5G, or wireless satellite communication The structure is connected to the web terminal and mobile devices (such as mobile phones), so that the monitoring terminal can visually and intuitively reflect the 3D site layout of the site during the construction phase.

In one embodiment, the wearable detector 3 further includes a trigger feedback element (not shown in the figure), and the Internet of Things system 7 will activate the The feedback element is triggered to send a vibration notification to the constructor.

In one embodiment, it further includes an augmented reality (Augmented Reality, AR) step s18. An augmented reality image is generated from the graphical platform and expanded by the Internet of Things system 7 and one of the monitoring terminals. The augmented reality imaging device 10 communicates, and the augmented reality imaging device 10 receives and displays the augmented reality image. Among them, the augmented reality display device 10 can be a head-mounted display, such as glasses, which allows designers and managers to directly experience the scene of field investigations through the three-dimensional model, experience more realistic construction site scenes, and greatly improve the construction site The feasibility and safety of construction reduce the risk of rework and reorganization of the construction site. If so, a brand-new graphical supervision and management method is formed by the above disclosed process.

The graphical supervision and management method of the present invention uses webGL to provide a graphical platform, wirelessly connects various components through the Internet of Things system of the LORA communication protocol, and uses personal wearable detectors to achieve overall monitoring of construction sites , The construction personnel and even the peripheral area of the construction site are within the monitoring scope of the present invention, and all the occurrences of the situation can be grasped. Through the application of construction site informatization and intelligent construction technology, and the refined control of construction, it can effectively reduce the construction cost and improve the construction. On-site decision-making ability and management efficiency, and can reduce the probability of disasters; thereby, the present invention has the effects of safety, visualization, high efficiency, low cost, and high transparency, and can realize a digital, refined and intelligent construction site A new and visualized supervision and management mode.

To sum up, the present invention is a graphical supervision and management method, which can effectively improve the various shortcomings of conventional use, and can achieve overall monitoring of construction site engineering operations. The construction personnel and even the peripheral areas of the construction site are within the monitoring scope of the present invention. The occurrence of all conditions, through the application of site information, intelligent construction technology, and refined construction management, can effectively reduce construction costs, improve construction site decision-making capabilities and management efficiency, and It can reduce the probability of disasters, and thus has the effects of safety, visualization, high efficiency, low cost, and high transparency. It can realize a new type of visual supervision and management mode of construction site digitization, refinement and intelligence, thereby making the present invention Produces that can be more advanced, more practical, and more in line with the needs of users, and indeed meet the requirements of an invention patent application, and a patent application is filed in accordance with the law.

However, the above are only preferred embodiments of the present invention, and should not be used to limit the scope of implementation of the present invention; therefore, all simple equivalent changes and modifications made in accordance with the scope of the patent application of the present invention and the content of the description of the invention , Should still fall within the scope of the invention patent.

s11~s18‧‧‧step

Claims (15)

A graphical supervision and management method, which is used to automatically and extensively provide graphical resource monitoring through the Internet of Things. Visual remote management of a construction site. It is suitable for a management system, image processing module, wearable detector, and environment. Detectors, vehicle detectors, emergency notification devices, IoT systems, and supervision devices of the icon platform. The method includes at least the following steps: a personnel detection step: each construction worker wears a wearable detector , Using the wearable detector to perform on-site call-in and check-in of the worker, and detect the worker’s temperature, heartbeat and human body motion information, generate a detection signal about the worker and transmit it to the IoT system, The detection signal includes the temperature (temp), pulse (Pulse), acceleration (G) of displacement, and positioning signal of the construction worker; an environment detection step: at least one environment detector detects the temperature in a monitoring area An environmental information is transmitted to the Internet of Things system, and the environmental information is associated with a water level detection value, a rain detection value, an incline detection value, And a vibration detection value, where the scope of the monitoring area is 50%~80% radially spreading outward from a construction site area as the center; a vehicle detection step: tracking by the vehicle detector And control the access control data of vehicles entering and exiting the construction site area and the dynamic data in the construction site area. Each vehicle is equipped with a radio frequency identification tag with identification data to monitor and track the access control information of the vehicle equipped with the radio frequency identification tag in real time And dynamic data and transfer to the Internet of Things system; an Internet of Things processing step: the Internet of Things system processes and analyzes the wearable detection The traffic and network traffic of the detector, the environment detector, the vehicle detector, and the emergency annunciator, and at least one of the environmental information measured by the environment detector is calculated to generate an emergency When a status message is activated, the emergency annunciator is activated to send an emergency notification signal, and a message program is used to transmit the emergency status message to the outside. The Internet of Things system will obtain the detection signal of the constructor, the environmental information, and the access control of the vehicle Data and dynamic data, and the emergency notification signal are transmitted to the graphic platform; a project management step: the management system processes the site management operations to generate a project construction information and transmits it to the graphic platform, where the project The construction information includes work order, construction timeline, public works negotiation and communication, inventory of on-site equipment (inventory), and inspection list for regular maintenance of on-site equipment; an image recognition step: by the image processing module An original image captured by an image capturing module around a construction site is adjusted to generate a corrected image, and an image identification data is generated based on the corrected image and transmitted to the icon platform, wherein the image identification data includes the construction site The number of people or vehicles around, a construction site electronic fence intrusion detection, and a disaster identification; and a graphical step: the graphic platform uses the WebGL drawing standard to receive the detection signal of the construction personnel and the environment The information, the access control data and dynamic data of the vehicle, the emergency notification signal, the construction information, and the image identification data are visually programmed in a 3D model, and finally displayed on the web and mobile devices as a graphic representation . According to the graphical supervision management method described in item 1 of the scope of patent application, the management system integrates a dispatch unit, a construction operation unit, a notification unit, an equipment database, and an equipment maintenance unit. According to the graphical supervision and management method described in item 1 of the scope of patent application, the wearable detector has a radio frequency identification (RFID) element and at least one physiological detection element. According to the graphical supervision and management method described in item 3 of the scope of patent application, the physiological detection element includes an integrated thermometer, a multi-axis accelerometer, a global positioning system (GPS), and an optical sensor. According to the graphical supervision management method described in item 1 of the scope of patent application, the image processing module includes a feature recognition unit, an image recognition unit, and an environment recognition unit. According to the graphical supervision and management method described in item 1 of the scope of patent application, the image capture module includes a camera (carear) and a video recording device (Network video recorder, NVR). According to the graphical supervision management method described in item 1 of the scope of patent application, the emergency notification device is selected from the group consisting of a light indicator and an auditory indicator. According to the graphical supervision and management method described in item 1 of the scope of patent application, the message program is a short message service message (SMS) program, LINE, WHATSAPP, SKYPE, instant messaging program, WeChat, Twitter (TWITTER) or electronic At least one of the mail programs sent. According to the graphical supervision and management method described in item 1 of the scope of patent application, the graphical platform, the wearable detectors, the environment detector, the vehicle detector, and the emergency notification device are wireless Connect to the Internet of Things system to receive and transmit signals with the Internet of Things system through a long-distance low-power transmission protocol. According to the graphical supervision and management method described in item 9 of the scope of patent application, the long-distance low-power transmission protocol is a LoRa communication protocol. According to the graphical supervision and management method described in item 1 of the scope of patent application, the wear The wearable detector further includes a trigger feedback element. When the IoT system generates the emergency state message, the trigger feedback element will be activated to send a vibration notification to the construction worker. The graphical supervision management method described in item 1 of the scope of patent application further includes an augmented reality step. An augmented reality image is generated from the graphical platform, and the Internet of Things system and a monitoring terminal An augmented reality (Augmented Reality, AR) imaging device communicates, and the augmented reality imaging device receives and displays the augmented reality image. According to the graphical supervision and management method described in item 12 of the scope of patent application, the augmented reality imaging device is a head-mounted display. According to the graphical supervision and management method described in item 1 of the scope of patent application, the reading range of the vehicle detector is within 2 meters. According to the graphic supervision and management method described in the first item of the patent application, the graphic platform is provided with a communication unit, which can be transmitted by at least one of Wi-Fi, Ethernet, 4G, 5G, or wireless satellite communication Graphics to the web and mobile devices.

Images