CN106780248A - City internet of things equipment operation control system and method based on big data technology - Google Patents

City internet of things equipment operation control system and method based on big data technology Download PDF

Info

Publication number
CN106780248A
CN106780248A CN201611076429.4A CN201611076429A CN106780248A CN 106780248 A CN106780248 A CN 106780248A CN 201611076429 A CN201611076429 A CN 201611076429A CN 106780248 A CN106780248 A CN 106780248A
Authority
CN
China
Prior art keywords
device data
big data
sends
equipment
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611076429.4A
Other languages
Chinese (zh)
Inventor
李杨
李泠杉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Terminus Beijing Technology Co Ltd
Original Assignee
Terminus Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Terminus Beijing Technology Co Ltd filed Critical Terminus Beijing Technology Co Ltd
Priority to CN201611076429.4A priority Critical patent/CN106780248A/en
Publication of CN106780248A publication Critical patent/CN106780248A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2462Approximate or statistical queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/06Electricity, gas or water supply
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2216/00Indexing scheme relating to additional aspects of information retrieval not explicitly covered by G06F16/00 and subgroups
    • G06F2216/05Energy-efficient information retrieval
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention provides a kind of city internet of things equipment operation control system based on big data technology and method, wherein method includes:Collector gathers the device data of at least one internet of things equipment, and the device data that will be collected is sent to concentrator, wherein, device data includes facility information and environmental information;Concentrator sends to cloud gateway device data;Cloud gateway sends device data to message system;Message system carries out separating treatment to device data, is sent to Streams Module or big data analysis module device data according to preset rules;Equipment characteristic is saved in database by Streams Module according to default Different Rule, the equipment characteristic in extraction equipment data;Big data analysis module is counted and inquired about, and carries out energy analysis making Energy Saving Strategy model;Operation management platform performs management operation according to the data that Streams Module and big data analysis module are produced, and sends control information to cloud gateway.

Description

City internet of things equipment operation control system and method based on big data technology
Technical field
The present invention relates to data processing field, more particularly to a kind of city internet of things equipment operation based on big data technology Control system and method.
Background technology
Internet of Things (Internet of things, IoT) is the connected internet of thing thing, is the weight of generation information technology Part is wanted, is also the important development stage in " informationization " epoch.
Smart city is exactly with information and communication technology (ICT) means sensing, analysis, integrates each of city operations core system Item key message, so as to being made including the various demands including the people's livelihood, environmental protection, public safety, urban service, industry and commerce activity Intelligent response.Its essence is advanced information technology is utilized, realize the management of city intelligent formula and run, and then be the people in city More good days is created, promotes harmony, the Sustainable Growth in city.
Internet of Things is applied to smart city, due to there is substantial amounts of equipment, can produce the problem of various operation controls, including: How equipment quick search, how equipment to patrol and examine, and large number quipments adjustment and upgrades, and how device data is collected, how using sea One of the device data of amount simultaneously produces value etc., but do not there is perfect operation control program to solve the above problems now.
The content of the invention
It is contemplated that at least overcoming one of drawbacks described above to provide a kind of city internet of things equipment based on big data technology Operation control system and method, so as to be effectively controlled to city internet of things equipment operation.
To reach above-mentioned purpose, what technical scheme was specifically realized in:
One aspect of the present invention provides a kind of city internet of things equipment operation control system based on big data technology, Including:At least one collector, each collector is used to gather the device data of at least one internet of things equipment, and will collect Device data send to concentrator, wherein, device data include facility information and environmental information;At least one concentrator, Each concentrator is used to receive the device data of collector transmission, and device data is sent to cloud gateway;At least one cloud net Close, each cloud gateway is used to receive the device data of concentrator transmission, and sends device data to message system, receives operation pipe The control information that platform sends;Message system, for carrying out separating treatment to device data, according to preset rules by number of devices According to transmission to Streams Module or big data analysis module;Streams Module, the number of devices for receiving message system transmission According to, and according to default Different Rule, the equipment characteristic in extraction equipment data, and equipment characteristic is saved in number According to storehouse;Big data analysis module, the device data for receiving message system transmission, is counted and is inquired about, and carried out the energy Analysis makes Energy Saving Strategy model;Operation management platform, for using Web User Interface, according to Streams Module and big data The data that analysis module is produced perform management operation, and send control information to cloud gateway.
In addition, cloud gateway uses Haproxy+Keepalived as load balancing.
In addition, message system is realized using Kafka.
In addition, Streams Module, is additionally operable to the condition set according to trigger, when equipment characteristic reaches threshold range When, triggering prompting event to operation management platform.
In addition, big data analysis module receive in the following way message system transmission device data, counted and Inquiry, and carry out energy analysis making Energy Saving Strategy model:Message system, being additionally operable to send device data to Hadoop is carried out Storage;Big data analysis module, the device data stored to Hadoop is sent specifically for obtaining message system, is based on Hadoop is counted and inquired about, and carries out energy analysis making Energy Saving Strategy model.
In addition, big data analysis module, specifically for using Spark SQL query HDFS, the energy, system is analyzed using MLib Make Energy Saving Strategy model.
In addition, management operation includes:Equipment query, equipment alarm treatment, the inquiry of area equipment batch updating, statistics And/or report form showing.
Another aspect of the present invention provides a kind of city internet of things equipment operation controlling party based on big data technology Method, including:Collector gathers the device data of at least one internet of things equipment, and the device data that will be collected is sent to concentration Device, wherein, device data includes facility information and environmental information;Concentrator receives the device data that collector sends, and will Device data is sent to cloud gateway;Cloud gateway receives the device data that concentrator sends, and sends device data to message system; Message system carries out separating treatment to device data, is sent to Streams Module or big number device data according to preset rules According to analysis module;Streams Module receives the device data that message system sends, and according to default Different Rule, extraction equipment Equipment characteristic in data, and equipment characteristic is saved in database;Big data analysis module receives message system The device data of transmission, is counted and is inquired about, and carries out energy analysis making Energy Saving Strategy model;Operation management platform is used Web User Interface, the data produced according to Streams Module and big data analysis module perform management operation, and are sent out to cloud gateway Send control information;Cloud gateway receives the control information that operation management platform sends.
In addition, cloud gateway uses Haproxy+Keepalived as load balancing.
In addition, message system is realized using Kafka.
In addition, method also includes:The condition that Streams Module is set according to trigger, when equipment characteristic reaches threshold value During scope, triggering prompting event to operation management platform.
In addition, big data analysis module receives the device data that message system sends, counted and inquired about, and carried out energy Source analysis makes Energy Saving Strategy model to be included:Big data analysis module obtains message system and sends to setting that Hadoop is stored Standby data;Big data analysis module is counted and inquired about based on Hadoop, and carries out energy analysis making Energy Saving Strategy model.
In addition, big data analysis module receives the device data that message system sends, counted and inquired about, and carried out energy Source analysis makes Energy Saving Strategy model to be included:Big data analysis module receives the device data that message system sends, and uses Spark SQL query HDFS, the energy is analyzed using MLib, makes Energy Saving Strategy model.
In addition, management operation includes:Equipment query, equipment alarm treatment, the inquiry of area equipment batch updating, statistics And/or report form showing.
As seen from the above technical solution provided by the invention, the city thing based on big data technology that the present invention is provided Networked devices operation control system and method, operation management platform can obtain the phase of Streams Module and big data analysis module Data are closed, so as to be effectively controlled to city internet of things equipment operation according to the result of monitoring.
Brief description of the drawings
Technical scheme in order to illustrate more clearly the embodiments of the present invention, below will be to that will use needed for embodiment description Accompanying drawing be briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for this For the those of ordinary skill in field, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings Accompanying drawing.
Fig. 1 is the knot of the city internet of things equipment operation control system based on big data technology provided in an embodiment of the present invention Structure schematic diagram;
Fig. 2 shows that Streams Module provided in an embodiment of the present invention triggers a specific example of prompting event;
Fig. 3 shows that big data analysis module provided in an embodiment of the present invention carries out the specific example of data analysis;
Fig. 4 is the stream that the city internet of things equipment based on big data technology provided in an embodiment of the present invention runs control method Cheng Tu.
Specific embodiment
Embodiments of the present invention are described in detail below in conjunction with the accompanying drawings.
Fig. 1 is the knot of the city internet of things equipment operation control system based on big data technology provided in an embodiment of the present invention Structure schematic diagram, referring to Fig. 1, the city internet of things equipment operation control system based on big data technology provided in an embodiment of the present invention System, including:
At least one collector 101, each collector 101 is used to gather the device data of at least one internet of things equipment, And the device data that will be collected is sent to concentrator 102, wherein, device data includes facility information and environmental information;
At least one concentrator 102, each concentrator 102 is used to receive the device data of the transmission of collector 101, and will set For data is activation to cloud gateway 103;
At least one cloud gateway 103, each cloud gateway 103 is used to receive the device data of the transmission of concentrator 102, and to disappearing Breath system 104 sends device data, receives the control information that operation management platform 107 sends;
Message system 104, for carrying out separating treatment to device data, sends to number device data according to preset rules According to flow module 105 or big data analysis module 106;
Streams Module 105, the device data for receiving the transmission of message system 104, and according to default Different Rule, Equipment characteristic in extraction equipment data, and equipment characteristic is saved in database;
Big data analysis module 106, the device data for receiving the transmission of message system 104, is counted and is inquired about, and Carry out energy analysis and make Energy Saving Strategy model;
Operation management platform 107, for using Web User Interface, according to Streams Module 105 and big data analysis module 106 data for producing perform management operation, and send control information to cloud gateway 103.
As can be seen here, controlled by the city internet of things equipment operation based on big data technology provided in an embodiment of the present invention System, operation management platform can obtain the related data of Streams Module and big data analysis module, so as to according to monitoring Result is effectively controlled to city internet of things equipment operation.
Specifically, internet of things equipment is the equipment for referring to the accession to Internet of Things, and such as street lamp, gate inhibition, garage are argued for the sake of arguing, the present invention The particular content of equipment is not limited to, as long as the equipment that can access Internet of Things all should belong to protection scope of the present invention.
Collector 101, can specifically collect internet of things equipment information and environmental information etc., can specifically include but not limit Opening, voltage, temperature in equipment etc., and timing uploads to concentrator 102.
Concentrator 102 is the transmission intermediary of IoT equipment thing (networked devices), its can according to the type of collector 101 and Deployed environment is different, supports the transmission means such as wired, Wifi, LoRa.Concentrator 102 can receive the number of the transmission of collector 101 According to, and upload to cloud gateway 103.
Cloud gateway 103 is the Network Access Point of cloud platform, specifically for receiving the device data for flowing into, and is sent out to equipment Send instruction.Used as an optional embodiment of the embodiment of the present invention, cloud gateway 103 uses Haproxy+Keepalived conducts Load balancing, it is possible thereby to ensure the extension of system, improves system saturation.
Because the inflow data of cloud gateway 103 there are multiple systems to be required for using and analyze, implement accordingly, as the present invention One optional embodiment of example, message system 104 can carry out the separation of message using the message distributing system Kafka for increasing income Treatment, i.e. message system 104 are realized using Kafka.It is possible thereby to ensure the extension of system, system saturation is improved.
Used as an optional embodiment of the embodiment of the present invention, message system 104 can be according to preset rules by portion Data are processed for Streams Module 105 in the form of streaming by the consumption interface of Kafka;Another data Cun Chudao Hadoop, big data analysis is carried out for big data analysis module 106.
Used as an optional embodiment of the embodiment of the present invention, Streams Module 105 can be flowed with monitoring information system 104 The device data for entering, according to the Different Rule for setting, extracts equipment characteristic, and be saved in Mysql databases.The data Storehouse saves the parameters such as the presence of equipment, heart time, voltage, temperature.Subsequently to use.
Used as an optional embodiment of the embodiment of the present invention, Streams Module 105 is additionally operable to be set according to trigger Condition, when equipment characteristic reaches threshold range, triggering prompting event is to operation management platform 107.Specifically, data The condition that flow module 105 is set according to trigger, when state or desired value reach threshold range, trigger notice or alarm thing Part.Fig. 2 shows that Streams Module 105 triggers a specific example of prompting event, but the invention is not limited in this.Thus Prompting supervisor, facilitates personal management.
Used as an optional embodiment of the embodiment of the present invention, big data analysis module 106 is received in the following way The device data that message system 104 sends, is counted and is inquired about, and carries out energy analysis making Energy Saving Strategy model:Message System 104, is additionally operable to send device data to Hadoop and is stored;Big data analysis module 106, disappears specifically for obtaining Breath system 104 sends the device data stored to Hadoop, is counted based on Hadoop and is inquired about, and carries out the energy point Analysis makes Energy Saving Strategy model.It is possible thereby in the case of business growth and history log sustainable growth, be taken by increasing Business device node, it is ensured that the health operation of system
Big data analysis module 106 specifically, can be based on the Spark systems increased income, and use Spark SQL queries HDFS, for the statistics class data query of mass data;The energy is analyzed using MLib, Energy Saving Strategy model is made.Fig. 3 shows Big data analysis module 106 carries out the specific example of data analysis, but the invention is not limited in this.It is possible thereby to so that big number According to analysis simple and fast.
Operation management platform 107 is the Web User Interface that administrative staff use, and is analyzed according to Streams Module and big data Streams Module and perform management operation that module is produced, send control information to cloud gateway 103.Wherein, management operation is main Including herein below:Equipment query, equipment alarm treatment, the inquiry of area equipment batch updating, statistics and/or form exhibition It is existing.Thereby guarantee that diversification and the convenience of operation management.
In the present invention, in view of the data volume of City-level Internet of Things, it is desirable to which, when equipment rolls up, system is can for system Extension.Therefore, the present invention provide system from it is following some ensure that horizontal extension:
1st, cloud gateway can make load balancing using Haproxy+Keepalived, and gateway server node can arbitrarily increase Plus;
2nd, message system uses Kafka, by increasing server node, with any level extended capability;
3rd, Hadoop is used as distributed document database, business increase and history log sustainable growth in the case of, By increasing server node, the health operation of system is also ensured that.
Fig. 4 shows the city internet of things equipment operation control method based on big data technology provided in an embodiment of the present invention Flow chart, and the city internet of things equipment operation control method based on big data technology provided in an embodiment of the present invention is applied to Said system, is only briefly described to the city internet of things equipment operation control method based on big data technology below, other Unaccomplished matter, referring specifically to the related description of said system.It is provided in an embodiment of the present invention based on big data technology referring to Fig. 4 City internet of things equipment operation control method, including:
S401, collector gathers the device data of at least one internet of things equipment, and the device data that will be collected sends To concentrator, wherein, device data includes facility information and environmental information;
S402, concentrator receives the device data that collector sends, and device data is sent to cloud gateway;
S403, cloud gateway receives the device data that concentrator sends, and sends device data to message system;
S404, message system carries out separating treatment to device data, is sent to data device data according to preset rules Flow module or big data analysis module;
S405, Streams Module receives the device data that message system sends, and according to default Different Rule, extraction sets Equipment characteristic in standby data, and equipment characteristic is saved in database;
S406, big data analysis module receives the device data that message system sends, and is counted and is inquired about, and carries out energy Source analysis makes Energy Saving Strategy model;
S407, operation management platform uses Web User Interface, is produced according to Streams Module and big data analysis module Data perform management operation, and send control information to cloud gateway;
S408, cloud gateway receives the control information that operation management platform sends.
As can be seen here, controlled by the city internet of things equipment operation based on big data technology provided in an embodiment of the present invention Method, operation management platform can obtain the related data of Streams Module and big data analysis module, so as to according to monitoring Result is effectively controlled to city internet of things equipment operation.
Used as an optional embodiment of the embodiment of the present invention, cloud gateway is using Haproxy+Keepalived as negative Carry balanced.It is possible thereby to ensure the extension of system, system saturation is improved.
Used as an optional embodiment of the embodiment of the present invention, message system is realized using Kafka, similarly, thus The extension of system can be ensured, system saturation is improved.
Used as an optional embodiment of the embodiment of the present invention, method also includes:Streams Module sets according to trigger The condition put, when equipment characteristic reaches threshold range, triggering prompting event to operation management platform.Thus prompting supervision Personnel, facilitate personal management.
Used as an optional embodiment of the embodiment of the present invention, big data analysis module receives setting for message system transmission For data, being counted and inquired about, and carry out energy analysis making Energy Saving Strategy model includes:Big data analysis module is obtained and disappeared Breath system sends the device data stored to Hadoop;Big data analysis module is counted and inquired about based on Hadoop, And carry out energy analysis making Energy Saving Strategy model.It is possible thereby in business growth and the situation of history log sustainable growth Under, by increasing server node, it is ensured that the health operation of system.
Used as an optional embodiment of the embodiment of the present invention, big data analysis module receives setting for message system transmission For data, being counted and inquired about, and carry out energy analysis making Energy Saving Strategy model includes:Big data analysis module is received and disappeared The device data that breath system sends, using Spark SQL query HDFS, the energy is analyzed using MLib, makes Energy Saving Strategy model. It is possible thereby to so that big data analysis simple and fast.
Used as an optional embodiment of the embodiment of the present invention, management operation includes:At equipment query, equipment alarm Reason, the inquiry of area equipment batch updating, statistics and/or report form showing.Thereby guarantee that the diversification of operation management and convenient Property.
Any process described otherwise above or method description in flow chart or herein is construed as, and expression includes It is one or more for realizing specific logical function or process the step of the module of code of executable instruction, fragment or portion Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussion suitable Sequence, including function involved by basis by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention Embodiment person of ordinary skill in the field understood.
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method is carried The rapid hardware that can be by program to instruct correlation is completed, and described program can be stored in a kind of computer-readable storage medium In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means to combine specific features, structure, material or spy that the embodiment or example are described Point is contained at least one embodiment of the invention or example.In this manual, to the schematic representation of above-mentioned term not Necessarily refer to identical embodiment or example.And, the specific features of description, structure, material or feature can be any One or more embodiments or example in combine in an appropriate manner.
Embodiment above is only that the preferred embodiment of the present invention is described, and not the scope of the present invention is carried out Limit, on the premise of design spirit of the present invention is not departed from, this area ordinary skill technical staff is to technical scheme The various modifications made and improvement, all should fall into the protection domain of claims of the present invention determination.

Claims (14)

1. a kind of city internet of things equipment operation control system based on big data technology, it is characterised in that including:
At least one collector, each collector is used to gather the device data of at least one internet of things equipment, and will collect The device data send to concentrator, wherein, the device data include facility information and environmental information;
Concentrator described at least one, each described concentrator is used to receiving the device data that the collector sends, and by institute Device data is stated to send to cloud gateway;
Cloud gateway described at least one, each described cloud gateway is used to receiving the device data that the concentrator sends, and to disappearing Breath system sends the device data, receives the control information that operation management platform sends;
The message system, for carrying out separating treatment to the device data, sends out the device data according to preset rules Deliver to Streams Module or big data analysis module;
The Streams Module, for receiving the device data that the message system sends, and according to default different rule Then, the equipment characteristic in the device data is extracted, and the equipment characteristic is saved in database;
The big data analysis module, for receiving the device data that the message system sends, is counted and is inquired about, And carry out energy analysis making Energy Saving Strategy model;
The operation management platform, for using Web User Interface, produces according to Streams Module and big data analysis module Data perform management operation, and send control information to the cloud gateway.
2. system according to claim 1, it is characterised in that the cloud gateway uses Haproxy+Keepalived conducts Load balancing.
3. system according to claim 1, it is characterised in that the message system is realized using Kafka.
4. system according to claim 1, it is characterised in that the Streams Module, is additionally operable to be set according to trigger Condition, when the equipment characteristic reaches threshold range, triggering prompting event is to the operation management platform.
5. the system according to claim 1 or 3, it is characterised in that the big data analysis module connects in the following way The device data that the message system sends is received, is counted and is inquired about, and carry out energy analysis and make Energy Saving Strategy mould Type:
The message system, is additionally operable to send the device data to Hadoop and is stored;
The big data analysis module, the equipment stored to Hadoop is sent specifically for obtaining the message system Data, are counted and are inquired about based on Hadoop, and carry out energy analysis making Energy Saving Strategy model.
6. system according to claim 1, it is characterised in that the big data analysis module, specifically for using SparkSQL inquires about HDFS, and the energy is analyzed using MLib, makes Energy Saving Strategy model.
7. the system according to any one of claim 1 to 6, it is characterised in that the management operation includes:Equipment query, Equipment alarm treatment, the inquiry of area equipment batch updating, statistics and/or report form showing.
8. a kind of city internet of things equipment based on big data technology runs control method, it is characterised in that including:
Collector gathers the device data of at least one internet of things equipment, and the device data that will be collected is sent to concentration Device, wherein, the device data includes facility information and environmental information;
The concentrator receives the device data that the collector sends, and the device data is sent to cloud gateway;
The cloud gateway receives the device data that the concentrator sends, and sends the device data to message system;
The message system carries out separating treatment to the device data, is sent to number the device data according to preset rules According to flow module or big data analysis module;
The Streams Module receives the device data that the message system sends, and according to default Different Rule, carries The equipment characteristic in the device data is taken, and the equipment characteristic is saved in database;
Big data analysis module receives the device data that the message system sends, and is counted and is inquired about, and carries out energy Source analysis makes Energy Saving Strategy model;
The operation management platform uses Web User Interface, according to the data that Streams Module and big data analysis module are produced Management operation is performed, and control information is sent to the cloud gateway;
The cloud gateway receives the control information that operation management platform sends.
9. method according to claim 8, it is characterised in that the cloud gateway uses Haproxy+Keepalived conducts Load balancing.
10. method according to claim 8, it is characterised in that the message system is realized using Kafka.
11. methods according to claim 8, it is characterised in that also include:The Streams Module is set according to trigger Condition, when the equipment characteristic reaches threshold range, triggering prompting event is to the operation management platform.
12. method according to claim 8 or 10, it is characterised in that the big data analysis module receives the message System send the device data, counted and inquired about, and carry out energy analysis make Energy Saving Strategy model include:
The big data analysis module obtains the message system and sends the device data stored to Hadoop;
The big data analysis module is counted and inquired about based on Hadoop, and carries out energy analysis making Energy Saving Strategy mould Type.
13. methods according to claim 8, it is characterised in that the big data analysis module receives the message system Send the device data, counted and inquired about, and carry out energy analysis make Energy Saving Strategy model include:
The big data analysis module receives the device data that the message system sends, and uses Spark SQL queries HDFS, the energy is analyzed using MLib, makes Energy Saving Strategy model.
14. method according to any one of claim 8 to 13, it is characterised in that the management operation includes:Equipment is looked into Inquiry, equipment alarm treatment, the inquiry of area equipment batch updating, statistics and/or report form showing.
CN201611076429.4A 2016-11-29 2016-11-29 City internet of things equipment operation control system and method based on big data technology Pending CN106780248A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611076429.4A CN106780248A (en) 2016-11-29 2016-11-29 City internet of things equipment operation control system and method based on big data technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611076429.4A CN106780248A (en) 2016-11-29 2016-11-29 City internet of things equipment operation control system and method based on big data technology

Publications (1)

Publication Number Publication Date
CN106780248A true CN106780248A (en) 2017-05-31

Family

ID=58900979

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611076429.4A Pending CN106780248A (en) 2016-11-29 2016-11-29 City internet of things equipment operation control system and method based on big data technology

Country Status (1)

Country Link
CN (1) CN106780248A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107360537A (en) * 2017-07-06 2017-11-17 上海电力学院 The consumption information management method of low-power consumption wide area network internet of things networking technology
CN108763600A (en) * 2018-08-14 2018-11-06 广东校园卫士网络科技有限责任公司 A kind of student's big data management system and method based on Internet of Things
CN108989116A (en) * 2018-07-25 2018-12-11 河北华沃通信科技有限公司 Big data collects and surveys system and method
CN109150588A (en) * 2018-07-25 2019-01-04 河北华沃通信科技有限公司 device management method and device
CN109413185A (en) * 2018-10-31 2019-03-01 国网河南省电力公司焦作供电公司 A kind of equipment routing inspection system and its Cloud Server design method
CN110535909A (en) * 2019-07-29 2019-12-03 广东电网有限责任公司信息中心 Big data and cloud computing unified platform system towards energy Internet application
CN114785821A (en) * 2022-03-16 2022-07-22 陇东学院 Urban Internet of things data processing system and method based on Hadoop
CN115801789A (en) * 2023-02-08 2023-03-14 安徽朋德信息科技有限公司 Internet of things data aggregation system and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015191324A2 (en) * 2014-05-30 2015-12-17 Reylabs Inc. Systems and methods involving mobile indoor energy efficiency exploration, monitoring and/or display aspects
CN105388768A (en) * 2015-10-19 2016-03-09 浙江爱德利电器股份有限公司 Remote circuit control system and method based on cloud platform
CN105467949A (en) * 2015-05-19 2016-04-06 上海谷德软件工程有限公司 Crane remote monitoring and intelligent maintenance system based on IOT and DSP
KR20160074694A (en) * 2014-12-17 2016-06-29 중앙대학교 산학협력단 Industrial Security based Reminding Service System for Home Energy Management System

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015191324A2 (en) * 2014-05-30 2015-12-17 Reylabs Inc. Systems and methods involving mobile indoor energy efficiency exploration, monitoring and/or display aspects
KR20160074694A (en) * 2014-12-17 2016-06-29 중앙대학교 산학협력단 Industrial Security based Reminding Service System for Home Energy Management System
CN105467949A (en) * 2015-05-19 2016-04-06 上海谷德软件工程有限公司 Crane remote monitoring and intelligent maintenance system based on IOT and DSP
CN105388768A (en) * 2015-10-19 2016-03-09 浙江爱德利电器股份有限公司 Remote circuit control system and method based on cloud platform

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107360537A (en) * 2017-07-06 2017-11-17 上海电力学院 The consumption information management method of low-power consumption wide area network internet of things networking technology
CN108989116A (en) * 2018-07-25 2018-12-11 河北华沃通信科技有限公司 Big data collects and surveys system and method
CN109150588A (en) * 2018-07-25 2019-01-04 河北华沃通信科技有限公司 device management method and device
CN108989116B (en) * 2018-07-25 2021-05-25 河北华沃通信科技有限公司 Big data collection and analysis system and method
CN108763600A (en) * 2018-08-14 2018-11-06 广东校园卫士网络科技有限责任公司 A kind of student's big data management system and method based on Internet of Things
CN108763600B (en) * 2018-08-14 2023-09-05 广州铭诚计算机科技有限公司 Student big data management system and method based on Internet of things
CN108763600B8 (en) * 2018-08-14 2024-04-16 广东校园卫士网络科技有限责任公司 Student big data management system and method based on Internet of things
CN109413185A (en) * 2018-10-31 2019-03-01 国网河南省电力公司焦作供电公司 A kind of equipment routing inspection system and its Cloud Server design method
CN110535909A (en) * 2019-07-29 2019-12-03 广东电网有限责任公司信息中心 Big data and cloud computing unified platform system towards energy Internet application
CN114785821A (en) * 2022-03-16 2022-07-22 陇东学院 Urban Internet of things data processing system and method based on Hadoop
CN115801789A (en) * 2023-02-08 2023-03-14 安徽朋德信息科技有限公司 Internet of things data aggregation system and method

Similar Documents

Publication Publication Date Title
CN106780248A (en) City internet of things equipment operation control system and method based on big data technology
CN106021508A (en) Sudden event emergency information mining method based on social media
CN105069025A (en) Intelligent aggregation visualization and management control system for big data
Bendadouche et al. Extension of the semantic sensor network ontology for wireless sensor networks: The stimulus-WSNnode-communication pattern
CN104616205A (en) Distributed log analysis based operation state monitoring method of power system
Chang et al. Big data platform for air quality analysis and prediction
CN108900541A (en) One kind being directed to cloud data center SDN Security Situation Awareness Systems and method
Huang et al. Software-defined QoS provisioning for fog computing advanced wireless sensor networks
CN105677842A (en) Log analysis system based on Hadoop big data processing technique
CN104376365A (en) Method for constructing information system running rule libraries on basis of association rule mining
CN105825462A (en) Smart city information system based on internet of things and cloud computing
CN104376005A (en) Method and system for processing user detail lists by software heartbeat mechanism signaling access probe
CN108880888A (en) A kind of SDN network method for predicting based on deep learning
CN105528671B (en) A kind of power grid Multidimensional Awareness based on big data and safety estimation system and method
CN103258027A (en) Context awareness service platform based on intelligent terminal
CN104202719A (en) People number testing and crowd situation monitoring method and system based on position credibility
CN108268569A (en) The acquisition of water resource monitoring data and analysis system and method based on big data technology
CN106921507A (en) The method and apparatus being predicted to customer complaint within a wireless communication network
CN106789408A (en) A kind of IPRAN network access layers equipment cyclization rate computational methods
CN109446385A (en) A kind of method of equipment map that establishing Internet resources and the application method of the equipment map
CN109150859A (en) A kind of Botnet detection method flowing to similitude based on network flow
CN104778528A (en) Method and system for obtaining smart city evaluation indexes by utilizing big data
CN107464022A (en) A kind of Optimization Method for Location-Selection based on decomposition multi-objective Evolutionary Algorithm
US20220247667A1 (en) Method and Apparatus for Inter-Domain Data Interaction
Umamaheswari et al. Technologies used in smart city applications–An overview

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170531