CN112801136A - Internet of things gateway data processing method and device with feature identification - Google Patents
Internet of things gateway data processing method and device with feature identification Download PDFInfo
- Publication number
- CN112801136A CN112801136A CN202011641076.4A CN202011641076A CN112801136A CN 112801136 A CN112801136 A CN 112801136A CN 202011641076 A CN202011641076 A CN 202011641076A CN 112801136 A CN112801136 A CN 112801136A
- Authority
- CN
- China
- Prior art keywords
- data
- forwarded
- internet
- feature
- data storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims description 6
- 238000013500 data storage Methods 0.000 claims abstract description 126
- 238000000034 method Methods 0.000 claims abstract description 30
- 230000006855 networking Effects 0.000 claims 1
- 230000005540 biological transmission Effects 0.000 abstract description 13
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses a method and a device for processing gateway data of the Internet of things with a characteristic identifier, wherein the method comprises the following steps: analyzing the acquired data uploaded by a plurality of different terminal devices to obtain data characteristic identifications; receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identification, if so, adding a first characteristic identification to the data to be forwarded, and sending the data to a server, if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage; and when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server. According to the scheme, the data storage and forwarding efficiency is improved, and the data transmission system of the Internet of things is optimized.
Description
Technical Field
The embodiment of the application relates to the technical field of Internet of things, in particular to a method and a device for processing gateway data of the Internet of things with feature identification.
Background
With the popularization of the internet of things technology and the powerful functions of intelligent equipment, the internet of things equipment plays an increasingly important role in daily life of people. Various kinds of intelligent physical network terminal devices are applied to various fields. Generally, the internet of things connects articles with the internet through various information sensing devices, so that information exchange can be realized for all common physical objects which can be independently addressed, and the purposes of intelligent identification, positioning, tracking, monitoring and management are finally achieved.
Generally, when data interaction is performed between an internet of things terminal and a server, data forwarding needs to be performed through an internet of things gateway, and if the data processing efficiency of the internet of things gateway is improved, the problem that needs to be solved at present is urgently solved.
Disclosure of Invention
The embodiment of the invention provides a method and a device for processing gateway data of the Internet of things with characteristic identification, which improve the data storage and forwarding efficiency and optimize a data transmission system of the Internet of things.
In a first aspect, an embodiment of the present invention provides a method for processing data of an internet of things gateway with a feature identifier, where the method includes:
analyzing the acquired data uploaded by a plurality of different terminal devices to obtain data characteristic identifications;
receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identification, if so, adding a first characteristic identification to the data to be forwarded, and sending the data to a server, if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage;
and when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server.
Optionally, analyzing the collected data uploaded by the multiple different terminal devices to obtain the data feature identifier includes:
and analyzing the acquired data uploaded by the different terminal equipment according to the received scene uploading instruction to obtain the data characteristic identification.
Optionally, the determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage includes:
determining data similarity based on a plurality of collected forwarding data, and generating data storage templates corresponding to different forwarding data based on the data similarity, wherein the data storage templates comprise public data and private data;
and determining a data storage template corresponding to the data to be forwarded, and storing the data to be forwarded according to the format of the data storage template.
Optionally, the determining whether the data to be forwarded has data content corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded includes:
determining whether the data to be forwarded meets a threshold condition corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded; or, determining whether the data to be forwarded contains the feature data corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded;
wherein, adding a first feature identifier to the data to be forwarded includes:
and carrying out first characteristic marking on the data content corresponding to the data characteristic identification in the data to be forwarded.
In a second aspect, an embodiment of the present invention further provides an internet of things gateway data processing apparatus with a feature identifier, including:
the characteristic identifier determining module is used for analyzing the acquired data uploaded by the different terminal equipment to obtain data characteristic identifiers;
the data processing module is used for receiving data to be forwarded sent by the terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identifier, if so, adding a first characteristic identifier to the data to be forwarded, and sending the data to the server, and if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage;
and the data sending module is used for sending the stored data to the server when the data volume of the data storage is detected to be larger than the set data sending volume upper limit.
Optionally, the feature identifier determining module is specifically configured to:
and analyzing the acquired data uploaded by the different terminal equipment according to the received scene uploading instruction to obtain the data characteristic identification.
Optionally, the data processing module is specifically configured to:
determining data similarity based on a plurality of collected forwarding data, and generating data storage templates corresponding to different forwarding data based on the data similarity, wherein the data storage templates comprise public data and private data;
and determining a data storage template corresponding to the data to be forwarded, and storing the data to be forwarded according to the format of the data storage template.
Optionally, the data processing module is specifically configured to:
determining whether the data to be forwarded meets a threshold condition corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded; or, determining whether the data to be forwarded contains the feature data corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded;
and carrying out first characteristic marking on the data content corresponding to the data characteristic identification in the data to be forwarded.
In a third aspect, an embodiment of the present invention further provides an internet of things gateway data processing device with a feature identifier, where the device includes:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the method for processing the gateway data with the feature identifier in the embodiment of the invention.
In a fourth aspect, the embodiment of the present invention further provides a storage medium containing computer executable instructions, which when executed by a computer processor, are configured to perform the method for processing gateway data of the internet of things with feature identifiers according to the embodiment of the present invention.
In the embodiment of the invention, the data characteristic identification is obtained by analyzing the collected data uploaded by a plurality of different terminal devices; receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identification, if so, adding a first characteristic identification to the data to be forwarded, and sending the data to a server, if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage; and when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server. According to the scheme, the data storage and forwarding efficiency is improved, and the data transmission system of the Internet of things is optimized.
Drawings
Fig. 1 is a flowchart of a method for processing data of an internet of things gateway with a feature identifier according to an embodiment of the present invention;
fig. 2 is a flowchart of another method for processing data of an internet of things gateway with a feature identifier according to an embodiment of the present invention;
fig. 3 is a flowchart of another method for processing data of an internet of things gateway with a feature identifier according to an embodiment of the present invention;
FIG. 3a is a schematic diagram of a data storage template according to an embodiment of the present invention;
fig. 4 is a flowchart of another method for processing data of an internet of things gateway with a feature identifier according to an embodiment of the present invention;
fig. 5 is a block diagram of a data processing apparatus of an internet of things gateway with a feature identifier according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an apparatus according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention will be described in further detail with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad invention. It should be further noted that, for convenience of description, only some structures, not all structures, relating to the embodiments of the present invention are shown in the drawings.
Fig. 1 is a flowchart of a method for processing data of an internet of things gateway with a feature identifier according to an embodiment of the present invention, where the embodiment is suitable for transmission of data of an internet of things device and is executed by the internet of things gateway device. The scheme of one embodiment of the application specifically comprises the following steps:
step S101, analyzing the collected data uploaded by a plurality of different terminal devices to obtain data characteristic identifications.
In one embodiment, the terminal device forwards data to the server through the gateway device of the internet of things, and performs data communication in the server to realize the function of the device of the internet of things. The gateway equipment of the internet of things analyzes the acquired data uploaded by the different terminal equipment to obtain corresponding feature identifiers. In one embodiment, the internet of things gateway device receives a scene uploading instruction sent by a server, and analyzes data uploaded by a plurality of different terminal devices according to the scene uploading instruction to obtain data characteristic identifiers.
Step S102, receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identification, if so, adding a first characteristic identification to the data to be forwarded, sending the data to a server, if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage.
In an embodiment, the internet of things gateway device receives a plurality of different data to be forwarded uploaded by different terminal devices, and determines, for each data to be forwarded, whether the data to be forwarded has data content corresponding to the data feature identifier, where the data feature identifier is determined in step S101.
And if so, adding a first characteristic identifier to the data to be forwarded, and sending the data to be forwarded to a server. The first characteristic mark is used for carrying out data marking so as to represent specific data meeting the server requirement in the data to be forwarded.
And if the data to be forwarded does not exist, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage. The data storage is correspondingly set for different types of data to be forwarded, such as character types, audio types, image video types, and the like. In one embodiment, the data storage template includes public data and private data, where the public data represents the same data in each data to be forwarded, and the private data is data corresponding to a content difference portion between each data to be forwarded. Specifically, the data similarity may be determined based on a plurality of collected forwarding data, and a data storage template corresponding to different forwarding data is generated based on the data similarity, where the data storage template includes public data and private data; and determining a data storage template corresponding to the data to be forwarded, and storing the data to be forwarded according to the format of the data storage template.
And step S103, when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server.
In one embodiment, the gateway of the internet of things receives data uploaded by the terminal device, stores the data by using the generated template, and sends the stored data to the server when detecting that the data volume of the data storage is larger than the set upper limit of the data sending volume (for example, 80% of the storage space).
In another embodiment, it may also be: receiving a data reporting instruction sent by a server, wherein the data reporting instruction is related to a scene query event input by a server end; and obtaining private data corresponding to the data reporting instruction, and uploading the private data to the server. Specifically, in an embodiment, after the internet of things gateway device stores data, the stored content is uploaded according to the received data reporting instruction. The data reporting instruction is generated in a manner of being related to a scene query event input by a server side. In one embodiment, the database is queried for the data reporting instruction, and since the stored data is stored as public data and private data in a data storage template form, the private data meeting the query condition is reported. Preferably, when another reporting instruction is received, if a reporting instruction for uploading the public data is needed, the corresponding public data is reported.
Therefore, the data characteristic identification is obtained by analyzing the acquired data uploaded by the different terminal devices; receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identification, if so, adding a first characteristic identification to the data to be forwarded, and sending the data to a server, if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage; and when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server. According to the scheme, the data storage and forwarding efficiency is improved, and the data transmission system of the Internet of things is optimized.
Fig. 2 is a flowchart of another method for processing data of an internet of things gateway with a feature identifier according to an embodiment of the present invention. On the basis of the above technical solution, analyzing the collected data uploaded by the plurality of different terminal devices to obtain the data feature identifier includes:
and analyzing the acquired data uploaded by the different terminal equipment according to the received scene uploading instruction to obtain the data characteristic identification. The method specifically comprises the following steps:
step S201, according to the received scene uploading instruction, analyzing the collected data uploaded by the plurality of different terminal devices to obtain the data feature identifier.
In one embodiment, according to a received scene uploading instruction, the collected data uploaded by a plurality of different terminal devices is analyzed to obtain data characteristic identifiers. Specifically, for example, the terminal device is an audio acquisition device, the corresponding data type is an audio type, and the scene uploading instruction may be an instruction for acquiring sound of a target (e.g., a person) in a certain period. Correspondingly, the audio type data is analyzed according to the voice acquisition instruction, and the obtained data feature identifier is the identifier of the human voice.
Step S202, receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identification, if so, adding a first characteristic identification to the data to be forwarded, sending the data to a server, if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage.
And step S203, when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server.
According to the data transmission method, the collected data uploaded by the different terminal devices are analyzed according to the received scene uploading instruction to obtain the data characteristic identification, so that a prerequisite condition is provided for reasonable and efficient subsequent data transmission, the data storage and transmission efficiency is improved, and the data transmission system of the Internet of things is optimized.
Fig. 3 is a flowchart of another method for processing data of an internet of things gateway with a feature identifier according to an embodiment of the present invention. On the basis of the above technical solution, the determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage includes:
determining data similarity based on a plurality of collected forwarding data, and generating data storage templates corresponding to different forwarding data based on the data similarity, wherein the data storage templates comprise public data and private data;
and determining a data storage template corresponding to the data to be forwarded, and storing the data to be forwarded according to the format of the data storage template. The method specifically comprises the following steps:
step S301, according to the received scene uploading instruction, analyzing the collected data uploaded by the different terminal devices to obtain data characteristic identification.
Step S302, receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identifier, if so, adding a first characteristic identifier to the data to be forwarded, and sending the data to be forwarded to a server.
Step S303, if the data do not exist, determining data similarity based on the collected multiple pieces of forwarding data, generating data storage templates corresponding to different pieces of forwarding data based on the data similarity, wherein the data storage templates comprise public data and private data, determining the data storage templates corresponding to the pieces of data to be forwarded, and storing the pieces of data to be forwarded according to the formats of the data storage templates.
Illustratively, taking character data as an example, the data a uploaded by the device 1 includes 8 fields, where the fields 1 to 6 are general fields, and the fields 7 and 8 are fields characterizing characteristics of current data, and then the fields 1 to 6 are associated fields in each data; taking image data as an example, the device 2 uploads an image a at a first time and uploads an image b at a second time, and the image association between the image a and the image b can be determined, if the contents of background images are consistent and no special target object exists, the association between the image a and the image b is 100%, if the difference between the image a and the image b exists, the association is determined by exemplarily taking the area size of the whole image occupied by the target object, and if the difference exists between the image a and the image b, the association is determined to be 90%; taking the text content as an example, the device 3 uploads the text a and the text b, and if the contents of the text a and the text b at the beginning or the end are determined to be consistent through similarity comparison, the association degree is 100% of the middle content part, obvious text difference exists, and the similarity is 0.
In one embodiment, the content that is consistent (or has a similarity greater than a certain threshold) is determined to be public data, and the rest are private data to generate the corresponding data storage template. And after receiving the data to be forwarded, determining whether the data to be forwarded has a corresponding data storage template, and if so, storing the data in the form of the data storage template.
Exemplarily, as shown in fig. 3a, fig. 3a is a schematic diagram of a data storage template according to an embodiment of the present invention, where the data storage template includes public data and private data, the public data is common data that satisfies a condition determined in the foregoing description, and the private data is characteristic data, and the received data uploaded by the terminal device is stored in the template manner.
And step S304, when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server.
According to the scheme, the data similarity is determined based on the collected multiple pieces of forwarding data, the data storage templates corresponding to different pieces of forwarding data are generated based on the data similarity, the data storage templates comprise public data and private data, the data storage templates corresponding to the pieces of data to be forwarded are determined, and the pieces of data to be forwarded are stored according to the formats of the data storage templates, so that the data storage and forwarding efficiency is improved, and the data transmission system of the Internet of things is optimized.
Fig. 4 is a flowchart of another method for processing data of an internet of things gateway with a feature identifier according to an embodiment of the present invention. On the basis of the above technical solution, the determining whether the data to be forwarded has data content corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded includes:
determining whether the data to be forwarded meets a threshold condition corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded; or, determining whether the data to be forwarded contains the feature data corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded;
wherein, adding a first feature identifier to the data to be forwarded includes:
and carrying out first characteristic marking on the data content corresponding to the data characteristic identification in the data to be forwarded. The method specifically comprises the following steps:
step S401, according to the received scene uploading instruction, analyzing the collected data uploaded by the plurality of different terminal devices to obtain data characteristic identification.
Step S402, receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded meets a threshold condition corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded; or, determining whether the data to be forwarded contains the feature data corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded.
In one embodiment, taking character data as an example, the data to be forwarded is a temperature value, humidity, illumination intensity value, and the like acquired by the terminal device of the internet of things, the data feature identifier is a temperature value, and accordingly, it is determined whether the data to be forwarded meets a threshold condition corresponding to the data feature identifier, where the temperature value may be greater than a set threshold value. Taking the type of image video data as an example, the data feature identifier may be an image containing a human face, and the corresponding threshold condition may be a front image of the human face or data to be forwarded of the human face image satisfying resolution. Correspondingly, in the process of adding the first feature identifier to the data to be forwarded, taking the type of the audio data as an example, the first feature identifier is added to a part containing a voice in the audio stream data, and for example, the first feature identifier is used to indicate a position where a specific audio containing a voice part is located in the current data to be forwarded.
Step S403, if the data similarity does not exist, determining data similarity based on the collected multiple pieces of forwarding data, generating data storage templates corresponding to different pieces of forwarding data based on the data similarity, wherein the data storage templates comprise public data and private data, determining the data storage templates corresponding to the pieces of data to be forwarded, and storing the pieces of data to be forwarded according to the formats of the data storage templates.
And S404, when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server.
According to the above, whether the data to be forwarded meets the threshold condition corresponding to the data feature identifier is determined by receiving the data to be forwarded sent by the terminal device, and if so, the data to be forwarded is added with the first feature identifier; or, whether the data to be forwarded contains the characteristic data corresponding to the data characteristic identifier is determined, and if yes, the first characteristic identifier is added to the data to be forwarded, so that the data storage and forwarding efficiency is improved, and the data transmission system of the internet of things is optimized.
Fig. 5 is a block diagram of a data processing apparatus of an internet of things gateway with a feature identifier according to an embodiment of the present invention, where the apparatus is configured to execute a data processing method of an internet of things gateway with a feature identifier according to an embodiment of the data receiving end, and has corresponding functional modules and beneficial effects of the execution method. As shown in fig. 5, the apparatus specifically includes: a feature identification determination module 101, a data processing module 102 and a data transmission module 103, wherein,
the characteristic identifier determining module 101 is configured to analyze the acquired data uploaded by the plurality of different terminal devices to obtain data characteristic identifiers;
the data processing module 102 is configured to receive data to be forwarded sent by a terminal device, determine whether the data to be forwarded has data content corresponding to the data feature identifier, add a first feature identifier to the data to be forwarded and send the data to a server if the data to be forwarded exists, and determine a data storage template corresponding to the data to be forwarded if the data to be forwarded does not exist, convert the data to be forwarded into a corresponding data storage template format, and store the data;
and the data sending module 103 is configured to send the stored data to the server when detecting that the data amount of the data storage is greater than the set data sending amount upper limit.
According to the scheme, the data characteristic identification is obtained by analyzing the collected data uploaded by the different terminal devices; receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identification, if so, adding a first characteristic identification to the data to be forwarded, and sending the data to a server, if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage; and when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server. According to the scheme, the data storage and forwarding efficiency is improved, and the data transmission system of the Internet of things is optimized.
In a possible embodiment, the feature identifier determining module is specifically configured to:
and analyzing the acquired data uploaded by the different terminal equipment according to the received scene uploading instruction to obtain the data characteristic identification.
In a possible embodiment, the data processing module is specifically configured to:
determining data similarity based on a plurality of collected forwarding data, and generating data storage templates corresponding to different forwarding data based on the data similarity, wherein the data storage templates comprise public data and private data;
and determining a data storage template corresponding to the data to be forwarded, and storing the data to be forwarded according to the format of the data storage template.
In a possible embodiment, the data processing module is specifically configured to:
determining whether the data to be forwarded meets a threshold condition corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded; or, determining whether the data to be forwarded contains the feature data corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded;
and carrying out first characteristic marking on the data content corresponding to the data characteristic identification in the data to be forwarded.
Fig. 6 is a schematic structural diagram of an internet of things gateway data processing apparatus with feature identifiers according to an embodiment of the present invention, as shown in fig. 6, the apparatus includes a processor 201, a memory 202, an input device 203, and an output device 204; the number of the processors 201 in the device may be one or more, and one processor 201 is taken as an example in fig. 6; the processor 201, the memory 202, the input device 203 and the output device 204 in the apparatus may be connected by a bus or other means, for example in fig. 6. The memory 202 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the data processing method of the internet of things gateway with feature identifier in the embodiment of the present invention. The processor 201 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 202, that is, the method for processing the data of the internet of things gateway with the feature identifier is implemented. The input device 203 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function controls of the apparatus. The output device 204 may include a display device such as a display screen.
Embodiments of the present invention also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a method for processing data of an internet of things gateway with a feature identifier, where the method includes:
analyzing the acquired data uploaded by a plurality of different terminal devices to obtain data characteristic identifications;
receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identification, if so, adding a first characteristic identification to the data to be forwarded, and sending the data to a server, if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage;
and when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server.
In a possible embodiment, the analyzing the collected data uploaded by the plurality of different terminal devices to obtain the data feature identifier includes:
and analyzing the acquired data uploaded by the different terminal equipment according to the received scene uploading instruction to obtain the data characteristic identification.
In a possible embodiment, the determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage includes:
determining data similarity based on a plurality of collected forwarding data, and generating data storage templates corresponding to different forwarding data based on the data similarity, wherein the data storage templates comprise public data and private data;
and determining a data storage template corresponding to the data to be forwarded, and storing the data to be forwarded according to the format of the data storage template.
In a possible embodiment, the determining whether the data to be forwarded has data content corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded includes:
determining whether the data to be forwarded meets a threshold condition corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded; or, determining whether the data to be forwarded contains the feature data corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded;
wherein, adding a first feature identifier to the data to be forwarded includes:
and carrying out first characteristic marking on the data content corresponding to the data characteristic identification in the data to be forwarded.
From the above description of the embodiments, it is obvious for those skilled in the art that the embodiments of the present invention can be implemented by software and necessary general hardware, and certainly can be implemented by hardware, but the former is a better implementation in many cases. Based on such understanding, the technical solutions of the embodiments of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions to make a computer device (which may be a personal computer, a service, or a network device) perform the methods described in the embodiments of the present invention.
It should be noted that, in the embodiment of the internet of things gateway data processing apparatus with the feature identifier, each unit and each module included in the embodiment are only divided according to functional logic, but are not limited to the above division as long as the corresponding function can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the embodiment of the invention.
It should be noted that the foregoing is only a preferred embodiment of the present invention and the technical principles applied. Those skilled in the art will appreciate that the embodiments of the present invention are not limited to the specific embodiments described herein, and that various obvious changes, adaptations, and substitutions are possible, without departing from the scope of the embodiments of the present invention. Therefore, although the embodiments of the present invention have been described in more detail through the above embodiments, the embodiments of the present invention are not limited to the above embodiments, and many other equivalent embodiments may be included without departing from the concept of the embodiments of the present invention, and the scope of the embodiments of the present invention is determined by the scope of the appended claims.
Claims (10)
1. The method for processing the gateway data of the Internet of things with the feature identifier is characterized by comprising the following steps:
analyzing the acquired data uploaded by a plurality of different terminal devices to obtain data characteristic identifications;
receiving data to be forwarded sent by terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identification, if so, adding a first characteristic identification to the data to be forwarded, and sending the data to a server, if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage;
and when the data storage amount is detected to be larger than the set data sending amount upper limit, sending the stored data to the server.
2. The internet of things gateway data processing method with the feature identifier according to claim 1, wherein the analyzing the collected data uploaded by the plurality of different terminal devices to obtain the data feature identifier comprises:
and analyzing the acquired data uploaded by the different terminal equipment according to the received scene uploading instruction to obtain the data characteristic identification.
3. The internet of things gateway data processing method with the feature identifier according to claim 1, wherein the determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage comprises:
determining data similarity based on a plurality of collected forwarding data, and generating data storage templates corresponding to different forwarding data based on the data similarity, wherein the data storage templates comprise public data and private data;
and determining a data storage template corresponding to the data to be forwarded, and storing the data to be forwarded according to the format of the data storage template.
4. The method for processing gateway data of the internet of things with the feature identifier according to any one of claims 1 to 3, wherein the determining whether the data to be forwarded has data content corresponding to the data feature identifier, and if the data to be forwarded has the data content corresponding to the data feature identifier, adding a first feature identifier to the data to be forwarded includes:
determining whether the data to be forwarded meets a threshold condition corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded; or, determining whether the data to be forwarded contains the feature data corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded;
wherein, adding a first feature identifier to the data to be forwarded includes:
and carrying out first characteristic marking on the data content corresponding to the data characteristic identification in the data to be forwarded.
5. Thing networking gateway data processing apparatus with characteristic identification, its characterized in that includes:
the characteristic identifier determining module is used for analyzing the acquired data uploaded by the different terminal equipment to obtain data characteristic identifiers;
the data processing module is used for receiving data to be forwarded sent by the terminal equipment, determining whether the data to be forwarded has data content corresponding to the data characteristic identifier, if so, adding a first characteristic identifier to the data to be forwarded, and sending the data to the server, and if not, determining a data storage template corresponding to the data to be forwarded, and converting the data to be forwarded into a corresponding data storage template format for data storage;
and the data sending module is used for sending the stored data to the server when the data volume of the data storage is detected to be larger than the set data sending volume upper limit.
6. The internet of things gateway data processing device with feature identification as claimed in claim 5, wherein the feature identification determination module is specifically configured to:
and analyzing the acquired data uploaded by the different terminal equipment according to the received scene uploading instruction to obtain the data characteristic identification.
7. The internet of things gateway data processing device with feature identification as claimed in claim 5, wherein the data processing module is specifically configured to:
determining data similarity based on a plurality of collected forwarding data, and generating data storage templates corresponding to different forwarding data based on the data similarity, wherein the data storage templates comprise public data and private data;
and determining a data storage template corresponding to the data to be forwarded, and storing the data to be forwarded according to the format of the data storage template.
8. The internet of things gateway data processing device with feature identification as claimed in any one of claims 5-7, wherein the data processing module is specifically configured to:
determining whether the data to be forwarded meets a threshold condition corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded; or, determining whether the data to be forwarded contains the feature data corresponding to the data feature identifier, and if so, adding a first feature identifier to the data to be forwarded;
and carrying out first characteristic marking on the data content corresponding to the data characteristic identification in the data to be forwarded.
9. An internet of things gateway data processing device with feature identification, the device comprising: one or more processors; a storage device for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the method for processing data of an internet of things gateway with feature identification according to any one of claims 1 to 4.
10. A storage medium containing computer executable instructions for performing the method of internet of things gateway data processing with feature identification as claimed in any one of claims 1-4 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011641076.4A CN112801136B (en) | 2020-12-31 | 2020-12-31 | Internet of things gateway data processing method and device with characteristic identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011641076.4A CN112801136B (en) | 2020-12-31 | 2020-12-31 | Internet of things gateway data processing method and device with characteristic identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112801136A true CN112801136A (en) | 2021-05-14 |
| CN112801136B CN112801136B (en) | 2024-04-26 |
Family
ID=75809106
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011641076.4A Active CN112801136B (en) | 2020-12-31 | 2020-12-31 | Internet of things gateway data processing method and device with characteristic identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112801136B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115202867A (en) * | 2022-06-09 | 2022-10-18 | 南京慧安炬创信息科技有限公司 | Data processing method and system based on edge calculation |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20140021372A (en) * | 2012-08-10 | 2014-02-20 | 에스케이텔레콤 주식회사 | Contents delivery service method and local cache apparatus using contents identification |
| US20180288195A1 (en) * | 2017-03-30 | 2018-10-04 | Nec Corporation | Communication system |
| CN108880867A (en) * | 2018-05-31 | 2018-11-23 | 腾讯科技（深圳）有限公司 | A kind of network equipment collecting method and system |
| CN108965484A (en) * | 2018-09-30 | 2018-12-07 | 深圳市酷达通讯有限公司 | A kind of transmission method of internet of things data, system and terminal |
| CN109325076A (en) * | 2018-06-07 | 2019-02-12 | 北京百度网讯科技有限公司 | Data managing method, equipment, computer equipment and readable medium in Internet of Things |
| CN110139166A (en) * | 2018-02-08 | 2019-08-16 | 杭州海康威视系统技术有限公司 | A kind of method of transmitting video data, device, system and electronic equipment |
| CN110166561A (en) * | 2019-05-24 | 2019-08-23 | 北京旷视科技有限公司 | Data processing method, device, system, equipment and the medium of wearable device |
| CN110276002A (en) * | 2019-06-26 | 2019-09-24 | 浙江大搜车软件技术有限公司 | Search for application data processing method, device, computer equipment and storage medium |
| CN110334140A (en) * | 2019-05-24 | 2019-10-15 | 深圳绿米联创科技有限公司 | The method, apparatus and server of processing equipment reported data |
| CN110417734A (en) * | 2019-06-24 | 2019-11-05 | 广州迈峰网络科技有限公司 | Remote device data acquisition method, device and system |
| WO2019218454A1 (en) * | 2018-05-16 | 2019-11-21 | 平安科技（深圳）有限公司 | Subscription report generation method and apparatus, computer device and storage medium |
| CN110941656A (en) * | 2019-09-23 | 2020-03-31 | 新奥数能科技有限公司 | Internet of things data access method and device based on universal energy CIM |
| CN111371832A (en) * | 2019-12-11 | 2020-07-03 | 添可智能科技有限公司 | Data storage and detection method and equipment |
| CN111897587A (en) * | 2020-06-19 | 2020-11-06 | 深圳奇迹智慧网络有限公司 | Internet of things application configuration method and device, computer equipment and storage medium |
| CN111966868A (en) * | 2020-09-07 | 2020-11-20 | 航天云网数据研究院(广东)有限公司 | Data management method based on identification analysis and related equipment |
-
2020
- 2020-12-31 CN CN202011641076.4A patent/CN112801136B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20140021372A (en) * | 2012-08-10 | 2014-02-20 | 에스케이텔레콤 주식회사 | Contents delivery service method and local cache apparatus using contents identification |
| US20180288195A1 (en) * | 2017-03-30 | 2018-10-04 | Nec Corporation | Communication system |
| CN110139166A (en) * | 2018-02-08 | 2019-08-16 | 杭州海康威视系统技术有限公司 | A kind of method of transmitting video data, device, system and electronic equipment |
| WO2019218454A1 (en) * | 2018-05-16 | 2019-11-21 | 平安科技（深圳）有限公司 | Subscription report generation method and apparatus, computer device and storage medium |
| CN108880867A (en) * | 2018-05-31 | 2018-11-23 | 腾讯科技（深圳）有限公司 | A kind of network equipment collecting method and system |
| CN109325076A (en) * | 2018-06-07 | 2019-02-12 | 北京百度网讯科技有限公司 | Data managing method, equipment, computer equipment and readable medium in Internet of Things |
| CN108965484A (en) * | 2018-09-30 | 2018-12-07 | 深圳市酷达通讯有限公司 | A kind of transmission method of internet of things data, system and terminal |
| CN110166561A (en) * | 2019-05-24 | 2019-08-23 | 北京旷视科技有限公司 | Data processing method, device, system, equipment and the medium of wearable device |
| CN110334140A (en) * | 2019-05-24 | 2019-10-15 | 深圳绿米联创科技有限公司 | The method, apparatus and server of processing equipment reported data |
| CN110417734A (en) * | 2019-06-24 | 2019-11-05 | 广州迈峰网络科技有限公司 | Remote device data acquisition method, device and system |
| CN110276002A (en) * | 2019-06-26 | 2019-09-24 | 浙江大搜车软件技术有限公司 | Search for application data processing method, device, computer equipment and storage medium |
| CN110941656A (en) * | 2019-09-23 | 2020-03-31 | 新奥数能科技有限公司 | Internet of things data access method and device based on universal energy CIM |
| CN111371832A (en) * | 2019-12-11 | 2020-07-03 | 添可智能科技有限公司 | Data storage and detection method and equipment |
| CN111897587A (en) * | 2020-06-19 | 2020-11-06 | 深圳奇迹智慧网络有限公司 | Internet of things application configuration method and device, computer equipment and storage medium |
| CN111966868A (en) * | 2020-09-07 | 2020-11-20 | 航天云网数据研究院(广东)有限公司 | Data management method based on identification analysis and related equipment |
Non-Patent Citations (3)
| Title |
|---|
| ADITYA NUGUR等: "Design and Development of an IoT Gateway for Smart Building Applications", 《IEEE INTERNET OF THINGS JOURNAL》, vol. 6, no. 5, 31 October 2019 (2019-10-31), pages 9020 - 9029, XP011749821, DOI: 10.1109/JIOT.2019.2926099 * |
| 叶平: "物联网数据在侵财案件侦防中的应用", 《中国优秀硕士学位论文全文数据库 社会科学I辑》, no. 2020, 15 October 2020 (2020-10-15), pages 113 - 17 * |
| 邹达: "运维报告智能化生成平台的设计与研究", 《开发测试》, 28 February 2020 (2020-02-28), pages 51 - 56 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115202867A (en) * | 2022-06-09 | 2022-10-18 | 南京慧安炬创信息科技有限公司 | Data processing method and system based on edge calculation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112801136B (en) | 2024-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112559813B (en) | Internet of things gateway data processing method and device based on instruction association pushing | |
| EP2688296B1 (en) | Video monitoring system and method | |
| US20140108653A1 (en) | Man-Machine Interaction Data Processing Method and Apparatus | |
| US20190188478A1 (en) | Method and apparatus for obtaining video public opinions, computer device and storage medium | |
| CN109271533A (en) | A kind of multimedia document retrieval method | |
| CN113473166A (en) | Data storage system and method | |
| CN112801136B (en) | Internet of things gateway data processing method and device with characteristic identification | |
| CN112738286B (en) | IP attribute identification method, system and computer equipment | |
| CN107992538B (en) | Message log generation method and device, query method and information processing system | |
| CN112312590B (en) | Equipment communication protocol identification method and device | |
| CN109102556A (en) | The configuration method of edit tool and the generation method of configuration parameter | |
| CN108111557B (en) | Method and device for acquiring data in cloud storage system | |
| CN105721885B (en) | Method, device and system for processing transcoding data | |
| CN112765372A (en) | Internet of things gateway data processing method and device based on template simplification | |
| CN111901561B (en) | Video data processing method, device and system in monitoring system and storage medium | |
| CN104462219B (en) | A kind of information agency interface and the application system based on the information agency interface | |
| CN110909288B (en) | Service data processing method, device, platform, service end, system and medium | |
| CN111818389A (en) | Data processing method and device and computer readable storage medium | |
| CN111382306A (en) | Method and device for inquiring video frame | |
| CN116260844B (en) | Community cloud edge end architecture system based on Internet of things mode, community data processing method and control system | |
| CN112765371A (en) | Internet of things single data storage method and device based on deduplication rule | |
| CN115273168A (en) | Face recognition method, face recognition device, storage medium and electronic equipment | |
| CN114328534A (en) | Multidimensional mapping association method and device based on fields and storage medium | |
| CN117014156A (en) | Encrypted traffic identification method and device, storage medium and electronic equipment | |
| CN117375958A (en) | Web application system identification method and device and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |