CN113132678B - Data transmission method and device, electronic equipment and storage medium - Google Patents

Data transmission method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN113132678B
CN113132678B CN201911414880.6A CN201911414880A CN113132678B CN 113132678 B CN113132678 B CN 113132678B CN 201911414880 A CN201911414880 A CN 201911414880A CN 113132678 B CN113132678 B CN 113132678B
Authority
CN
China
Prior art keywords
data
image data
cluster node
request
initial image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911414880.6A
Other languages
Chinese (zh)
Other versions
CN113132678A (en
Inventor
黄焯真
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Intellifusion Technologies Co Ltd
Original Assignee
Shenzhen Intellifusion Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Intellifusion Technologies Co Ltd filed Critical Shenzhen Intellifusion Technologies Co Ltd
Priority to CN201911414880.6A priority Critical patent/CN113132678B/en
Publication of CN113132678A publication Critical patent/CN113132678A/en
Application granted granted Critical
Publication of CN113132678B publication Critical patent/CN113132678B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2347Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention relates to the technical field of image recognition, and provides a data transmission method, a device, electronic equipment and a storage medium, wherein the method comprises the following steps: acquiring image data, and performing data processing on the image data to obtain initial image data; the initial image data is sent to a data cluster node through a producer service node, the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a unidirectional access port is constructed; and if the data calling request sent by the data cluster node in the calling direction is detected, extracting initial image data corresponding to the data calling request in the data cluster node through the one-way access port, and outputting the initial image data as target image data. The embodiment of the invention can improve the flexibility and usability of the data transmission mode.

Description

Data transmission method and device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of image recognition technologies, and in particular, to a data transmission method, a data transmission device, an electronic device, and a storage medium.
Background
Along with the development of scientific technology, the application of the face recognition technology is applied to various fields of society, and the face recognition technology has greatly progressed in the fields of security, finance, education and business. At present, after a human image is controlled by a deep eye system based on human image recognition, when a front-end camera captures a human face image in real time, picture extraction is carried out, and as the picture cannot be directly stored in a public security intranet, the picture must be stored in a picture cache server, then the picture is automatically extracted by a gate program of a specified video private network and stored in a specified directory, and the picture is extracted by a gate service of the public security intranet and then is analyzed by the system of the public security intranet. However, with the mass deployment of front-end cameras, the number of pictures captured by the front-end is increased by one order, so that the flexible and configurable load capacity cannot be supported by the gatekeeper program, the pressure of the gatekeeper program is greatly increased, message backlog occurs, and the messages cannot be transmitted to the public security intranet in real time. Therefore, the data transmission mode in the prior art has the problems of poor flexibility and complex transmission mode.
Disclosure of Invention
The embodiment of the invention provides a data transmission method, which can improve the flexibility of a data transmission mode and has higher usability.
In a first aspect, an embodiment of the present invention provides a data transmission method, including the steps of:
acquiring image data, and performing data processing on the image data to obtain initial image data;
the initial image data is sent to a data cluster node through a producer service node, the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a unidirectional access port is constructed, wherein the producer service node is used for acquiring the image data and distributing the initial image data;
and if the data calling request sent by the data cluster node in the calling direction is detected, extracting initial image data corresponding to the data calling request in the data cluster node through the one-way access port, and outputting the initial image data as target image data.
In a second aspect, an embodiment of the present invention further provides a data transmission apparatus, including:
the acquisition module is used for acquiring image data, and performing data processing on the image data to obtain initial image data;
the sending module is used for sending the initial image data to a data cluster node through a producer service node, wherein the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a one-way access port is constructed, wherein the producer service node is used for acquiring the image data and distributing the initial image data;
And the output module is used for extracting initial image data corresponding to the data calling request in the data cluster node as target image data through the unidirectional access port and outputting the initial image data if the data calling request sent by the data cluster node in the calling direction is detected.
In a third aspect, an embodiment of the present invention further provides an electronic device, including: the system comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the steps in the data transmission method provided by the embodiment when executing the computer program.
In a fourth aspect, a computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps in the data transmission method provided by the embodiment.
In the embodiment of the invention, the image data is obtained and subjected to data processing to obtain initial image data; the initial image data is sent to a data cluster node through a producer service node, the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a unidirectional access port is constructed; and if the data calling request sent by the data cluster node in the calling direction is detected, extracting initial image data corresponding to the data calling request in the data cluster node through the one-way access port, and outputting the initial image data as target image data. According to the embodiment of the invention, after the acquired image data is subjected to data processing, the processed initial image data is forwarded to the data cluster node, then the central port of the data cluster node is mapped with the calling port of the calling party, so that a unidirectional access port is constructed, when the calling party is detected to send out a data calling request, the initial image data corresponding to the data calling request can be directly called in the data cluster node through the unidirectional access port to obtain target image data for the calling party, and therefore, the limitation and the complexity of transmission caused by a network gate procedure are avoided by adjusting a data transmission link of the image data to the calling party; and the data cluster nodes can be laterally expanded, so that the data processing speed can be increased, a dynamically adjustable transmission mode is formed, and the flexibility and usability of data transmission are improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a system architecture diagram of a data transmission method according to an embodiment of the present invention;
fig. 2 is a flowchart of a data transmission method according to an embodiment of the present invention;
fig. 3 is a flowchart of another data transmission method according to an embodiment of the present invention;
fig. 4 is a flowchart of another data transmission method according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a data transmission device according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of another data transmission device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of another data transmission device according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of another data transmission device according to an embodiment of the present invention;
Fig. 9 is a schematic structural diagram of another data transmission device according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of another data transmission device according to an embodiment of the present invention;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The terms "comprising" and "having" and any variations thereof in the description and claims of the present application and in the description of the drawings are intended to cover a non-exclusive inclusion. The terms first, second and the like in the description and in the claims or drawings are used for distinguishing between different objects and not for describing a particular sequential order. Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.
As shown in fig. 1, fig. 1 is a system architecture diagram of a system architecture corresponding to a data transmission method according to an embodiment of the present invention. The system architecture 1000 includes a front-end camera 1001, a producer service node 1002, a data cluster service node 1003, and a caller 1004.
The front-end camera 1001 may be an image capturing device for capturing image data, and may include a plurality of cameras distributed in different areas, such as front-end camera a, front-end cameras b, … …, front-end camera n, and the number of front-end cameras is not limited in the present invention.
The producer service node 1002 and the data cluster service node 1003 belong to devices on the external network side. The producer service node 1002 is configured to receive image data collected by the front-end camera 1001, process the image data, and after the data processing, call an interface to send the processed data to the data cluster service node 1003 for storage, and the caller may obtain target image data from the data cluster service node 1003 through the built unidirectional access port.
The data cluster service node 1003 is configured to receive the initial image data processed by the producer service node 1002, and distribute the initial image data to a plurality of servers disposed therein to store the initial image data. In addition, the data cluster service node 1003 may send feedback data to the producer service node 1002, and after receiving the feedback data, the producer service node 1002 may notify the structuring engine to perform structuring processing on the feedback data and transmit the feedback data back to the producer service node 1002, and the producer service node 1002 submits the structured image data after structuring processing to the data cluster service node 1003.
The caller 1004 may refer to an intranet of a public security network, and is configured to provide data support for various cases by invoking image data. The caller 1004 may monitor the data cluster service node 1003 through a unidirectional access port, when the target image data needs to be acquired, the data cluster service node 1003 may send a data call request, after receiving the data call request, the data cluster service node 1003 may parse the data call request, and find the initial image data corresponding to the data call request as the target image data to output to the caller 1004, where the user may apply for data call to the caller 1004 through the terminal device under the permission of the caller 1004.
It should be appreciated that the above-described numbers of front-end cameras 1001, producer service nodes 1002, data cluster service nodes 1003, and invokers 1004 are merely illustrative, and specific adjustments may be made as needed for implementation.
It is to be appreciated that the above-described terminal device can be a variety of electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, electronic book readers, players, laptop and desktop computers, and the like. Terminal devices may also be referred to as terminals, mobile terminals, clients, etc.
As shown in fig. 2, fig. 2 is a flowchart of a data transmission method according to an embodiment of the present invention, where the data transmission method includes the following steps:
201. image data is acquired, and data processing is performed on the image data to obtain initial image data.
In this embodiment, the scenario of the application of the data transmission method includes, but is not limited to, a face recognition system, and in practical application, the face recognition system using the data transmission method may include capturing criminal suspects to achieve rapid positioning, for example capturing criminals such as lost children, walking children, and the like. And the electronic equipment on which the data transmission method operates can acquire image data and the like through a wired connection mode or a wireless connection mode. It should be noted that the Wireless connection may include, but is not limited to, a 3G/4G connection, a WiFi (Wireless-Fidelity) connection, a bluetooth connection, a WiMAX (Worldwide Interoperability forMicrowaveAccess) connection, a Zigbee (low power lan protocol, also known as the purple peak protocol) connection, a UWB (ultrawideband) connection, and other now known or later developed Wireless connection means.
The image data may include face image data, body image data, environment image data, and the like. The image data may be an image acquisition device with techniques of snapshot, storage, interface display, image processing, etc., such as: front-end cameras (cameras), mobile terminals with snapshot functions, etc. The image acquisition equipment can be arranged in different occasions and different positions. One party monitoring the image acquisition device may be a management department of each region, for example: public security authorities, road authorities, public security authorities and the like in each region. Each management department can set up a plurality of image acquisition devices in different areas to the position that is located, and image acquisition device can take a candid photograph the people or things in its monitoring range fast, for example: during security inspection, the front-end camera is arranged on the security inspection column, and faces of all persons passing the security inspection are collected. For another example: front-end cameras are installed at each security channel in shops, office buildings and residential areas, and image data (including faces, bodies, articles carried by people and the like) of the person can be collected when the person is detected to pass through.
The front-end camera may save all the acquired image data, and finally may form an image data set corresponding to each region, where the image data set may be classified according to data types, for example: the human face is A and the human body is B. The method can also be used for classifying and storing according to places: such as building a store 1, building a store 2, etc. In order to acquire more complete image data, the image data can be captured by arranging a plurality of entrance guard cameras rotating at multiple angles. Of course, if the image data acquired by the image acquisition device is used for acquiring a human face, a part of the acquired human face image data, which is not a human face, can be cut, or an image of the acquired human face image data, in which no human face exists, can be deleted, so that the occupation of a storage space is avoided.
The data volume after the image data collected by all the image collecting devices are gathered is very large, the captured image data can be sent to a synchronous server (SYNC Servcie VIID) of an external network (a video private network or a video network with similar functions to the video private network) in a real-time or timed transmission mode, and then the image data is synchronously transmitted to a producer service node (VK SYNC Producer Serivce) for data processing. The video private network described above may be a system dedicated to processing video data, including image data. The above-mentioned processing of the image data may be an optimization process of the collected image data, where the optimization process may be encryption of the image data, and matching the image data with the theme identifier, so as to enhance the security and the recognizability of the image data transmission. And after the optimization processing, the obtained image data is the initial image data.
202. The method comprises the steps that initial image data are sent to a data cluster node through a producer service node, the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a one-way access port is constructed, wherein the producer service node is used for acquiring the image data and distributing the initial image data.
The producer service node may refer to a server node that specifically performs data processing on image data, for example: extraction and distribution of image data can be performed. The data cluster node can be a Kafka data cluster node, and the server in the whole Kafka data cluster node is organized and coordinated by constructing a Kafka server in a machine room in each area of an external network to enable zookeeper to serve as a distributed coordination middleware. The central port may refer to a port for performing data call between the Kafka data cluster node and the caller, and data transmission is implemented through the port. The caller may refer to a public security network end in the embodiment of the present invention. The mapping between the central port and the call port of the public security network end may be that an operation and maintenance person performs corresponding port mapping according to a network security protocol provided by the public security network end, so as to obtain the unidirectional access port, where the unidirectional access port can only be opened when the public security network end actively calls data to the Kafka data cluster node, and the Kafka data cluster node cannot actively send data to the public security network end. Therefore, the safety of data transmission can be ensured, and the situations such as poisoning, information theft and the like are avoided.
The producer service node comprises a preset script program KZ.jar, and the script program has the following functions: 1. the Kafka data cluster nodes are automatically connected, initial image data can be sent to the Kafka data cluster nodes through a self-provided method, and data returned by the Kafka data cluster nodes can be consumed through the self-provided method; 2. setting public and private keys for encrypting and decrypting the respective image data, and encrypting and decrypting the data transmitted by the user through the terminal; 3. setting a Theme (TOPIC) identifier of each image data, ensuring that an image data channel transmitted by a user has uniqueness in Kafka data cluster nodes, and avoiding conflict; 4. the script program can monitor the abnormal state of the service in the Kafka data cluster node through a watch mechanism of the zookeeper, and inform operation and maintenance personnel to check the problem in real time through a short message.
The above Kafka is a client-server based messaging publish/subscribe transport protocol that handles all action flow data in consumer scale websites. Kafka has high throughput and even very common hardware Kafka can support millions of messages per second; and supports partitioning messages through Kafka server and consumer clusters, as well as Hadoop parallel data loading. The use of Kafka facilitates the creation of highly available services. And a copy mechanism is arranged in the Kafka, the copy mechanism can ensure the integrity of the initial image data in the Kafka data cluster node, and high-reliability service is built. The zookeeper may be a software providing a consistency service for a distributed application, and the provided functions include: configuration maintenance, domain name service, distributed synchronization, group service and the like, the ZooKeeper can package complex and error-prone key services, and provides a simple and easy-to-use interface and a system with high performance and stable function for users.
203. If a data calling request sent by a data cluster node in a calling direction is detected, extracting initial image data corresponding to the data calling request in the data cluster node through a one-way access port, and outputting the initial image data as target image data.
In the Kafka data cluster node, the working state of the service in the Kafka data cluster node can be monitored through the zookeeper, so that whether the data call request is received by the Kafka data cluster node or not can be detected in real time or at a fixed time. After the public security network end actively sends a data call request to the Kafka data cluster node through the unidirectional access port, the initial image data in the Kafka request queue is classified, so that the initial image data corresponding to the data call request can be quickly searched in the Kafka request queue to serve as target image data, and the target image data is returned to be used for responding to the data call request through the unidirectional access port, so that the data call efficiency can be improved.
In the embodiment of the invention, the image data is subjected to data processing by acquiring the image data so as to obtain initial image data; the method comprises the steps that initial image data are sent to a data cluster node through a producer service node, the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a unidirectional access port is constructed; if a data calling request sent by a data cluster node in a calling direction is detected, extracting initial image data corresponding to the data calling request in the data cluster node through a one-way access port, and outputting the initial image data as target image data. According to the embodiment of the invention, after the acquired image data is subjected to data processing, the processed initial image data is forwarded to the data cluster node, then the central port of the data cluster node is mapped with the calling port of the calling party, so that a unidirectional access port is constructed, when the calling party is detected to send out a data calling request, the initial image data corresponding to the data calling request can be directly called in the data cluster node through the unidirectional access port to obtain target image data for the calling party, and therefore, the limitation and the complexity of transmission caused by a network gate procedure are avoided by adjusting a data transmission link of the image data to the calling party; and the data cluster nodes can be laterally expanded, so that the data processing speed can be increased, a dynamically adjustable transmission mode is formed, and the flexibility and usability of data transmission are improved.
As shown in fig. 3, fig. 3 is a flowchart of another method provided in an embodiment of the present invention, including the following steps:
301. whether a data uploading request exists is detected, wherein the data uploading request comprises image data.
The image data may be data respectively captured by each regional office through a front-end camera (front-end capturing camera), the data uploading request may be sent by mobile devices configured by each regional office, real-time data transmission between each mobile device configured by each regional office and the front-end camera deployed in the region can be realized, and after the front-end camera captures an image, the image may be rapidly uploaded to the corresponding mobile device through protocol transmission. Of course, the image appearing in the monitoring range of the front-end camera can be observed in real time on the mobile device corresponding to the image, and the acquired data such as video can be stored on the mobile device side. When the calling party needs to call the data, the image data stored on the terminal equipment of each branch office is used as the basic data. When each regional office needs to upload the image data for the calling party to use, the image data needs to be sent to the external network firstly in consideration of the problems of large data quantity, safety performance and the like, and the external network processes the image data and then calls the calling party.
302. If the data uploading request is detected, receiving the image data in the data uploading request and sending the image data to the producer service node.
The server may detect the data upload request, and if the server detects the data upload request, the server may first receive the image data in the data upload request, and then send the received image data to the producer service node.
303. The producer service node performs data processing on the image data to obtain initial image data, the data processing including encrypting the image data and/or matching the image data with a unique identifier.
After the image data is obtained, data processing can be performed on the image data, wherein the data processing comprises encrypting the image data, matching a unique identifier for the image data, and the like. The image data can be protected in the transmission process by encrypting the image data; the unique identifier is matched with the image data, so that the uniqueness of the image data transmission channel in the cluster can be ensured, and the conflict is avoided. Wherein, which image data needs to be encrypted and which data can be obtained without encryption can be analyzed and obtained from the data uploading request.
304. The method comprises the steps that initial image data are sent to a data cluster node through a producer service node, the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a unidirectional access port is constructed.
305. If a data calling request sent by a data cluster node in a calling direction is detected, extracting initial image data corresponding to the data calling request in the data cluster node through a one-way access port, and outputting the initial image data as target image data.
Optionally, the step 303 may include:
and analyzing the data uploading request, and identifying whether the data uploading request comprises an encryption request and/or a classification request.
After the data uploading request is analyzed, all data contained in the data uploading request can be analyzed to judge whether encryption requests, data classification requests and the like exist in the data uploading request. The data classification request may indicate that the unique identifier is matched with the image data, that is, the uploaded image data in different regions may be distinguished according to the data type, the data source and other conditions.
Because the producer service node contains the KZ.jar script program and has the function of setting public and private keys for encrypting and decrypting respective data, the image data of the encryption request is included in the data uploading request, the image data can be encrypted in the producer service node, the image data can be protected in the transmission process, and the user directly calling the external network end and storing in the external network database (video network end database) can carry out calling restriction, so that the situations of exposing part of important image data and the like are avoided. And the KZ.jar script program in the producer service node can set the Theme (TOPIC) identification of the respective data, so that the uniqueness of the image data transmission channel in the cluster can be ensured, and the conflict is avoided. The producer service node can also inform the engine of the initial image data obtained after processing through an internal server, store the initial image into the external network database, and a user needing to call the external network database can acquire the initial image data through an API service between the used mobile equipment and the external network.
If the data uploading request comprises an encryption request and/or a classification request, encrypting the image data in the data uploading request; and/or
And classifying the image data, and matching corresponding unique identifiers for the image data with different data types.
Specifically, when it is identified that the data upload request includes an encryption request, the corresponding image data in the data upload request needs to be encrypted, for example: and setting a secret key xxxxx for the face image data uploaded in the area A. When it is identified that the data uploading request includes a classification request, the image data needs to be classified, and corresponding unique identifiers are matched for the image data with different data types, for example: region a-image data, region B-image data, region C-image data. It is even possible to distinguish between image data of different data types for each region, for example, region a-01 face image data, region a-02 face image data, region B-01 face image data, region B-02 face image data.
In the embodiment of the invention, as the implementation detects whether the front end sends the data uploading request, the data uploading request is analyzed under the condition of receiving the data uploading request, the image data contained in the data uploading request is identified, and when the encryption request and/or the classification request are judged to be contained in the data uploading request, the corresponding image data is encrypted and/or matched with the unique identifier on the producer service node so as to obtain the initial image data, thereby improving the safety and the identification degree of data transmission; the method comprises the steps that initial image data are forwarded to a data cluster node through a producer service node, then a central port of the data cluster node is mapped with a calling port of a calling party, a unidirectional access port is constructed, and when the fact that the calling party sends a data calling request is detected, the initial image data corresponding to the data calling request can be directly called in the data cluster node through the unidirectional access port, so that target image data are obtained for the calling party to use. Therefore, the limitation and the complexity of transmission caused by a network gate procedure are avoided by adjusting the data transmission link from the image data to the calling party, the data volume of the server in the data cluster node is limited, the transverse expansion can be carried out, a dynamically adjustable transmission mode is formed, the flexibility is high, and the usability is higher.
As shown in fig. 4, fig. 4 is a flowchart of another data transmission method provided by the embodiment of the present invention, which specifically includes the following steps:
401. image data is acquired, and data processing is performed on the image data to obtain initial image data.
402. And sending the initial image data to the data cluster node through the producer service node, and if the producer service node is detected to receive the response information of the data cluster node, acquiring feedback data contained in the response information returned by the data cluster node, wherein the feedback data comprises the initial image data.
After the producer service node of the external network finishes operations such as encrypting the image data and matching the unique identifier, the data can be sent to the data cluster node, namely the Kafka data cluster node. There may be multiple servers in the Kafka data cluster node, and the initial image data may be distributed to the various servers through a load balancing policy. Each server is provided with a plurality of storage areas, and initial image data can be correspondingly stored in different areas according to data types. In this way, the parallel speed of receiving the initial image data can be increased.
When the Kafka data cluster node receives the initial data, response information may be transmitted to the producer service node, indicating that the reception of the initial image data has been completed. Feedback data may be included in the returned response information, which may refer to the initial image data that the Kafka data cluster node has received.
The producer service node does not store mass data, but in order to ensure high availability and comprehensiveness of data, the Kafka data cluster node needs initial image data and structured image data after engine structuring. Thus, there is a need for Kafka data cluster nodes to respond and return feedback data to the producer service node.
403. And carrying out structuring processing on the feedback data to obtain structured image data, wherein the structured image data is the image data obtained after structuring processing on the initial image data included in the feedback data.
The structuring engine may be configured to perform structuring processing on the feedback data, and convert the feedback data into data that may be logically expressed in a two-dimensional table structure. After receiving the feedback data returned by the Kafka data cluster node, the producer service node can send notification information to the structuring engine, forward the feedback data to the structuring engine, and obtain structured image data after structuring by the structuring engine, and the structuring engine returns the structured image data to the producer service node.
404. And submitting the structured image data to a data cluster node through a producer service node, wherein the data cluster node comprises a central port, and mapping the central port of the data cluster node with a calling port of a calling party to construct a unidirectional access port.
Wherein, after the structuring engine transmits the structured image data back to the producer service node, the producer service node distributes the received structured image data to the Kafka data cluster node. In the Kafka data cluster node operation device, a KZ.jar script program in a producer service node can monitor the abnormal state of each server service in the Kafka data cluster node through a latch mechanism of a zookeeper, so that once the abnormality is found, operation and maintenance personnel can be informed to check the problem in a short message mode in real time. If a certain server in the Kafka data cluster node fails, other servers in the cluster are not affected, the operation executed by the failed server can be converted to other alternative servers to continue, and when the abnormal server is restored to a normal working state, the operation can be started continuously.
405. If a data calling request sent by a data cluster node in a calling direction is detected, extracting initial image data corresponding to the data calling request in the data cluster node through a one-way access port, and outputting the initial image data as target image data.
Optionally, the step 402 includes:
the remaining storage space of the data cluster node is detected.
Wherein the amount of data is huge, and the number of servers in the Kafka data cluster node is not changed, but the storage space is limited in the Kafka data cluster node, so that the rest storage space in the Kafka data cluster node can be detected in real time or at fixed time before or after each time the initial image data or the structured image data sent by the producer service node is received. The remaining storage space may refer to a total remaining storage space of all services in the Kafka dataset nodes.
If the remaining storage space is greater than the occupied space of the initial image data in the producer service node, the producer service node sends the initial image data to the data cluster node.
After detecting the remaining storage space of the Kafka data cluster node, the storage space required to be occupied by the initial image data to be uploaded to the Kafka data cluster node may be compared with the remaining storage space, for example: the remaining storage space remains 2G, and the storage space occupied by the initial image data to be uploaded to the Kafka data cluster node needs 3G, which indicates that the Kafka data cluster node cannot load so much initial image data. When the remaining storage space of the Kafka data cluster node is not enough, sequential loading can be performed according to the time sequence. Of course, if the remaining storage space is larger than the storage space occupied by the initial image data to be uploaded to the Kafka data cluster node, the initial image data uploaded to the Kafka data cluster node by the producer service node can be directly accepted, for example: and the remaining storage space is 5G, and the storage space occupied by the initial image data which needs to be uploaded to the Kafka data cluster node is 2G, so that the Kafka data cluster node can load the 2G initial image data.
As a possible embodiment, when the storage space of the servers in the Kafka data cluster node is not enough, the number of servers can be dynamically expanded, and the storage space of the data is increased, for example: the original 8 servers are provided, the storage space of each server is 100G, and when the residual storage space is insufficient, 4 servers with the same storage space can be added. By transversely expanding the Kafka data cluster nodes, the loading speed of the data is increased, the storage space is increased, the integrity of the data in the Kafka data cluster nodes is ensured, and a flexible and adjustable data transmission mode is realized.
As another possible embodiment, the initial image data stored by the server in the Kafka data cluster node may also be filtered at regular time, and part of the data may be pruned. The condition for filtering may be, for example, storage time, number of times data is called, etc.: the Kafka data cluster node performs self-checking at regular time, and automatically deletes the initial image data stored for more than 2 years, or obtains whether the number of times that all initial image data in the Kafka data cluster node are called in 1 year reaches 20 times or not, and if the number of times is not reached 20 times, the initial image data with the number of times of being called being below 20 times can be deleted. By the method, the remaining storage space in the Kafka data cluster node can be updated, so that the remaining storage space can meet the storage space required by the initial image data.
Optionally, the step 405 includes:
it is detected whether the unidirectional access port receives a data call request.
Whether the unidirectional access port has a data call request or not can be detected in real time on the Kafka data cluster node, the data call request can be a request actively sent by a calling party, and the data call request can comprise initial image data which is wanted to be called. The caller can refer to an intranet of the public security network. The public security network may also be configured with a producer service node VK SYNC Consumer Serivce that listens to the video private network by mapping unidirectional access ports: the initial image data in the Kafka data cluster node.
And if the data calling request is received, analyzing the data calling request, and screening initial image data corresponding to the data calling request from the initial image data as target image data.
When a data call request is detected, the caller is indicated to need to acquire the corresponding data. At this time, the Kafka data cluster node may parse the data call request to identify the data that is desired to be acquired, for example: x time x place image data. After the image data which the calling party wants to acquire is found in the Kafka data cluster node, the image data can be used as target image data to be output to the public security network intranet based on the one-way access port. The searching of the target image data may be performed according to key information, feature values, etc. in the data call request, for example: the search is performed by time, place, person, object, characteristic information and the like.
The target image data is output to the caller through the unidirectional access port.
After the target image data is found, the target image data can be output to the internal network of the public security network through the unidirectional access port. And each Kafka consumer group can be built in the public security network, each group can comprise a plurality of consumer servers, and target image data of different subjects output by Kafka data cluster nodes are monitored in real time and distributed in a load manner. The public security network intranet can be also provided with a producer service node, the producer service node can be also provided with a KZ.jar script program, the script program can monitor the abnormal state of server service in Kafka consumer grouping through a latch mechanism of a zookeeper, and when the abnormal state is detected, operation and maintenance personnel are informed of the problem in real time through a short message and the like.
After receiving the target image data, the internal network of the public security network can submit the target image data to an internal server, inform an engine to input the target image data into a database, and store the target image data into a storage system of the internal network of the public security network. When the mobile terminal accesses the public security network intranet, the password can be input to unlock the target image data through the data port API service, and the password is input correctly. The mobile terminal can access the image data in the internal network of the public security network.
In the embodiment of the invention, after the acquired image data is subjected to data processing, the processed initial image data is forwarded to the data cluster node, and when the response information of the data cluster node is received by the producer service node, feedback data contained in the response information returned by the data cluster node is acquired, and the structuring engine is informed of structuring the feedback data to acquire structured image data and submitting the structured image data to the data cluster node so as to ensure that the data in the data cluster node are complete and orderly stored. And the residual storage space of the data cluster nodes is detected in real time or at regular time, and under the condition of insufficient space, the servers in the data cluster nodes can be laterally expanded or the storage space of the data cluster nodes can be deleted, so that enough storage space is ensured to store the initial image data uploaded by the producer service nodes, a dynamically adjustable transmission mode is formed, and the method is high in flexibility and higher in usability. When detecting that the caller sends a data call request, the caller can directly call initial image data corresponding to the data call request in the data cluster node through the unidirectional access port to obtain target image data for the caller to use. Therefore, the limitation and the complexity of transmission caused by the network gate program are avoided by adjusting the data transmission link of the image data to the calling party.
As shown in fig. 5, fig. 5 is a schematic structural diagram of a data transmission device according to an embodiment of the present invention, where a data transmission device 500 includes:
the acquiring module 501 is configured to acquire image data, and perform data processing on the image data to obtain initial image data;
a sending module 502, configured to send initial image data to a data cluster node through a producer service node, where the data cluster node includes a central port, map the central port of the data cluster node with a call port of a caller, and construct a unidirectional access port, where the producer service node is configured to obtain the image data and distribute the initial image data;
and the output module 503 is configured to extract, through the unidirectional access port, initial image data corresponding to the data call request in the data cluster node as target image data and output the target image data if the data call request sent by the data cluster node in the call direction is detected.
Optionally, as shown in fig. 6, fig. 6 is a schematic structural diagram of another data transmission device according to an embodiment of the present invention, and the obtaining module 501 includes:
a first detecting unit 5011 configured to detect whether there is a data upload request, where the data upload request includes image data;
A receiving unit 5012 configured to receive image data in the data upload request and send the image data to the producer service node if the data upload request is detected;
a first processing unit 5013 for the producer service node to perform data processing on the image data to obtain initial image data, the data processing including encrypting the image data and/or matching the image data with a unique identifier.
Optionally, as shown in fig. 7, fig. 7 is a schematic structural diagram of another data transmission device provided in an embodiment of the present invention, where the first processing unit 5013 includes:
the parsing subunit 50131 is configured to parse the data upload request, and identify whether the data upload request includes an encryption request and/or a classification request;
a processing subunit 50132, configured to encrypt the image data in the data upload request if the data upload request includes an encryption request and/or a classification request; and/or
The processing subunit 50132 is further configured to classify the image data, and match corresponding unique identifiers for the image data of different data types.
Optionally, as shown in fig. 8, fig. 8 is a schematic structural diagram of another data transmission apparatus provided in an embodiment of the present invention, and the sending module 502 includes:
The obtaining unit 5021 is configured to send initial image data to a data cluster node through a producer service node, and if it is detected that the producer service node receives response information of the data cluster node, obtain feedback data included in the response information returned by the data cluster node, where the feedback data includes the initial image data;
the second processing unit 5022 is configured to perform structural processing on the feedback data to obtain structural image data, where the structural image data is image data obtained by performing structural processing on initial image data included in the feedback data;
a submitting unit 5023 for submitting the structured image data to the data cluster node via the producer service node.
Optionally, as shown in fig. 9, fig. 9 is a schematic structural diagram of another data transmission apparatus provided in an embodiment of the present invention, and the sending module 502 further includes:
a second detecting unit 5024, configured to detect a remaining storage space of the data cluster node;
and a sending unit 5025, configured to send the initial image data to the data cluster node by the producer service node if the remaining storage space is greater than the occupied space of the initial image data in the producer service node.
Optionally, as shown in fig. 10, fig. 10 is a schematic structural diagram of another data transmission device according to an embodiment of the present invention, and the output module 503 includes:
a third detecting unit 5031, configured to detect whether the unidirectional access port receives a data call request;
a filtering unit 5032, configured to, when receiving the data call request, parse the data call request, and filter, from the initial image data, the initial image data corresponding to the data call request as target image data;
an output unit 5033 for outputting the target image data to the caller through the unidirectional access port.
The data transmission device provided by the embodiment of the invention can realize each process of the data transmission method in the embodiment of the method and can achieve the same beneficial effects, and in order to avoid repetition, the description is omitted.
As shown in fig. 11, fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, where the electronic device 1100 includes: the steps in the data transmission method provided by the embodiment are implemented by the processor 1101 when the processor 1101 executes the computer program, and the memory 1102, the processor 1101, the network interface 1103 and the computer program stored in the memory 1102 and executable on the processor 1101.
Specifically, the processor 1101 is configured to perform the following steps:
acquiring image data, and performing data processing on the image data to obtain initial image data;
the method comprises the steps that initial image data are sent to a data cluster node through a producer service node, the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a one-way access port is constructed, wherein the producer service node is used for acquiring the image data and distributing the initial image data;
if a data calling request sent by a data cluster node in a calling direction is detected, extracting initial image data corresponding to the data calling request in the data cluster node through a one-way access port, and outputting the initial image data as target image data.
Optionally, the step of acquiring image data and performing data processing on the image data performed by the processor 1101 includes:
detecting whether a data uploading request exists, wherein the data uploading request comprises image data;
if the data uploading request is detected, receiving image data in the data uploading request and sending the image data to a producer service node;
the producer service node performs data processing on the image data to obtain initial image data, the data processing including encrypting the image data and/or matching the image data with a unique identifier.
Optionally, the step of encrypting the image data and/or matching the image data with a unique identifier performed by the processor 1101 includes:
analyzing the data uploading request, and identifying whether the data uploading request comprises an encryption request and/or a classification request;
if the data uploading request comprises an encryption request and/or a classification request, encrypting the image data in the data uploading request; and/or
And classifying the image data, and matching corresponding unique identifiers for the image data with different data types.
Optionally, the step performed by the processor 1101 of sending the initial image data to the data cluster node by the producer service node comprises:
if the producer service node is detected to receive the response information of the data cluster node, acquiring feedback data contained in the response information returned by the data cluster node, wherein the feedback data comprises the initial image data;
carrying out structuring treatment on the feedback data to obtain structured image data, wherein the structured image data is the image data obtained after structuring treatment on the initial image data included in the feedback data;
submitting, by the producer service node, the structured image data to the data cluster node.
Optionally, the step performed by the processor 1101 of sending the initial image data to the data cluster node by the producer service node further comprises:
detecting the residual storage space of the data cluster node;
if the remaining storage space is greater than the occupied space of the initial image data in the producer service node, the producer service node sends the initial image data to the data cluster node.
Optionally, the step performed by the processor 1101 to output, through the unidirectional access port, the target image data corresponding to the data call request in the data cluster node includes:
detecting whether a unidirectional access port receives a data call request;
if a data calling request is received, analyzing the data calling request, and screening initial image data corresponding to the data calling request from the initial image data to serve as target image data;
the target image data is output to the caller through the unidirectional access port.
The electronic device 1100 provided by the embodiment of the present invention can implement each implementation manner in the embodiment of the data transmission method, and corresponding beneficial effects, and in order to avoid repetition, a detailed description is omitted here.
It should be noted that only 1101-1103 with components are shown in the figures, but it should be understood that not all of the illustrated components are required to be implemented and that more or fewer components may be implemented instead. It will be appreciated by those skilled in the art that the electronic device 1100 herein is a device capable of automatically performing numerical calculations and/or information processing according to predetermined or stored instructions, and the hardware thereof includes, but is not limited to, microprocessors, application specific integrated circuits (Application Specific Integrated Circuit, ASICs), programmable gate arrays (FPGAs), digital processors (Digital Signal Processor, DSPs), embedded devices, etc.
The electronic device 1100 may be a computing device such as a desktop computer, a notebook computer, or a palm top computer. The electronic device 1100 may interact with a user by way of a keyboard, mouse, remote control, touch pad, or voice control device.
Memory 1102 includes at least one type of readable storage medium including flash memory, hard disk, multimedia card, card memory (e.g., SD or DX memory, etc.), random Access Memory (RAM), static Random Access Memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 1102 may be an internal storage unit of the electronic device 1100, such as a hard disk or memory of the electronic device 1100. In other embodiments, the memory 1102 may also be an external storage device of the electronic device 1100, such as a plug-in hard disk, smart Media Card (SMC), secure Digital (SD) Card, flash Card (Flash Card) or the like, which are provided on the electronic device 1100. Of course, memory 1102 may also include both internal storage units and external storage devices of electronic device 1100. In this embodiment, the memory 1102 is typically used for storing an operating system and various application software installed on the electronic device 1100, such as program codes of a data transmission method. In addition, the memory 1102 can also be used to temporarily store various types of data that have been output or are to be output.
The processor 1101 may be a central processing unit (Central Processing Unit, CPU), controller, microcontroller, microprocessor, or other data processing chip in some embodiments. The processor 1101 is generally used to control the overall operation of the electronic device 1100. In this embodiment, the processor 1101 is configured to execute a program code stored in the memory 1102 or process data, such as a program code for executing a data transmission method.
The network interface 1103 may include a wireless network interface or a wired network interface, the network interface 1103 typically being used to establish communication connections between the electronic device 1100 and other electronic devices.
The embodiment of the present invention further provides a computer readable storage medium, on which a computer program is stored, where the computer program when executed by the processor 1101 realizes each process in the data transmission method provided in the embodiment, and the same technical effects can be achieved, so that repetition is avoided, and no further description is provided herein.
Those skilled in the art will appreciate that all or part of the processes in implementing the methods of the embodiments may be implemented by a computer program for instructing the relevant hardware, and the program may be stored in a computer readable storage medium, and the program may include processes as embodiments of the methods when executed. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory 1102 (RandomAccess Memory, RAM) or the like.
The foregoing disclosure is illustrative of the present invention and is not to be construed as limiting the scope of the invention, which is defined by the appended claims.

Claims (9)

1. A data transmission method, comprising the steps of:
acquiring image data, and performing data processing on the image data to obtain initial image data;
the initial image data is sent to a data cluster node through a producer service node, the residual storage space of the data cluster node is detected before the initial image data sent by the producer service node is received each time, and when the residual storage space of the data cluster node is not enough, the initial image data is loaded in sequence according to the time sequence; if the producer service node is detected to receive the response information of the data cluster node, acquiring feedback data contained in the response information returned by the data cluster node, wherein the feedback data comprises the initial image data; carrying out structuring treatment on the feedback data to obtain structured image data, wherein the structured image data is the image data obtained after structuring treatment on the initial image data included in the feedback data; submitting the structured image data to the data cluster node by the producer service node; the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a unidirectional access port is constructed, wherein the producer service node is used for acquiring the image data and distributing the initial image data;
And if the data calling request sent by the data cluster node in the calling direction is detected, extracting initial image data corresponding to the data calling request in the data cluster node through the one-way access port, and outputting the initial image data as target image data.
2. The data transmission method according to claim 1, wherein the step of acquiring image data and performing data processing on the image data comprises:
detecting whether a data uploading request exists, wherein the data uploading request comprises the image data;
if the data uploading request is detected, receiving the image data in the data uploading request and sending the image data to the producer service node;
the producer service node performs data processing on the image data to obtain the initial image data, the data processing including encrypting the image data and/or matching the image data with a unique identifier.
3. The data transmission method according to claim 2, wherein the step of encrypting the image data and/or matching the image data with a unique identifier comprises:
Analyzing the data uploading request, and identifying whether the data uploading request comprises an encryption request and/or a classification request;
if the data uploading request comprises an encryption request and/or a classification request, encrypting the image data in the data uploading request; and/or
And classifying the image data, and matching corresponding unique identifiers for the image data with different data types.
4. The data transmission method of claim 1, wherein the step of transmitting the initial image data to a data cluster node through a producer service node further comprises:
and if the residual storage space is larger than the occupied space of the initial image data in the producer service node, directly receiving the initial image data uploaded to the data cluster node by the producer service node.
5. The data transmission method as claimed in claim 1, wherein the step of outputting the target image data corresponding to the data call request in the data cluster node through the unidirectional access port includes:
detecting whether the unidirectional access port receives a data call request or not;
If the data calling request is received, analyzing the data calling request, and screening initial image data corresponding to the data calling request from the initial image data to serve as target image data;
and outputting the target image data to the calling party through the unidirectional access port.
6. A data transmission apparatus, comprising:
the acquisition module is used for acquiring image data, and performing data processing on the image data to obtain initial image data;
the sending module is used for sending the initial image data to a data cluster node through a producer service node, detecting the residual storage space of the data cluster node before receiving the initial image data sent by the producer service node each time, and loading the initial image data in sequence according to the time sequence when the residual storage space of the data cluster node is insufficient; if the producer service node is detected to receive the response information of the data cluster node, acquiring feedback data contained in the response information returned by the data cluster node, wherein the feedback data comprises the initial image data; carrying out structuring treatment on the feedback data to obtain structured image data, wherein the structured image data is the image data obtained after structuring treatment on the initial image data included in the feedback data; submitting the structured image data to the data cluster node by the producer service node; the data cluster node comprises a center port, the center port of the data cluster node is mapped with a calling port of a calling party, and a unidirectional access port is constructed, wherein the producer service node is used for acquiring the image data and distributing the initial image data;
And the output module is used for extracting initial image data corresponding to the data calling request in the data cluster node as target image data through the unidirectional access port and outputting the initial image data if the data calling request sent by the data cluster node in the calling direction is detected.
7. The data transmission apparatus of claim 6, wherein the acquisition module comprises:
the detection unit is used for detecting whether a data uploading request exists or not, and the data uploading request comprises the image data;
a receiving unit, configured to receive the image data in the data upload request and send the image data to the producer service node if the data upload request is detected;
and the processing unit is used for carrying out data processing on the image data by the producer service node so as to obtain the initial image data, wherein the data processing comprises encrypting the image data and/or matching a unique identifier with the image data.
8. An electronic device, comprising: memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps in the data transmission method according to any one of claims 1 to 5 when the computer program is executed.
9. A computer-readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the steps of the data transmission method according to any one of claims 1 to 5.
CN201911414880.6A 2019-12-31 2019-12-31 Data transmission method and device, electronic equipment and storage medium Active CN113132678B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911414880.6A CN113132678B (en) 2019-12-31 2019-12-31 Data transmission method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911414880.6A CN113132678B (en) 2019-12-31 2019-12-31 Data transmission method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113132678A CN113132678A (en) 2021-07-16
CN113132678B true CN113132678B (en) 2023-08-01

Family

ID=76770484

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911414880.6A Active CN113132678B (en) 2019-12-31 2019-12-31 Data transmission method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113132678B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114697090B (en) * 2022-03-17 2024-01-09 北京声智科技有限公司 Streaming media acquisition system, method, device, storage medium and product
CN115277610B (en) * 2022-07-25 2024-06-04 平安科技(深圳)有限公司 Message split sending method, device, equipment and medium based on dual-activity environment

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106980678A (en) * 2017-03-30 2017-07-25 温馨港网络信息科技(苏州)有限公司 Data analysing method and system based on zookeeper technologies

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9830331B2 (en) * 2015-05-04 2017-11-28 Netapp, Inc. Cluster scale synchronization of producer consumer file access via multi-protocol nodes
CN108076103A (en) * 2016-11-18 2018-05-25 北京优朋普乐科技有限公司 A kind of message treatment method, system and message producer's cluster
CN110134332B (en) * 2019-04-28 2022-03-08 平安科技(深圳)有限公司 Data storage method and related device
CN110427446B (en) * 2019-08-02 2023-05-16 武汉中地数码科技有限公司 Method and system for rapidly publishing and browsing mass image services

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106980678A (en) * 2017-03-30 2017-07-25 温馨港网络信息科技(苏州)有限公司 Data analysing method and system based on zookeeper technologies

Also Published As

Publication number Publication date
CN113132678A (en) 2021-07-16

Similar Documents

Publication Publication Date Title
Li et al. IoT forensics: Amazon echo as a use case
US8831294B2 (en) Broadcast identifier enhanced facial recognition of images
CN109492536B (en) Face recognition method and system based on 5G framework
US9740940B2 (en) Event triggered location based participatory surveillance
AU2018409900B2 (en) Providing security to mobile devices via image evaluation operations that electronically analyze image data received from cameras of the mobile devices
CN104581062A (en) Video monitoring method and system capable of realizing identity information and video linkage
CN113132678B (en) Data transmission method and device, electronic equipment and storage medium
CN101848374A (en) Wireless video monitoring system and wireless video monitoring method thereof
KR20210047350A (en) Attendance management system, method and electronic device
CN110399225A (en) Monitoring information processing method, system and computer system
CN106161406B (en) The method and apparatus for obtaining user account
CN111614761A (en) Block chain message transmission method, device, computer and readable storage medium
Omri et al. Cloud-ready biometric system for mobile security access
Actoriano et al. Forensic Investigation on WhatsApp Web Using Framework Integrated Digital Forensic Investigation Framework Version 2
KR20190066218A (en) Method, computing device and program for executing harmful object control
CN108833500B (en) Service calling method, service providing method, data transmission method and server
CN115361450B (en) Request information processing method, apparatus, electronic device, medium, and program product
Giambona et al. Demonstrating MQTT+ An Advanced Broker for Data Filtering, Processing and Aggregation
US20210365431A1 (en) False submission filter device, false submission filter system, false submission filter method, and computer readable medium
CN104243597A (en) Business card dispensing and collecting system and business card dispensing and collecting method based on WLAN (wireless local area network) environment
CN110300290B (en) Teaching monitoring management method, device and system
CN103353822A (en) Method and device for acquiring file
CN105338290A (en) Code stream synthetic method and apparatus
CN110739067A (en) Personal health data acquisition management system based on smart home
CN107797731B (en) Information processing method, system and mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant