CN111611308A

CN111611308A - Information processing method, device and system

Info

Publication number: CN111611308A
Application number: CN202010527134.4A
Authority: CN
Inventors: 胡祥林; 蔡尧; 李瞳; 洪月; 郑毅; 李晓军
Original assignee: Shanghai Qianzhen Information Technology Co ltd
Current assignee: Shanghai Qianzhen Information Technology Co ltd
Priority date: 2020-06-11
Filing date: 2020-06-11
Publication date: 2020-09-01

Abstract

The application discloses an information processing method, device and system, wherein the method comprises the following steps: receiving data from a device that transmitted the data; pushing the received data to a message queue; and consuming the message queue to store the data in the data consumption queue into a first database for the first type of user to inquire. The information processing method, the device and the system provided by the invention can solve the technical problem that the data storage and the data query have obvious time difference in the prior art.

Description

Information processing method, device and system

Technical Field

The present invention relates to the field of information processing technologies, and in particular, to an information processing method, apparatus, and system.

Background

The information acquisition by using a bargun is a common technical means in the logistics storage industry. Common barguns are of two types: one is only simple input equipment, and the work can be finished only by connecting a computer to run related software; the other is an intelligent device similar to a PDA or a mobile phone, which is called an information collector and can be provided with software to independently complete code scanning collection. When a bargun is used for data acquisition, data is usually stored in local equipment at first and then uploaded to a server at regular time, so that an obvious time difference is generated between data acquisition and uploading, and the difference of statistical calibers is caused in subsequent data processing and management.

Disclosure of Invention

The invention aims to provide an information processing method, device and system, which aim to solve the technical problem that obvious time difference exists between data storage and data query in the prior art.

The purpose of the invention is realized by adopting the following technical scheme:

a first aspect of the present invention provides an information processing method, including:

receiving data from a device that transmitted the data;

pushing the received data to a message queue;

and consuming the message queue to store the data in the data consumption queue into a first database for the first type of user to inquire.

The data are received from the equipment for sending the data and pushed to the message queue, and the message queue is consumed to store the data in the data consumption queue into the first database for the first type of user to inquire, so that the first type of user can inquire the data through the first database, the data storage and the data inquiry operation are separated from each other, the data can be received from a large number of equipment for sending the data in parallel, the real-time performance of the data storage and the data inquiry is ensured, and no obvious time difference exists between the data storage and the data inquiry.

Optionally, the method further comprises:

and providing the message queue to a second type of user for consumption.

The message queue is provided for the second type of users for consumption, so that the second type of users can directly acquire data through the message queue, and the data acquisition timeliness is improved.

Optionally, the method further comprises:

and storing the received data into a second database for a third type of user to obtain, wherein the real-time requirement of the third type of user on data obtaining is lower than that of the second type of user.

The received data are stored in the second database for the third type of users to obtain, so that the third type of users can obtain the data through the second database, and the requirement of the third type of users on the real-time property of data obtaining is lower than that of the second type of users, so that the situations of high requirement on the real-time property of data obtaining and low requirement on the real-time property can be considered, and the requirement on timeliness is favorably met, and meanwhile, the load of hardware resources is reduced.

Optionally, the storing the received data in a second database for a third type of user to obtain includes:

storing the received data in a second database;

and exporting the data stored in the second database according to a preset period for a third type user to obtain.

The received data are stored in the second database, and the data stored in the second database are exported according to the preset period to be acquired by the third type of users, so that the third type of users can acquire the data from the second database according to the preset period.

Optionally, the receiving data from the device that transmits data includes:

verifying whether the device sending the data is a registered device;

if the device is a registered device, the data is received.

By verifying whether the equipment for sending data is the registered equipment or not and receiving the data under the condition that the equipment is the registered equipment, the method is favorable for ensuring the reliability of the data source and improving the safety, and is favorable for avoiding redundant data generated by receiving invalid data.

A second aspect of the present invention provides an information processing apparatus, the apparatus comprising:

a receiving module for receiving data from a device that transmits data;

the pushing module is used for pushing the received data to a message queue;

and the consumption module is used for consuming the message queue so as to store the data in the data consumption queue into a first database for the first type of user to inquire.

Optionally, the apparatus further comprises:

and the providing module is used for providing the message queue for the second type of users for consumption.

Optionally, the apparatus further comprises:

and the storage module is used for storing the received data into a second database for a third type of user to obtain, wherein the real-time requirement of the third type of user on data acquisition is lower than that of the second type of user.

Optionally, the logging module comprises:

the storage unit is used for storing the received data into a second database;

and the exporting unit is used for exporting the data stored in the second database according to a preset period for a third type user to obtain.

Optionally, the receiving module includes:

a verification unit configured to verify whether the device that transmits data is a registered device;

a receiving unit, configured to receive data if the device is a registered device.

A third aspect of the present invention provides an information processing system, the system comprising:

the data acquisition device is used for responding to the acquisition operation instruction to acquire data;

data processing means for receiving data from said data acquisition means; and pushing the received data to a message queue; and consuming the message queue to store the data in the data consumption queue into a first database for a first type of user to query;

a first database for storing the data for querying by the first type of user;

and the message queue device is used for providing a message queue for storing the data.

Performing data acquisition by a data acquisition device in response to an acquisition operation instruction to obtain data, receiving the data from the data acquisition device by a data processing device, pushing the received data to a message queue, consuming the message queue to store the data in the data consumption queue into a first database for being inquired by a first type of user, storing said data by a first database for querying by said first type of user, and providing a message queue storing said data by message queue means, thus, a first type of user can query data through the first database, so that data logging and data query operations are separated from each other, therefore, the data can be received from a large number of devices for sending data in parallel, the real-time performance of data storage and data query is guaranteed, and no obvious time difference exists between the data storage and the data query.

Optionally, the data processing apparatus is further configured to store the received data in a second database for a third type of user to obtain;

the message queue also provides a second type of user for consumption, wherein the real-time requirement of the second type of user on data acquisition is higher than that of the third type of user;

the system also includes a second database for storing the data for retrieval by a third type of user.

The message queue is provided for the second type user for consumption, so that the second type user can directly acquire data through the message queue, and the data acquisition timeliness is improved; the received data is stored in the second database for the third type of users to obtain, so that the third type of users can obtain the data through the second database, and the requirement of the third type of users on the real-time property of data acquisition is lower than that of the second type of users, so that the situations of high requirement on the real-time property of data acquisition and low requirement on the real-time property can be considered, and the load of hardware resources is reduced while the requirement on the timeliness is favorably met; in the information processing system, the second type users and the third type users are not directly related to the data acquisition device, so that even if the data acquisition device fails or is changed, the normal work of the second type users and the third type users is not affected.

Optionally, the first database is a Redis database.

The Redis database is adopted as the first database, so that the query efficiency can be improved, and the pressure of the second database is reduced.

Optionally, the data acquisition device is further configured to provide a user login interface, and obtain basic data from the first database after the login is completed, where the basic data includes at least one of time information, company information, and personnel information. The data acquisition device is also used for providing a user login interface and acquiring basic data from the first database after login is completed, wherein the basic data comprises at least one of time information, company information and personnel information, so that the data acquisition device can acquire the latest basic data, and data acquisition work can be carried out more smoothly.

A fourth aspect of the present invention provides an information processing electronic device, comprising a processor and a memory, the memory being configured to store executable instructions of the processor, the processor being configured to perform the steps of the above-mentioned information processing method via execution of the executable instructions.

A fifth aspect of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed, implements the steps of the above-described information processing method.

Drawings

The present application is further described below with reference to the drawings and examples.

Fig. 1 is a schematic flow chart of an information processing method according to an embodiment of the present invention;

FIG. 2 is a schematic flow chart of step S10 in FIG. 1;

FIG. 3 is a flow chart illustrating a further information processing method according to an embodiment of the present invention;

FIG. 4 is a flow chart illustrating a further information processing method according to an embodiment of the present invention;

FIG. 5 is a schematic flow chart of step S50 in FIG. 4;

fig. 6 is a flowchart illustrating a message transmission method based on a message queue according to an embodiment of the present invention;

FIG. 7 is a flow chart of a method for publishing messages according to an embodiment of the present invention;

fig. 8 is a flowchart illustrating a message queue management method according to an embodiment of the present invention;

fig. 9 is a flowchart illustrating a message queue management method according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of the receiving module 10 in fig. 10;

FIG. 12 is a schematic structural diagram of another information processing apparatus according to an embodiment of the present invention;

fig. 13 is a schematic structural diagram of another information processing apparatus according to an embodiment of the present invention;

FIG. 14 is a schematic diagram of the configuration of the logging module 50 of FIG. 13;

FIG. 15 is a block diagram of an information handling system according to an embodiment of the present invention;

FIG. 16 is a block diagram of yet another information handling system in accordance with an embodiment of the present invention;

FIG. 17 is a block diagram of an information handling system according to yet another embodiment of the present invention;

FIG. 18 is a flowchart illustrating a method of application of the information handling system of FIG. 17;

FIG. 19 is a schematic flow chart of querying data from a Redis database according to an embodiment of the present invention;

fig. 20 is a block diagram of an electronic device for processing information according to an embodiment of the present invention.

Fig. 21 is a schematic structural diagram of a program product for implementing an information processing method according to an embodiment of the present invention.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

In order to explain the technical means of the present invention, the following description will be given by way of specific examples.

Fig. 1 shows an information processing method of an embodiment of the present invention. As shown in fig. 1, the method may include:

step S10: data is received from a device that transmitted the data. The device for sending data may be a data acquisition device, specifically, it may be a bargun, for example, it may be a simple input device, connected to a computer and running related software to complete work, or it may be a smart device like a PDA or a mobile phone, on which software may be installed to independently complete code scanning acquisition work. In other embodiments, the device for sending data may also be other service systems. Specifically, as shown in fig. 2, the step S10 may include: step S11: verifying whether the device sending the data is a registered device; and step S12: if the device is a registered device, the data is received. The data is received by verifying whether the equipment for sending the data is the registered equipment or not and under the condition that the equipment is the registered equipment, so that the data source reliability is ensured, the safety is improved, and the redundant data generated by receiving invalid data is avoided.

S20: and pushing the received data to a message queue. The Message Queue, namely, Message Queue, is abbreviated as MQ. The message queue may be comprised by a message queue means, in particular the message queue means may be a message queue server.

S30: and consuming the message queue to store the data in the data consumption queue into a first database for the first type of user to inquire. Wherein the first database may be a Redis database; the first type of user can be a handler and a manager of the logistics network.

As shown in fig. 3, the method may further include:

step S40: and providing the message queue to a second type of user for consumption. Wherein the second type of user may be a downstream system that needs data.

As shown in fig. 4, the method may further include:

step S50: and storing the received data in a second database for a third type of user to obtain. Wherein the third type of user may be other downstream systems that require data, and the third type of user has lower real-time requirements for data acquisition than the second type of user. Specifically, as shown in fig. 5, the step S50 may include: step S51: storing the received data in a second database; and step S52: and exporting the data stored in the second database according to a preset period for a third type user to obtain. The preset period may be determined according to actual needs, for example, the preset period may be half an hour, 1 hour, 4 hours, 8 hours, 12 hours, 1 day, 2 days, 1 week, and the like. The received data are stored in the second database, and the data stored in the second database are exported according to the preset period to be acquired by the third type of users, so that the third type of users can acquire the data from the second database according to the preset period.

It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.

Referring to fig. 6, in this embodiment, the message transmission method based on the message queue may include the following steps:

step S110: and consuming the messages in the upstream message queue of the upstream message queue middleware, wherein the messages in the upstream message queue of the upstream message queue middleware are the messages received by the upstream message queue middleware and sent by the message issuing end.

Step S120: and issuing the consumed message to downstream message queue middleware, so that the downstream message queue middleware adds the message to a downstream message queue of the downstream message queue middleware, and a message consumption end consumes the message from the downstream message queue of the downstream message queue middleware.

Specifically, although the above steps only describe the message transmission manner of the two-level message queue middleware (the upstream message queue middleware and the downstream message queue middleware), the present invention is not limited thereto, and the message transmission manner of the message queue middleware with more than two levels is also within the protection scope of the present invention. In the message transmission mode of the message queue middleware with more than two levels, according to the direction from the message publishing end to the message consuming end, the message transmission of the first level message queue middleware and the second level message queue middleware can be realized by taking the first level message queue middleware as the upstream message queue middleware and taking the second level message queue middleware as the downstream message queue middleware (so that the message consuming end in the step S120 in the transmission process is an intermediate message consuming end, such as a consuming module of the message transmission device provided by the invention); the second level message queue middleware is used as an upstream message queue middleware, and the third level message queue middleware is used as a downstream message queue middleware to implement message transmission of the second level message queue middleware and the third level message queue middleware (so that the message publishing end described in step S110 in the transmission process is an intermediate message publishing end, such as a publishing module of the message transmission device provided by the present invention), and so on. Further, the message transmission manner of the multi-level composite message queue middleware (such as a message publishing terminal transmitting a message to a message consuming terminal through the two-level message queue middleware, the message publishing terminal transmitting a message to another message consuming terminal through the three-level message queue middleware, the message publishing terminal transmitting a message to another message consuming terminal through the one-level message queue middleware) is also within the protection scope of the present invention, and is not described herein again.

Therefore, in the message transmission method based on the message queue provided by the embodiment of the present invention, synchronization of a message distribution end to a message consumption end is realized through at least two levels of message queue middleware (an upstream message queue middleware and a downstream message queue middleware), and the message consumption end and the upstream message queue middleware are further decoupled. Therefore, on one hand, the problem of message queue bottleneck generated by the fact that the same message queue middleware bears a plurality of message consuming terminals can be solved; on the other hand, the expansion of message release can be flexibly realized, and the message transmission performance of the whole message middleware is provided; on the other hand, the message synchronization of at least two levels of message queue middleware is more convenient for the management of the message queue middleware, and the labor development cost and the equipment resource cost are reduced.

Referring to fig. 7, fig. 7 is a flow chart illustrating a process of issuing a message. The message joins the upstream message queue of the upstream message queue middleware through the steps shown in fig. 7:

step S101: and receiving, by an upstream switch of the upstream message queue middleware, a message sent by the message publishing terminal associated with the upstream switch.

Step S102: adding, by an upstream switch of the upstream message queue middleware, the received message to at least one upstream message queue associated with the upstream switch.

Wherein, a message distribution end is associated with at most one upstream switch, and an upstream switch is associated with at most one message distribution end.

And adding the message issued by the message issuing end into the corresponding upstream message queue through the upstream switch, thereby realizing the management between the message issuing end and the upstream message queue through the upstream switch. Meanwhile, the incidence relation that one message issuing end is associated to at most one upstream switch and one upstream switch is associated to at most one message issuing end is set, so that the condition of message missending generated when multiple message issuing ends and multiple upstream message queues are used is avoided. The upstream switch may implement different message routing requirements by setting.

Specifically, in the message transmission method based on the message queue provided in the embodiment of the present invention, the publishing the consumed message to the downstream message queue middleware may include: issuing the consumed message to a downstream switch of the associated downstream message queue middleware to add the received message to at least one downstream message queue associated with the downstream switch by the downstream switch of the downstream message queue middleware. Wherein, a downstream switch is associated with at least one message consumption end, and a message consumption end is associated with a plurality of downstream switches.

Messages consumed from upstream message queue middleware are thus added by the downstream switch to the corresponding downstream message queue, thereby enabling management between message forwarding and downstream message queues by the downstream switch. Meanwhile, the incidence relation that one downstream switch is associated with at least one message consumption end and one message consumption end is associated with at most one downstream switch is set, so that the situation that messages are sent by mistake when multiple message consumption ends and multiple downstream message queues are generated is avoided.

In the above embodiments, the upstream message queue middleware and the downstream message queue middleware both perform message routing through the switch, but the invention is not limited thereto. In some variations of the present invention, the message routing may be implemented by the upstream message queue middleware and the downstream message queue middleware in other manners, which are not described herein again.

In some variations of the foregoing embodiments, the method may further include the step of dynamically configuring and managing an association relationship among the message distributor, the upstream message queue middleware, the upstream message queue, the downstream message queue middleware, the downstream message queue, and the message consumer.

Therefore, the association relation among the components can be flexibly adjusted, and the message transmission path from the message issuing end to the message consuming end can be adjusted. For example, a message consuming side that is more time-critical may be associated with downstream message queue middleware that is closer to the message publishing side; message consumers with lower demand on time efficiency may be associated with downstream message queue middleware further away from the message publisher. The distance and the near are the number of the message queue middleware which passes through in the message transmission process, and the larger the number of the message queue middleware which passes through is, the farther the message queue middleware is; the smaller the number of message queue middleware that passes through, the closer. Furthermore, the load of the middleware of the upstream message queue and the middleware of the downstream message queue can be balanced by flexibly adjusting the association relation among the components.

In some variations of the foregoing embodiments, the method may further include the step of dynamically adding or subtracting upstream message queue middleware and/or downstream message queue middleware.

Thus, lateral expansion of message transmission (the number of downstream message queue middleware and upstream message queue middleware) can be achieved, thereby expanding the breadth of message transmission. In other words, the same message can be transmitted to more message consumers by lateral spreading.

In some variations of the foregoing embodiments, the method may further include the step of dynamically increasing or decreasing the upstream message queue of the upstream message queue middleware and/or dynamically increasing or decreasing the downstream message queue of the downstream message queue middleware.

Therefore, internal expansion of message transmission can be realized, and load balance of each message queue middleware is realized by increasing and decreasing the same message queue middleware.

In some variations of the foregoing embodiments, the method may further include the step of using the downstream message queue middleware as an upstream message queue middleware and using another message queue middleware as a downstream message queue middleware of the upstream message queue middleware.

Therefore, the vertical extension of the message queue middleware (the multi-stage message queue middleware and the composite multi-stage message queue middleware) is flexibly realized, so that the message queue middleware can be conveniently configured into various different application scenes.

Furthermore, the upstream message queues in the upstream message queue middleware and the downstream message queues in the downstream message queue middleware can be managed through permission setting, so that the safety in the information transmission process is ensured.

Referring now to fig. 8, fig. 8 is a flow chart illustrating a message queue management method. The management method of the message queue comprises the following steps:

step S210: searching a message transmission device associated with a message publishing terminal according to the information of the message publishing terminal, wherein the message publishing terminal is associated with an upstream message queue middleware to transmit the message to the upstream message queue middleware associated with the message publishing terminal, and the message transmission device is configured to transmit the message in the upstream message queue of the upstream message queue middleware to a downstream message queue of a downstream message queue middleware.

Step S220: according to the search result of the message transmission device, enabling a message consumption end to be associated with the searched message transmission device; or adding a message transmission device and enabling the message consumption end to be associated with the message transmission device.

Step S230: and distributing a downstream message queue of the downstream message queue middleware to the message consumption end according to the message transmission device associated with the message consumption end.

Therefore, by means of inquiring and associating the message transmission device, a user can conveniently know and directly apply the existing message queue of the message issuing end, the message queue does not need to be re-developed, and the manual development cost and the equipment resource cost are reduced; in addition, the synchronous information from the information issuing end to the information consuming end is realized through at least two levels of information queue middleware (an upstream information queue middleware and a downstream information queue middleware), and the information consuming end and the upstream information queue middleware are further decoupled, so that the bottleneck problem of the information queue caused by the fact that the same information queue middleware bears a plurality of information consuming ends is solved, meanwhile, the expansion of information issuing can be flexibly realized, and the information transmission performance of the whole information middleware is provided.

Referring now to fig. 9, fig. 9 is a flow chart illustrating a message queue management method. Fig. 9 shows the following steps in total:

step S200: the message publisher registers the publisher. The message publisher registers a publisher's information in the system and provides message types (JSON, XML, STRING, etc.), field descriptions, and message examples.

Step S201: an upstream message queue middleware and an upstream switch are assigned to the publisher. This step may be performed by an administrator or automatically by the system.

Step S202: the message publisher develops a message publisher and pushes the message by the message publisher to a given upstream switch.

Step S203: the message consumer inquires the existing publisher in the system and finds the needed publisher.

Step S204: and the message fee side provides a message consumption application.

Step S205: it is determined whether the applied publisher has an associated message delivery device.

If the determination in step S205 is no, step S207 and step S208 are executed: adding a message transmission device for the consumer, distributing a downstream message queue for the consumer on a downstream switch associated with the message transmission device, registering the message transmission device, the downstream message queue and the consumer information in the system as consumer data, and finally providing the registered consumer information to a message user.

If the determination in step S205 is yes, step S206 is executed to determine whether the downstream switch associated with the message transmission device is load-tolerant. If the determination in step S206 is no, step S207 and step S208 are executed: adding a message transmission device for the consumer, distributing a downstream message queue for the consumer on a downstream switch associated with the message transmission device, registering the message transmission device, the downstream message queue and the consumer information in the system as consumer data, and finally providing the registered consumer information to a message user. If the judgment in step S206 is yes, then no message transmission device is added, only step S208 is executed to allocate a downstream message queue for the consumer on the downstream switch associated with the message transmission device, and at the same time, the message transmission device, the downstream message queue and the consumer information are registered in the system as consumer data, and finally, the registered consumer information is provided to the message user.

Step S209: after the message consumer receives the consumer information, the message consumer side configures and develops the message consumer side according to the downstream message queue middleware information, the downstream switch and the downstream message queue.

In the above embodiment, the message transmission device may be newly added in step S207 in the following manner:

first, a publisher ID, downstream message queue middleware (some existing downstream message queue middleware), and a downstream switch name (newly added) are entered and stored in a message transfer device configuration interface. Then, the system automatically creates a downstream switch, generates a message transmission device and starts to operate the message transmission device according to the input information.

Specifically, in the present embodiment, the message transmission apparatus is an aggregate of the message consumption side and the message distribution side. An upstream message queue with the same name as the message transmission device is bound on the upstream switch corresponding to the message publishing end, and the message transmission device consumes the messages of the upstream message queue (one upstream switch may correspond to a plurality of message transmission devices, and each message transmission device corresponds to at most one upstream message queue). After taking the message, the message transmission device sends the message to the corresponding downstream switch (one message transmission device corresponds to at most one downstream switch). Thus, different message transmission devices can be generated simply by generating configuration files (configuration files available in a programming language, such as java program, properties, as a function of different development languages) from message queue sources and destinations.

In a specific practical implementation of the present invention, the method for managing the message queue may be performed as follows:

the website system development ORDER data interface can provide real-time ORDER information externally, so that a developer registers a publisher named PUB _ BRANCH _ ORDER in the system, the type of the publisher is JSON, and field description and an example data style are submitted.

The administrator receives the registration details, reviews the information, confirms that the information can be published, and then distributes the "PUB _ BRANCH _ ORDER" publisher to the upstream message queue middleware a1, and creates an upstream switch for it: UEX _ BRANCH _ ORDER and informs the server IP, port, upstream switch name to the developer of the site system.

The developer of the network site system completes the development and pushes the message to the UEX _ BRANCH _ ORDER switch of the upstream message queue middleware a1, and at this time, because there is no consumer, the upstream switch does not bind the upstream message queue, and the message is automatically discarded after being sent. (data that nobody is consuming is meaningless and can therefore be discarded).

The developer of the transportation management system needs to capture ORDER information in real time, so the platform inquires whether a relevant real-time message queue exists, finds the publisher PUB _ BRANCH _ ORDER, considers that the message can be used after checking the field information, and initiates a use application.

After receiving the application, the administrator and the administrator of the website system are checked and confirmed that the transportation management system can use the ORDER data, then the administrator makes a query of the forwarder, finds that the publisher is the "PUB _ BRANCH _ ORDER" and has no associated message transmission device, so that a message transmission device named as "TRANS _ BRANCH _ ORDER _ 1" is additionally arranged on the message transmission device maintenance interface, the publisher is the "PUB _ BRANCH _ ORDER", and the downstream switch is distributed to the downstream message queue middleware B2 which is idle at present and named as "DEX _ BRANCH _ ORDER _ 1".

The administrator registers a consumer for the transportation management system, named "CON _ TPMS _ ORDER", the associated forwarder "TRANS _ BRANCH _ ORDER _ 1", and the downstream queue "Q _ TPMS _ ORDER", and notifies the developer of the transportation management system of the consumer information.

The developer of the transportation management system starts to develop the consumer, and the consumer information he has taken is as follows: is B2, the downstream switch is DEX _ BRANCH _ ORDER _1, and the downstream queue is Q _ TPMS _ ORDER.

The development and test of the transportation management system are completed, the functions are on line, and at the moment, the transportation management system can obtain real-time order data.

The foregoing is merely an illustrative description of one specific implementation of the present invention and is not intended to be limiting thereof. The message transmission method and the message queue management method can be applied to scenes of multi-system message transmission and message synchronization, and the application field is not limited to e-commerce platforms, social network platforms, various other service platforms and the like. The message publishing end and the message consuming end refer to clients, not device terminals, and thus, a plurality of message consuming ends that consume messages from different message queues and/or a plurality of message publishing ends that publish messages to different message queues may be installed on the same device terminal, which is not limited in the present invention. The message queue middleware includes, but is not limited to, Apache kafka, rockmq, rabbitmq, Active MQ, Zero MQ, Meta MQ, and other structures that can implement the message queue middleware function. Further, in various embodiments of the invention, the switch is an original component of the message queue middleware or a component that is self-added to the message queue middleware. The message queue middleware can be a message queue server or a message queue server cluster.

Fig. 10 shows an information processing apparatus according to an embodiment of the present invention. As shown in fig. 10, the apparatus includes:

a receiving module 10, configured to receive data from a device that transmits data. The device for sending data may be a data acquisition device, specifically, it may be a bargun, for example, it may be a simple input device, connected to a computer and running related software to complete work, or it may be a smart device like a PDA or a mobile phone, on which software may be installed to independently complete code scanning acquisition work. In other embodiments, the device for sending data may also be other service systems. Specifically, as shown in fig. 11, the receiving module 10 may include: a verification unit 11 configured to verify whether the device that transmits data is a registered device; and a receiving unit 12 for receiving data if the device is a registered device. The data is received by verifying whether the equipment for sending the data is the registered equipment or not and under the condition that the equipment is the registered equipment, so that the data source reliability is ensured, the safety is improved, and the redundant data generated by receiving invalid data is avoided.

And a pushing module 20, configured to push the received data to the message queue. Wherein, the message queue, namely MessageQueue, is abbreviated as MQ. The message queue may be comprised by a message queue means, in particular the message queue means may be a message queue server.

And the consumption module 30 is used for consuming the message queue so as to store the data in the data consumption queue into a first database for the first type of user to inquire. Wherein the first database may be a Redis database; the first type of user can be a handler and a manager of the logistics network.

As shown in fig. 12, the apparatus may further include:

a providing module 40 for providing the message queue to a second type of user for consumption. Wherein the second type of user may be a downstream system that needs data.

As shown in fig. 13, the apparatus may further include:

and a storing module 50, configured to store the received data in a second database for a third type of user to obtain, where a real-time requirement of the third type of user on data obtaining is lower than that of the second type of user. Specifically, as shown in fig. 14, the logging module may include: a storing unit 51 for storing the received data into a second database; and a derivation unit 52, configured to derive the data stored in the second database according to a preset period, for a third type of user to obtain. The preset period may be determined according to actual needs, for example, the preset period may be half an hour, 1 hour, 4 hours, 8 hours, 12 hours, 1 day, 2 days, 1 week, and the like. The received data are stored in the second database, and the data stored in the second database are exported according to the preset period to be acquired by the third type of users, so that the third type of users can acquire the data from the second database according to the preset period.

The function implementation of each module in the information processing apparatus corresponds to each step in the information processing method embodiment, and the function and implementation process thereof are not described in detail here.

Fig. 15 shows an information processing system according to an embodiment of the present invention. According to the information processing system, real-time uploading and query of data collected by the bargun (or other business systems) can be realized. After different stations scan data, other stations and downstream systems can obtain relevant information immediately. The scanning time and the uploading time are very close, the uploading time can be used for equivalently replacing the scanning time, and the artificial errors in the subsequent management are avoided. In this information processing system, there is no direct correlation between the upstream system and the downstream system, and when a change occurs in a certain portion of the upstream, the other portion of the upstream or downstream is not affected.

As shown in fig. 15, the information processing system may include:

the data acquisition device 100 is used for performing data acquisition in response to an acquisition operation instruction to obtain data. As an optional specific implementation manner, the data acquisition device is further configured to provide a user login interface, and obtain basic data from the first database after the login is completed, where the basic data includes at least one of time information, company information, and personnel information. The data acquisition device is also used for providing a user login interface and acquiring basic data from the first database after login is completed, wherein the basic data comprises at least one of time information, company information and personnel information, so that the data acquisition device can acquire the latest basic data, and data acquisition work can be carried out more smoothly. Specifically, the data collection device 100 may be a bargun, for example, which is a simple input device and needs to be connected to a computer to run related software to complete the work, or an intelligent device like a PDA or a mobile phone, on which software may be installed to independently complete code scanning collection work.

A data processing device 200 for receiving data from the data acquisition device; and pushing the received data to a message queue; and consuming the message queue to store the data in the data consumption queue into a first database for a first type of user to query.

A first database 300 for storing said data for querying by said first type of user;

a message queue device 400, configured to provide a message queue for storing the data.

As an alternative embodiment, the data processing apparatus 100 is further configured to store the received data in a second database for retrieval by a third type of user.

Further, as an optional implementation manner, the message queue further provides a second type of user for consumption, wherein the real-time performance requirement of the second type of user for data acquisition is higher than that of the third type of user.

Further, as an alternative embodiment, as shown in fig. 16, the system further includes a second database 500 for storing the data for the third type of user to obtain.

The message queue is provided for the second type user for consumption, so that the second type user can directly acquire data through the message queue, and the data acquisition timeliness is improved; the received data are stored in the second database for the third type of users to obtain, so that the third type of users can obtain the data through the second database, and the requirement of the third type of users on the real-time property of data acquisition is lower than that of the second type of users, so that the situations of high requirement on the real-time property of data acquisition and low requirement on the real-time property can be considered, and the timeliness requirement can be met, and meanwhile, the hardware resource load is reduced; in the information processing system, the second type users and the third type users are not directly related to the data acquisition device, so that even if the data acquisition device fails or is changed, the normal work of the second type users and the third type users cannot be affected.

Wherein the second database 500 and the first database 300 may be different types of databases. The first database 300 may be a Redis database.

The second database and the first database are different types of databases, so that the method can adapt to the characteristic that the first type of users and the third type of users have different data acquisition modes, and the configuration of the information processing system is more intensive; as the second database is a Redis database, the query efficiency can be improved, and the pressure of the second database is reduced.

Fig. 17 shows an information processing system according to an embodiment of the present invention. As shown in fig. 17, the system includes:

the bargun is used for responding to the acquisition operation instruction to acquire data, providing a user login interface and acquiring basic data from the first database after login is completed, wherein the basic data comprises at least one of time information, company information and personnel information.

A scan upload service to receive data from a bargun; and pushing the received data to a message queue; and consuming the message queue to store the data in the data consumption queue into a first database for a first type of user to query; and for storing the received data in a scanning database for retrieval by a third type of user.

A Redis database for storing the data for querying by the first type of user;

and the MQ (Message Queue) server is used for providing a Message Queue for storing the data, wherein the Message Queue also provides the second type of user for consumption.

And the scanning database is used for storing the data for the third type of users to obtain.

As shown in fig. 17, the system provides a scan upload service. And different barguns or other business devices immediately send data to the scanning uploading service after completing the data acquisition operation. And the scanning uploading service stores the data in a database after receiving the data and pushes the data to the MQ. And the scanning data consumption end pushes the scanning data into a Redis database for the query of the downloading service. The whole system realizes read-write separation of transaction operation, the database only has write-in operation (note: batch discharge of data is not transaction operation), and query is realized by the Redis database, so that a large number of guns can be operated simultaneously, and high real-time and high concurrent processing is realized. According to the characteristics of a downstream system, data pushing is divided into real-time pushing and batch pushing, so that timeliness can be improved, and system load can be reduced.

Fig. 18 shows an application method of the information processing system in fig. 17. As shown in fig. 18, the method includes:

and starting.

The bargun was logged in and the basic data downloaded. Specifically, a first type user performs a login operation on a bargun and downloads basic information from Redis through a download service after the login is successful. Wherein the basic information includes server time, company institution, personnel, etc. The latest basic data can be obtained by downloading the basic information, thereby supporting the subsequent scanning operation.

And collecting data and sending the data to a scanning and uploading service. Specifically, a first type of user performs a code scanning operation on the logistics piece through a bargun. And transmitting the data obtained by the code scanning operation to a scanning uploading service in real time. The scanning and uploading service verifies the information of the user, the company and the rifle, and specifically, compares the information of the user, the company and the rifle with existing data in Redis to judge whether the information is consistent or not so as to confirm whether the rifle is a registered legal device or not.

Wherein the scan upload service writes the received data into a scan database:

and receiving and warehousing the data. Specifically, a scanning database receives data and stores the data in the database.

The CSV file is exported periodically. And (4) exporting batch data from the scanning database at regular time, and unloading the data to a text file.

And the downstream system with low real-time requirement acquires data from the CSV file. Namely, the downstream system with low time efficiency requirement can obtain the scanning data through the text file.

Wherein the scanning upload service asynchronously pushes a same piece of information to the MQ server:

data is received and written to the MQ.

Data is received from the MQ and written to Redis. Specifically, the scanning data consumption end obtains data from the MQ server and writes the data into a Redis database. When the bargun needs relevant scanning data, the data can be consulted through a downloading service, and the downloading service inquires the data from a Redis database, so that read-write separation is realized. Specifically, as shown in fig. 19, it may include: starting; initiating a query; the download service queries from Redis and returns results; and (6) ending.

Downstream systems that require real-time data receive the data from the MQ. In particular, downstream systems that scan data in real-time are required to interface message queues on the MQ server for consumption.

And (6) ending.

The embodiment of the invention also provides another application method of the information processing system in fig. 17. The method may include:

the handler logs in the bargun. The bargun automatically synchronizes the current time, the company list, the personnel list through the download service.

The loading and unloading worker prepares to unload the goods on the truck, opens the unloading interface on the bus gun, then starts to unload the truck, sweeps the bill on the truck once unloading, and automatically sends the scanned information to the scanning and uploading service.

After the scanning and uploading service verifies that the information of the user, the company and the equipment is correct, the received data is written into the database, and meanwhile, the same information is pushed to the MQ.

And the scanning data consumption end acquires the unloading data from the MQ and writes the unloading data into Redis.

The manager logs in the business system to check the loading and unloading working condition of today, and the business system inquires the loading and unloading condition of today through the downloading service.

And the downstream waybill management system acquires real-time scanning data through the MQ, so that the client can inquire the real-time circulation information of the goods.

And the downstream data center loads the scanned data into a data warehouse for subsequent analysis through the text file unloaded from the database.

Referring to fig. 20, an embodiment of the present invention provides an information processing electronic device 3, where the electronic device 3 includes at least one storage unit 31, at least one processing unit 32, and a bus 33 connecting different platform systems.

The storage unit 31 may include readable media in the form of volatile storage units, such as a random access memory unit (RAM)311 and/or a cache memory unit 312, and may further include a read only memory unit (ROM) 313.

Wherein the storage unit 31 further stores a program product 4, the program product 4 can be executed by the processing unit 32, so that the processing unit 32 executes the steps of the information processing method in the above-mentioned embodiment (as shown in fig. 1). The storage unit 31 may also include a program/utility 314 having a set (at least one) of program modules 315, including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.

Accordingly, the processing unit 32 may execute the program product 4 described above, and may execute the program/utility 314.

Bus 33 may be one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

The electronic device 3 may also communicate with one or more external devices 34, such as a keyboard, pointing device, bluetooth device, etc., and may also communicate with one or more devices capable of interacting with the electronic device 3, and/or with any device (e.g., router, modem, etc.) that enables the electronic device 3 to communicate with one or more other computing devices. Such communication may be through input/output (I/O) interfaces 35. Also, the electronic device 3 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 36. The network adapter 36 may communicate with other modules of the electronic device 3 via the bus 33. It should be appreciated that although not shown in FIG. 20, other hardware and/or software modules may be used in conjunction with the electronic device 3, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms, to name a few.

Referring to fig. 21, an embodiment of the present invention provides a computer-readable storage medium for storing a computer program, which when executed implements the steps of the information processing method (as shown in fig. 1) in the above-described embodiment. Fig. 21 shows a program product 4 provided by the present embodiment for implementing the above method, which may employ a portable compact disc read only memory (CD-ROM) and include program codes, and may be run on a terminal device, such as a personal computer. However, the program product 4 of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. Program product 4 may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

A computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing. Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

The foregoing description and drawings are only for purposes of illustrating the preferred embodiments of the present application and are not intended to limit the present application, which is, therefore, to the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present application.

Claims

1. An information processing method, characterized in that the method comprises:

receiving data from a device that transmitted the data;

pushing the received data to a message queue;

2. The information processing method according to claim 1, characterized by further comprising:

and providing the message queue to a second type of user for consumption.

3. The information processing method according to claim 2, characterized by further comprising:

4. The information processing method of claim 3, wherein the storing the received data in a second database for acquisition by a third type of user comprises:

storing the received data in a second database;

5. The information processing method according to any one of claims 1 to 4, wherein the receiving data from the apparatus that transmits data includes:

verifying whether the device sending the data is a registered device;

if the device is a registered device, the data is received.

6. An information processing apparatus characterized in that the apparatus comprises:

a receiving module for receiving data from a device that transmits data;

the pushing module is used for pushing the received data to a message queue;

7. An information processing system, the system comprising:

a first database for storing the data for querying by the first type of user;

8. The information processing system according to claim 7,

the data processing device is also used for storing the received data into a second database for a third type of user to obtain;

9. The information handling system of claim 8, wherein the first database is a Redis database.

10. The information processing system of any one of claims 7-9, wherein the data collection device is further configured to provide a user login interface and obtain basic data from the first database after the login is completed, the basic data including at least one of time information, company information, and personnel information.