CN113868479A - Method and device for processing service data - Google Patents

Method and device for processing service data Download PDF

Info

Publication number
CN113868479A
CN113868479A CN202111158392.0A CN202111158392A CN113868479A CN 113868479 A CN113868479 A CN 113868479A CN 202111158392 A CN202111158392 A CN 202111158392A CN 113868479 A CN113868479 A CN 113868479A
Authority
CN
China
Prior art keywords
processing
audited
data
processing unit
service data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111158392.0A
Other languages
Chinese (zh)
Inventor
徐志鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alipay Hangzhou Information Technology Co Ltd
Original Assignee
Alipay Hangzhou Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alipay Hangzhou Information Technology Co Ltd filed Critical Alipay Hangzhou Information Technology Co Ltd
Priority to CN202111158392.0A priority Critical patent/CN113868479A/en
Publication of CN113868479A publication Critical patent/CN113868479A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/901Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/258Data format conversion from or to a database
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/90335Query processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The embodiment of the invention provides a method and a device for processing service data, wherein the processing method is applied to a duty chain, the duty chain comprises a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in the duty chain according to a preset sequence; the processing method comprises the steps of firstly obtaining service data to be audited; then, processing the service data to be audited according to the respective processing rule of each processing unit through each processing unit in the responsibility chain; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; the target format is the same as the data format of the auditing rule in the auditing system corresponding to the service system; and finally, sending the service data in the target format to the auditing system.

Description

Method and device for processing service data
Technical Field
The present application relates to the field of internet technologies, and in particular, to a method and an apparatus for processing service data.
Background
In order to implement different business functions, a large-scale enterprise may be provided with various types of business systems, such as a financial business system, a network live broadcast business system, and the like, and different business systems may implement different business functions.
In the operation process of these service systems, the service data generated by each service system should be able to be audited by the auditing system to ensure the security of the service data.
However, when the service system calls the auditing system, the data type of the service data may not meet the access condition of the auditing system, and the auditing system may not be accessed, which results in low access efficiency.
Disclosure of Invention
In view of this, embodiments of the present specification provide a method and an apparatus for processing service data, so as to reduce difficulty in accessing a service data of a service system to an auditing system and improve access efficiency.
The invention discloses a method for processing service data, which is applied to a duty chain, wherein the duty chain comprises a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in the duty chain according to a preset sequence; the processing method comprises the following steps:
acquiring service data to be audited;
processing the service data to be audited according to the respective processing rule of each processing unit through each processing unit in the responsibility chain; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; the target format is the same as the data format of the auditing rule in the auditing system corresponding to the service system;
and sending the service data in the target format to the auditing system.
The invention also discloses a device for processing the service data, which is applied to a duty chain, wherein the duty chain comprises a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in the duty chain according to a preset sequence; the processing device comprises:
the acquisition module is used for acquiring the service data to be audited;
processing the service data to be audited according to the respective processing rule of each processing unit through each processing unit in the responsibility chain; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; the target format is the same as the data format of the auditing rule in the auditing system corresponding to the service system;
and sending the service data in the target format to the auditing system.
The embodiment of the specification adopts at least one technical scheme which can achieve the following beneficial effects:
the embodiment of the invention provides a processing method and a processing device for business data, wherein the processing method is applied to a responsibility chain, the responsibility chain comprises a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in the responsibility chain according to a preset sequence; the processing method comprises the steps of firstly obtaining service data to be audited; then, processing the service data to be audited according to the respective processing rule of each processing unit through each processing unit in the responsibility chain; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; the target format is the same as the data format of the auditing rule in the auditing system corresponding to the service system; and finally, sending the service data in the target format to the auditing system. The service system and the auditing system can be decoupled, the difficulty of accessing the service data of the service system to the auditing system is reduced, and the access efficiency is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic diagram of a network architecture provided in an embodiment of the present disclosure.
Fig. 2 is a flowchart illustrating a method for processing service data according to an embodiment of the present disclosure.
Fig. 3 is a system configuration diagram of the processing apparatus shown in the embodiment of the present invention.
Fig. 4 is a schematic flow chart illustrating that the to-be-audited service data is processed according to the respective processing rule of each processing unit according to the embodiment of the present invention.
Fig. 5 is a schematic flow chart illustrating that the to-be-audited service data is processed according to the respective processing rule of each processing unit according to the embodiment of the present invention.
Fig. 6 is a schematic flow chart illustrating that the to-be-audited service data is processed according to the respective processing rule of each processing unit according to the embodiment of the present invention.
Fig. 7 is a schematic flow chart illustrating that the to-be-audited service data is processed according to the respective processing rule of each processing unit according to the embodiment of the present invention.
Fig. 8 is a schematic flow chart illustrating that the to-be-audited service data is processed according to the respective processing rule of each processing unit according to the embodiment of the present invention.
Fig. 9 is a schematic flowchart illustrating a process of processing to-be-audited service data according to respective processing rules of each processing unit according to an embodiment of the present invention.
Fig. 10 is a schematic structural diagram of an electronic device shown in an embodiment of this specification.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The technical solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.
Fig. 1 is a schematic diagram of a network architecture disclosed in an embodiment of the present disclosure.
As shown in fig. 1, includes: a processing device 101, a business server 102 and an auditing server 103.
In this embodiment of the present invention, a chain of responsibilities, also referred to as a chain of responsibilities, is adopted in the processing apparatus 101, and in this embodiment of the present invention, the chain of responsibilities may include a plurality of processing units, where logical sequences of the units in the chain of responsibilities are arranged in a preset sequence. Of course, each processing unit may be a processor with independent processing capabilities or may be a different application. Each processing unit corresponds to a respective processing rule. The service server 102 is a server capable of performing a specific service, for example, a financial service server, a payment service server, and the like. The auditing server 103 is a server with auditing capability, and can check the received data to determine whether the data meets the auditing rules. The auditing rules can be set according to actual needs, and different service servers can correspond to different auditing servers and can also correspond to different auditing rules in the same auditing server. Whether the data conforms to the auditing rule, for example, whether the data has a term of false publicity, whether the data has an absolute term, whether the data has an image which is not suitable for display, and the like, can be different according to actual needs and according to different service data sent by the service server, and the auditing rule can have a corresponding relation with the service data sent by the service server.
Fig. 2 is a flowchart illustrating a method for processing service data according to an embodiment of the present disclosure.
As shown in fig. 2, the method for processing service data provided by the present invention is applied to a responsibility chain, where the responsibility chain includes a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in a preset order in the responsibility chain.
In this embodiment of the present invention, the processing device 21 may be a chain of responsibilities, 22 is a business system, and 23 is an auditing system, where each processing unit in the chain of responsibilities has its own processing rule, such as a rule for converting into an audio file, a rule for extracting text content, a rule for storing original data, and so on. Can be set according to actual needs. Each processing unit is logically arranged in a preset sequence, namely after the first processing unit finishes processing, data are continuously sent to a second processing unit according to the preset data, and the second processing unit is a subsequent processing unit of the first processing unit.
In the embodiment of the invention, each processing unit in the responsibility chain only processes the data which should be processed by the processing unit per se and processes the data according to the processing rule. Regardless of whether the previous processing unit processes or not, after the current processing unit receives the data, the data is sent to the next processing unit after the processing rule of the current processing unit is processed.
In the embodiment of the invention, the processing method comprises the following steps:
step 200: acquiring service data to be audited;
in the embodiment of the invention, the service system can send the data to be audited to the responsibility chain, or the responsibility chain can actively acquire the service data to be audited in the service system connected with the processing device.
The service data to be audited may include: interactive draft images, video files in a live webcast room, H5 links, voice files to be converted and the like adopted for popularization activities are different according to the data types of the business data to be audited corresponding to different business systems of the business systems.
In practical use, for example, in a financial system, a financial engineer intercepts a picture of conversation content or generates a chat text file when communicating with a client on line, the picture or text file is service data to be audited, the auditing system may be a picture auditing system or a text auditing system, or may also be, for example, a poster of a campaign, an interactive draft, or other image with larger pixels, and the image is service data to be audited, and it is necessary for the picture auditing system corresponding to the service system to audit whether illegal content exists in the image.
Of course, the business data to be audited may include a plurality of files or pictures, or may include only one data type, such as a text file of only a text type. The setting can be performed according to actual needs, which is not described herein.
Step 202: processing the service data to be audited according to the respective processing rule of each processing unit through each processing unit in the responsibility chain; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; the target format is the same as the data format of the auditing rule in the auditing system corresponding to the service system;
in the embodiment of the present invention, each processing unit in the chain of responsibility processes the received, for example, to-be-audited data or the processed to-be-audited data according to the respective processing rule.
The at least one processing unit can convert the data format of the service data to be audited into the data format specified by the audit rule in the service system.
The processing unit has different rules and processes for processing the data to be audited. For example, the processing unit may be a file drop platform processing unit, and the processing unit saves the received data to the platform. The data can be logically connected with the file rule binding processing unit, and then the data is sent to the file rule binding processing unit for processing.
For example, if the received to-be-checked data is a plurality of text files and the processing unit is the rule binding unit, the text files may be respectively bound to the audit rules, for example, the first text file is bound to be an advertisement false promotion audit rule, the second text file is bound to be an absolute user audit rule, and the like. And subsequently, different auditing algorithms can be executed according to different binding rules or sent to different auditing systems for auditing.
In this embodiment of the present invention, the processing, by each processing unit in the responsibility chain, the to-be-audited service data according to the respective processing rule of each processing unit specifically includes:
after a first processing unit in the responsibility chain receives the service data to be audited, the first processing unit processes the service data to be audited according to the processing rule of the first processing unit;
and the first processing unit sends the processed business data to be audited to a second processing unit, and the second processing unit is positioned at the next position of the first processing unit in the responsibility chain.
In the embodiment of the present invention, the next position of the first processing unit is the second processing unit logically connected to the first processing unit. And the first processing unit sends the processed data to be audited to the second processing unit. For example, the first processing unit extracts the voice file from the data to be audited, and sends the voice file to the second processing unit, and the second processing unit converts the voice file into a text file.
It can be understood that, the service data to be audited received by the second processing unit after being processed by the first processing unit may also be sent to the second processing unit at the same time. Can be set according to actual needs.
It is to be understood that, in the embodiments of the present invention, the first processing unit and the second processing unit are only illustrated by locations, and are not limited to the first processing unit being the first processing unit in the chain of responsibilities, but of course, the first processing unit may be the first processing unit or the last processing unit in the chain of responsibilities.
In the embodiment of the present invention, detailed processing procedures of the respective processing units are described in detail later.
Step 204: and sending the service data in the target format to the auditing system.
In the embodiment of the invention, the business data in the target format can be sent to the auditing system for subsequent auditing.
For example, the service system is a live webcast system, the auditing system corresponding to the service system is a text auditing system, the data to be audited in the target format obtained in step 202 in the embodiment of the present invention may be a text file in a text format, and the text parameters of the text file conform to the text parameters specified by the auditing rules in the auditing system, and the text file is sent to the text auditing system, and after the text auditing system receives the text file in the text format, the text file is audited according to the predetermined requirements. Of course, the predetermined requirement may be a preset requirement for auditing the contents of the text file, for example, to determine whether an absolute term exists, and if so, the text file is an illegal.
In the embodiment of the present invention, the service data in the target format is sent to the auditing system, or an auditing algorithm of the auditing system may be directly invoked, so as to reduce the pressure of the auditing system, for example, a text compliance auditing algorithm in a text auditing system is invoked to audit whether the content in a text file conforms to a preset rule. The text compliance audit algorithm may be similar to the predetermined requirements described above, or may be a predetermined audit algorithm.
In addition, because a plurality of processing units are arranged in the responsibility chain, the processing rules in each processing unit can be set according to different requirements, and therefore, when a new processing unit is required to be added, the new processing unit only needs to be inserted into a proper position. The other processing units do not need any modification.
The embodiment of the invention can also comprise:
receiving an insert request for transmission after inserting a target processing unit at a particular location in the chain of responsibilities;
updating the preset sequence according to the specific position;
and saving the processing rule corresponding to the target processing unit.
In the embodiment of the present invention, if a new target processing unit needs to be set, for example, the target processing unit may be a legal document extraction unit, and may extract relevant legal documents in the service data to be audited, when a position before the video file processing unit inserted in a specific position, for example, after the original data storage processing unit is received, the preset arrangement sequence is updated, and the processing rule of the target processing unit is stored, so that when the service data to be audited is received, the service data to be audited may be processed according to the processing rule of the target processing unit.
Of course, it may also include:
receiving a delete request for deleting a target processing unit;
deleting the identification of the target processing unit in the preset sequence and updating the preset sequence;
and deleting the processing rule corresponding to the target processing unit.
In the embodiment of the present invention, the processing rule corresponding to each processing unit located in the responsibility chain cannot be modified, but a new processing unit and a corresponding processing rule can be inserted. Of course, each processing unit may also exist in the form of a processing function, and the processing rule may be a class, a trigger, and the like used in the function operation, and only needs to be able to execute the above flow.
In the embodiment of the invention, the target processing unit can be deleted or added at will according to actual needs to realize the increase and reduction of functions, the flexibility is strong, and for a sender, the processing process in a responsibility chain is not required to be known, and the sender is decoupled with a receiver.
It can be seen from the foregoing embodiments that, different types of service data in an upstream system of a processing apparatus, for example, a service system, are sent to a responsibility chain, different processing may be performed according to different processing units, so as to obtain service data in a target format that meets an audit rule in an audit system, different processing may be performed on different processing units in the responsibility chain for different material types, so as to obtain service data that can be efficiently accessed to the audit system, it is not necessary for each audit system to convert the type of service data again after an error is returned by the service system, so that access efficiency is improved, and meanwhile, a sender in the responsibility chain may transmit data to be audited asynchronously, thereby achieving decoupling from a receiver.
Of course, in the embodiment of the present invention, after the request is sent to the auditing system, a process of returning an auditing result of the business system may also be included.
The embodiment of the invention can also comprise:
receiving an auditing result returned after the auditing system audits the target service data;
and sending the auditing result to the service system.
In the embodiment of the invention, after the auditing system audits the service data in the target format, the auditing result can be returned.
And after receiving the audit result, sending the audit result to the service system. Of course, the audit result may also be sent to other terminals that need to know the audit result, such as a terminal of an auditor, a terminal of a supervision department, and the like.
In the embodiment of the invention, the service system is used as a sender, the processing process after sending is not required to be known, and the connection with the auditing system is not required to be established, so that the sender and the receiver are decoupled, the input of redundant information is avoided, and the working efficiency of the service system is improved.
Fig. 3 is a schematic system structure diagram of a processing apparatus according to an embodiment of the present invention.
The system structure 300 may include a role chain material processing framework and a bottom layer dependency framework, where a role chain is adopted in the role chain material processing framework, and the role chain may include a plurality of processing units, such as a degradation logic processing unit 31, an original data saving unit 32, an inspection screenshot unit 33, a video file processing unit 34, a voice file processing unit 35, a file dropping os unit 36, a file rule binding unit 37, a package information call auditing unit 38, and the like. The directions of arrows in the figure are preset sequences, and all the processing units are logically connected. The bottom-level dependency framework may include a patrol middle station unit 390, an algorithm engine unit 391, an FFMPEG unit 392, an oss storage unit 393, and the like.
It will be appreciated that multiple processing units in the chain of responsibilities material processing framework may include respective corresponding processing rules.
The embodiment of the invention can process the data to be audited by adopting the system structure shown in fig. 3 in practical use.
The foregoing describes the processing rules of different processing units as being different. As described in detail below.
In this embodiment of the present invention, if the processing unit is an original data storage unit, the processing the to-be-audited service data according to the respective processing rule of each processing unit includes:
and storing the service data to be audited into a storage device.
In the embodiment of the present invention, the processing unit may be an original data storage unit, and in order to prevent the original data from being restored due to a processing failure occurring in the subsequent processing process, in the embodiment of the present invention, the original data may be stored first, so that when a subsequent failure occurs, the stored original data may be recalled for processing.
Of course, the storage device may be a part of the processing device, or may be a storage device of a different processing system, and is not limited herein. And after the storage is finished, the service data to be audited is sent to the next processing unit. For example, the processing unit is a first processing unit, and sends the service data to be audited to a second processing unit.
Fig. 4 is a schematic flow chart illustrating that the to-be-audited service data is processed according to the respective processing rule of each processing unit according to the embodiment of the present invention.
As shown in fig. 4, in the embodiment of the present invention, if the processing unit is a video file processing unit, the processing the to-be-audited service data according to the respective processing rule of each processing unit includes:
step 400: judging whether the data type of the service data to be audited is a video file type;
step 402: if the data type of the service data to be audited is a video file type, extracting voice data in the service data to be audited to obtain a voice file;
step 404: and taking the voice file as the processed business data to be audited.
In the embodiment of the present invention, if the processing unit is a video file processing unit, the corresponding processing rule may be to extract the voice data in the video file to obtain the voice file.
When the video file processing unit receives the service data to be audited, judging whether the data type is the video file type, if so, processing the video file by using a FFMPEG processing tool, and extracting the voice data to obtain the voice file. And then the voice file is taken as processed data to be audited and sent to a subsequent processing unit. Of course, the data to be checked may also be sent to the subsequent processing unit at the same time.
The service data to be audited can be sent to the data conversion platform, and the data conversion platform extracts the voice data to obtain a voice file and returns the voice file to the sender.
In the embodiment of the invention, if the service type of the service data to be audited is the video file type, the voice data in the service data is extracted to obtain the voice file. The extraction of the voice file can be realized. The process of extracting the voice file is not required to be executed again by the auditing system, and the auditing system and the service system are decoupled, so that the pressure of the auditing system and the service system is improved.
Fig. 5 is another schematic flow chart illustrating that the to-be-audited service data is processed according to the respective processing rule of each processing unit according to the embodiment of the present invention.
As shown in fig. 5. If the processing unit is a voice file processing unit, the processing the service data to be audited according to the respective processing rule of each processing unit includes:
step 500: judging whether the data type of the service data to be audited is a voice file type;
step 502: if the data type of the service data to be audited is a voice file type, extracting characters in the service data to be audited to obtain a text file;
step 504: and taking the text file as the processed business data to be audited.
In the embodiment of the invention, the processing unit is a voice file processing unit, and when the data type of the received service data to be audited is determined to be the voice file type, the characters in the received service data are extracted to obtain the text file.
The text file obtained by extracting the characters from the voice file can be obtained by calling a preset plug-in to extract the characters in the service data to be audited of the voice file type.
Of course, the service data to be audited may also be sent to the voice interaction server, so that the voice interaction server extracts the characters of the service data to be audited to obtain a text file, and returns the text file to the sender. The voice interaction server can be a server with a voice-to-text function, and the embodiment of the invention can convert the parameters of the target voice file into the parameters consistent with the interface parameters of the voice interaction server according to the interface parameters of the voice interaction server. For example, the interface parameters include a frequency of 16000Hz or 8000Hz, a size of less than 10Mb, and the like. Only the voice interaction server needs to be able to convert.
After the text file is obtained, it may be sent to a subsequent processing unit, for example, a second processing unit, as the to-be-audited service data.
Fig. 6 is a schematic flowchart of another process of processing to-be-audited service data according to the processing rule of each processing unit in the embodiment of the present invention.
As shown in fig. 6. If the processing unit is an inspection screenshot unit, the processing the service data to be audited according to the respective processing rule of each processing unit includes:
step 600: judging whether the data type of the service data to be audited is a picture type;
step 602: if the data type of the business data to be audited is a picture type, cutting the business data to be audited into at least one picture with a preset size;
step 604: and taking the at least one picture with the preset size as the processed business data to be audited.
The processing method further comprises the following steps:
step 606: identifying text content in the processed business data to be audited;
step 608: judging whether the text content meets preset regulations or not;
step 610: and if the text content has characters which do not accord with the preset specification, outputting alarm information.
In the embodiment of the invention, the processing unit can be an inspection screenshot unit, has the inspection capability of the service data to be inspected, can judge whether the service data to be inspected is a picture type, and cuts the service data to be inspected into pictures in accordance with the preset size if the service data to be inspected is the picture type. For example, a poster of a campaign is cut out into a plurality of pictures that fit a preset size. The preset size may be in units of pixels or in units of length. Only the cut picture needs to be read for identification.
The mode of cutting the picture can be calling a preset function plug-in, or sending the picture to a function interface of a preset platform, and calling a transfer function.
Then, the content in the picture, for example, the text content, can be identified to determine whether the text content meets the preset specification. The predetermined rule includes, for example, illegal publicity terms, and can be set as needed.
The judging process can adopt a regular expression mode for matching, if the content is matched, the text content is determined to have the content which is not in accordance with the preset regulation, and the alarm information can be output. The alarm information can be sent to a set terminal, such as a terminal of a service person, a terminal of a supervisor, and the like. The method can be set according to actual needs.
In the embodiment of the invention, the inspection screenshot unit is arranged, and the processing unit can realize the inspection capability of the picture, screen out the picture which does not accord with the preset regulation and send out the alarm information for prompting.
Fig. 7 is a schematic flowchart of another process of processing to-be-audited service data according to the processing rule of each processing unit in the embodiment of the present invention.
As shown in fig. 7, if the processing unit is a downgrade logic unit, the processing the to-be-audited service data according to the respective processing rule of each processing unit includes:
step 700: judging whether an auditing system corresponding to the service system is abnormal or not;
step 702: if the abnormal data exists, the business data to be audited is marked as degraded data; the degraded data is data processed after the system resources reach a preset value.
In the embodiment of the invention, the processing unit is provided with the degradation logic unit and can carry out targeted degradation processing according to the scene of the service system.
For example, after the service system sends the service data to be audited, the degradation logic unit sends an inquiry instruction, the service system returns an exception, or the service data to be audited carries an identifier of the service system exception, the service data to be audited is marked and marked as degradation data, and the degradation data can be data that is processed only when the system resource reaches a preset value. For example, system resources are idle before degraded data is processed. Of course, degraded data may also be associated with the business system. According to different application scenes of the service system, the content of the degraded data representation is different, and personalized setting can be realized according to different scenes. The flexibility of the processing device is improved.
Fig. 8 is a schematic flowchart of another process of processing to-be-audited service data according to the processing rule of each processing unit in the embodiment of the present invention.
As shown in fig. 8, if the processing unit is a sending module, the processing the to-be-audited service data according to the respective processing rule of each processing unit includes:
step 800: determining a data format in the audit rule;
step 802: converting the data format of the received processed service data to be audited into a target format matched with the data format in the audit rule;
step 804: and sending the processed service data to be audited in the target format to the auditing system.
In the embodiment of the present invention, if the processing unit is a sending unit, the received data format of the processed to-be-audited service data is converted into a target format matched with the data format in the audit rule.
In the embodiment of the present invention, the data format is converted, for example, the data format is subjected to packing processing, encryption processing, and the like. And then sending the processed business data to be audited to an auditing system. The auditing system can process the received data without any conversion, and the auditing efficiency of the auditing system is improved.
It should be understood that, in the embodiment of the present invention, algorithms of each auditing system may also be stored in advance, or the processing apparatus of the present application may also be a module of the auditing system, and the sending to the auditing system is sending to another module in the auditing system.
In the embodiment of the invention, the data format can be converted, and the data format of the service data to be audited is converted according to the data format specified by the auditing rule in the auditing system. The processing unit, if a sending unit, may be the last processing unit in the chain of responsibilities, which may communicate directly with the auditing system.
In the embodiment of the invention, different data format conversions can be carried out on the service data to be audited according to different auditing rules, so that the possibility of returning errors by an auditing system is reduced, and the auditing efficiency is improved.
Based on the same conception, the invention also discloses a processing device for the business data, which is applied to a duty chain, wherein the duty chain comprises a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in the duty chain according to a preset sequence.
Fig. 9 is a schematic structural diagram of a processing apparatus for service data according to the present disclosure. As shown in fig. 9, the processing apparatus includes:
the acquiring module 91 is configured to acquire service data to be audited;
a processing module 92, configured to process, by each processing unit in the responsibility chain, the to-be-audited service data according to a respective processing rule of each processing unit; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; the target format is the same as the data format of the auditing rule in the auditing system corresponding to the service system;
a sending module 93, configured to send the service data in the target format to the auditing system.
In some embodiments, the processing, by each processing unit in the responsibility chain, the to-be-audited service data according to the respective processing rule of each processing unit specifically includes:
after a first processing unit in the responsibility chain receives the service data to be audited, the first processing unit processes the service data to be audited according to the processing rule of the first processing unit;
and the first processing unit sends the processed business data to be audited to a second processing unit, and the second processing unit is positioned at the next position of the first processing unit in the responsibility chain.
In some embodiments, if the processing unit is an original data storage unit, the processing, by the first processing unit, the to-be-audited service data according to the processing rule of the first processing unit includes:
and storing the service data to be audited into a storage device.
In some embodiments, if the processing unit is a video file processing unit, the processing the service data to be audited according to the respective processing rule of each processing unit includes:
judging whether the data type of the service data to be audited is a video file type;
if the data type of the service data to be audited is a video file type, extracting voice data in the service data to be audited to obtain a voice file;
and taking the voice file as the processed business data to be audited.
In some embodiments, if the processing unit is a voice file processing unit, the processing the service data to be audited according to the respective processing rule of each processing unit includes:
judging whether the data type of the service data to be audited is a voice file type;
if the data type of the service data to be audited is a voice file type, extracting characters in the service data to be audited to obtain a text file;
and taking the text file as the processed business data to be audited.
In some embodiments, if the processing unit is an inspection screenshot unit, the processing the to-be-inspected service data according to the respective processing rule of each processing unit includes:
judging whether the data type of the service data to be audited is a picture type;
if the data type of the business data to be audited is a picture type, cutting the business data to be audited into at least one picture with a preset size;
and taking the at least one picture with the preset size as the processed business data to be audited.
In some embodiments, the processing method further comprises:
identifying text content in the processed business data to be audited;
judging whether the text content meets preset regulations or not;
and if the text content has characters which do not accord with the preset specification, outputting alarm information.
In some embodiments, if the processing unit is a downgrade logic unit, the processing the to-be-audited service data according to the respective processing rule of each processing unit includes:
judging whether an auditing system corresponding to the service system is abnormal or not;
if the abnormal data exists, the business data to be audited is marked as degraded data; the degraded data is data processed after the system resources reach a preset value.
In some embodiments, if the processing unit is a sending unit, the processing the to-be-audited service data according to the respective processing rule of each processing unit includes:
determining a data format in the audit rule;
converting the data format of the received processed service data to be audited into a target format matched with the data format in the audit rule;
and sending the processed service data to be audited in the target format to the auditing system.
In some embodiments, the processing module is further to:
receiving an insert request for transmission after inserting a target processing unit at a particular location in the chain of responsibilities;
updating the preset sequence according to the specific position;
and saving the processing rule corresponding to the target processing unit.
In some embodiments, the processing module is further to:
receiving an auditing result returned after the auditing system audits the service data in the target format;
and sending the auditing result to the service system.
Fig. 10 is a schematic structural diagram of an electronic device for processing business data, corresponding to fig. 2, provided in an embodiment of this specification. The electronic device may include a smart phone, a tablet computer, or a notebook computer.
As shown in fig. 10, the electronic device 1000 may include:
at least one processor 1010; and the number of the first and second groups,
a memory 1030 communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory 1030 stores instructions 1020 executable by the at least one processor 1010 to enable the at least one processor 1010 to:
acquiring service data to be audited;
processing the service data to be audited according to the respective processing rule of each processing unit through each processing unit in the responsibility chain; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; the target format is the same as the data format of the auditing rule in the auditing system corresponding to the service system; the responsibility chain comprises a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in the responsibility chain according to a preset sequence;
and sending the service data in the target format to the auditing system.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
Based on the same idea, the embodiment of the present specification further provides a computer-readable medium corresponding to the above method. The computer readable medium has computer readable instructions stored thereon that are executable by a processor to implement the method of:
acquiring service data to be audited;
processing the service data to be audited according to the respective processing rule of each processing unit through each processing unit in the responsibility chain; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; the target format is the same as the data format of the auditing rule in the auditing system corresponding to the service system; the responsibility chain comprises a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in the responsibility chain according to a preset sequence;
and sending the service data in the target format to the auditing system.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. Because the method is basically similar to the method embodiment, the description is simple, and the relevant points can be referred to partial description of the method embodiment.
In the 90 s of the 20 th century, improvements in a technology could clearly distinguish between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by a user. A digital character system is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate a dedicated integrated circuit chip. Furthermore, nowadays, instead of manually making an Integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Hardware Description Language), traffic, pl (core universal Programming Language), HDCal (jhdware Description Language), lang, Lola, HDL, laspam, hardward Description Language (vhr Description Language), vhal (Hardware Description Language), and vhigh-Language, which are currently used in most common. It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.
The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic for the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may thus be considered a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium which can be used to store information which can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (10)

1. A processing method for business data is applied to a responsibility chain, wherein the responsibility chain comprises a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in the responsibility chain according to a preset sequence; the processing method comprises the following steps:
acquiring service data to be audited;
processing the service data to be audited according to the respective processing rule of each processing unit through each processing unit in the responsibility chain; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; the target format is the same as the data format of the auditing rule in the auditing system corresponding to the service system;
and sending the service data in the target format to the auditing system.
2. The processing method according to claim 1, wherein the processing, by each processing unit in the responsibility chain, the to-be-audited service data according to the respective processing rule of each processing unit specifically includes:
after a first processing unit in the responsibility chain receives the service data to be audited, the first processing unit processes the service data to be audited according to the processing rule of the first processing unit;
and the first processing unit sends the processed business data to be audited to a second processing unit, and the second processing unit is positioned at the next position of the first processing unit in the responsibility chain.
3. The processing method according to claim 2, wherein the processing unit is an original data storage unit, and the processing, by the first processing unit, of the to-be-audited service data according to the processing rule of the first processing unit includes:
and storing the service data to be audited into a storage device.
4. The processing method according to claim 2, wherein the processing unit is a video file processing unit, and the processing the service data to be audited according to the respective processing rule of each processing unit includes:
judging whether the data type of the service data to be audited is a video file type;
if the data type of the service data to be audited is a video file type, extracting voice data in the service data to be audited to obtain a voice file;
and taking the voice file as the processed business data to be audited.
5. The processing method according to claim 2, wherein the processing unit is a voice file processing unit, and the processing the service data to be audited according to the respective processing rule of each processing unit includes:
judging whether the data type of the service data to be audited is a voice file type;
if the data type of the service data to be audited is a voice file type, extracting characters in the service data to be audited to obtain a text file;
and taking the text file as the processed business data to be audited.
6. The processing method according to claim 2, wherein the processing unit is an inspection screenshot unit, and the processing the to-be-inspected service data according to the respective processing rule of each processing unit includes:
judging whether the data type of the service data to be audited is a picture type;
if the data type of the business data to be audited is a picture type, cutting the business data to be audited into at least one picture with a preset size;
and taking the at least one picture with the preset size as the processed business data to be audited.
7. The processing method of claim 6, further comprising:
identifying text content in the processed business data to be audited;
judging whether the text content meets preset regulations or not;
and if the text content has characters which do not accord with the preset specification, outputting alarm information.
8. The processing method according to claim 2, wherein the processing unit is a downgrade logic unit, and the processing the to-be-audited service data according to the respective processing rule of each processing unit includes:
judging whether an auditing system corresponding to the service system is abnormal or not;
if the abnormal data exists, the business data to be audited is marked as degraded data; the degraded data is data processed after the system resources reach a preset value.
9. The processing method according to claim 2, wherein the processing unit is a sending unit, and the processing the to-be-audited service data according to the respective processing rule of each processing unit includes:
determining a data format in the audit rule;
converting the data format of the received processed service data to be audited into a target format matched with the data format in the audit rule;
and sending the processed service data to be audited in the target format to the auditing system.
10. A processing device for business data is applied to a responsibility chain, wherein the responsibility chain comprises a plurality of processing units, the processing rules of the processing units are different, and the processing units are arranged in a preset sequence in the responsibility chain; the processing device comprises:
the acquisition module is used for acquiring the service data to be audited;
processing the service data to be audited according to the respective processing rule of each processing unit through each processing unit in the responsibility chain; at least one processing unit in the responsibility chain is used for converting the service data to be audited into service data in a target format; and the target format and the data format of the auditing rule in the auditing system corresponding to the service system send the service data in the target format to the auditing system.
CN202111158392.0A 2021-09-30 2021-09-30 Method and device for processing service data Pending CN113868479A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111158392.0A CN113868479A (en) 2021-09-30 2021-09-30 Method and device for processing service data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111158392.0A CN113868479A (en) 2021-09-30 2021-09-30 Method and device for processing service data

Publications (1)

Publication Number Publication Date
CN113868479A true CN113868479A (en) 2021-12-31

Family

ID=79000963

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111158392.0A Pending CN113868479A (en) 2021-09-30 2021-09-30 Method and device for processing service data

Country Status (1)

Country Link
CN (1) CN113868479A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114218599A (en) * 2022-02-22 2022-03-22 飞狐信息技术(天津)有限公司 Business data processing method and device, storage medium and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130031067A1 (en) * 2011-07-29 2013-01-31 Harish Iyer Data audit module for application software
US20180232433A1 (en) * 2017-02-13 2018-08-16 American Express Travel Related Services Company, Inc. System and Method for Dynamically Refactoring Business Data Objects
CN111258940A (en) * 2020-01-13 2020-06-09 中国平安财产保险股份有限公司 Configuration method, service auditing method, system, equipment and storage medium
US20200210391A1 (en) * 2018-12-31 2020-07-02 T-Mobile Usa, Inc. Automated audit balance and control processes for data stores

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130031067A1 (en) * 2011-07-29 2013-01-31 Harish Iyer Data audit module for application software
US20180232433A1 (en) * 2017-02-13 2018-08-16 American Express Travel Related Services Company, Inc. System and Method for Dynamically Refactoring Business Data Objects
US20200210391A1 (en) * 2018-12-31 2020-07-02 T-Mobile Usa, Inc. Automated audit balance and control processes for data stores
CN111258940A (en) * 2020-01-13 2020-06-09 中国平安财产保险股份有限公司 Configuration method, service auditing method, system, equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114218599A (en) * 2022-02-22 2022-03-22 飞狐信息技术(天津)有限公司 Business data processing method and device, storage medium and electronic equipment
CN114218599B (en) * 2022-02-22 2022-05-27 飞狐信息技术(天津)有限公司 Business data processing method and device, storage medium and electronic equipment

Similar Documents

Publication Publication Date Title
CN108363634B (en) Method, device and equipment for identifying service processing failure reason
CN103647696A (en) Message reply method and system under micro message development mode
US11800201B2 (en) Method and apparatus for outputting information
CN107479868B (en) Interface loading method, device and equipment
CN110826799B (en) Service prediction method, device, server and readable storage medium
CN109472540B (en) Service processing method and device
CN110602163B (en) File uploading method and device
CN111737528A (en) Data acquisition and verification method and device, electronic equipment and storage medium
CN113868479A (en) Method and device for processing service data
CN110888972A (en) Sensitive content identification method and device based on Spark Streaming
GB2521637A (en) Messaging digest
CN110505289B (en) File downloading method and device, computer readable medium and wireless communication equipment
CN113282590A (en) Interface joint debugging method and device based on 5G message
CN106411718B (en) Data synchronization method and device based on instant messaging application
CN108616603B (en) Method and system for synchronizing internal and external network data
CN116071590A (en) Model training method, system, computer device and storage medium
US8615744B2 (en) Methods and system for managing assets in programming code translation
CN112039971B (en) Data recording method and device, and data storage method and device
CN115061785A (en) Information issuing method and device, storage medium and server
CN113949887A (en) Method and device for processing network live broadcast data
CN107222559B (en) Information calling method
CN112214669A (en) Home decoration material formaldehyde release data processing method and device and monitoring server
CN112748968A (en) Auxiliary operation method, device, equipment and storage medium
CN111198721A (en) Application program running method and device
CN110908958B (en) File processing method, device, terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination