CN112287270A - Content auditing method and device - Google Patents
Content auditing method and device Download PDFInfo
- Publication number
- CN112287270A CN112287270A CN202011038667.2A CN202011038667A CN112287270A CN 112287270 A CN112287270 A CN 112287270A CN 202011038667 A CN202011038667 A CN 202011038667A CN 112287270 A CN112287270 A CN 112287270A
- Authority
- CN
- China
- Prior art keywords
- auditing
- data
- audit
- content
- processed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000012550 audit Methods 0.000 claims abstract description 112
- 210000004258 portal system Anatomy 0.000 claims abstract description 89
- 238000007726 management method Methods 0.000 claims abstract description 57
- 238000012545 processing Methods 0.000 claims abstract description 42
- 238000004590 computer program Methods 0.000 claims description 18
- 238000003860 storage Methods 0.000 claims description 8
- 239000008186 active pharmaceutical agent Substances 0.000 description 23
- 230000006870 function Effects 0.000 description 19
- 238000001514 detection method Methods 0.000 description 15
- 238000011161 development Methods 0.000 description 14
- 230000018109 developmental process Effects 0.000 description 14
- 238000012552 review Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 230000004927 fusion Effects 0.000 description 6
- 238000012423 maintenance Methods 0.000 description 5
- 206010028813 Nausea Diseases 0.000 description 4
- 230000008693 nausea Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000003973 irrigation Methods 0.000 description 2
- 230000002262 irrigation Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013439 planning Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 210000003484 anatomy Anatomy 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000740 bleeding effect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 230000033772 system development Effects 0.000 description 1
- 210000001835 viscera Anatomy 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The embodiment of the invention provides a content auditing method and a device, which are applied to an operation center, wherein the operation center is integrated in a city portal system, the city portal system also comprises a content security management platform, and the content security management platform is used for providing a content auditing service interface, and the method comprises the following steps: acquiring data to be processed; calling the content auditing service interface, and auditing the data to be processed to obtain a first auditing result; and if the first audit result is that the audit is not passed, generating and outputting prompt information. In the city portal system, the operation center calls a content auditing service interface provided by the content security management platform for processing, so that the operation center of the city portal system can conveniently audit the content of the data to be processed in other service platforms, the content security of the data of other service platforms is ensured, and the influence of non-compliance and non-content on platform users is reduced.
Description
Technical Field
The present invention relates to the field of network technologies, and in particular, to a content auditing method and a content auditing apparatus.
Background
With the development of technologies such as computers, networks, communication and the like, the artificial intelligence deep application is taken as a way to construct urban construction conforming to a cross-domain multi-dimensional concept, technical fusion, business fusion, data fusion and application fusion are promoted, cross-level, cross-region, cross-system, cross-department and cross-business cooperative management and service are realized, the urban construction is accelerated by cooperating with various industries, enterprises and teams, and the method is a development direction of smart cities.
At present, most urban developments have no multi-dimensional fusion planning scheme, and the problems that information platforms of various industries, enterprises and teams are not related and mutual-aided in function, information is not shared and exchanged, and information, service flow and application are mutually disjointed cause that the information in the information platforms cannot be fully utilized.
The urban portal system for realizing multi-dimensional fusion aiming at the city and how to make the urban portal system more beneficial to the use of users are the solutions urgently needed at present.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide a content auditing method and a corresponding content auditing apparatus that overcome or at least partially solve the above problems.
In order to solve the above problems, an embodiment of the present invention discloses a content auditing method, which is applied to an operation center, wherein the operation center is integrated in a city portal system, the city portal system further includes a content security management platform, a content auditing service interface provided by the content security management platform is registered and issued to a unified service gateway of the city portal system, and the method includes:
acquiring data to be processed;
calling the content auditing service interface, and auditing the data to be processed to obtain a first auditing result;
and if the first audit result is that the audit is not passed, generating and outputting prompt information.
Optionally, the city portal system further includes a plurality of service platforms, and the acquiring the data to be processed includes:
acquiring data to be issued submitted by users of the plurality of service platforms; the data to be published comprises information to be published, application, service and information.
Optionally, the content auditing service interface includes a text auditing service interface, and/or an image auditing service interface, and/or a video auditing service interface; the calling the content auditing service interface to audit the data to be processed to obtain a first auditing result, and the method comprises the following steps:
calling the text auditing service interface, and performing text auditing processing on the text data in the data to be processed to obtain a first auditing result;
and/or calling the image auditing service interface to perform image auditing processing on the image data in the data to be processed to obtain a first auditing result;
and/or calling the video auditing service interface, and performing video auditing processing on the video data in the data to be processed to obtain a first auditing result.
Optionally, the step of generating and outputting the prompt message includes:
and generating prompt information and sending the prompt information to a user of the service platform.
Optionally, the method further comprises:
and if the first audit result is that the audit is passed, the data to be issued is issued to the city portal system.
Optionally, the method further comprises:
if the first audit result is that manual audit is needed, generating and outputting manual audit indication information to indicate an administrator of the operation center to perform manual audit;
acquiring a second auditing result of manual auditing of an administrator of the operation center;
and if the second audit result is that the audit is not passed, generating and outputting prompt information.
Optionally, the method further comprises:
and if the second audit result is that the audit is passed, the data to be issued is issued to the city portal system.
The embodiment of the invention also discloses a content auditing device which is applied to an operation center, wherein the operation center is integrated in a city portal system, the city portal system also comprises a content security management platform, a content auditing service interface provided by the content security management platform is registered and issued to a unified service gateway of the city portal system, and the device comprises:
the data to be processed acquisition module is used for acquiring data to be processed; the data to be processed comprises information, application, service and information to be issued;
the auditing processing module is used for calling the content auditing service interface, and auditing the data to be processed to obtain a first auditing result;
and the prompt information output module is used for generating and outputting prompt information if the first audit result is that the audit is not passed.
Optionally, the city portal system further comprises a plurality of service platforms; the module for acquiring the data to be processed comprises:
the data to be processed acquisition submodule is used for acquiring data to be issued submitted by users of the plurality of service platforms; the data to be published comprises information to be published, application, service and information.
Optionally, the content auditing service interface includes a text auditing service interface, and/or an image auditing service interface, and/or a video auditing service interface; the audit processing module comprises:
the first auditing processing submodule is used for calling the text auditing service interface, and performing text auditing processing on the text data in the data to be processed to obtain a first auditing result;
the second auditing processing submodule is used for calling the image auditing service interface, and performing image auditing processing on the image data in the data to be processed to obtain a first auditing result;
and the third auditing processing sub-module is used for calling the video auditing service interface, and performing video auditing processing on the video data in the data to be processed to obtain a first auditing result.
Optionally, the prompt information output module includes:
and the prompt information sending submodule is used for generating prompt information and sending the prompt information to a user of the service platform.
Optionally, the apparatus further comprises:
and the to-be-issued data issuing module is used for issuing the to-be-issued data to the city portal system if the first audit result is that the audit is passed.
Optionally, the apparatus further comprises:
the indication information output module is used for generating and outputting manual review indication information to indicate an administrator of the operation center to perform manual review if the first review result is that manual review is required;
the second audit result acquisition module is used for acquiring a second audit result of manual audit of an administrator of the operation center;
and the prompt information output module is used for generating and outputting prompt information if the second audit result is that the audit is not passed.
The embodiment of the invention also discloses an electronic device, which comprises: a processor, a memory and a computer program stored on the memory and being executable on the processor, the computer program, when executed by the processor, implementing the steps of any of the content auditing methods.
The embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and when being executed by a processor, the computer program realizes the steps of any content auditing method.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, the operation center integrated in the city portal system can acquire the data to be processed from other service platforms, audit the acquired data to be processed by calling the content audit service interface provided by the content security management platform, and generate and output the prompt message when the audit result is that the audit is not passed. In the city portal system, the operation center calls a content auditing service interface provided by the content security management platform for processing, so that the operation center of the city portal system can conveniently audit the content of the data to be processed in other service platforms, the content security of the data of other service platforms is ensured, and the influence of non-compliance and non-content on platform users is reduced.
Drawings
FIG. 1 is a block diagram of a city portal system of an embodiment of the present invention;
FIG. 2 is a flow chart of steps of a first embodiment of a content auditing method of the present invention;
FIG. 3 is a flowchart illustrating steps of a second embodiment of a content auditing method according to the present invention;
fig. 4 is a block diagram of a content auditing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
The city portal system is a public platform portal which integrates comprehensive internet information aiming at city planning and provides comprehensive application services. The service objects of the city portal system include: government, individual, enterprise, developer, can provide a plurality of comprehensive services such as government affairs service, individual service, enterprise service, etc.
Referring to fig. 1, a block diagram of a city portal system according to an embodiment of the present invention is shown, which may specifically include: a front-end system 10, a back-end system 11, an API open platform 12, a developer portal system 13, an operation center 14, and the like.
A front-end system 10 that implements a plurality of functions and provides a plurality of pages; the plurality of pages include a plurality of UI elements corresponding to the plurality of functions; the plurality of functions includes a function supported by a backend system to provide a service.
The front-end system is a client facing the user, and is used as a tool for the user to use various contents in the urban portal system, and the user can use information, applications, API services, system functions and the like in the urban portal system through the front-end system. The front-end system displays a universal front-end development framework such as Vue, React and the like to realize unified presentation of a single page of the multi-service system.
The front-end system supports multi-dimensional user use, including tourists, natural people, corporate legal people, enterprise employees and government personnel. The front-end system supports multi-dimensional business city services, including government affair services, public services, characteristic services and the like. The user may use a variety of city services through the head-end system.
The front-end system can comprise an APP client, a Web client and a Web management end, wherein the Web client faces tourists, natural people, enterprises and government users and is used for city portal system official networks, API open platforms and developer portals. The APP client faces tourists, natural people, enterprises and government users and is used for moving the APP; the Web management end faces to operators and system managers and is used for operation centers and other back-end management systems.
And the back-end system 11 is configured to provide service support for the front-end system, respond to a service request of the front-end system, and execute a corresponding service operation.
And the back-end system takes the universal service component or the technical service as a bridge to get through the bottom data. The front-end system is decoupled from the back-end system, and the back-end system provides service support for the front-end system. The front-end system and the back-end system are separately deployed, and the back-end system serves dynamic capacity expansion to achieve the maximum performance of the system.
And the API open platform 12 is used for providing management services aiming at the API, including API publishing services, purchasing services and using services.
The API open platform provides a unified standard data and system development environment, can be applied to various industries and systems, is an open comprehensive service platform with unified solution capability service, and aims to realize the management and control of the whole flow life cycle of unified capability opening including service capability access, open management, capability application and the like. By publishing the API services to the API open platform, developers can apply for or purchase use on the platform by other persons.
A developer portal system 13 for providing an environment for API, application, data development and deployment, and common procedural components.
The developer portal system can provide the developer with an environment for application, algorithm, and data development and deployment, as well as generic AI building blocks, technical building blocks, and business building blocks. The method comprises the functions of application development, algorithm development, application release, service release and the like. Developers can quickly develop and publish applications and APIs based on the environment, components, templates, etc. provided by the developer portal system. The developer portal system may include three platforms, an algorithm development platform, an application development platform, and a data development platform.
And the operation center 14 is used for managing the content, the users, the applications and the API of the city portal system.
The operation center is a business center station which provides unified daily operation management for managers and operators to the urban portal system. The management personnel can carry out unified management on the content, the users, the applications, the API and the like of the city portal system through the operation center.
The embodiment of the invention provides an urban portal system which can integrate a front-end system, a back-end system, an API open platform, a developer portal system, an operation center and other platforms. The front-end system serves as a client and faces various users, and the users can obtain contents provided by various platforms integrated in the urban portal system by performing operations on the front-end system. The back-end system provides service support for the front-end system, responds to the service request of the front-end system and executes corresponding service operation. The API open platform provides management services aiming at the API, including API publishing services, purchasing services and using services; the method can be used for developers to call API uniformly and establish a standard and uniform information platform. The developer portal system can provide an environment for API, application, data development and deployment, and general purpose procedural components; and the development of various services can be realized by developers. The operation center can manage the content, users, applications and API of the city portal system. The embodiment of the invention provides a comprehensive city portal system for a city, which is oriented to various users in the city, and the users can quickly and conveniently realize various digital services through the city portal system; and standardized service development is realized through the city portal system.
Referring to fig. 2, a flowchart of a first embodiment of a content auditing method according to the present invention is shown, and is applied to an operation center, where the operation center is integrated in a city portal system, the city portal system further includes a content security management platform, and a content auditing service interface provided by the content security management platform is registered and issued to a unified service gateway of the city portal system, and specifically includes the following steps:
in an embodiment of the present invention, the city portal system may include an operation center and a content security management platform, where the operation center may communicate with the content security management platform, and may call a content auditing service interface provided by the content security management platform, and perform auditing processing on the acquired to-be-processed data through a service provided by the content auditing service interface.
The method comprises the steps that a content auditing service interface can be called to audit data to be processed, and a first auditing result obtained by automatically auditing the content auditing service provided by the content auditing service interface is obtained; the first review result obtained by performing the automatic review may include that the review is passed, the review is not passed, and manual review is required. Specifically, the operation center calls the content auditing service interface, and at this time, the operation center integrated in the city portal system can generate an interface call request for the content auditing service interface and send the interface call request to the content security management platform through the gateway to call the content auditing service interface. When the interface call request is sent by the operation center, the city portal system can perform identity authentication on an operation user of the operation center, that is, the interface call request is sent to the content security management platform under the condition that the identity authentication platform judges that the session (time domain) session corresponding to the user and the session corresponding to the user are valid.
And step 203, if the first examination result is that the examination is not passed, generating and outputting prompt information.
In an embodiment of the present invention, the operation center may obtain the audit result after invoking a content audit interface provided by the content security management platform to perform audit processing on the acquired to-be-processed data, where the acquired to-be-processed data may be data published to the city portal system or data to be published to the portal system.
In one case, the first audit result of automatically auditing the data to be processed is that the data to be processed is passed, if the data to be processed is the data published to the city portal system, the data displayed in the city portal system is retained, and if the data to be processed is the data to be published to the city portal system, the data to be published can be published to the city portal system after the audit is passed; in another case, the first audit result of the automatic audit performed on the to-be-processed data is that the to-be-processed data does not pass, and at this time, if the to-be-processed data is data that has been issued to the city portal system, the data displayed in the city portal system may be deleted and prompt information for warning may be generated and output to the publisher, and if the to-be-processed data is data that has been issued to the city portal system, the prompt information for warning may be output to the publisher.
In the embodiment of the invention, the operation center integrated in the city portal system can acquire the data to be processed from other service platforms, audit the acquired data to be processed by calling the content audit service interface provided by the content security management platform, and generate and output the prompt message when the audit result is that the audit is not passed. In the city portal system, the operation center calls a content auditing service interface provided by the content security management platform for processing, so that the operation center of the city portal system can conveniently audit the content of the data to be processed in other service platforms, the content security of the data of other service platforms is ensured, and the influence of non-compliance and non-content on platform users is reduced.
Referring to fig. 3, a flowchart illustrating steps of a second embodiment of the content auditing method according to the present invention is shown, and is applied to an operation center, where the method specifically includes the following steps:
in an embodiment of the present invention, the city portal system may further include a plurality of service platforms, the operation center may communicate with other plurality of service platforms, and at this time, the operation center may obtain, from other plurality of service platforms, to-be-processed data that needs to be checked and processed and is submitted by the user through a communication manner.
In a specific implementation, when users of other multiple service platforms submit data to be published, a submission request for data publishing of the data to be published needs to be generated, and at this time, when the submission request for the data publishing of the data to be published is detected by the operation center, the data to be published that needs to be published can be acquired, so that the data to be published is checked and verified.
The user who publishes the data to be published can be a login user of a developer portal system integrated in the urban portal system, and can also be a user of other service platforms except the developer portal system in the urban portal system; for the generation and sending mode of the data release request, after a user logs in a developer portal system or other service platforms, a main page of the system or a main page of the platform can appear, the main page can comprise a release operation column for releasing data to be released or a release link entry for releasing the data to be released, and at the moment, the generation and sending of the data release request can be realized through touch operation of the logged-in user acting on the release operation column or the release link entry.
In a preferred embodiment, before the touch operation is performed on the publishing operation bar or the publishing connection entry by the login user, an editing operation may be performed on the data to be published, and at this time, an editing page for the editing operation may be provided. The editing page can support free creation of a publishing template aiming at the data to be published, namely, the publishing module can be freely imported or exported according to a plug-in implementation form, and in the process that a login user edits the data to be published, a title, content, column, author reprinting source and other systems can be input, so that news can be automatically generated, and a data publishing request can be immediately generated to be published to the city portal system; the login user can also be provided with a function of previewing the data to be published after editing and before publishing so as to reduce errors after publishing the data to be published, and the previewing function of the data to be published can comprise previewing the data which is edited and is provided with a publishing template and previewing the data which is pre-published (namely sending a data publishing request but not performing auditing treatment), and can be previewing the data of which news is automatically generated.
In the embodiment of the invention, when a login user uploads a picture, the automatic generation of picture news can be supported; when the login user attaches the relevant connection, the automation of the relevant connection can be supported, namely, the information database can be searched and the corresponding information is selected as the relevant information of the information.
It should be noted that the data to be published may include information, applications, services, and messages to be published, and the data to be published may be in any text form, any picture form, any video form, and any audio form, which is not limited in the embodiments of the present invention.
in practical application, after acquiring data to be issued, which needs to be issued, according to a data issuing request, an operation center may call a content auditing service interface provided by a content security management platform for auditing the data to be issued; the content auditing service interface is a service interface which is registered in advance in a unified service gateway of the city portal system and issued and is used for providing content auditing service. The content management security platform can be a management control platform which can guarantee the normal operation of content security service, can complete user management, system configuration, operation and maintenance information management, report form calling query and the like of a whole set of content security privatization scheme in the management control platform, can support a customized gallery and a word stock, and can perform manual auditing operation through the customized gallery and the word stock. The privatization deployment aiming at the content security privatization scheme can comprise basic services, the basic services can comprise algorithm API services and an operation and maintenance console system, the algorithm API services refer to relying on container services and providing content security detection APIs externally, detection requests can be dispatched to corresponding algorithm models according to strategies such as algorithm models, label threshold values, calling flow limitation and the like configured in the system, and algorithm detection results are returned; the operation and maintenance console system can provide functions of user management, AppKey management, License management, algorithm configuration, sample library management, algorithm call report, self-help audit, cluster operation and maintenance data overview, system log viewing and the like required by daily operation/operation and maintenance through a visual interface. The privatized deployment can also comprise content security detection algorithm services, and the content security detection algorithm services can comprise algorithm services related to content auditing services provided by a content auditing service interface, such as image-text OCR, riot recognition, yellow identification algorithm, sensitive face recognition, text anti-spam and nausea picture recognition. It should be noted that the tag threshold returned after content identification or content audit performed by the content security detection algorithm service may be configured by the console.
The content auditing service provided by the content management security platform can be used for auditing information, application, service, message and the like to be issued, and mainly calls a content auditing service interface to perform security auditing on titles, pictures, videos and contents when the information, application, service, message and the like are issued, if the contents violate rules, the content violations can be prompted, and the contents violations are issued after being modified; if the content is normal or cannot be confirmed, an approval process can be generated.
The content auditing service interface can support OSS violation detection, CDN violation detection and site detection. The OSS violation detection can refer to violation identification of pictures stored on an OSS by a user through an artificial intelligence technology, and the pictures can be conveniently and quickly processed through quick operations such as deletion, omission and the like to provide a convenient and easy-to-use result display platform, so that the auditing labor is reduced, the violation risk is effectively reduced, daily incremental scanning and stock scanning are supported, and the risk of dead angle coverage is avoided; the CDN violation detection can refer to automatically identifying a source returning request of CDN picture acceleration service, and can derive a violation picture source station address for a user to delete the derived violation pictures in batch; the website detection can be used for providing information content safety detection and management and control services for cloud website users, early warning can be given out in advance when the website content relates to violation information, violation webpage addresses and snapshot viewing functions are provided, and manual detection of the website content is reduced.
In one embodiment of the present invention, step 302 may include the following sub-steps:
the substep S11 is to call the text auditing service interface to perform text auditing processing on the text data in the data to be processed to obtain a first auditing result;
specifically, the content auditing service interface may include a text auditing service interface, the service provided by the text auditing service interface may be a text auditing service for the data to be processed, and at this time, the text auditing service may be adopted to perform text auditing processing on the text data in the data to be processed, so as to obtain a first auditing result for the text data.
The text auditing treatment can comprise text anti-spam treatment and text error correction treatment, wherein the text anti-spam treatment refers to an artificial intelligent text auditing technology based on deep learning and large-scale sample training, adopts multi-dimension, multi-model and multi-detection means in combination with behaviors and contents to identify spam contents contained in text data, such as pornography, advertisements, irrigation, political affairs, abuse, contraband and other risk categories, and also supports user-defined keywords; text error correction refers to identifying segments of text data that have errors and presenting the correct suggested text content while error prompting.
The substep S12 is to call the image auditing service interface to perform image auditing processing on the image data in the data to be processed to obtain a first auditing result;
in another case, the content auditing service interface may include an image auditing service interface, where the service provided by the image auditing service interface may be an image auditing service for the data to be processed, and at this time, the image auditing service may be adopted to perform image auditing processing on the image data in the data to be processed, so as to obtain a first auditing result for the image data.
In practical application, the image auditing treatment of the image data in the data to be treated can be realized by an automatic AI image auditing technology, the automatic AI image auditing can support identification including yellow identification, riot identification, political sensitive identification, public character identification, nausea picture identification and the like, and after the AI automatic auditing is finished, specific personnel can be pushed according to the setting of a system administrator, and the image auditing can be published after the auditing is finished so as to reduce errors.
The yellow identification refers to the support of identifying whether the picture/video is pornographic/sexy content; the riot and terrorist identification refers to the identification of contents which can support various aspects related to politics/riot and terrorist, including aspects related to political contents, special marks (such as certain country marks and certain organization marks), explosion smoke and light, special dressing, weapons and the like; political sensitive identification means that political figures and sensitive political event scenes can be identified, a portal platform is helped to identify sensitive information, and related risks are avoided; the public figure identification can support the identification of whether the content to be detected contains portrait information which is identified as sensitive faces or not, and comprises various sensitive face types such as politics, entertainment stars, sports stars and horse falling officers; nausea picture recognition refers to images that can support recognition of nausea, discomfort, such as large areas of bleeding, anatomy, internal organs, etc.; and meanwhile, the method can also support image-text OCR, namely, the image-text OCR recognition task is submitted, the machine learning technology is utilized to recognize the text information in the picture and obtain a recognition result, and after the recognition result is obtained, the junk content contained in the obtained recognition result, such as pornographic, advertisement, irrigation, wading, abuse, contraband and other risk categories, can be recognized based on the artificial intelligent text auditing technology of deep learning and large-scale sample training.
And a substep S13, calling the video auditing service interface, and performing video auditing processing on the video data in the data to be processed to obtain a first auditing result.
In another case, the content auditing service interface may include a video auditing service interface, where the service provided by the video auditing service interface may be a video auditing service for the data to be processed, and at this time, the video auditing service may be adopted to perform video auditing processing on the video data in the data to be processed, so as to obtain a first auditing result for the video data.
The method and the device can be used for carrying out multi-dimensional intelligent auditing on the video content, such as pornography, riot, political sensitivity and the like, so that the identification accuracy is improved, the auditing difficulty is reduced, and manual auditing is reduced.
And step 303, outputting prompt information when the first audit is failed.
In an embodiment of the present invention, after the operation center detects data publishing requests of other multiple service platforms for the data to be published, and invokes a content auditing service interface provided by the content security management platform according to the data publishing requests, the data to be published can be automatically audited through the content auditing service provided by the content auditing service interface, and a first auditing result for the data to be published is obtained.
The first audit result may be an audit result obtained by performing audit processing on the data to be processed by calling a content audit service interface and performing automatic audit through the content audit service provided by the content audit service interface.
In the first case, when the first audit result is that the audit is not passed, the prompt information may be generated and sent to the user of the service platform, specifically, the operation center may reject the data publishing request for the data to be published, and output the prompt information for warning to the user sending the data publishing request, that is, the data to be published is not allowed to be published to the city portal system, thereby ensuring the content security of the data, and reducing the influence of the non-compliant and non-compliant content on the platform user.
In the second case, when the first audit result is that the audit passes, the data to be published can be published to the city portal system.
In a third situation, when the first audit result is that manual audit is required, generating manual audit indication information and outputting the manual audit indication information to indicate an administrator of the operation center to perform manual audit, and after the administrator is indicated to perform manual secondary audit on the data to be issued, acquiring a second audit result of the manual audit performed by the administrator of the operation center; if the second audit result of the manual secondary audit is that the audit is not passed, prompt information can be generated and output, so that the user sending the data release request is warned through the output prompt information; and if the second audit result is that the audit is passed, the data to be issued can be issued to the city portal system.
In a preferred embodiment, the operation center can not only perform audit processing on the data to be published, but also perform audit on published data at regular time, and mainly represent information management for updating and maintaining website contents and catalog management. The information management can provide functions of inputting, inquiring, modifying, deleting and pausing specific information in various news categories and special topics in the background, and each piece of information can also select a series of perfect information management functions such as whether the information appears in a first page of a column, a first page of a website and the like; at this time, the information can be searched, namely, the website content can be searched according to the search information such as keywords, titles, full texts, authors, sources, time and the like, and when the published data is not approved at regular time, the published data which is not approved can be deleted after being searched according to the related search information.
In addition, the catalog management means that each category (including the general category and the category of the next level) can be adjusted at any time, and can be added, modified or deleted according to the needs, and supports multiple levels of subdirectories, that is, columns of websites can be added, wherein the specific functions provided by the category management can include functions of adding, modifying, deleting news categories and topics.
In the embodiment of the invention, the operation center integrated in the city portal system can acquire the data to be processed from other service platforms, audit the acquired data to be processed by calling the content audit service interface provided by the content security management platform, and generate and output the prompt message when the audit result is that the audit is not passed. In the city portal system, the operation center calls a content auditing service interface provided by the content security management platform for processing, so that the operation center of the city portal system can conveniently audit the content of the data to be processed in other service platforms, the content security of the data of other service platforms is ensured, and the influence of non-compliance and non-content on platform users is reduced.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 4, a block diagram of a content auditing apparatus according to an embodiment of the present invention is shown, and is applied to an operation center, where the operation center is integrated in a city portal system, the city portal system further includes a content security management platform, and a content auditing service interface provided by the content security management platform is registered and issued to a unified service gateway of the city portal system, and may specifically include the following modules:
a to-be-processed data obtaining module 401, configured to obtain to-be-processed data;
an audit processing module 402, configured to invoke the content audit service interface, and perform audit processing on the to-be-processed data to obtain an audit result;
and a prompt information output module 403, configured to generate and output a prompt information if the audit result is that the audit does not pass.
In an embodiment of the present invention, the city portal system further comprises a plurality of service platforms; the to-be-processed data acquisition module 401 may include the following sub-modules:
the data to be processed acquisition submodule is used for acquiring data to be issued submitted by users of the plurality of service platforms; the data to be published comprises information to be published, application, service and information.
In an embodiment of the present invention, the content auditing service interface includes a text auditing service interface, and/or an image auditing service interface, and/or a video auditing service interface; the audit processing module 302 may include the following sub-modules:
the first auditing processing submodule is used for calling the text auditing service interface, and performing text auditing processing on the text data in the data to be processed to obtain a first auditing result;
the second auditing processing submodule is used for calling the image auditing service interface, and performing image auditing processing on the image data in the data to be processed to obtain a first auditing result;
and the third auditing processing sub-module is used for calling the video auditing service interface, and performing video auditing processing on the video data in the data to be processed to obtain a first auditing result.
In an embodiment of the present invention, the prompt information output module 403 may include the following sub-modules:
and the prompt information sending submodule is used for generating prompt information and sending the prompt information to a user of the service platform.
In an embodiment of the present invention, the apparatus may further include the following modules:
and the to-be-issued data issuing module is used for issuing the to-be-issued data to the city portal system if the first audit result is that the audit is passed.
In an embodiment of the present invention, the apparatus may further include the following modules:
the indication information output module is used for generating and outputting manual review indication information to indicate an administrator of the operation center to perform manual review if the first review result is that manual review is required;
the second audit result acquisition module is used for acquiring a second audit result of manual audit of an administrator of the operation center;
and the prompt information output module is used for generating and outputting prompt information if the second audit result is that the audit is not passed.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
An embodiment of the present invention further provides an electronic device, including:
the content auditing method comprises a processor, a memory and a computer program which is stored on the memory and can run on the processor, wherein when the computer program is executed by the processor, each process of the content auditing method embodiment is realized, the same technical effect can be achieved, and the details are not repeated here to avoid repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements each process of the content auditing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The content auditing method and the content auditing device provided by the invention are described in detail, the principle and the implementation mode of the invention are explained by applying specific examples, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A content auditing method is applied to an operation center, the operation center is integrated in a city portal system, the city portal system also comprises a content security management platform, a content auditing service interface provided by the content security management platform is registered to a uniform service gateway of the city portal system and is issued, and the method comprises the following steps:
acquiring data to be processed;
calling the content auditing service interface, and auditing the data to be processed to obtain a first auditing result;
and if the first audit result is that the audit is not passed, generating and outputting prompt information.
2. The method of claim 1, wherein the city portal system further comprises a plurality of service platforms, and wherein the obtaining the data to be processed comprises:
acquiring data to be issued submitted by users of the plurality of service platforms; the data to be processed comprises information to be issued, applications, services and messages.
3. The method according to claim 1, wherein the content audit service interface comprises a text audit service interface, and/or an image audit service interface, and/or a video audit service interface; the calling the content auditing service interface to audit the data to be processed to obtain a first auditing result, and the method comprises the following steps:
calling the text auditing service interface, and performing text auditing processing on the text data in the data to be processed to obtain a first auditing result;
and/or calling the image auditing service interface to perform image auditing processing on the image data in the data to be processed to obtain a first auditing result;
and/or calling the video auditing service interface, and performing video auditing processing on the video data in the data to be processed to obtain a first auditing result.
4. The method of claim 2, wherein the step of generating and outputting a prompt message comprises:
and generating prompt information and sending the prompt information to a user of the service platform.
5. The method of claim 2, further comprising:
and if the first audit result is that the audit is passed, the data to be issued is issued to the city portal system.
6. The method of claim 2, further comprising:
if the first audit result is that manual audit is needed, generating and outputting manual audit indication information to indicate an administrator of the operation center to perform manual audit;
acquiring a second auditing result of manual auditing of an administrator of the operation center;
and if the second audit result is that the audit is not passed, generating and outputting prompt information.
7. The method of claim 6, further comprising:
and if the second audit result is that the audit is passed, the data to be issued is issued to the city portal system.
8. A content auditing device is applied to an operation center, the operation center is integrated in a city portal system, the city portal system further comprises a content security management platform, a content auditing service interface provided by the content security management platform is registered to a unified service gateway of the city portal system and is issued, and the device comprises:
the data to be processed acquisition module is used for acquiring data to be processed;
the auditing processing module is used for calling the content auditing service interface, and auditing the data to be processed to obtain a first auditing result;
and the prompt information output module is used for generating and outputting prompt information if the first audit result is that the audit is not passed.
9. An electronic device, comprising: processor, memory and a computer program stored on the memory and being executable on the processor, the computer program, when executed by the processor, implementing the steps of the content auditing method according to any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the content auditing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011038667.2A CN112287270A (en) | 2020-09-28 | 2020-09-28 | Content auditing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011038667.2A CN112287270A (en) | 2020-09-28 | 2020-09-28 | Content auditing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112287270A true CN112287270A (en) | 2021-01-29 |
Family
ID=74422645
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011038667.2A Pending CN112287270A (en) | 2020-09-28 | 2020-09-28 | Content auditing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112287270A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113095178A (en) * | 2021-03-30 | 2021-07-09 | 北京大米科技有限公司 | Bad information detection method, system, electronic device and readable storage medium |
| CN113254827A (en) * | 2021-05-21 | 2021-08-13 | 四川金熊猫新媒体有限公司 | Information release processing method and device |
| CN113283730A (en) * | 2021-05-17 | 2021-08-20 | 鲁班(北京)电子商务科技有限公司 | Universal approval process application method and device |
| CN113592465A (en) * | 2021-09-29 | 2021-11-02 | 飞狐信息技术（天津）有限公司 | Method and device for shunting to-be-audited content, server and computer storage medium |
| CN115271686A (en) * | 2022-09-28 | 2022-11-01 | 北京长河数智科技有限责任公司 | Intelligent government affair data auditing method and device |
| CN115328463A (en) * | 2022-08-01 | 2022-11-11 | 无锡雪浪数制科技有限公司 | Design system based on visual business arrangement |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107894990A (en) * | 2017-10-09 | 2018-04-10 | 中国电子科技集团公司第二十八研究所 | A kind of city general utility functions platform |
| CN109862062A (en) * | 2018-10-24 | 2019-06-07 | 平安科技（深圳）有限公司 | Content uploading management method and device, electronic equipment and storage medium |
| CN111143621A (en) * | 2019-11-19 | 2020-05-12 | 京东数字科技控股有限公司 | Data auditing method and device and data processing system |
-
2020
- 2020-09-28 CN CN202011038667.2A patent/CN112287270A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107894990A (en) * | 2017-10-09 | 2018-04-10 | 中国电子科技集团公司第二十八研究所 | A kind of city general utility functions platform |
| CN109862062A (en) * | 2018-10-24 | 2019-06-07 | 平安科技（深圳）有限公司 | Content uploading management method and device, electronic equipment and storage medium |
| CN111143621A (en) * | 2019-11-19 | 2020-05-12 | 京东数字科技控股有限公司 | Data auditing method and device and data processing system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113095178A (en) * | 2021-03-30 | 2021-07-09 | 北京大米科技有限公司 | Bad information detection method, system, electronic device and readable storage medium |
| CN113283730A (en) * | 2021-05-17 | 2021-08-20 | 鲁班(北京)电子商务科技有限公司 | Universal approval process application method and device |
| CN113254827A (en) * | 2021-05-21 | 2021-08-13 | 四川金熊猫新媒体有限公司 | Information release processing method and device |
| CN113592465A (en) * | 2021-09-29 | 2021-11-02 | 飞狐信息技术（天津）有限公司 | Method and device for shunting to-be-audited content, server and computer storage medium |
| CN115328463A (en) * | 2022-08-01 | 2022-11-11 | 无锡雪浪数制科技有限公司 | Design system based on visual business arrangement |
| CN115271686A (en) * | 2022-09-28 | 2022-11-01 | 北京长河数智科技有限责任公司 | Intelligent government affair data auditing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112287270A (en) | Content auditing method and device | |
| CN110851879B (en) | Method, device and equipment for infringement and evidence preservation based on evidence preservation block chain | |
| US8683311B2 (en) | Generating structured data objects from unstructured web pages | |
| US9984427B2 (en) | Data ingestion module for event detection and increased situational awareness | |
| US20100100967A1 (en) | Secure collaborative environment | |
| US20070100863A1 (en) | Newsmaker verification and commenting method and system | |
| US9369418B2 (en) | Determining additional information associated with geographic location information | |
| WO2017214213A1 (en) | Message content modification devices and methods | |
| US20160012074A1 (en) | System and method for providing contextual analytics data | |
| CN111885211A (en) | Application publishing method and device | |
| CN107403108A (en) | A kind of method and system of data processing | |
| Masters | Ethics in medical education digital scholarship: AMEE Guide No. 134 | |
| CN109087053B (en) | Collaborative office processing method, device, equipment and medium based on association topological graph | |
| CN113434588B (en) | Data mining analysis method and device based on mobile communication ticket | |
| CN110555482A (en) | Vulgar picture identification method and device based on artificial intelligence and electronic equipment | |
| Mutula et al. | Web Information management: a cross-disciplinary textbook | |
| CN111798351A (en) | Data processing method and device and readable storage medium | |
| US9021373B2 (en) | Systems and methods for webpage creation and updating | |
| Schatz et al. | Generalising event forensics across multiple domains | |
| US8769420B2 (en) | Systems and methods for webpage creation and updating | |
| CN112287104A (en) | Natural language processing method and device | |
| CN112257100A (en) | Method and device for detecting sensitive data protection effect and storage medium | |
| CN111814090A (en) | Government affair information open platform operation and maintenance management system | |
| Khan et al. | Crime management system | |
| CN115618120B (en) | Public number information pushing method, system, terminal equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |