CN112667933A - Data processing method and device, electronic equipment and computer storage medium - Google Patents

Data processing method and device, electronic equipment and computer storage medium Download PDF

Info

Publication number
CN112667933A
CN112667933A CN202011585340.7A CN202011585340A CN112667933A CN 112667933 A CN112667933 A CN 112667933A CN 202011585340 A CN202011585340 A CN 202011585340A CN 112667933 A CN112667933 A CN 112667933A
Authority
CN
China
Prior art keywords
conference
user side
url
request
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011585340.7A
Other languages
Chinese (zh)
Inventor
杨红生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Blue Cloud Network Technology Co ltd
Original Assignee
Shanghai Blue Cloud Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Blue Cloud Network Technology Co ltd filed Critical Shanghai Blue Cloud Network Technology Co ltd
Priority to CN202011585340.7A priority Critical patent/CN112667933A/en
Publication of CN112667933A publication Critical patent/CN112667933A/en
Pending legal-status Critical Current

Links

Images

Abstract

The embodiment of the application provides a data processing method, a data processing device, electronic equipment and a computer storage medium, wherein the data processing method comprises the following steps: acquiring an Http request of a user side on a webpage corresponding to conference software and identification information of the user side; determining a URL request according to a URL template corresponding to the Http request and the identification information of the user side; and extracting the conference data information stored in the webpage corresponding to the conference software according to the URL request to obtain effective data information in a preset format. The method comprises the steps of obtaining an Http request of a user side on a webpage, analyzing the Http request to obtain a URL template corresponding to the Http request, determining the URL request by combining identification information of the user side, extracting conference data information stored in the webpage according to the URL request, obtaining effective data information in a preset format, and achieving the purposes of no need of manual copying and pasting by the user, no need of steps of sorting interference parameters in the data information, format updating and the like.

Description

Data processing method and device, electronic equipment and computer storage medium
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a data processing method and device, electronic equipment and a computer storage medium.
Background
Conference software, as a popular real-time office communication tool at present, is an enterprise-level multi-end platform for communication and collaboration, and supports various forms such as mobile phones, computers, web pages and the like. Through a simple and convenient operation interface of conference software, the functions of multi-user audio or video conference, file sharing, communication of a special channel and the like can be realized, and more mobile office requirements are met.
The conference software stores a large amount of data information in the multi-person work cooperation, and some content packages need to be stored locally and are arranged into different memorandums, so that subsequent users can directly view the required data information. In the prior art, when a large amount of data information stored in conference software is collated, the recorded large amount of data information needs to be copied and pasted manually.
However, the amount of data information is large, and the data information includes interference parameters such as labels and time, so that time consumption is long when the data information is sorted, and after copying and pasting, data formats need to be sorted and updated manually, so that the operation is complex and the efficiency is low.
Disclosure of Invention
In view of this, embodiments of the present application provide a data processing method, an apparatus, an electronic device, and a computer storage medium, so as to overcome the defects in the prior art that the time consumption is long and the operation is complex when data information is collated.
In a first aspect, an embodiment of the present application provides a data processing method, where the method includes:
acquiring an Http request of a user side on a webpage corresponding to conference software and identification information of the user side;
determining a URL request according to a URL template corresponding to the Http request and the identification information of the user side;
and extracting conference data information stored in a webpage corresponding to the conference software according to the URL request to obtain effective data information in a preset format.
In a second aspect, an embodiment of the present application provides a data processing apparatus, where the apparatus includes an obtaining module, a request determining module, and an extracting module;
the acquisition module is used for acquiring an Http request of a user side on a webpage corresponding to the conference software and identification information of the user side;
the request determining module is used for determining a URL request according to a URL template corresponding to the Http request and the identification information of the user side;
the extraction module is used for extracting the conference data information stored in the webpage corresponding to the conference software according to the URL request to obtain effective data information in a preset format.
In a third aspect, an embodiment of the present application provides an electronic device, including: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus; the memory is configured to store at least one executable instruction, where the executable instruction causes the processor to perform an operation corresponding to the data processing method according to the first aspect or any one of the embodiments of the first aspect.
In a fourth aspect, the present application provides a computer storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the data processing method as described in the first aspect or any one of the embodiments of the first aspect.
The embodiment of the application provides a data processing method, a data processing device, electronic equipment and a computer storage medium, wherein the data processing method comprises the following steps: acquiring an Http request of a user side on a webpage corresponding to conference software and identification information of the user side; determining a URL request according to a URL template corresponding to the Http request and the identification information of the user side; and extracting the conference data information stored in the webpage corresponding to the conference software according to the URL request to obtain effective data information in a preset format. The method and the device for acquiring the conference information have the advantages that the Http request of the user side on the webpage corresponding to the conference software is acquired, the URL template corresponding to the Http request is acquired by analyzing the Http request, the URL request is determined by combining the identification information of the user side, and then the conference data information stored in the webpage corresponding to the conference software is extracted according to the URL request, so that the effective data information in the preset format can be acquired, the user does not need to manually copy and paste the effective data information stored in the webpage corresponding to the conference software, and the steps of sorting, format updating and the like of interference parameters in the data information are not needed.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the embodiments of the present application, and other drawings can be obtained by those skilled in the art according to the drawings.
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present application;
fig. 2 is a schematic view of a scenario for acquiring data information according to an embodiment of the present application;
fig. 3 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application shall fall within the scope of the protection of the embodiments in the present application.
It should be noted that the object in the present application is only to express the singular concept, and is not limited to be specific to a certain object, for example, the Json format object; first and second in this application are for distinguishing names and do not represent sequential relationships and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated, e.g. first ICM ID, second ICM ID, first URL template, second URL template, first URL request, second URL request.
The following further describes specific implementations of embodiments of the present application with reference to the drawings of the embodiments of the present application.
The first embodiment,
An embodiment of the present application provides a data processing method, as shown in fig. 1, fig. 1 is a flowchart of the data processing method provided in the embodiment of the present application, and the data processing method includes the following steps:
step S101, obtaining an Http request of a user side on a webpage corresponding to the conference software and identification information of the user side.
The conference software in the present application may include office software such as Microsoft Teams, outlook, Foxmail, wechat, and nailing, and the embodiment of the present application is not limited thereto, and any software used for functions such as communication, conference, video, and chat is within the scope of the present application.
It should be noted that the data processing method provided in the embodiment of the present application is applied to a web page version of conference software, and a web page corresponding to the conference software represents a web page in a desktop version of the conference software. When the user terminal sends a request to the server through the browser, the Http request is transmitted to the server. The identification information of the user side is used for representing the unique identification of the user identity, the server can identify and verify the user according to the identity identification, and respond to the search requirement of the user according to the identification information of the user side, and the identification information can comprise Cookies and Token.
The data processing method provided by the embodiment of the application can be applied to the following scenes that a plurality of employees in a certain team enter a meeting through meeting software, operations of speaking, video, discussion, uploading video, audio and text files and the like exist in the process of meeting, after the conference is finished, the conference software can record and store the data generated in the conference process as a memo, the stored data has tag information and time information, employees who do not participate in the conference can view the text content of the conference and the specified content in the conference process through the memo, employees who already participate in the conference can view the text content of the conference and the specified content in the conference process again through the memo, and the specified content in the conference process includes the conference content in a specified time period, the speaking content of a specified speaker, the uploaded data and the like. A user end clicks a function option on a webpage corresponding to conference software, as shown in fig. 2, fig. 2 is a scene schematic diagram for acquiring data information provided in an embodiment of the present application, a login scene in fig. 2 includes two function options, a function option conversion History for representing text content of a conference, and a function option Get Team TimeLines for representing specified content of a dedicated channel, when the user end clicks the login option, a monitoring tool API is called, a local agent is started, a browser is opened, and in a process of logging in the webpage corresponding to the conference software, the monitoring tool API acquires identification information of the user end; after the user clicks the function option conversion History, the server sends a Please input ID or LastMessage dialog box for prompting the user to input an ICM ID of the conversion History or last call information (LastMessage) of the conference, and after the user clicks the function option Get Team TimeLines, the server sends a Please input ID dialog box for prompting the user to input an ICM ID of the Get Team Times, wherein the ICM ID may be identification information of conference events, the ICM ID is related to each conference event, one conference event corresponds to one ICM ID, the ICM ID of the conversion History and the ICM ID of the Get Team may be the same or different, and the technical personnel in the field can set the dialog box according to the actual situation, and after the user inputs the ICM ID, the ICM ID of the conversion History and the ICM ID of the Get Team can be confirmed by clicking an OK button or cancel the confirmation is carried out, the input ICM ID is analyzed, the exclusive number corresponding to the function option can be determined, the program initiates an Http request, a URL template corresponding to the Http request is obtained by analyzing the Http request, the URL request is determined by combining the identification information of the user side, and then the conference data information stored in the webpage corresponding to the conference software according to the URL request is extracted, so that the effective data information in the preset format can be obtained.
On one hand, in the prior art, when text content of a conference is extracted through conference software, the conference content is copied, however, the conference content is more, chat interfaces are slower to refresh and cannot be selected completely, only one page can be copied, the operation is complex, and time is consumed.
On the other hand, in the prior art, when the conference software extracts the specified content of the dedicated channel, various tag information and time information are provided during copying, and after copying, formats are required to be manually sorted and updated, so that the operation is complex.
And S102, determining the URL request according to the URL template corresponding to the Http request and the identification information of the user side.
A Uniform Resource Locator (URL) is a method for identifying a Resource location and an access method, and is an address of a standard Resource on the internet, each file on the internet has a unique URL, and information included in the URL indicates a location of the file and how the browser should process the file. The server can be configured with a plurality of URL templates in advance, the URL templates correspond to the Http request, the URL templates can represent the replacement content in the URL templates by the placeholder information, the placeholder information is replaced by the corresponding parameters in the Http request, the URL requests are automatically generated based on the URL templates corresponding to the Http request and the identification information of the user side, manual writing and providing are not needed, URL requests corresponding to the Http request can be generated, URL requests to be captured can also be generated in batch, the capture development cost is reduced, data processing resources and processing time are saved, and the working efficiency is improved.
Step S103, conference data information stored in a webpage corresponding to the conference software is extracted according to the URL request, and effective data information in a preset format is obtained.
The preset format may be set by a person skilled in the art according to an actual situation, for example, the preset format may be a lightweight data interchange (Json) format, may be an Extensible Markup Language (XML) format, and is only required to be serialized data, so as to facilitate reading and writing by a user, and the embodiment of the present application is not limited. In the embodiment of the application, the URL request comprises the path and specific content information of the request data, a great amount of conference data information is stored in the conference data information stored in the webpage corresponding to the conference software, and after the URL request is obtained by the server, the conference data information stored in the webpage corresponding to the conference software is extracted according to the URL request, so that effective data information in a preset format is obtained, the steps of manually copying and pasting the effective data information stored in the webpage corresponding to the conference software by a user, sorting interference parameters in the data information, updating the format and the like are not needed, the operation is simple and convenient, and the working efficiency is improved.
Example II,
Based on the solution of the first embodiment, the step S101 in the first embodiment can also be implemented as the following step S101 a-step S101 e.
Step S101a, acquiring the function options clicked by the user side and the ICM ID corresponding to the function options input by the user side; step S101b, initiating a request for inquiring a conference list to a server; step S101c, after the conference list information returned by the server is analyzed, matching is carried out with the current ICM ID, and whether the current conference list information comprises the ICM ID is judged; step S101d, if the current conference list information includes ICM ID, determining the conference information according to ICM ID, and determining the exclusive ID corresponding to the function option according to the conference information; step S101e, acquiring an Http request of the user end on a web page corresponding to the conference software according to the exclusive ID.
The ICM ID in this embodiment of the application may be understood as an inclusion ID, and is used to represent identification information related to a function option input by a user, and for example, the function option is used to extract text content or dedicated channel specific content of a conference in a certain conference event.
According to the embodiment of the application, a user who acquires conference information clicks a button of a function option and a user side inputs an ICM ID corresponding to the function option, then a request for inquiring a conference list is sent to a server, the server returns the conference list information, the conference list information returned by the server is analyzed and then matched with the current ICM ID, whether the current conference list information comprises the input ICM ID or not is judged, if the current conference list information comprises the input ICM ID, the conference information is determined according to the ICM ID, an exclusive ID corresponding to the function option is determined according to the conference information, and then an Http request of the user side on a webpage corresponding to conference software is acquired according to the exclusive ID, so that a URL request is determined according to a URL template corresponding to the Http request and identification information of the user side.
Optionally, in an embodiment of the present application, the function options include a function option for characterizing extraction of text content of the conference and a function option for characterizing extraction of specified content of the dedicated channel; the ICM ID includes a first ICM ID corresponding to the conference and a second ICM ID corresponding to the dedicated channel; the URL template comprises a first URL template used for extracting the text content of the conference and a second URL template used for extracting the appointed content of the special channel; the URL request includes a first URL request corresponding to the meeting and a second URL request corresponding to the dedicated channel.
The functional options in the embodiment of the application include two functional options, one is a functional option for representing and extracting text content of a conference, and the other is a functional option for representing and extracting specified content of a dedicated channel, where the text content of the conference may be text content generated in the whole process of the conference, and the specified content of the dedicated channel may conform to communication records of a preset rule and a preset format, for example, conference content of a specified time period, speech content of a specified speaker, and specified uploaded materials. The ICM IDs input by the user may be the same or different, and in this embodiment, different ICM IDs are used as an example, where the different ICM IDs correspond to different function options, for example, the ICM IDs include a first ICM ID corresponding to the conference and a second ICM ID corresponding to the dedicated channel; the method comprises the steps that the function options are different, and the corresponding URL templates are different, wherein the URL templates in the embodiment of the application comprise a first URL template used for extracting text contents of a conference and a second URL template used for extracting appointed contents of a special channel; correspondingly, the function options are different, and the corresponding URL requests are also different, and the URL requests comprise a first URL request corresponding to the conference and a second URL request corresponding to the special channel. The embodiment of the application provides a scheme for searching the text content of the conference and the designated content of the dedicated channel, thereby facilitating different requirements of users and improving the user experience.
In step S101, optionally, in an embodiment of the present application, when the user terminal clicks the login option, the monitoring tool API is called, the local agent is started, the browser is opened, and the monitoring tool API obtains the identification information of the user terminal in the process of logging in the webpage corresponding to the conference software.
In the embodiment of the Application, when a user clicks a login option, a monitoring tool, an Application Programming Interface (API), which can be understood as a Dynamic Link Library (DLL), is a packet capturing tool, and automatically opens a local agent, where the local agent can be understood as an agent for monitoring data records generated when a user accesses a website by using a local network, and opens the local agent to trigger opening of a browser, and therefore, the monitoring tool API can capture identification information of the user in a process of logging in a webpage corresponding to conference software. The identification information is Token, which is generated at the server, and if the user uses a user name or a password to request authentication from the server, the server successfully authenticates, the server returns Token to the user, and the user can take Token to prove the legal status of the user each time the user requests to access the website. According to the embodiment of the application, the identification information necessary for accessing the website is acquired through the packet capturing tool (monitoring tool API), and the identification information of the user side is combined with the URL template corresponding to the Http request to generate the URL request, so that the conference data information is extracted according to the URL request, the operation is simple and convenient, and the working efficiency is improved.
Optionally, the listening tool is Fiddler Core.
The Fiddler Core API can capture the identification information of the user side and is used for generating the URL request by combining the URL template corresponding to the Http request, so that the conference data information is extracted according to the URL request, the operation is simple and convenient, and the working efficiency is improved.
Fiddler is a server debugging agent that can record all Http and Http traffic sent by a computer and can compare the response with the business data to obtain the access mode of the data service. The Fiddler Core API acts as a listening agent for the server, and all Http requests from the Microsoft Internet services go through Fiddle before arriving at the target server, and similarly, all Http responses go through Fiddler before returning to the client. The monitoring tool Fiddler Core API may monitor the call of the data, when the client initiates an Http request link to the server, for example, the client sends an Http request to the monitoring tool Fiddler Core API, the monitoring tool Fiddler Core API receives the Http request of the client and sends the Http request to the server, the server receives the Http request, obtains corresponding feedback data information, and sends the feedback data information to the monitoring tool Fiddler Core API, and the monitoring tool Fiddler Core API returns the feedback data information to the client.
Optionally, in an embodiment of the present application, obtaining, by the monitoring tool API, the identification information of the user side may further be implemented as the following steps: acquiring Cookies corresponding to the user side by using the monitoring tool API; acquiring Token URL information according to Cookies corresponding to the user side; and initiating a request according to the Token URL information, and determining a Token corresponding to the user side, wherein the identification information of the user side comprises Cookies and the Token.
The Token in the embodiment of the application represents the identity information of the user side and serves as a Token for the user side to request, the Token can be generated by the server into a string of character strings, after the user side logs in for the first time, the server generates a Token and returns the Token to the user side, and the user side only needs to take the Token to request data later, and does not need to take the user name and the password again. After receiving Token, the client may store Token, for example, in Cookie or Local Storage. For example, in the embodiment of the present application, a Token corresponding to a user side may be directly obtained by a monitoring tool API, where the identification information of the user side includes the Token, the Token corresponding to the user side is not changed for a period of time, but the Token is time-efficient, the user needs to re-verify after a period of time, and if the Token expires, and the user side cannot successfully request data, the monitoring tool API needs to obtain Cookies corresponding to the user side first; acquiring Token URL information according to Cookies corresponding to the user side; and initiating a request according to the Token URL information to obtain a Token corresponding to the user side.
Optionally, in an embodiment of the present application, after acquiring the identification information of the user side, the method further includes: the listener API is closed as well as the home agent.
After Cookies and Token of a user side are obtained, the Fiddler Core API and the local agent can be automatically closed, and data processing resources are saved.
Optionally, in an embodiment of the present application, after the user logs in successfully, if the same user logs in the web page corresponding to the conference software again within a preset time period, the Cookies corresponding to the user and the Token URL information corresponding to the user are directly used to obtain the Token corresponding to the user.
The Cookies are the same in a period of time, a preset time period is further set in the embodiment of the present application, for example, one month, three months, and the like, specific time can be set by a person skilled in the art according to actual conditions or a large number of experimental results, and the embodiment of the present application is not limited as long as the Cookies of the user side are not changed in the preset time period, when the same user side logs in the webpage corresponding to the conference software again in the preset time period, the Cookies corresponding to the webpage corresponding to the conference software again are directly obtained, the tokens corresponding to the user side are directly obtained by using the Cookies and Token URL information corresponding to the user side, and the capturing of the Cookies is realized without calling a monitoring tool API and starting a local agent, so that a data processing process and computing resources are saved, and the working efficiency is improved. If the user logs in beyond the preset time period, the Cookies need to be regenerated, namely, the local agent is started by calling the monitoring tool API, so that the Cookies are captured, and then the Token corresponding to the user is obtained according to the Cookies and the Token URL information.
Optionally, in an embodiment of the present application, the step S104 in the first embodiment may also be implemented as the following steps S104a-S104 d: step S104a, extracting conference data information stored in a webpage corresponding to the conference software according to the URL request, and acquiring Json format data; step S104b, performing reverse serialization on the Json format data to generate a Json format object corresponding to the Json format data; step S104c, determining a Json format target object from the Json format objects; step S104d, generating an Html file according to data corresponding to the Json format target object; s104e, adding an Html tag to the Html file, and formatting to obtain effective data information in a preset format.
The Json format data is convenient for a user to read and write, is convenient for a machine to analyze and generate, and needs to be converted to know the serialization mode of the data when the data is transmitted and exchanged. The Json format data is in a serialization structure data exchange format, conference data information stored in a webpage corresponding to conference software is extracted according to a URL request, Json format data is obtained, then reverse serialization processing is carried out on the Json format data, a Json format Object corresponding to the Json format data is generated, Object Oriented development programming is achieved, and a Json format target Object is determined from the Json format Object; and generating an Html file according to data corresponding to the Json format target object, starting analyzing an Html code after the browser acquires the Html file, or requesting a server to download resources, rendering the requested resources and the Html code by the browser by using an internal working mechanism, adding an Html tag to the Html file, and formatting to obtain effective data information in a preset format. The Json format data are subjected to reverse serialization to generate a Json format object, object-oriented development programming is achieved, the data processing process is reduced, a Json format target object is determined from the Json format object, an Html file is generated according to data corresponding to the Json format target object, and then formatting is performed after an Html tag is added to the Html file, so that the accuracy of obtaining effective data information in a preset format is improved, and the working efficiency is improved.
Further, the conference software is taken as the example of the Teams software, and a specific example is taken to describe the data extraction in the Teams webpage in the embodiment of the present application, which can be realized by the following scheme.
As shown in fig. 2 in the first embodiment, the user side can extract text content of the conference by clicking the "conversion History" button on the server interface, and the user side can extract specified content of the dedicated channel by clicking the "Get Team timeliness" button on the server interface. After the two buttons are clicked, the corresponding ICM ID is required to be input, the input ICM ID is analyzed, the exclusive number corresponding to the function option can be determined, and the program initiates an Http request, namely, the text content related to the conference and the specified content of the special channel can be extracted.
In the embodiment of the application, the server acquires an Http request of the user terminal on a team webpage according to the exclusive number, acquires a URL template for acquiring text contents of a conference and specific channel specific contents by analyzing the Http request of a Microsoft team webpage version, acquires Token by combining the analysis of the Http request, sends the URL request corresponding to the text contents of the conference and the specific channel specific contents through Http client, and processes returned Json format data, such as adjusting the size of characters, adjusting the spacing and the like, extracts related characters and performs formatting processing. It should be noted that the URL request templates for extracting the text contents of the conference and the specific channel designation contents are different.
In the above operation of extracting data, the most important is to obtain Cookies and tokens of the temes webpage version, which can be specifically realized by the following method:
(1) when the user side logs in on click, a Fiddler Core API is called, and a local agent is started;
(2) opening an IE browser, and logging in a web page version Teams;
(3) as the local proxy is started, Cookies and Token can be captured in the login process, when the Token corresponding to the user side is obtained, for example, the Cookies can be obtained firstly, Token URL information can be obtained according to the Cookies, a request can be initiated according to the Token URL information, and the Token corresponding to the user side can be obtained;
(4) after Cookies and Token are obtained, the local agent can be automatically closed;
(5) analyzing the obtained URL template and related parameters according to the Http request on the Teams webpage version, and then adding Cookies and Token to send out the Http request;
(6) and formatting and outputting the data result returned according to the Http request.
The example is described by taking conference software as the Teams software as an example, and it can be understood that the extraction of data in the web page provided by the example is also applicable to other conference software or office software, and the embodiment of the present application is not limited thereto.
At present, the temas web page version belongs to the communication work newly developed by microsoft, and the introduction of documents for extracting contents in the temas web page version is less, and technical personnel in the field do not have the right to call the API related to microsoft at present, and only have the access right of the temas software, so to realize the function of extracting text contents of a conference and specified contents of a dedicated channel, a user side generates thousands of Http requests in the process of logging in the temas web page, the thousands of Http requests include a URL request requesting a current conference list, a URL request requesting Cookies, a URL request requesting Token, and the like, and the thousands of Http requests need to be filtered and analyzed to find a URL request corresponding to a user requirement, and the association relationship between different URL requests needs to be cleared, which is time-consuming and labor-consuming. According to the embodiment of the application, the Fiddler Core API is adopted to capture the URL request related to the request for logging in the Teams webpage edition Http, the reusable information (Cookies) is analyzed and stored, a basis is provided for automatically capturing the Teams related information by a program, the time is saved, and the working efficiency is improved.
The server returns Json format type data according to the related URL request, reverse serialization is needed to be carried out on the data, a related Json data object is generated and returned, programming is carried out on the object, working efficiency can be improved, the needed Json data target object is found in the Json data object, the Json data target object is written into a temporary Html file, and formatting is carried out after the Html tag is added to the Html file, so that effective Json format data in the preset format are obtained. Since the text content of the extracted conference and the specified content of the dedicated channel are different in URL request, the generated Json data object is also different, the written temporary Html file is also different, and the added Html tag is also different. According to the data processing method provided by the embodiment of the application, after the tool development is completed, the tool is used for extracting the text content of the conference and the specified content of the special channel, all related text content can be extracted in real time and formatted according to the conference and the special number of the channel each time, the number is reduced to about 30 seconds from the previous 10 minutes, and the working efficiency is greatly improved.
Example III,
An embodiment of the present application provides a data processing apparatus, as shown in fig. 3, fig. 3 is the data processing apparatus provided in the embodiment of the present application, and the data processing apparatus 30 includes an obtaining module 301, a request determining module 302, and an extracting module 303; the obtaining module 301 is configured to obtain an Http request of a user terminal on a webpage corresponding to the conference software and identification information of the user terminal; the request determining module 302 is configured to determine a URL request according to a URL template corresponding to the Http request and the identification information of the user side; the extracting module 303 is configured to extract conference data information stored in a webpage corresponding to the conference software according to the URL request, and obtain valid data information in a preset format.
Optionally, in an embodiment of the present application, the obtaining module 301 is further configured to obtain a function option clicked by the user side and an ICM ID corresponding to the function option and input by the user side; initiating a request for inquiring a conference list to a server; after analyzing the conference list information returned by the server, matching the conference list information with the current ICM ID, and judging whether the current conference list information comprises the ICM ID; if the current conference list information comprises an ICM ID, determining conference information according to the ICM ID, and determining an exclusive ID corresponding to the functional option according to the conference information; and acquiring an Http request of the user side on a webpage corresponding to the conference software according to the exclusive ID.
Optionally, in an embodiment of the present application, the function options include a function option for characterizing extraction of text content of the conference and a function option for characterizing extraction of specified content of the dedicated channel; the ICM ID includes a first ICM ID corresponding to the conference and a second ICM ID corresponding to the dedicated channel; the URL template comprises a first URL template used for extracting the text content of the conference and a second URL template used for extracting the appointed content of the special channel; the URL request includes a first URL request corresponding to the meeting and a second URL request corresponding to the dedicated channel.
Optionally, in an embodiment of the present application, the obtaining module 301 is further configured to call a monitoring tool API when the user terminal clicks the function option, open the local agent, open the browser, and obtain the identification information of the user terminal through the monitoring tool API in a process of logging in a webpage corresponding to the conference software.
Optionally, in an embodiment of the present application, the obtaining module 301 is further configured to obtain Cookies corresponding to the user side by the monitoring tool API; acquiring Token URL information according to Cookies corresponding to the user side; and initiating a request according to the Token URL information, and determining a Token corresponding to the user side, wherein the identification information of the user side comprises Cookies and the Token.
Optionally, in an embodiment of the present application, the data processing apparatus further includes a shutdown module, where the shutdown module is configured to shutdown the listening tool API and the home agent.
Optionally, in one embodiment of the present application, the listening tool is a Fiddler Core.
Optionally, in an embodiment of the application, the login module is further configured to, after the user logs in successfully, obtain the Token corresponding to the user by directly using Cookies and Token URL information corresponding to the user if the same user logs in the web page corresponding to the conference software again within a preset time period.
Optionally, in an embodiment of the present application, the data processing apparatus further includes an extracting module 303, where the extracting module 303 is configured to extract, according to the URL request, meeting data information stored in a webpage corresponding to the meeting software, and acquire data in a Json format; performing reverse serialization on the Json format data to generate a Json format object corresponding to the Json format data; determining a Json format target object from the Json format objects; generating an Html file according to data corresponding to the Json format target object; and adding an Html tag to the Html file, and then formatting to obtain effective data information in a preset format.
The data processing apparatus of this embodiment is configured to implement the corresponding data processing method in the foregoing multiple method embodiments, and has the beneficial effects of the corresponding method embodiment, which are not described herein again. In addition, the functional implementation of each module in the data processing apparatus of this embodiment can refer to the description of the corresponding part in the foregoing method embodiment, and is not repeated here.
Example four,
Based on any data processing method described in the first embodiment and the second embodiment, the embodiment of the present application provides an electronic device, and it should be noted that the data processing method of the present embodiment may be executed by any suitable electronic device with data processing capability, including but not limited to: server, mobile terminal (such as mobile phone, PAD, etc.), PC, etc. As shown in fig. 4, fig. 4 is a structural diagram of an electronic device according to an embodiment of the present application. The specific embodiments of the present application do not limit the specific implementation of the electronic device. The electronic device 40 may include: a processor (processor)402, a Communications Interface 404, a memory 406, and a Communications bus 408.
Wherein: the processor 402, communication interface 404, and memory 406 communicate with each other via a communication bus 408.
A communication interface 404 for communicating with other electronic devices or servers.
The processor 402 is configured to execute the computer program 410, and may specifically perform relevant steps in the above-described data processing method embodiment.
In particular, the computer program 410 may comprise computer program code comprising computer operating instructions.
The processor 402 may be a central processing unit CPU, or an application Specific Integrated circuit asic, or one or more Integrated circuits configured to implement embodiments of the present application. The intelligent device comprises one or more processors which can be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.
A memory 406 for storing a computer program 410. Memory 406 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.
It can be understood that, for convenience and brevity of description, it can be clearly understood by those skilled in the art that the specific working processes of the above-described devices and modules may refer to the corresponding process descriptions in the foregoing method embodiments, and are not described herein again.
Example V,
Based on the data processing methods described in the first and second embodiments, an embodiment of the present application provides a computer storage medium storing a computer program that, when executed by a processor, implements the data processing methods described in the first and second embodiments.
It should be noted that, according to the implementation requirement, each component/step described in the embodiment of the present application may be divided into more components/steps, and two or more components/steps or partial operations of the components/steps may also be combined into a new component/step to achieve the purpose of the embodiment of the present application.
The above-described methods according to embodiments of the present application may be implemented in hardware, firmware, or as software or computer code storable in a recording medium such as a CD ROM, a RAM, a floppy disk, a hard disk, or a magneto-optical disk, or as computer code originally stored in a remote recording medium or a non-transitory machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the methods described herein may be stored in such software processes on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware such as an ASIC or FPGA. It will be appreciated that the computer, processor, microprocessor controller or programmable hardware includes memory components (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code that, when accessed and executed by the computer, processor or hardware, implements the data processing methods described herein. Further, when a general-purpose computer accesses code for implementing the data processing method shown herein, execution of the code converts the general-purpose computer into a special-purpose computer for executing the data processing method shown herein.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
Those of ordinary skill in the art will appreciate that the various illustrative elements and method steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the embodiments of the present application.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above embodiments are only used for illustrating the embodiments of the present application, and not for limiting the embodiments of the present application, and those skilled in the relevant art can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application, so that all equivalent technical solutions also belong to the scope of the embodiments of the present application, and the scope of patent protection of the embodiments of the present application should be defined by the claims.
The embodiment of the application provides the following technical scheme:
1. a method of data processing, the method comprising:
acquiring an Http request of a user side on a webpage corresponding to conference software and identification information of the user side;
determining a URL request according to a URL template corresponding to the Http request and the identification information of the user side;
and extracting conference data information stored in a webpage corresponding to the conference software according to the URL request to obtain effective data information in a preset format.
2. The method of claim 1, wherein the obtaining of the Http request of the user terminal on the web page corresponding to the conference software comprises:
acquiring a function option clicked by the user side and an ICM ID which is input by the user side and corresponds to the function option;
initiating a request for inquiring a conference list to a server;
after analyzing the conference list information returned by the server, matching the conference list information with the current ICM ID, and judging whether the current conference list information comprises the ICM ID;
if the current conference list information comprises the ICM ID, determining conference information according to the ICM ID, and determining an exclusive ID corresponding to the functional option according to the conference information;
and acquiring the Http request of the user side on the webpage corresponding to the conference software according to the exclusive ID.
3. The method of claim 2, wherein the function options include a function option for characterizing extraction of text content of the meeting and a function option for characterizing extraction of specified content of the dedicated channel; the ICM ID includes a first ICM ID corresponding to the conference and a second ICM ID corresponding to the dedicated channel; the URL template comprises a first URL template used for extracting the text content of the conference and a second URL template used for extracting the appointed content of the special channel; the URL request includes a first URL request corresponding to the meeting and a second URL request corresponding to the dedicated channel.
4. The method of claim 1, wherein the obtaining the identification information of the user end comprises:
and when the user side clicks the function option, calling a monitoring tool API, starting a local proxy, opening a browser, and acquiring the identification information of the user side by the monitoring tool API in the process of logging in the webpage corresponding to the conference software.
5. The method of claim 4, wherein obtaining, by the listener API, the identification information of the user side comprises:
obtaining Cookies corresponding to the user side by the monitoring tool API;
acquiring Token URL information according to Cookies corresponding to the user side;
and initiating a request according to the Token URL information, and determining a Token corresponding to the user side, wherein the identification information of the user side comprises the Cookies and the Token.
6. The method according to claim 4 or 5, wherein after acquiring the identification information of the user side, the method further comprises: closing the listener API and the home agent.
7. The method of claim 4 or 5, wherein the listening tool is a Fiddler Core.
8. The method of claim 5, further comprising:
after the user side successfully logs in, if the same user side logs in the webpage corresponding to the conference software again within a preset time period, the Cookies corresponding to the user side and the Token URL information are directly used for obtaining the Token corresponding to the user side.
9. The method of claim 1, wherein extracting the conference data information stored in the web page corresponding to the conference software according to the URL request to obtain valid data information in a preset format comprises:
extracting conference data information stored in a webpage corresponding to the conference software according to the URL request to acquire Json format data;
performing reverse serialization on the Json format data to generate a Json format object corresponding to the Json format data;
determining a Json format target object from the Json format objects;
generating an html file according to the data corresponding to the Json format target object;
and adding an html tag to the html file and then formatting to obtain the valid data information in the preset format.
10. A data processing device is characterized by comprising an acquisition module, a request determination module and an extraction module;
the acquisition module is used for acquiring an Http request of a user side on a webpage corresponding to the conference software and identification information of the user side;
the request determining module is used for determining a URL request according to a URL template corresponding to the Http request and the identification information of the user side;
the extraction module is used for extracting the conference data information stored in the webpage corresponding to the conference software according to the URL request to obtain effective data information in a preset format.
11. An electronic device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;
the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the corresponding operation of the data processing method according to any one of claims 1-9.
12. A computer storage medium, characterized in that a computer program is stored thereon, which program, when being executed by a processor, carries out the data processing method of any one of claims 1-9.

Claims (10)

1. A method of data processing, the method comprising:
acquiring an Http request of a user side on a webpage corresponding to conference software and identification information of the user side;
determining a URL request according to a URL template corresponding to the Http request and the identification information of the user side;
and extracting conference data information stored in a webpage corresponding to the conference software according to the URL request to obtain effective data information in a preset format.
2. The method of claim 1, wherein the obtaining of the Http request of the user terminal on the web page corresponding to the conference software comprises:
acquiring a function option clicked by the user side and an ICMID (Internet control information identification) corresponding to the function option input by the user side;
initiating a request for inquiring a conference list to a server;
after analyzing the conference list information returned by the server, matching the conference list information with the current ICM ID, and judging whether the current conference list information comprises the ICM ID;
if the current conference list information comprises the ICMID, determining conference information according to the ICMID, and determining an exclusive ID corresponding to the functional option according to the conference information;
and acquiring the Http request of the user side on the webpage corresponding to the conference software according to the exclusive ID.
3. The method of claim 2, wherein the function options include a function option for characterizing extraction of text content of the meeting and a function option for characterizing extraction of specified content of the dedicated channel; the ICM ID includes a first ICM ID corresponding to the conference and a second ICM ID corresponding to the dedicated channel; the URL template comprises a first URL template used for extracting the text content of the conference and a second URL template used for extracting the appointed content of the special channel; the URL request includes a first URL request corresponding to the meeting and a second URL request corresponding to the dedicated channel.
4. The method of claim 1, wherein the obtaining the identification information of the user end comprises:
and when the user side clicks the function option, calling a monitoring tool API, starting a local proxy, opening a browser, and acquiring the identification information of the user side by the monitoring tool API in the process of logging in the webpage corresponding to the conference software.
5. The method of claim 4, wherein obtaining, by the listener API, the identification information of the user side comprises:
obtaining Cookies corresponding to the user side by the monitoring tool API;
acquiring Token URL information according to Cookies corresponding to the user side;
and initiating a request according to the Token URL information, and determining a Token corresponding to the user side, wherein the identification information of the user side comprises the Cookies and the Token.
6. The method of claim 5, further comprising:
after the user side successfully logs in, if the same user side logs in the webpage corresponding to the conference software again within a preset time period, the Cookies corresponding to the user side and the Token URL information are directly used for obtaining the Token corresponding to the user side.
7. The method of claim 1, wherein extracting the conference data information stored in the web page corresponding to the conference software according to the URL request to obtain valid data information in a preset format comprises:
extracting conference data information stored in a webpage corresponding to the conference software according to the URL request to acquire Json format data;
performing reverse serialization on the Json format data to generate a Json format object corresponding to the Json format data;
determining a Json format target object from the Json format objects;
generating an html file according to the data corresponding to the Json format target object;
and adding an html tag to the html file and then formatting to obtain the valid data information in the preset format.
8. A data processing device is characterized by comprising an acquisition module, a request determination module and an extraction module;
the acquisition module is used for acquiring an Http request of a user side on a webpage corresponding to the conference software and identification information of the user side;
the request determining module is used for determining a URL request according to a URL template corresponding to the Http request and the identification information of the user side;
the extraction module is used for extracting the conference data information stored in the webpage corresponding to the conference software according to the URL request to obtain effective data information in a preset format.
9. An electronic device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;
the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the corresponding operation of the data processing method according to any one of claims 1-9.
10. A computer storage medium, characterized in that a computer program is stored thereon, which program, when being executed by a processor, carries out the data processing method of any one of claims 1-9.
CN202011585340.7A 2020-12-28 2020-12-28 Data processing method and device, electronic equipment and computer storage medium Pending CN112667933A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011585340.7A CN112667933A (en) 2020-12-28 2020-12-28 Data processing method and device, electronic equipment and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011585340.7A CN112667933A (en) 2020-12-28 2020-12-28 Data processing method and device, electronic equipment and computer storage medium

Publications (1)

Publication Number Publication Date
CN112667933A true CN112667933A (en) 2021-04-16

Family

ID=75411352

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011585340.7A Pending CN112667933A (en) 2020-12-28 2020-12-28 Data processing method and device, electronic equipment and computer storage medium

Country Status (1)

Country Link
CN (1) CN112667933A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115190174A (en) * 2022-07-07 2022-10-14 深圳证券通信有限公司 Data processing method and device, computer equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040019518A1 (en) * 2000-03-22 2004-01-29 Comscore Networks, Inc. Systems for and methods of user demographic reporting usable for indentifying users and collecting usage data
CN105843808A (en) * 2015-01-13 2016-08-10 丰小月 Computer conference real-time information extraction method based on anchor tag and time stamp
US20180081983A1 (en) * 2016-09-16 2018-03-22 Oracle International Corporation Cookie based state propagation for a multi-tenant identity cloud service
US20180341986A1 (en) * 2016-06-03 2018-11-29 Tencent Technology (Shenzhen) Company Limited Information processing method, terminal, backgroundserver and system, storage medium
CN109543085A (en) * 2018-11-15 2019-03-29 中电科嘉兴新型智慧城市科技发展有限公司 Data extraction method, device and computer readable storage medium
CN110738024A (en) * 2019-09-24 2020-01-31 深圳丝路天地电子商务有限公司 Method for converting WebAPP into API service interface

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040019518A1 (en) * 2000-03-22 2004-01-29 Comscore Networks, Inc. Systems for and methods of user demographic reporting usable for indentifying users and collecting usage data
CN105843808A (en) * 2015-01-13 2016-08-10 丰小月 Computer conference real-time information extraction method based on anchor tag and time stamp
US20180341986A1 (en) * 2016-06-03 2018-11-29 Tencent Technology (Shenzhen) Company Limited Information processing method, terminal, backgroundserver and system, storage medium
US20180081983A1 (en) * 2016-09-16 2018-03-22 Oracle International Corporation Cookie based state propagation for a multi-tenant identity cloud service
CN109543085A (en) * 2018-11-15 2019-03-29 中电科嘉兴新型智慧城市科技发展有限公司 Data extraction method, device and computer readable storage medium
CN110738024A (en) * 2019-09-24 2020-01-31 深圳丝路天地电子商务有限公司 Method for converting WebAPP into API service interface

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
曾健荣;张仰森;郑佳;黄改娟;陈若愚;: "面向多数据源的网络爬虫实现技术及应用", 计算机科学, no. 05 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115190174A (en) * 2022-07-07 2022-10-14 深圳证券通信有限公司 Data processing method and device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
CN108319547B (en) Test case generation method, device and system
US9092758B2 (en) Service providing apparatus, information processing system and methods
US11936760B2 (en) Method and system of generating generic protocol handlers
CN109739717B (en) Page data acquisition method and device and server
US20130054792A1 (en) Cloud-based performance testing of functionality of an application prior to completion of development
US10673912B2 (en) Join feature restoration to online meeting
US8370859B2 (en) Creating web services from an existing web site
US20130111011A1 (en) Server-side tracing of requests
US11082456B2 (en) Automated agent for a web communication feature
CN104618412A (en) Page skipping method and device
US9459913B2 (en) System and method for providing print ready content to a printing device
CN111885211A (en) Application publishing method and device
CN109829123A (en) A kind of method for sending information and device
WO2022000888A1 (en) Apparatus and method for executing customized artificial intelligence production line, and device and medium
CN111880858A (en) Document processing and instant messaging method, device, electronic equipment and storage medium
CN112667933A (en) Data processing method and device, electronic equipment and computer storage medium
WO2021093672A1 (en) Method for embedding external system, workflow system, device and computer readable storage medium
CN116185871A (en) Cloud-edge collaborative mobile barrier-free experience and evaluation system and method
CN110659006A (en) Cross-screen display method and device, electronic equipment and readable storage medium
JP5061316B1 (en) Communication packet analyzer
CN112988872A (en) Interface document management method and device, storage medium and electronic equipment
JP2010097583A (en) Record browsing system
EP1674991A2 (en) System and method for creating web services from an existing web site
US11775935B1 (en) Archiving whiteboard events
CN112565106B (en) Traffic service identification method, device, equipment and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination