WO2021218177A1 - 页面数据生成方法、装置、计算机设备及存储介质 - Google Patents

页面数据生成方法、装置、计算机设备及存储介质 Download PDF

Info

Publication number
WO2021218177A1
WO2021218177A1 PCT/CN2020/136016 CN2020136016W WO2021218177A1 WO 2021218177 A1 WO2021218177 A1 WO 2021218177A1 CN 2020136016 W CN2020136016 W CN 2020136016W WO 2021218177 A1 WO2021218177 A1 WO 2021218177A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
binning
information
service terminal
terminal
Prior art date
Application number
PCT/CN2020/136016
Other languages
English (en)
French (fr)
Inventor
周学立
朱恩东
张茜
凌海挺
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2021218177A1 publication Critical patent/WO2021218177A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/602Providing cryptographic facilities or services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6245Protecting personal data, e.g. for financial or medical purposes

Definitions

  • This application relates to the field of data processing, and in particular to a method, device, computer equipment and storage medium for generating page data.
  • the page display system will display different page data according to different users. Therefore, the page display system obtains the page data by communicating with the data supporter.
  • data security is often taken into consideration, so that a large number of encryption operations are performed on the data.
  • the number of users increases, the amount of data calculations increases, which in turn leads to page display systems and data During the information exchange process of the supporting party, the pressure of data processing and data transmission increased.
  • the embodiments of the present application provide a page data generation method, device, computer equipment, and storage medium to solve the problem of high data processing and data transmission pressure in the system.
  • a method for generating page data including:
  • the request access instruction instructs the service terminal to access the data partition corresponding to the bin number, and compare the sample information and the access request instruction corresponding to the bin number
  • the data information of the data partition corresponding to the bin number is calculated by the engine to obtain an intermediate result
  • a page data generating device including:
  • the binning processing module is configured to perform binning processing on the to-be binned data in the database according to a preset binning strategy to obtain binning information and data partitions of the to-be binned data;
  • the binning information sending module is used to send the binning information to the service terminal to instruct the service terminal to hash the data samples according to the binning information to obtain the binning number, the binning number Used to indicate the corresponding data partition;
  • the binning number receiving module is configured to receive the binning number and an access request instruction returned by the service terminal.
  • the access requesting instruction instructs the service terminal to access the data partition corresponding to the binning number, and
  • the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number are calculated by the engine to obtain an intermediate result;
  • the first engine calculation module is configured to receive the intermediate result sent by the service terminal, and perform engine calculation on the intermediate result to obtain a calculation result;
  • a calculation result sending module configured to send the calculation result to the service terminal to instruct the service terminal to integrate the calculation result to obtain page data
  • the page data receiving module is configured to receive the page data sent by the service terminal to display the page according to the page data.
  • a computer device includes a memory, a processor, and computer-readable instructions that are stored in the memory and can run on the processor, and the processor implements the following steps when the processor executes the computer-readable instructions:
  • the request access instruction instructs the service terminal to access the data partition corresponding to the bin number, and compare the sample information and the access request instruction corresponding to the bin number
  • the data information of the data partition corresponding to the bin number is calculated by the engine to obtain an intermediate result
  • a computer device includes a memory, a processor, and computer-readable instructions that are stored in the memory and can run on the processor, and the processor implements the following steps when the processor executes the computer-readable instructions:
  • binning information a hash operation is performed on the data sample to obtain the binning number corresponding to the data sample, and the binning number is used to indicate the data corresponding to the binning number in the data support terminal Partitioning, where the data partition is that the data support terminal performs binning processing on the data to be binned in the database according to a preset binning strategy;
  • the page data is sent to the data support terminal to instruct the data support terminal in question to display the page according to the page data.
  • One or more readable storage media storing computer readable instructions, when the computer readable instructions are executed by one or more processors, the one or more processors execute the following steps:
  • One or more readable storage media storing computer readable instructions, when the computer readable instructions are executed by one or more processors, the one or more processors execute the following steps:
  • binning information a hash operation is performed on the data sample to obtain the binning number corresponding to the data sample, and the binning number is used to indicate the data corresponding to the binning number in the data support terminal Partitioning, where the data partition is that the data support terminal performs binning processing on the data to be binned in the database according to a preset binning strategy;
  • the page data is sent to the data support terminal to instruct the data support terminal in question to display the page according to the page data.
  • the above-mentioned page data generation method, device, computer equipment, and storage medium perform a one-way binning operation on the data through the hash binning method, so that the original database becomes a distributed database.
  • the page display system, recommendation system, voice assistant or precision advertising system needs to obtain data from the data supporter, the corresponding data can be obtained quickly, which effectively reduces the magnitude and complexity of the overall calculation of the system, thereby reducing data transmission Stress and save time.
  • page data can be quickly generated. For example, when the page system generates page data information corresponding to the user, it can obtain more accurate and comprehensive page data information, that is, page data.
  • FIG. 1 is a schematic diagram of an application environment of a method for generating page data in an embodiment of the present application
  • FIG. 2 is a flowchart of a method for generating page data in an embodiment of the present application
  • FIG. 3 is another flowchart of a method for generating page data in an embodiment of the present application
  • FIG. 4 is another flowchart of a method for generating page data in an embodiment of the present application.
  • FIG. 5 is another flowchart of a method for generating page data in an embodiment of the present application.
  • Fig. 6 is a functional block diagram of a page data generating device in an embodiment of the present application.
  • FIG. 7 is another principle block diagram of the page data generating device in an embodiment of the present application.
  • FIG. 8 is another principle block diagram of a page data generating device in an embodiment of the present application.
  • FIG. 9 is another principle block diagram of the page data generating device in an embodiment of the present application.
  • Fig. 10 is a schematic diagram of a computer device in an embodiment of the present application.
  • the method for generating page data may be applied to the application environment as shown in FIG. 1.
  • the method for generating page data is applied to a page data generating system.
  • the page data generating system includes a data support terminal and a service terminal as shown in FIG. Data processing and data transmission pressure problems.
  • the data support terminal is used to provide data support for the service terminal, respond to the request of the service terminal, and perform calculations in the page data generation method.
  • the data support terminal can be, but is not limited to, various personal computers, laptops, smart phones, and tablets. Computers, portable wearable devices and computer clusters.
  • the service terminal is the service requester, which sends service data requests and performs calculations in the page data generation method to the data support terminal.
  • the service terminal can be, but is not limited to, various personal computers, laptops, smart phones, tablets, and portable wearables. equipment.
  • a method for generating page data is provided. Taking the method applied to the data support terminal in FIG. 1 as an example for description, the method includes the following steps:
  • S11 Perform binning processing on the data to be binned in the database according to a preset binning strategy to obtain binning information and data partitions of the data to be binned.
  • the preset binning strategy refers to the rules for binning the data to be binned in the database in the data support terminal.
  • the preset binning strategy can be the default strategy in the data support terminal, or it can be based on the data Support the number of binning machines included in the terminal to make a strategy.
  • the data to be sorted refers to the data in the database waiting to be sorted.
  • the data to be sorted can include ID identity information and keyword data of the search record corresponding to the ID, ID identity information and the ID corresponding to the data or ID of the visited page
  • the identity information and the ID correspond to the data of downloading application software.
  • the data to be sorted may also include ID identity information and static data corresponding to the ID.
  • the static data may be the age, gender, or residential area of the ID identity information.
  • the binning information refers to the information obtained after binning the data to be binned in the database according to the preset binning strategy.
  • the essence of binning information is rule information, which is used to instruct the service terminal to perform the data according to the binning information.
  • the sample performs the same operation.
  • the data partition refers to the classification area obtained after the data to be binned is binned.
  • the number of partitions of the data partition is determined according to the number of binning machines included in the data support terminal and the data volume of the data to be binned.
  • the ID identity information of the data to be binned in the database is binned, and the ID identity information of the data to be binned is calculated through a hash operation to obtain the hash value of all ID identity information, according to the preset
  • the binning strategy and data support the computing resources of the terminal, and all the hash values of the ID identity information are binned to obtain binning information and data partitions corresponding to the data to be binned.
  • the computing resources of the data support terminal refers to the number of binning machines in the data support terminal. Exemplarily, suppose that there are 40 binning machines in the data support terminal, and the data to be binned in the database is binned.
  • the data to be binned can be divided into 40 Part, that is, each binning machine corresponds to a category of data to be binned, which can improve the comprehensiveness of the data category; if the amount of data to be binned is small, the data to be binned can be divided into 20 parts, that is, every two Each binning machine corresponds to a category of to-be-sorted bin data, which can share the pressure of being accessed by the binning machine.
  • S12 Send the binning information to the service terminal to instruct the service terminal to perform a hash operation on the data sample according to the binning information to obtain a binning number, which is used to indicate the corresponding data partition.
  • the service terminal is a terminal that sends a service request to the data support terminal.
  • the service terminal can be, but is not limited to, various personal computers, notebook computers, smart phones, and tablet computers.
  • the data sample is data in the service terminal, and the data sample includes the ID identity information of the user in the service terminal and the characteristic information corresponding to the ID identity information.
  • Hashing is an arithmetic method that transforms an input of any length (also called a pre-mapped pre-image) into a fixed-length output through a hashing algorithm.
  • the box number is obtained by the service terminal after hashing the data sample according to the box information.
  • the box number corresponds to the box information, and the box number is used to indicate that the box number corresponds to the box number in the data support terminal Data partition.
  • the binning information is sent to the service terminal, and the binning information is sent to the service terminal.
  • the service terminal After receiving the binning information, the service terminal performs the same hash operation on the ID identity information in the data sample as the data support terminal according to the binning information to obtain the first hash value. According to the first hash value, the data sample's Box number.
  • S13 Receive the bin number and request access instruction returned by the service terminal, the request access instruction instructs the service terminal to access the data partition corresponding to the bin number, and compare the sample information corresponding to the bin number and the data of the data partition corresponding to the bin number The information is calculated by the engine, and intermediate results are obtained.
  • the access request instruction is an instruction for the service terminal to request access to the data partition in the data support terminal after determining the access to the data partition in the data support terminal according to the bin number.
  • the sample information corresponding to the bin number is the information obtained by hashing the data sample of the service terminal.
  • the data information of the data partition corresponding to the bin number is the data information of the partition corresponding to the bin number in the data partition.
  • the essence of engine calculation is to determine the calculation method of ID identity information shared by the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number.
  • the intermediate result is the result of engine calculation by the service terminal on the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number.
  • the service terminal after the service terminal performs a hash operation on the data sample according to the binning information to obtain the bin number, the service terminal sends the bin number and the request access instruction to the data support terminal, and the data support terminal receives the bin number and the request The access instruction, the bin number is used to indicate the data partition corresponding to the bin number in the data support terminal, and the request instruction instructs the service terminal to request access to the corresponding data partition. Further, after the data support terminal receives the access request instruction, the service terminal is given the authority to access the data partition corresponding to the bin number. The service terminal performs engine calculation on the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number to obtain an intermediate result.
  • S14 Receive the intermediate result sent by the service terminal, and perform engine calculation on the intermediate result to obtain the calculation result.
  • the engine calculation is a calculation method in which the data support terminal calculates the intermediate result to obtain the calculation result, and the engine calculation performed by the data support terminal is different from the engine calculation performed by the service terminal.
  • the calculation result is the result obtained by the data support terminal performing engine calculation on the intermediate result. Specifically, after the service terminal performs engine calculation on the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number, and after obtaining the intermediate result, the service terminal sends the intermediate result to the data support terminal, and the data support terminal Enter the engine calculation for the intermediate result and get the calculation result.
  • the data support terminal performs the intermediate result on the intermediate result after receiving the intermediate result. Decrypt, get the first calculation result. If the intermediate result does not include the intersection information of the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number, the data support terminal continues to calculate the intermediate result to obtain the second calculation result. Wherein, the first calculation result and the second calculation result are both calculation results.
  • S15 Send the calculation result to the service terminal to instruct the service terminal to integrate the calculation result to obtain page data.
  • integration refers to the service terminal sorting the received calculation results.
  • the page data is the information obtained by the service terminal continuing to integrate the calculation results. Specifically, after receiving the intermediate result sent by the service terminal, and performing engine calculation on the intermediate result, and obtaining the calculation result, the calculation result is sent to the service terminal.
  • the calculation result instructs the service terminal to integrate the calculation result to obtain the page data. Since both the service terminal and the data support terminal include at least one data partition, after performing engine calculation on the data, it is necessary to integrate the obtained calculation results to obtain the intersection ID identity information of the data of all data partitions, that is, page data.
  • S16 Receive page data sent by the service terminal to display the page according to the page data.
  • the service terminal After the service terminal integrates the calculation results to obtain the page data, the service terminal sends the page data to the data support terminal, and the data support terminal receives the page data and displays the page according to the page data. It should be emphasized that, in order to further ensure the privacy and security of the page data, the page data can also be stored in a node of a blockchain.
  • a one-way binning operation is performed on the data by hash binning, so that the original database becomes a distributed database.
  • the page display system, recommendation system, voice assistant or precision advertising system needs to obtain data from the data supporter, the corresponding data can be obtained quickly, which effectively reduces the magnitude and complexity of the overall calculation of the system, thereby reducing data transmission Stress and save time.
  • page data can be quickly generated. For example, when the page system generates page data information corresponding to the user, it can obtain more accurate and comprehensive page data information, that is, page data.
  • the page data generation method before step S11, that is, before the data to be binned in the database is binned according to a preset binning strategy, the page data generation method further includes the following steps:
  • S17 Receive the preset rule sent by the service terminal.
  • the preset rule is a rule sent by the service terminal to the data support terminal, and the essence of the preset rule is a unified rule for the data format of the ID identity information in the service terminal and the data support terminal.
  • the data format refers to the naming format of the ID information of the data in the database.
  • the unification operation refers to the operation of unifying the data format of the ID identity information of the data in the database with the data of the ID identity information of the service terminal.
  • Regularized data refers to data with a consistent data format, and the regularized data is obtained by performing a consistent operation on the data format of the data in the database using preset rules.
  • the service terminal sends a preset rule to the data support terminal, and after receiving the preset rule sent by the service terminal, the preset rule is used to perform a consistent operation on the data format in the database, and the data in the database
  • the ID identity information performs the unified operation of the naming method, and the unified processed data is obtained, that is, the regularized data.
  • the ID identity information in the database is "X123”
  • the ID identity information in the service terminal is "XX123”
  • the data format of the ID identity information is unified through the preset rules, so as to avoid the situation that the data of the service terminal and the data support terminal cannot match due to the difference in the data format of the ID identity information.
  • the uniform encryption algorithm is used to ensure the non-retrospecibility of the processed data to be binned, and enable the to-be binned data to be evenly distributed
  • the uniform encryption algorithm may be a uniform hash algorithm.
  • the uniform encryption algorithm is used to process the regularized data to obtain the data to be binned.
  • the regularized data is processed through the uniform encryption algorithm, so as to ensure the non-retrospecibility of the data obtained through the algorithm processing, so that the data to be binned follows the principle of data consistency and data one-to-one matching, and uniform encryption
  • the algorithm processes the regularized data so that the obtained data to be binned can be evenly distributed, avoiding performance degradation due to uneven distribution.
  • the data format of the data in the database of the data support terminal is consistent with the preset rules, and the uniform encryption algorithm is used to process the regularized data, which can make the data to be binned follow the data consistency
  • the principle of one-to-one matching with the data, and the data to be sorted obtained by the uniform encryption algorithm processing cannot be traced back, which saves the time required for the service process.
  • the page data generation method further includes the following steps:
  • the target partition is the partition corresponding to the bin number in the data partition. Specifically, after receiving the bin number returned by the service terminal, determine the partition corresponding to the bin number from the data partition, and use the partition corresponding to the bin number as the target partition.
  • S142 Send the encryption key to the service terminal to instruct the service terminal to use the encryption key and the first private key to encrypt the sample information corresponding to the bin number to obtain the first encrypted information.
  • the encryption key is a key provided by the data support terminal to the service terminal, and the encryption key is used for the service terminal to encrypt the sample information corresponding to the bin number.
  • the first private key is a key used by the service terminal to encrypt the sample information, and the first private key is owned only by the service terminal.
  • the first encrypted information is information obtained by encrypting the sample information corresponding to the bin number by the service terminal using the encryption key and the first private key. Specifically, after the partition corresponding to the bin number is determined from the data partition, the encryption key is sent to the service terminal. After receiving the encryption key, the service terminal uses the encryption key and the first private key to pair the bin number. The sample information is encrypted to obtain the first encrypted information.
  • S143 Receive the first encrypted information sent by the service terminal, encrypt the first encrypted information using the second private key to obtain the second encrypted information, and send the second encrypted information to the service terminal.
  • the second private key is a key owned by only the data support terminal.
  • the second encrypted information is information obtained by encrypting the first encrypted information using the second private key. Specifically, after the service terminal uses the encryption key and the first private key to encrypt the sample information corresponding to the bin number, and after obtaining the first encrypted information, the service terminal sends the first encrypted information to the data support terminal, and the data support terminal is in After receiving the first encrypted information, the second private key is used to encrypt the first encrypted information to obtain the second encrypted information.
  • S144 Use the encryption key and the second private key to encrypt the data information in the target partition to obtain third encrypted information.
  • the second encrypted information is information obtained by using an encryption key and a second private key to encrypt data information in the target partition. Specifically, after the partition corresponding to the bin number is determined from the data partition, and the target partition is obtained, the encryption key and the second private key are used to encrypt the data information in the target partition to obtain the second encrypted information.
  • the data support terminal uses the encryption key and the second private key to encrypt the data information in the target partition every time the service terminal requests, these operations will greatly increase the response time, waste a lot of computing resources, and The peak value calculated by the data support terminal has higher requirements.
  • the data support terminal will update the encryption key, which further ensures the security of the service terminal data. Therefore, optionally, the data support terminal can use the encryption key and the second private key to encrypt the data information in the data partition in advance, and after receiving the bin number sent by the service terminal, determine the bin number from the data partition.
  • the corresponding partition is used as the target partition, and the determined target partition does not need to perform S144: encrypt the data information in the target partition with the encryption key and the second private key to obtain the third encrypted information. Further, the service terminal obtains the first encrypted information and the data support terminal obtains the third encrypted information. The sequence of these two steps is not fixed. The service terminal may first obtain the first encrypted information, or the data support terminal may obtain the first encrypted information. Three encrypted information or two steps are performed at the same time.
  • S145 Send the third encrypted information to the service terminal to instruct the service terminal to perform engine calculations on the second encrypted information and the third encrypted information to obtain an intermediate result.
  • the third encrypted information is sent to the service terminal, and after the service terminal receives the third encrypted information , Perform engine calculations on the second encrypted information and the third encrypted information to obtain intermediate results.
  • the target partition is determined by the bin number, which can improve the accuracy of determining the target partition while ensuring data security.
  • the encryption key, the first private key and the second private key are used to encrypt the data information to ensure that the ID identity information of the service terminal and the data support terminal is not visible, and the shared ID identity information of the service terminal and the data support terminal can be found
  • the data information further improves the security of the data of both parties, and at the same time ensures the privacy of the users of the service terminal.
  • the page data generation method further includes the following steps:
  • S146 Count the number of times of receiving the box number, and after receiving a certain number of box numbers, adjust the weight of the data partition corresponding to the box number according to the number of times of receiving the box number.
  • the number of receptions refers to the number of times the box number is sent to the data support terminal.
  • a certain number of bin numbers can be determined according to the number of times the service terminal requests access, or according to the number of data partitions.
  • the first bin number refers to the bin number whose receiving times are higher than the preset range.
  • the second bin number refers to the bin number whose receiving times are lower than the preset range.
  • the preset range is the range used to determine whether the number of bins received meets the requirements.
  • the preset range can be set to 60%-80%, 70%-90%, or 80%-90%.
  • the data support terminal After receiving the box number returned by the service terminal, the data support terminal counts the number of times the box number has been received, and every time the step of receiving the box number returned by the service terminal is performed, the returned box number is checked. According to statistics, after receiving a certain number of bin numbers, if there is a bin number whose receiving times are higher than the preset range, then the weight of the data partition corresponding to the bin number is increased; if there are any receiving times lower than the preset range If the bin number is used, the weight of the data partition corresponding to the bin number is reduced.
  • the method of increasing the weight of the data partition corresponding to the bin number may be: increasing the binning machine corresponding to the data partition corresponding to the bin number, which can reduce the number of bins.
  • the method to reduce the weight of the data partition corresponding to the bin number can be: reduce the binning machines corresponding to the data partition corresponding to the bin number, or set several as the first The binning machines corresponding to the data partitions corresponding to the two bin numbers are merged to reduce the resource consumption of the binning machines.
  • the number of binning machines corresponding to the data partition of the binning number can be changed by the number of times the binning number is received.
  • the binning machines or the number of binning machines can be reduced.
  • Combining binning machines improves the utilization of binning machines.
  • the data information of certain data partitions is used multiple times, it can increase the binning machines for data partitions, reducing the load pressure that may be caused by excessive data.
  • a method for generating page data is provided.
  • the method is applied to the service terminal in FIG. 1 as an example for description, including the following steps:
  • S20 Receive boxing information sent by the data support terminal, where the boxing information is obtained after the data support terminal performs boxing processing on the data to be boxed in the database according to a preset boxing strategy.
  • the data support terminal is a terminal that receives service requests from the service terminal and provides data support.
  • the data support terminal can be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and computer clusters.
  • the binning information refers to the information obtained after the data support terminal performs binning processing on the data to be binned in the database according to the preset binning strategy.
  • the essence of binning information is rule information, which is used to instruct the service terminal according to the binning
  • the information performs the same hash operation on the data sample.
  • the preset binning strategy refers to the rules for binning the data to be binned in the database in the data support terminal.
  • the preset binning strategy can be the default strategy in the data support terminal, or it can be based on the data support terminal
  • the number of binning machines contained in it can be used to develop a strategy.
  • the data to be binned refers to the data in the database of the data support terminal that is waiting for binning processing.
  • the data to be binned may include ID identity information and keyword data of the user's search record, ID identity information and data of the user's access page Or ID identity information and data of the user downloading application software, etc.
  • the data support terminal After the data support terminal performs binning processing on the to-be-sorted data in the database according to the preset binning strategy, and obtains the binning information of the to-be-sorted data, the data support terminal sends the binning information to the service terminal, and the service The terminal receives the binning information.
  • S21 Perform a hash operation on the data sample according to the binning information to obtain a binning number corresponding to the data sample, where the binning number is used to indicate the data partition corresponding to the binning number in the data support terminal.
  • the hash operation is an operation method that transforms an input of any length (also called a pre-image) into a fixed-length output through a hash algorithm.
  • the data sample is data in the service terminal, and the data sample includes the ID identity information of the user in the service terminal and the characteristic information corresponding to the ID identity information.
  • the bin number is obtained by hashing the data sample according to the bin information, and the bin number is used to indicate the data partition corresponding to the bin number in the data support terminal.
  • the ID identity information in the data sample is hashed according to the binning information to obtain the first hash value, and according to the first hash value and the data sample In the feature information, get the box number.
  • the characteristic information is characteristic information corresponding to the ID identity information in the data sample.
  • a certain ID identity information searches for Huawei mobile phones in Taobao
  • the number of searches for Huawei mobile phones is the characteristic information.
  • the ID identity information also searches for Huawei mobile phones in JD.com
  • the number of searches for Huawei mobile phones in JD.com It is another feature information.
  • S22 Send the bin number and the access request instruction to the data support terminal, and perform engine calculation on the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number to obtain an intermediate result.
  • the access request instruction is an instruction for the service terminal to request access to the data partition in the data support terminal after determining the access to the data partition in the data support terminal according to the bin number.
  • the sample information corresponding to the bin number is the information obtained by hashing the data sample of the service terminal.
  • the data information of the data partition corresponding to the bin number is the data information of the partition corresponding to the bin number in the data partition.
  • the essence of engine calculation is to determine the calculation method of ID identity information shared by the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number.
  • the intermediate result is the result of engine calculation on the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number.
  • the data partition that needs to be accessed in the data support terminal is determined according to the bin number, the request access instruction is generated, and the binning is sent.
  • the number and request access instruction are sent to the data support terminal, access the data partition corresponding to the bin number, and perform engine calculation on the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number to obtain an intermediate result.
  • S23 Send the intermediate result to the data support terminal to instruct the data support terminal to perform engine calculation on the intermediate result to obtain the calculation result.
  • the calculation result is the result obtained by the data support terminal performing engine calculation on the intermediate result.
  • Engine calculation is a calculation method by which the data support terminal calculates the intermediate result to obtain the calculation result.
  • the engine calculation performed by the data support terminal is different from the engine calculation performed by the service terminal. Specifically, after engine calculation is performed on the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number, and the intermediate result is obtained, the intermediate result is sent to the data support terminal to instruct the data support terminal to The result is calculated by the engine and the calculation result is obtained.
  • the data support terminal performs the intermediate result on the intermediate result after receiving the intermediate result. Decrypt, get the first calculation result. If the intermediate result does not include the intersection information of the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number, the data support terminal continues to calculate the intermediate result to obtain the second calculation result. Wherein, the first calculation result and the second calculation result are both calculation results.
  • S24 Receive the calculation result sent by the data support terminal, and integrate the calculation result to obtain page data.
  • S25 Send the page data to the data support terminal to instruct the data support terminal to display the page according to the page data.
  • integration refers to the service terminal sorting the received calculation results.
  • the page data is the information obtained by the service terminal continuing to integrate the calculation results.
  • the data support terminal after the data support terminal performs engine calculations on the intermediate results, and after the calculation results are obtained, the data support terminal sends the calculation results to the service terminal, and the service terminal integrates the received calculation results to obtain page data, and the page data It is sent to the data support terminal, and after receiving the page data, the data support terminal displays the page according to the page data. Since both the service terminal and the data support terminal include at least one data partition, after performing engine calculation on the data, it is necessary to integrate the obtained calculation results to obtain the intersection ID identity information of the data of all data partitions, that is, page data.
  • the sample data is calculated by using the same hash algorithm as the data support terminal, and the generated bin number is sent to the data support terminal for calling, which can effectively reduce the magnitude and complexity of the overall calculation of the system. This reduces the transmission pressure and the time of each link.
  • engine calculation it communicates with the data support terminal in the data information interaction link, which makes the generated page data more accurate while ensuring the access to the correct data partition, and can quickly generate the page data of the user of the service terminal.
  • the page data generation method before receiving the binning information sent by the data support terminal, the page data generation method further includes:
  • the preset rule is a rule sent by the service terminal to the data support terminal, and the essence of the preset rule is a unified rule for the data format of the ID identity information in the service terminal and the data support terminal.
  • the data format refers to the naming format of the ID information of the data in the database.
  • the unification operation refers to the operation of unifying the data format of the ID identity information of the data in the database with the data format of the ID identity information of the service terminal.
  • Regularized data refers to data with a consistent data format. The regularized data is obtained by performing a consistent operation on the data format of the data in the database using preset rules.
  • the service terminal sends the preset rule to the data support terminal, and after receiving the preset rule sent by the service terminal, the preset rule is used to perform a consistent operation on the data in the database, and the ID in the database
  • the identity information undergoes a unified operation of naming methods to obtain regularized data.
  • the ID identity information in the database is "X123”
  • the ID identity information in the service terminal is "XX123”
  • essentially the two identity information is the same user, but the ID identity information has different manifestations , Resulting in inequality in the process of data matching and determining data partitions.
  • the data support terminal can perform uniform operations on the data format of the data in the database according to preset rules, so that the data format of the data in the data support terminal and the service terminal can be used to make the data to be binned Follow the principle of data consistency and data one-to-one matching, and the data to be sorted obtained by uniform encryption algorithm processing cannot be traced back, which saves the time required for the service process.
  • step S22 the engine calculation is performed on the sample information corresponding to the bin number and the data information of the data partition corresponding to the bin number, and obtaining the intermediate result specifically includes the following steps:
  • S221 Receive the encryption key sent by the data support terminal.
  • S222 Use the encryption key and the first private key to encrypt the sample information corresponding to the bin number to obtain the first encrypted information.
  • the encryption key is a key provided by the data support terminal to the service terminal, and the encryption key is used for the service terminal to encrypt the sample information corresponding to the bin number.
  • the first private key is a key used by the service terminal to encrypt the sample information, and the first private key is owned only by the service terminal.
  • the first encrypted information is information obtained by encrypting the sample information corresponding to the bin number by using the encryption key and the first private key. Specifically, after receiving the encryption key sent by the data support terminal, the encryption key and the first private key are used to encrypt the sample information corresponding to the bin number to obtain the first encrypted information.
  • S223 Send the first encrypted information to the data support terminal to instruct the data support terminal to use the second private key to encrypt the first encrypted information to obtain the second encrypted information.
  • the second private key is a key owned by only the data support terminal.
  • the second encrypted information is information obtained by the data support terminal using the second private key to encrypt the first encrypted information. Specifically, after encrypting the sample information corresponding to the bin number by using the encryption key and the first private key to obtain the first encrypted information, the first encrypted information is sent to the data support terminal, and the data support terminal receives the first After the information is encrypted, the first encrypted information is encrypted by using the second private key to obtain the second encrypted information.
  • S224 Receive the second encrypted information and the third encrypted information sent by the data support terminal, where the third encrypted information is information obtained by the data support terminal using the encryption key and the second private key to encrypt the data information of the data partition corresponding to the bin number .
  • the third encrypted information is information obtained by encrypting the data information in the target partition by the data support terminal using the encryption key and the second private key.
  • the data support terminal uses the second private key to encrypt the first encrypted information to obtain the second encrypted information
  • the data support terminal sends the second encrypted information to the service terminal.
  • the data support terminal uses the encryption key and the second private key to encrypt the data information of the data partition corresponding to the bin number to obtain the third encrypted information.
  • the data support terminal sends the third encrypted information to the service terminal.
  • the service terminal receives the second encryption information and the third encryption information sent by the data support terminal.
  • the service terminal obtains the first encrypted information and the data support terminal obtains the third encrypted information.
  • the sequence of these two steps is not fixed.
  • the service terminal may first obtain the first encrypted information, or the data support terminal may obtain the first encrypted information. Three encrypted information or two steps are performed at the same time.
  • S225 Perform engine calculation on the second encrypted information and the third encrypted information to obtain an intermediate result.
  • the engine calculation is performed on the second encrypted information and the third encrypted information to obtain an intermediate result.
  • the data can be interacted with the data support terminal under the condition that the data corresponding to the box number is guaranteed to be invisible, thereby ensuring
  • the security of the data also ensures the privacy of the user of the service terminal.
  • the service terminal and the data support terminal are more secure in the information interaction link, and the generated page data is more accurate.
  • a page data generation device is provided, and the page data generation device corresponds to the page data generation method in the above-mentioned embodiment one-to-one.
  • the page data generating device includes a binning processing module 11, a binning information sending module 12, a binning number receiving module 13, a first engine module 14, a calculation result sending module 15 and a page data receiving module 16.
  • the detailed description of each functional module is as follows:
  • the binning processing module 11 is configured to perform binning processing on the to-be binned data in the database according to a preset binning strategy to obtain binning information and data partitions of the to-be binned data.
  • the binning information sending module 12 is used to send binning information to the service terminal to instruct the service terminal to hash the data samples according to the binning information to obtain the binning number, which is used to indicate the corresponding data partition .
  • the box number receiving module 13 is used to receive the box number and the request access instruction returned by the service terminal.
  • the request access instruction instructs the service terminal to access the data partition corresponding to the box number, and compares the sample information corresponding to the box number and the box
  • the data information of the data partition corresponding to the number is calculated by the engine, and the intermediate result is obtained.
  • the first engine calculation module 14 is configured to receive the intermediate result sent by the service terminal, and perform engine calculation on the intermediate result to obtain the calculation result.
  • the calculation result sending module 15 is used to send the calculation result to the service terminal to instruct the service terminal to integrate the calculation result to obtain page data. It should be emphasized that, in order to further ensure the privacy and security of the page data, the page data can also be stored in a node of a blockchain.
  • the page data receiving module 16 is configured to receive page data sent by the service terminal to display the page according to the page data.
  • the page data generating device further includes:
  • the rule receiving module 17 is used to receive the preset rule sent by the service terminal.
  • the data consistency module 18 is used to perform a consistency operation on the data format of the data in the database using preset rules to obtain regularized data.
  • the uniform encryption module 19 is used to process the regularized data using a uniform encryption algorithm to obtain the data to be binned.
  • the page data generating device further includes:
  • the target partition determining module 141 is used to determine the partition corresponding to the bin number from the data partition to obtain the target partition.
  • the encryption key sending module 142 is configured to send the encryption key to the service terminal to instruct the service terminal to use the encryption key and the first private key to encrypt the sample information corresponding to the bin number to obtain the first encrypted information.
  • the first encrypted information receiving module 143 is configured to receive the first encrypted information sent by the service terminal, use the second private key to encrypt the first encrypted information to obtain the second encrypted information, and send the second encrypted information to the service terminal.
  • the first encryption module 144 is used to encrypt the data information in the target partition by using the encryption key and the second private key to obtain third encrypted information.
  • the third encrypted information sending module 145 is configured to send the third encrypted information to the service terminal to instruct the service terminal to perform engine calculations on the second encrypted information and the third encrypted information to obtain an intermediate result.
  • the page data generating device further includes:
  • the binning number statistics module 146 is used to count the number of binning numbers received, and after receiving a certain number of binning numbers, adjust the weight of the data partition corresponding to the binning number according to the number of receiving binning numbers.
  • the weight increasing module 147 is configured to increase the weight of the data partition corresponding to the bin number when the bin number is the first bin number, and the first bin number refers to bins whose receiving times are higher than the preset range No.
  • the weight reduction module 148 is configured to reduce the weight of the data partition corresponding to the bin number when the bin number is the second bin number, and the second bin number refers to the bin whose receiving times are lower than the preset range. Case number.
  • a page data generation device is provided, and the page data generation device corresponds to the page data generation method in the above-mentioned embodiment one-to-one.
  • the page data generating device includes a binning information receiving module 20, a hash calculation module 21, a binning number sending module 22, an intermediate result sending module 23 and a calculation result receiving module 24.
  • the detailed description of each functional module is as follows:
  • the binning information receiving module 20 is configured to receive binning information sent by the data support terminal, where the binning information is obtained after the data support terminal performs binning processing on the data to be binned in the database according to a preset binning strategy .
  • the hash operation module 21 is configured to perform a hash operation on the data sample according to the binning information to obtain the bin number corresponding to the data sample, and the bin number is used to indicate the bin number corresponding to the bin number in the data support terminal Data partition.
  • the box number sending module 22 is used to send the box number and request access instruction to the data support terminal, and perform engine calculation on the sample information corresponding to the box number and the data information of the data partition corresponding to the box number to obtain the intermediate result.
  • the intermediate result sending module 23 is configured to send the intermediate result to the data support terminal to instruct the data support terminal to perform engine calculation on the intermediate result to obtain the calculation result.
  • the calculation result receiving module 24 is configured to receive the calculation result sent by the data support terminal, and integrate the calculation result to obtain page data.
  • the page data sending module 25 is used to send the page data to the data support terminal to instruct the data support terminal to display the page according to the page data.
  • the page data generating device further includes:
  • the rule sending module is used to send preset rules to the data provider to instruct the data support terminal to perform uniform operations on the data format of the data in the database according to the preset rules to obtain regularized data.
  • the page data generating device further includes:
  • the encryption key receiving module 221 is used to receive the encryption key sent by the data support terminal.
  • the second encryption module 222 is configured to use the encryption key and the first private key to encrypt the sample information corresponding to the bin number to obtain the first encrypted information.
  • the second encrypted information sending module 223 is configured to send the first encrypted information to the data support terminal to instruct the data support terminal to use the second private key to encrypt the first encrypted information to obtain the second encrypted information.
  • the second encrypted information receiving module 224 is configured to receive the second encrypted information and the third encrypted information sent by the data support terminal.
  • the third encrypted information is that the data support terminal uses the encryption key and the second private key to divide the data partition corresponding to the bin number The information obtained by encrypting the data information.
  • the second engine calculation module 225 is configured to perform engine calculations on the second encrypted information and the third encrypted information to obtain intermediate results.
  • Each module in the above-mentioned page data generating device can be implemented in whole or in part by software, hardware, and a combination thereof.
  • the above-mentioned modules may be embedded in the form of hardware or independent of the processor in the computer equipment, or may be stored in the memory of the computer equipment in the form of software, so that the processor can call and execute the operations corresponding to the above-mentioned modules.
  • a computer device is provided.
  • the computer device may be a server, and its internal structure diagram may be as shown in FIG. 10.
  • the computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus.
  • the processor of the computer device is used to provide calculation and control capabilities.
  • the memory of the computer device includes a readable storage medium and an internal memory.
  • the readable storage medium stores an operating system, computer readable instructions, and a database.
  • the internal memory provides an environment for the operation of the operating system and the computer program in the readable storage medium.
  • the database of the computer device is used to store the data used in the page data generation method in the foregoing embodiment.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection.
  • the computer-readable instruction is executed by the processor to realize a page data generation method.
  • the readable storage medium provided in this embodiment includes a non-volatile readable storage medium and a volatile readable storage medium.
  • a computer device including a memory, a processor, and computer readable instructions stored in the memory and capable of running on the processor, and the processor implements the following steps when the processor executes the computer readable instructions:
  • the request access instruction instructs the service terminal to access the data partition corresponding to the bin number, and compare the sample information and the access request instruction corresponding to the bin number
  • the data information of the data partition corresponding to the bin number is calculated by the engine to obtain an intermediate result
  • a computer device including a memory, a processor, and computer-readable instructions stored in the memory and executable on the processor, and the processor executes the computer-readable instructions. The following steps are implemented when ordering:
  • binning information a hash operation is performed on the data sample to obtain the binning number corresponding to the data sample, and the binning number is used to indicate the data corresponding to the binning number in the data support terminal Partitioning, where the data partition is that the data support terminal performs binning processing on the data to be binned in the database according to a preset binning strategy;
  • the page data is sent to the data support terminal to instruct the data support terminal in question to display the page according to the page data.
  • one or more readable storage media storing computer readable instructions are provided.
  • the readable storage media provided in this embodiment include non-volatile readable storage media and volatile readable storage. Medium; the readable storage medium stores computer readable instructions, and when the computer readable instructions are executed by one or more processors, the one or more processors implement the following steps:
  • the request access instruction instructs the service terminal to access the data partition corresponding to the bin number, and compare the sample information and the access request instruction corresponding to the bin number
  • the data information of the data partition corresponding to the bin number is calculated by the engine to obtain an intermediate result
  • one or more readable storage media storing computer readable instructions are provided.
  • the readable storage media provided in this embodiment include non-volatile readable storage media and volatile readable storage. Medium; the readable storage medium stores computer readable instructions, and when the computer readable instructions are executed by one or more processors, the one or more processors implement the following steps:
  • binning information a hash operation is performed on the data sample to obtain the binning number corresponding to the data sample, and the binning number is used to indicate the data corresponding to the binning number in the data support terminal Partitioning, where the data partition is that the data support terminal performs binning processing on the data to be binned in the database according to a preset binning strategy;
  • the page data is sent to the data support terminal to instruct the data support terminal in question to display the page according to the page data.
  • Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • Volatile memory may include random access memory (RAM) or external cache memory.
  • RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
  • the blockchain referred to in this application is a new application mode of computer technology such as distributed data storage, point-to-point transmission, consensus mechanism, and encryption algorithm.
  • Blockchain essentially a decentralized database, is a series of data blocks associated with cryptographic methods. Each data block contains a batch of network transaction information for verification. The validity of the information (anti-counterfeiting) and the generation of the next block.
  • the blockchain can include the underlying platform of the blockchain, the platform product service layer, and the application service layer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Bioethics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种页面数据生成方法,包括:通过预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到待分箱数据的分箱信息和数据分区(S11);发送分箱信息至服务终端,以指示服务终端根据分箱信息对数据样本进行哈希运算得到分箱号(S12);服务终端对分箱号对应的样本信息和分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果(S13);接收服务终端发送的中间结果并进行引擎计算,得到计算结果(S14);服务终端对计算结果进行整合,得到页面数据(S15);数据支持终端根据页面数据进行页面展示(S16)。其中,所述页面数据存储于区块链中。

Description

页面数据生成方法、装置、计算机设备及存储介质
本申请要求于2020年4月30日提交中国专利局、申请号为202010365846.0,发明名称为“页面数据生成方法、装置、计算机设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及数据处理领域,尤其涉及一种页面数据生成方法、装置、计算机设备及存储介质。
背景技术
随着大数据时代来临,对用户的数据处理变得尤为重要,进而让一些应用发展也越来越迅速。例如:页面展示系统、推荐系统、语音助手或者精准广告系统等。
发明人意识到,传统上,页面展示系统会根据不同的用户展示不同的页面数据。因此,页面展示系统通过与数据支持方进行通信,进而获取到页面数据。但是在与数据支持方进行数据信息交互过程中,往往会考虑到数据安全性,从而对数据进行大量的加密运算,随着用户数量增多,数据的运算量增大,进而导致页面展示系统和数据支持方信息交互过程中,数据处理和数据传输压力增加。
申请内容
本申请实施例提供一种页面数据生成方法、装置、计算机设备及存储介质,以解决系统数据处理和数据传输压力大的问题。
一种页面数据生成方法,包括:
根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
将所述计算结果发送至所述服务终端,以指示服务终端对所述计算结果进行整合,得到页面数据;
接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
一种页面数据生成装置,包括:
分箱处理模块,用于根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
分箱信息发送模块,用于将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
分箱号接收模块,用于接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
第一引擎计算模块,用于接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
计算结果发送模块,用于将所述计算结果发送至所述服务终端,以指示所述服务终端对所述计算结果进行整合,得到页面数据;
页面数据接收模块,用于接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,所述处理器执行所述计算机可读指令时实现如下步骤:
根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
将所述计算结果发送至所述服务终端,以指示服务终端对所述计算结果进行整合,得到页面数据;
接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,所述处理器执行所述计算机可读指令时实现如下步骤:
接收数据支持终端发送的分箱信息,所述分箱信息为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的;
根据所述分箱信息,对数据样本进行哈希运算,得到所述数据样本对应的分箱号,所述分箱号用于指示在所述数据支持终端中与所述分箱号对应的数据分区,所述数据分区为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理;
发送所述分箱号和请求访问指令至所述数据支持终端,并对所述分箱号对应的样本信息和所述分箱号对应的所述数据分区的数据信息进行引擎计算,得到中间结果;
发送所述中间结果至所述数据支持终端中,以指示所述数据支持终端对中间结果进行引擎计算,得到计算结果;
接收所述数据支持终端发送的计算结果,并对所述计算结果进行整合,得到页面数据;
将所述页面数据发送至所述数据支持终端,以指示所诉数据支持终端根据所述页面数据进行页面展示。
一个或多个存储有计算机可读指令的可读存储介质,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:
根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
将所述计算结果发送至所述服务终端,以指示服务终端对所述计算结果进行整合,得到页面数据;
接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
一个或多个存储有计算机可读指令的可读存储介质,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:
接收数据支持终端发送的分箱信息,所述分箱信息为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的;
根据所述分箱信息,对数据样本进行哈希运算,得到所述数据样本对应的分箱号,所述分箱号用于指示在所述数据支持终端中与所述分箱号对应的数据分区,所述数据分区为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理;
发送所述分箱号和请求访问指令至所述数据支持终端,并对所述分箱号对应的样本信息和所述分箱号对应的所述数据分区的数据信息进行引擎计算,得到中间结果;
发送所述中间结果至所述数据支持终端中,以指示所述数据支持终端对中间结果进行引擎计算,得到计算结果;
接收所述数据支持终端发送的计算结果,并对所述计算结果进行整合,得到页面数据;
将所述页面数据发送至所述数据支持终端,以指示所诉数据支持终端根据所述页面数据进行页面展示。
上述页面数据生成方法、装置、计算机设备及存储介质,通过哈希分箱的方式,对数据进行单向性的分箱操作,使得原来的数据库变成分布式数据库。当页面展示系统,推荐系统、语音助手或者精准广告系统需要获取数据支持方的数据时,能够快速的获取相对应的数据,有效减少系统整体计算需要的量级和复杂度,进而减少了数据传输的压力并节省时间。而通过引擎计算,能够快速生成页面数据。例如,在页面系统生成用户相对应的页面数据信息时,能够获取到更加准确全面的页面数据信息,即页面数据。
本申请的一个或多个实施例的细节在下面的附图和描述中提出,本申请的其他特征和优点将从说明书、附图以及权利要求变得明显。
附图说明
为了更清楚地说明本申请实施例的技术方案,下面将对本申请实施例的描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1是本申请一实施例中页面数据生成方法的一应用环境示意图;
图2是本申请一实施例中页面数据生成方法的一流程图;
图3是本申请一实施例中页面数据生成方法的另一流程图;
图4是本申请一实施例中页面数据生成方法的另一流程图;
图5是本申请一实施例中页面数据生成方法的另一流程图;
图6是本申请一实施例中页面数据生成装置的一原理框图;
图7是本申请一实施例中页面数据生成装置的另一原理框图;
图8是本申请一实施例中页面数据生成装置的另一原理框图;
图9是本申请一实施例中页面数据生成装置的另一原理框图;
图10是本申请一实施例中计算机设备的一示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请 中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请实施例提供的页面数据生成方法,该页面数据生成方法可应用如图1所示的应用环境中。具体地,该页面数据生成方法应用在页面数据生成系统中,该页面数据生成系统包括如图1所示的数据支持终端和服务终端,数据支持终端与服务终端通过网络进行通信,用于解决系统数据处理和数据传输压力大的问题。其中,数据支持终端用于为服务终端提供数据支持、响应服务终端的请求和进行页面数据生成方法中的计算等,数据支持终端可以为但不限于各种个人计算机、笔记本电脑、智能手机、平板电脑、便携式可穿戴设备和计算机集群。服务终端为服务请求方,向数据支持终端发送服务数据请求和进行页面数据生成方法中的计算等,服务终端可以为但不限于各种个人计算机、笔记本电脑、智能手机、平板电脑和便携式可穿戴设备。
在一实施例中,如图2所示,提供一种页面数据生成方法,以该方法应用在图1中的数据支持终端为例进行说明,包括如下步骤:
S11:根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到待分箱数据的分箱信息和数据分区。
其中,预设的分箱策略指的是数据支持终端中对数据库中的待分箱数据进行分箱的规则,预设的分箱策略可以是数据支持终端中默认的策略,也可以是根据数据支持终端中所包含的分箱机器的数量来进行制定的策略。待分箱数据指的是数据库中等待进行分箱处理的数据,待分箱数据可以包括ID身份信息和该ID对应搜索记录的关键词数据,ID身份信息和该ID对应访问页面的数据或者ID身份信息和该ID对应下载应用软件的数据,待分箱数据还可以包括ID身份信息和该ID对应的静态数据等,静态数据可以为ID身份信息的年龄、性别或者居住地区等。分箱信息指的是根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的信息,分箱信息的实质是规则信息,用于指示服务终端根据分箱信息对数据样本进行相同的运算。数据分区指的是待分箱数据进行分箱处理后得到的分类区域,数据分区的分区数量是根据数据支持终端中所包含的分箱机器的数量和待分箱数据的数据量来确定的。
具体地,对数据库中的待分箱数据的ID身份信息进行分箱处理,通过哈希运算将待分箱数据的ID身份信息进行计算,得到所有ID身份信息的哈希值,根据预设的分箱策略和数据支持终端的计算资源,将所有ID身份信息的哈希值进行分箱,得到待分箱数据对应的分箱信息和数据分区。其中,数据支持终端的计算资源指的是数据支持终端中分箱机器的数量。示例性地,假设在数据支持终端中,拥有40台分箱机器,对数据库中的待分箱数据进行分箱处理,若待分箱数据的数量过大,则可以将待分箱数据分成40份,即每一台分箱机器对应一个类别的待分箱数据,能够提高数据类别的全面性;若待分箱数据的数量较少,则可以将待分箱数据分成20份,即每两台分箱机器对应一个类别的待分箱数据,能够分担分箱机器被访问的压力。
S12:将分箱信息发送至服务终端,以指示服务终端根据分箱信息对数据样本进行哈希运算,以得到分箱号,分箱号用于指示对应的数据分区。
其中,服务终端为向数据支持终端发送服务请求的终端,服务终端可以但不限于各种个人计算机、笔记本电脑、智能手机和平板电脑。数据样本为服务终端中的数据,数据样本包括服务终端中用户的ID身份信息和该ID身份信息对应的特征信息。哈希运算为把任意长度的输入(又叫做预映射pre-image)通过散列算法变换成固定长度的输出的运算方法。分箱号是服务终端根据分箱信息对数据样本进行哈希运算后得到的,分箱号是与分箱信息相对应的,分箱号用于指示在数据支持终端中与该分箱号对应的数据分区。
具体地,在根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到待分箱数据的分箱信息和数据分区之后,将分箱信息发送至服务终端,在服务终端接收到分箱信 息之后,服务终端根据分箱信息,对数据样本中的ID身份信息进行与数据支持终端相同哈希运算,得到第一哈希值,根据第一哈希值,得到数据样本的分箱号。
S13:接收服务终端返回的分箱号和请求访问指令,请求访问指令指示服务终端访问与分箱号对应的数据分区,对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果。
其中,请求访问指令为服务终端在根据分箱号确定访问数据支持终端中的数据分区之后,请求访问该数据分区的指令。分箱号对应的样本信息为服务终端的数据样本经过哈希运算得到的信息。分箱号对应的数据分区的数据信息为在数据分区中与分箱号对应的分区的数据信息。引擎计算的实质为确定分箱号对应的样本信息和分箱号对应的数据分区的数据信息中共有的ID身份信息的计算方式。中间结果为服务终端对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算得到的结果。
具体地,在服务终端根据分箱信息对数据样本进行哈希运算,得到分箱号之后,服务终端将分箱号和请求访问指令发送至数据支持终端中,数据支持终端接收分箱号和请求访问指令,该分箱号用于指示数据支持终端中与分箱号对应的数据分区,请求指令指示服务终端请求访问该对应的数据分区。进一步地,在数据支持终端接收到请求访问指令之后,给予服务终端访问与分箱号对应的数据分区的权限。服务终端对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果。
S14:接收服务终端发送的中间结果,并对中间结果进行引擎计算,得到计算结果。
其中,引擎计算为数据支持终端对中间结果进行计算得到计算结果的计算方式,数据支持终端进行的引擎计算与服务终端进行的引擎计算是不同的。计算结果为数据支持终端对中间结果进行引擎计算得到的结果。具体地,在服务终端对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果之后,服务终端将中间结果发送至数据支持终端中,数据支持终端对中间结果进引擎计算,得到计算结果。
在一具体实施例中,若中间结果包含了分箱号对应的样本信息和分箱号对应的数据分区的数据信息的交集信息,则数据支持终端在接收到该中间结果之后,对中间结果进行解密,得到第一计算结果。若中间结果没有包含分箱号对应的样本信息和分箱号对应的数据分区的数据信息的交集信息,则数据支持终端对该中间结果继续进行计算,得到第二计算结果。其中,第一计算结果和第二计算结果都为计算结果。
S15:将计算结果发送至服务终端,以指示服务终端对计算结果进行整合,得到页面数据。
其中,整合是指服务终端对接收到的计算结果进行整理。页面数据为服务终端对计算结果继续进行整合得到的信息。具体地,在接收到服务终端发送的中间结果,并对中间结果进行引擎计算,得到计算结果之后,将计算结果发送至服务终端中,该计算结果指示服务终端对计算结果进行整合,以得到页面数据。由于在服务终端和数据支持终端中都至少包含一个数据分区,对数据进行引擎计算之后,需要对得到的计算结果进行整合,得到所有的数据分区的数据的交集ID身份信息,即页面数据。
S16:接收服务终端发送的页面数据,以根据页面数据进行页面展示。
具体地,在服务终端对计算结果进行整合,得到页面数据之后,服务终端将页面数据发送至数据支持终端中,数据支持终端接收页面数据,并根据该页面数据进行页面展示。需要强调的是,为进一步保证上述页面数据的私密和安全性,上述页面数据还可以存储于一区块链的节点中。
在本实施例中,通过哈希分箱的方式,对数据进行单向性的分箱操作,使得原来的数据库变成分布式数据库。当页面展示系统,推荐系统、语音助手或者精准广告系统需要获取数据支持方的数据时,能够快速的获取相对应的数据,有效减少系统整体计算需要的量级和复杂度,进而减少了数据传输的压力并节省时间。而通过引擎计算,能够快速生成页 面数据。例如,在页面系统生成用户相对应的页面数据信息时,能够获取到更加准确全面的页面数据信息,即页面数据。
在一实施例中,如图3所示,在步骤S11之前,即在根据预设的分箱策略对数据库中的待分箱数据进行分箱处理之前,页面数据生成方法还包括如下步骤:
S17:接收服务终端发送的预设的规则。
S18:采用预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据。
其中,预设的规则为服务终端发送至数据支持终端的规则,预设的规则的实质为对服务终端和数据支持终端中的ID身份信息的数据格式进行统一的规则。数据格式指的是数据库中的数据的ID身份信息的命名格式。一致化操作指的是对数据库中的数据的ID身份信息的数据格式进行与服务终端的ID身份信息的数据统一的操作。规则化数据指的是数据格式一致的数据,该规则化数据是采用预设的规则对数据库中数据的数据格式进行一致化操作得到的。
具体地,服务终端将预设的规则发送至数据支持终端中,在接收到服务终端发送的预设的规则之后,采用预设的规则对数据库中的数据格式进行一致化操作,对数据库中的ID身份信息进行命名方式的统一化操作,得到统一化处理后的数据,即规则化数据。示例性地,假设数据库中的一个ID身份信息为“X123”,而服务终端中的ID身份信息为“XX123”,实质上为两个身份信息都是同一个用户,但是ID身份信息表现形式不同,因此通过预设的规则对ID身份信息的数据格式进行统一,避免由于ID身份信息的数据格式的不同,导致服务终端和数据支持终端的数据出现无法匹配的情况。
S19:采用均匀加密算法对规则化数据进行处理,得到待分箱数据。
其中,均匀加密算法用于保证处理得到的待分箱数据的不可回溯性,并且使得待分箱数据能够均匀分布,均匀加密算法可以为均匀哈希算法。具体地,在采用预设的规则对数据库中的数据格式进行一致化操作,得到规则化数据之后,采用均匀加密算法对规则化数据进行处理,得到待分箱数据。通过均匀加密算法对规则化数据进行处理,从而保证经过算法处理得到的数据的不可回溯性,使得到的待分箱数据之间遵循数据一致性和数据一对一匹配的原则,并且通过均匀加密算法对规则化数据进行处理,使得到的待分箱数据能够均匀分布,避免由于不均匀分布导致性能降低。
在本实施中,通过预设的规则对数据支持终端的数据库中数据的数据格式进行一致化处理,并采用均匀加密算法对规则化数据进行处理,能够使得到的待分箱数据遵循数据一致性和数据一对一匹配的原则,且进行均匀加密算法处理得到的待分箱数据不可回溯,节省了服务流程需要的时间。
在一实施例中,如图4所示,在步骤S14之后,即在接收服务终端返回的分箱号和请求访问指令之后,页面数据生成方法还包括如下步骤:
S141:从数据分区中确定与分箱号对应的分区,得到目标分区。
其中,目标分区为数据分区中与分箱号对应的分区。具体地,在接收到服务终端返回的分箱号之后,从数据分区中确定与该分箱号对应的分区,将该与该分箱号对应的分区作为目标分区。
S142:发送加密钥匙至服务终端中,以指示服务终端采用加密钥匙和第一私密钥匙对分箱号对应的样本信息进行加密,得到第一加密信息。
其中,加密钥匙为数据支持终端提供给服务终端的钥匙,加密钥匙用于服务终端对分箱号对应的样本信息进行加密。第一私密钥匙为服务终端对样本信息进行加密的钥匙,该第一私密钥匙仅服务终端拥有。第一加密信息为服务终端采用加密钥匙和第一私密钥匙对分箱号对应的样本信息进行加密得到的信息。具体地,在从数据分区中确定与该分箱号对应的分区之后,发送加密钥匙至服务终端中,服务终端在接收到该加密钥匙之后,采用加密钥匙和第一私密钥匙对分箱号的样本信息进行加密,得到第一加密信息。
S143:接收服务终端发送的第一加密信息,采用第二私密钥匙对第一加密信息进行加密,得到第二加密信息,并将第二加密信息发送至服务终端。
其中,第二私密钥匙为仅数据支持终端拥有的钥匙。第二加密信息为采用第二私密钥匙对第一加密信息进行加密得到的信息。具体地,在服务终端采用加密钥匙和第一私密钥匙对分箱号对应的样本信息进行加密,得到第一加密信息之后,服务终端将第一加密信息发送至数据支持终端中,数据支持终端在接收第一加密信息后,采用第二私密钥匙对第一加密信息进行加密,得到第二加密信息。
S144:采用加密钥匙和第二私密钥匙对目标分区中的数据信息进行加密,得到第三加密信息。
其中,第二加密信息为采用加密钥匙和第二私密钥匙对目标分区中的数据信息进行加密得到的信息。具体地,在从数据分区中确定与分箱号对应的分区,得到目标分区之后,采用加密钥匙和第二私密钥匙对目标分区中的数据信息进行加密,得到第二加密信息。
若在服务终端每次请求的时候,数据支持终端再采用加密钥匙和第二私密钥匙对目标分区中的数据信息进行加密,这些操作会极大的增加响应时间,浪费大量的计算资源,并对数据支持终端计算的峰值有了更高的要求。同时,考虑到服务终端在请求访问数据支持终端时的安全性,在一定的周期之后,数据支持终端会更新加密钥匙,进一步保证了服务终端数据的安全性。故可选地,数据支持终端可以提前采用加密钥匙和第二私密钥匙对数据分区中的数据信息进行加密,待接收到服务终端发送的分箱号之后,从数据分区中确定与该分箱号对应的分区,作为目标分区,此时确定的目标分区则不用进行S144:采用加密钥匙和第二私密钥匙对目标分区中的数据信息进行加密,得到第三加密信息这一步骤。进一步地,服务终端得到第一加密信息和数据支持终端得到第三加密信息,这两个步骤的顺序不是固定的,可以先由服务终端得到第一加密信息,也可以先由数据支持终端得到第三加密信息或者两个步骤同时进行。
S145:将第三加密信息发送至服务终端中,以指示服务终端对第二加密信息和第三加密信息进行引擎计算,得到中间结果。
具体地,在采用加密钥匙和第二私密钥匙对目标分区中的数据信息进行加密,得到第三加密信息之后,将该第三加密信息发送至服务终端中,服务终端接收到第三加密信息之后,对第二加密信息和第三加密信息进行引擎计算,得到中间结果。
在本实施例中,通过分箱号来确定目标分区,在保证数据的安全性的同时,能够提高确定目标分区的准确性。采用加密钥匙、第一私密钥匙和第二私密钥匙对数据信息加密的方式,保证服务终端和数据支持终端的ID身份信息不可见的情况下,找到服务终端和数据支持终端的共有的ID身份信息的数据信息,进一步提高了双方数据的安全性,同时保证了服务终端的用户的隐私性。
在一实施例中,在步骤S14之后,即在接收服务终端返回的分箱号和请求访问指令之后,页面数据生成方法还包括如下步骤:
S146:统计分箱号的接收次数,在接收到一定数量的分箱号之后,根据分箱号的接收次数,调整分箱号对应的数据分区的权重。
S147:若分箱号为第一分箱号,则提高该分箱号对应的数据分区的权重,所述第一分箱号指的是接收次数高于预设范围的分箱号。
S148:若分箱号为第二分箱号,则降低该分箱号对应的数据分区的权重,所述第二分箱号指的是接收次数低于预设范围的分箱号。
其中,接收次数指的是分箱号被发送至数据支持终端的次数。一定数量的分箱号可以根据服务终端请求访问次数来确定,也可以根据数据分区的数量来确定。第一分箱号指的是接收次数高于预设范围的分箱号。第二分箱号指的是接收次数低于预设范围的分箱号。预设范围是用于判断分箱号的接收次数是否符合要求的范围,预设范围可以设定为 60%-80%、70%-90%或者80%-90%。具体地,在接收到服务终端返回的分箱号之后,数据支持终端统计分箱号的接收次数,在每一次执行接收服务终端返回的分箱号这一步骤时,对返回的分箱号进行统计,在接收到一定数量的分箱号之后,若存在接收次数高于预设范围的分箱号,则提高该分箱号对应的数据分区的权重;若存在接收次数低于预设范围的分箱号,则降低该分箱号对应的数据分区的权重。
进一步地,当分箱号被判定为第一分箱号时,提高该分箱号对应的数据分区的权重的方法可以为:增加该分箱号对应的数据分区对应的分箱机器,能够减少该数据分区中数据的负载压力。当分箱号被判定为第二分箱号时,降低该分箱号对应的数据分区的权重的方法可以为:减少该分箱号对应的数据分区对应的分箱机器,或者将几个为第二分箱号对应的数据分区对应的分箱机器进行合并,减少分箱机器的资源消耗。
在本实施例中,能够通过接收分箱号的次数,改变分箱号对应数据分区的分箱机器的数量,当某些数据分区的数据信息被使用的较少时,能够减少分箱机器或者合并分箱机器,提高了分箱机器的利用率,当某些数据分区的数据信息被多次使用时,能够增加数据分区的分箱机器,降低了数据过量可能带来的负载压力。
在一实施例中,如图5所示,提供一种页面数据生成方法,以该方法应用在图1中的服务终端为例进行说明,包括如下步骤:
S20:接收数据支持终端发送的分箱信息,所述分箱信息为数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的。
其中,数据支持终端为接收服务终端的服务请求并提供数据支持的终端,数据支持终端可以为但不限于各种个人计算机、笔记本电脑、智能手机、平板电脑和计算机集群。分箱信息指的是数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的信息,分箱信息的实质是规则信息,用于指示服务终端根据分箱信息对数据样本进行相同的哈希运算。预设的分箱策略指的是数据支持终端中对数据库中的待分箱数据进行分箱的规则,预设的分箱策略可以是数据支持终端中默认的策略,也可以是根据数据支持终端中所包含的分箱机器的数量来进行制定的策略。待分箱数据指的是数据支持终端的数据库中等待进行分箱处理的数据,待分箱数据可以包括ID身份信息和该用户搜索记录的关键词数据,ID身份信息和该用户访问页面的数据或者ID身份信息和该用户下载应用软件的数据等。
具体地,在数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到待分箱数据的分箱信息之后,数据支持终端发送分箱信息至服务终端,服务终端接收该分箱信息。
S21:根据分箱信息,对数据样本进行哈希运算,得到数据样本对应的分箱号,所述分箱号用于指示在数据支持终端中与该分箱号对应的数据分区。
其中,哈希运算为把任意长度的输入(又叫做预映射pre-image)通过散列算法变换成固定长度的输出的运算方法。数据样本为服务终端中的数据,数据样本包括服务终端中用户的ID身份信息和该ID身份信息对应的特征信息。分箱号是根据分箱信息对数据样本进行哈希运算后得到的,分箱号用于指示在数据支持终端中与该分箱号对应的数据分区。
具体地,在接收到数据支持终端发送的分箱信息之后,根据分箱信息,对数据样本中的ID身份信息进行哈希运算,得到第一哈希值,根据第一哈希值和数据样本中的特征信息,得到分箱号。其中,特征信息为数据样本中的ID身份信息对应的特征信息。示例性地,某个ID身份信息在淘宝中搜索华为手机,而搜索华为手机的次数即为特征信息,假设该ID身份信息在京东中也搜索了华为手机,则在京东中搜索华为手机的次数则为另一个特征信息。
S22:发送分箱号和请求访问指令至数据支持终端中,并对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果。
其中,请求访问指令为服务终端在根据分箱号确定访问数据支持终端中的数据分区之后,请求访问该数据分区的指令。分箱号对应的样本信息为服务终端的数据样本经过哈希运算得到的信息。分箱号对应的数据分区的数据信息为在数据分区中与分箱号对应的分区的数据信息。引擎计算的实质为确定分箱号对应的样本信息和分箱号对应的数据分区的数据信息中共有的ID身份信息的计算方式。中间结果为对分箱号对应的样本信息和分箱号对应的数据分区的数据信息进行引擎计算后得到的结果。
具体地,在根据分箱信息,对数据样本进行哈希运算,得到数据样本对应的分箱号之后,根据分箱号确定数据支持终端中需要访问的数据分区,生成请求访问指令,发送分箱号和请求访问指令至数据支持终端中,访问分箱号对应的数据分区,对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果。
S23:发送中间结果至数据支持终端中,以指示数据支持终端对中间结果进行引擎计算,得到计算结果。
其中,计算结果为数据支持终端对中间结果进行引擎计算得到的结果。引擎计算为数据支持终端对中间结果进行计算得到计算结果的计算方式,数据支持终端进行的引擎计算与服务终端进行的引擎计算是不同的。具体地,在对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果之后,将中间结果发送至数据支持终端中,以指示数据支持终端对中间结果进行引擎计算,得到计算结果。
在一具体实施例中,若中间结果包含了分箱号对应的样本信息和分箱号对应的数据分区的数据信息的交集信息,则数据支持终端在接收到该中间结果之后,对中间结果进行解密,得到第一计算结果。若中间结果没有包含分箱号对应的样本信息和分箱号对应的数据分区的数据信息的交集信息,则数据支持终端对该中间结果继续进行计算,得到第二计算结果。其中,第一计算结果和第二计算结果都为计算结果。
S24:接收数据支持终端发送的计算结果,并对计算结果进行整合,得到页面数据。
S25:将页面数据发送至数据支持终端中,以指示数据支持终端根据页面数据进行页面展示。
其中,整合是指服务终端对接收到的计算结果进行整理。页面数据为服务终端对计算结果继续进行整合得到的信息。
具体地,在数据支持终端对中间结果进行引擎计算,得到计算结果之后,数据支持终端将计算结果发送至服务终端中,服务终端对接收到的计算结果进行整合,得到页面数据,并将页面数据发送至数据支持终端中,数据支持终端在接收到页面数据之后,根据该页面数据进行页面展示。由于在服务终端和数据支持终端中都至少包含一个数据分区,对数据进行引擎计算之后,需要对得到的计算结果进行整合,得到所有的数据分区的数据的交集ID身份信息,即页面数据。
在本实施例中,通过采用与数据支持终端相同的哈希算法对样本数据进行计算,并将生成的分箱号发送至数据支持终端进行调用,能够有效减少系统整体计算需要的量级和复杂度,从而减少了传输的压力和各个环节的时间。通过引擎计算,在数据信息交互环节上与数据支持终端进行通信,在保证访问正确的数据分区的同时,使得生成的页面数据更加准确,能够快速生成服务终端的用户的页面数据。
在一实施例中,在接收数据支持终端发送的分箱信息之前,页面数据生成方法还包括:
发送预设的规则至数据提供方中,以指示数据支持终端根据预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据。
其中,预设的规则为服务终端发送至数据支持终端的规则,预设的规则的实质为对服务终端和数据支持终端中的ID身份信息的数据格式进行统一的规则。数据格式指的是数据库中的数据的ID身份信息的命名格式。一致化操作指的是对数据库中的数据的ID身份信息的数据格式进行与服务终端的ID身份信息的数据格式统一的操作。规则化数据指的 是数据格式一致的数据,该规则化数据是采用预设的规则对数据库中数据的数据格式进行一致化操作得到的。
具体地,服务终端将预设的规则发送至数据支持终端中,在接收到服务终端发送的预设的规则之后,采用预设的规则对数据库中的数据进行一致化操作,对数据库中的ID身份信息进行命名方式的统一化操作,得到规则化数据。示例性地,假设数据库中的一个ID身份信息为“X123”,而服务终端中的ID身份信息为“XX123”,实质上为两个身份信息都是同一个用户,但是ID身份信息表现形式不同,导致在数据匹配确定数据分区的过程中造成不对等的情况。
在本实施例中,数据支持终端能够根据预设的规则,对数据库中数据的数据格式进行一致化操作,使得数据支持终端和服务终端中的数据的数据格式,能够使得到的待分箱数据遵循数据一致性和数据一对一匹配的原则,且进行均匀加密算法处理得到的待分箱数据不可回溯,节省了服务流程需要的时间。
在一实施例中,步骤S22中,即对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果具体包括以下步骤:
S221:接收数据支持终端发送的加密钥匙。
S222:采用加密钥匙和第一私密钥匙对分箱号对应的样本信息进行加密,得到第一加密信息。
其中,加密钥匙为数据支持终端提供给服务终端的钥匙,加密钥匙用于服务终端对分箱号对应的样本信息进行加密。第一私密钥匙为服务终端对样本信息进行加密的钥匙,该第一私密钥匙仅服务终端拥有。第一加密信息为采用加密钥匙和第一私密钥匙对分箱号对应的样本信息进行加密得到的信息。具体地,在接收到数据支持终端发送的加密钥匙之后,采用加密钥匙和第一私密钥匙对分箱号对应的样本信息进行加密,得到第一加密信息。
S223:将第一加密信息发送至数据支持终端,以指示数据支持终端采用第二私密钥匙对第一加密信息进行加密,得到第二加密信息。
其中,第二私密钥匙为仅数据支持终端拥有的钥匙。第二加密信息为数据支持终端采用第二私密钥匙对第一加密信息进行加密得到的信息。具体地,在采用加密钥匙和第一私密钥匙对分箱号对应的样本信息进行加密,得到第一加密信息之后,将第一加密信息发送至数据支持终端中,数据支持终端在接收到第一加密信息之后,采用第二私密钥匙对第一加密信息进行加密,得到第二加密信息。
S224:接收数据支持终端发送的第二加密信息和第三加密信息,第三加密信息为数据支持终端采用加密钥匙和第二私密钥匙对分箱号对应的数据分区的数据信息进行加密得到的信息。
其中,第三加密信息为数据支持终端采用加密钥匙和第二私密钥匙对目标分区中的数据信息进行加密得到的信息。
具体地,在数据支持终端采用第二私密钥匙对第一加密信息进行加密,得到第二加密信息之后,数据支持终端将第二加密信息发送至服务终端。数据支持终端采用加密钥匙和第二私密钥匙对分箱号对应的数据分区的数据信息进行加密,得到第三加密信息。数据支持终端在得到第三加密信息之后,将第三加密信息发送至服务终端中。服务终端接收数据支持终端发送的第二加密信息和第三加密信息。
进一步地,服务终端得到第一加密信息和数据支持终端得到第三加密信息,这两个步骤的顺序不是固定的,可以先由服务终端得到第一加密信息,也可以先由数据支持终端得到第三加密信息或者两个步骤同时进行。
S225:对第二加密信息和第三加密信息进行引擎计算,得到中间结果。
具体地,在接收到数据支持终端发送的第二加密信息和第三加密信息之后,对第二加密信息和第三加密信息进行引擎计算,得到中间结果。
在本实施例中,通过采用加密钥匙对服务终端中分箱号对应的样本信息加密,在保证分箱号对应的数据不可见的情况下,能够与数据支持终端进行数据的交互,从而保证了数据的安全性的同时,保证了服务终端的用户的隐私性。通过引擎计算,使得服务终端与数据支持终端在信息交互环节上更安全,生成的页面数据更加准确。
应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。
在一实施例中,提供一种页面数据生成装置,该页面数据生成装置与上述实施例中页面数据生成方法一一对应。如图6所示,该页面数据生成装置包括分箱处理模块11、分箱信息发送模块12、分箱号接收模块13、第一引擎模块14、计算结果发送模块15和页面数据接收模块16。各功能模块详细说明如下:
分箱处理模块11,用于根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到待分箱数据的分箱信息和数据分区。
分箱信息发送模块12,用于将发送分箱信息至服务终端,以指示服务终端根据分箱信息对数据样本进行哈希运算,以得到分箱号,分箱号用于指示对应的数据分区。
分箱号接收模块13,用于接收服务终端返回的分箱号和请求访问指令,请求访问指令指示服务终端访问与分箱号对应的数据分区,对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果。
第一引擎计算模块14,用于接收服务终端发送的中间结果,并对中间结果进行引擎计算,得到计算结果。
计算结果发送模块15,用于将计算结果发送至服务终端,以指示服务终端对计算结果进行整合,得到页面数据。需要强调的是,为进一步保证上述页面数据的私密和安全性,上述页面数据还可以存储于一区块链的节点中。
页面数据接收模块16,用于接收服务终端发送的页面数据,以根据页面数据进行页面展示。
可选地,如图7所示,页面数据生成装置还包括:
规则接收模块17,用于接收服务终端发送的预设的规则。
数据一致化模块18,用于采用预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据。
均匀加密模块19,用于采用均匀加密算法对规则化数据进行处理,得到待分箱数据。
可选地,如图8所示,页面数据生成装置还包括:
目标分区确定模块141,用于从数据分区中确定与分箱号对应的分区,得到目标分区。
加密钥匙发送模块142,用于发送加密钥匙至服务终端中,以指示服务终端采用加密钥匙和第一私密钥匙对分箱号对应的样本信息进行加密,得到第一加密信息。
第一加密信息接收模块143,用于接收服务终端发送的第一加密信息,采用第二私密钥匙对第一加密信息进行加密,得到第二加密信息,并将第二加密信息发送至服务终端。
第一加密模块144,用于采用加密钥匙和第二私密钥匙对目标分区中的数据信息进行加密,得到第三加密信息。
第三加密信息发送模块145,用于将第三加密信息发送至服务终端中,以指示服务终端对第二加密信息和第三加密信息进行引擎计算,得到中间结果。
可选地,页面数据生成装置还包括:
分箱号统计模块146,用于统计分箱号的接收次数,在接收到一定数量的分箱号之后,根据分箱号的接收次数,调整分箱号对应的数据分区的权重。
权重提高模块147,用于当分箱号为第一分箱号时,提高该分箱号对应的数据分区的权重,所述第一分箱号指的是接收次数高于预设范围的分箱号。
权重降低模块148,用于当分箱号为第二分箱号时,则降低该分箱号对应的数据分区 的权重,所述第二分箱号指的是接收次数低于预设范围的分箱号。
在一实施例中,提供一种页面数据生成装置,该页面数据生成装置与上述实施例中页面数据生成方法一一对应。如图9所示,该页面数据生成装置包括分箱信息接收模块20、哈希运算模块21、分箱号发送模块22、中间结果发送模块23和计算结果接收模块24。各功能模块详细说明如下:
分箱信息接收模块20,用于接收数据支持终端发送的分箱信息,所述分箱信息为数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的。
哈希运算模块21,用于根据分箱信息,对数据样本进行哈希运算,得到数据样本对应的分箱号,所述分箱号用于指示在数据支持终端中与该分箱号对应的数据分区。
分箱号发送模块22,用于发送分箱号和请求访问指令至数据支持终端中,并对分箱号对应的样本信息和该分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果。
中间结果发送模块23,用于发送中间结果至数据支持终端中,以指示数据支持终端对中间结果进行引擎计算,得到计算结果。
计算结果接收模块24,用于接收数据支持终端发送的计算结果,并对计算结果进行整合,得到页面数据。
页面数据发送模块25,用于将页面数据发送至数据支持终端中,以指示数据支持终端根据页面数据进行页面展示。
可选地,页面数据生成装置还包括:
规则发送模块,用于发送预设的规则至数据提供方中,以指示数据支持终端根据预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据。
可选地,页面数据生成装置还包括:
加密钥匙接收模块221,用于接收数据支持终端发送的加密钥匙。
第二加密模块222,用于采用加密钥匙和第一私密钥匙对分箱号对应的样本信息进行加密,得到第一加密信息。
第二加密信息发送模块223,用于将第一加密信息发送至数据支持终端,以指示数据支持终端采用第二私密钥匙对第一加密信息进行加密,得到第二加密信息。
第二加密信息接收模块224,用于接收数据支持终端发送的第二加密信息和第三加密信息,第三加密信息为数据支持终端采用加密钥匙和第二私密钥匙对分箱号对应的数据分区的数据信息进行加密得到的信息。
第二引擎计算模块225,用于对第二加密信息和第三加密信息进行引擎计算,得到中间结果。
关于页面数据生成装置的具体限定可以参见上文中对于页面数据生成方法的限定,在此不再赘述。上述页面数据生成装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。
在一个实施例中,提供了一种计算机设备,该计算机设备可以是服务器,其内部结构图可以如图10所示。该计算机设备包括通过系统总线连接的处理器、存储器、网络接口和数据库。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括可读存储介质、内存储器。该可读存储介质存储有操作系统、计算机可读指令和数据库。该内存储器为可读存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的数据库用于存储上述实施例中页面数据生成方法中使用到的数据。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机可读指令被处理器执行时以实现一种页面数据生成方法。本实施例所提供的可读存储介质包括非易失性可读存储介质和易失性可读存储介质。
在一个实施例中,提供了一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机可读指令,处理器执行计算机可读指令时实现如下步骤:
根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
将所述计算结果发送至所述服务终端,以指示所述服务终端对所述计算结果进行整合,得到页面数据;
接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
在一个实施例中,提供了一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,所述处理器执行所述计算机可读指令时实现如下步骤:
接收数据支持终端发送的分箱信息,所述分箱信息为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的;
根据所述分箱信息,对数据样本进行哈希运算,得到所述数据样本对应的分箱号,所述分箱号用于指示在所述数据支持终端中与所述分箱号对应的数据分区,所述数据分区为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理;
发送所述分箱号和请求访问指令至所述数据支持终端,并对所述分箱号对应的样本信息和所述分箱号对应的所述数据分区的数据信息进行引擎计算,得到中间结果;
发送所述中间结果至所述数据支持终端中,以指示所述数据支持终端对中间结果进行引擎计算,得到计算结果;
接收所述数据支持终端发送的计算结果,并对所述计算结果进行整合,得到页面数据;
将所述页面数据发送至所述数据支持终端,以指示所诉数据支持终端根据所述页面数据进行页面展示。
在一个实施例中,提供了一个或多个存储有计算机可读指令的可读存储介质,本实施例所提供的可读存储介质包括非易失性可读存储介质和易失性可读存储介质;该可读存储介质上存储有计算机可读指令,该计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器实现如下步骤:
根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
将所述计算结果发送至所述服务终端,以指示所述服务终端对所述计算结果进行整合,得到页面数据;
接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
在一个实施例中,提供了一个或多个存储有计算机可读指令的可读存储介质,本实施例所提供的可读存储介质包括非易失性可读存储介质和易失性可读存储介质;该可读存储介质上存储有计算机可读指令,该计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器实现如下步骤:
接收数据支持终端发送的分箱信息,所述分箱信息为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的;
根据所述分箱信息,对数据样本进行哈希运算,得到所述数据样本对应的分箱号,所述分箱号用于指示在所述数据支持终端中与所述分箱号对应的数据分区,所述数据分区为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理;
发送所述分箱号和请求访问指令至所述数据支持终端,并对所述分箱号对应的样本信息和所述分箱号对应的所述数据分区的数据信息进行引擎计算,得到中间结果;
发送所述中间结果至所述数据支持终端中,以指示所述数据支持终端对中间结果进行引擎计算,得到计算结果;
接收所述数据支持终端发送的计算结果,并对所述计算结果进行整合,得到页面数据;
将所述页面数据发送至所述数据支持终端,以指示所诉数据支持终端根据所述页面数据进行页面展示。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机可读指令可存储于一非易失性计算机可读取存储介质或者易失性计算机可读取存储介质中,该计算机可读指令在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部或者部分功能。
本申请所指区块链是分布式数据存储、点对点传输、共识机制、加密算法等计算机技术的新型应用模式。区块链(Blockchain),本质上是一个去中心化的数据库,是一串使用密码学方法相关联产生的数据块,每一个数据块中包含了一批次网络交易的信息,用于验证其信息的有效性(防伪)和生成下一个区块。区块链可以包括区块链底层平台、平台产品服务层以及应用服务层等。
以上所述实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围,均应包含在本申请的保护范围之内。

Claims (20)

  1. 一种页面数据生成方法,其中,包括:
    根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
    将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
    接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
    接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
    将所述计算结果发送至所述服务终端,以指示所述服务终端对所述计算结果进行整合,得到页面数据;
    接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
  2. 如权利要求1所述的页面数据生成方法,其中,在所述根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到待分箱数据的分箱信息和数据分区之前,所述页面数据生成方法还包括:
    接收所述服务终端发送的预设的规则;
    采用所述预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据;
    采用均匀加密算法对所述规则化数据进行处理,得到待分箱数据。
  3. 如权利要求1所述的页面数据生成方法,其中,在所述接收所述服务终端返回的所述分箱号和请求访问指令之后,所述页面数据生成方法还包括:
    从所述数据分区中确定与所述分箱号对应的分区,得到目标分区;
    发送加密钥匙至所述服务终端中,以指示所述服务终端采用所述加密钥匙和第一私密钥匙对所述分箱号对应的样本信息进行加密,得到第一加密信息;
    接收所述服务终端发送的所述第一加密信息,采用第二私密钥匙对所述第一加密信息进行加密,得到第二加密信息;
    采用加密钥匙和第二私密钥匙对所述目标分区中的数据信息进行加密,得到第三加密信息;
    将所述第二加密信息和所述第三加密信息发送至所述服务终端中,以指示所述服务终端对所述第二加密信息和所述第三加密信息进行引擎计算,得到所述中间结果。
  4. 如权利要求1所述的页面数据生成方法,其中,所述页面数据存储于区块链中,在所述接收所述服务终端返回的所述分箱号和请求访问指令之后,所述页面数据生成方法还包括:
    统计所述分箱号的接收次数,根据所述分箱号的接收次数,调整所述分箱号对应的数据分区的权重;
    若所述分箱号为第一分箱号,则提高所述分箱号对应的数据的权重,所述第一分箱号指的是接收次数高于预设范围的分箱号;
    若所述分箱号为第二分箱号,则降低所述分箱号对应的数据的权重,所述第二分箱号指的是接收次数低于预设范围的分箱号。
  5. 一种页面数据生成方法,其中,包括:
    接收数据支持终端发送的分箱信息,所述分箱信息为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的;
    根据所述分箱信息,对数据样本进行哈希运算,得到所述数据样本对应的分箱号,所述分箱号用于指示在所述数据支持终端中与所述分箱号对应的数据分区,所述数据分区为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理;
    发送所述分箱号和请求访问指令至所述数据支持终端,并对所述分箱号对应的样本信息和所述分箱号对应的所述数据分区的数据信息进行引擎计算,得到中间结果;
    发送所述中间结果至所述数据支持终端中,以指示所述数据支持终端对中间结果进行引擎计算,得到计算结果;
    接收所述数据支持终端发送的计算结果,并对所述计算结果进行整合,得到页面数据;
    将所述页面数据发送至所述数据支持终端,以指示所诉数据支持终端根据所述页面数据进行页面展示。
  6. 如权利要求5所述的页面数据生成方法,其中,在所述接收数据支持终端发送的分箱信息之前,所述页面数据生成方法还包括:
    发送预设的规则至所述数据支持终端中,以指示所述数据支持终端根据预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据。
  7. 如权利要求5所述的页面数据生成方法,其中,所述页面数据存储于区块链中,所述对所述分箱号对应的样本信息和所述分箱号对应的所述数据分区的数据信息进行引擎计算,得到中间结果,包括:
    接收所述数据支持终端发送的加密钥匙;
    采用所述加密钥匙和第一私密钥匙对所述分箱号对应的样本信息进行加密,得到第一加密信息;
    将所述第一加密信息发送至数据支持终端,以指示所述数据支持终端采用第二私密钥匙对所述第一加密信息进行加密,得到第二加密信息;
    接收所述数据支持终端发送的所述第二加密信息和第三加密信息,所述第三加密信息为所述数据支持终端采用所述加密钥匙和第二私密钥匙对所述分箱号对应的所述数据分区的数据信息进行加密得到的。
    对所述第二加密信息和所述第三加密信息进行引擎计算,得到中间结果。
  8. 一种页面数据生成装置,其中,包括:
    分箱处理模块,用于根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
    分箱信息发送模块,用于将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
    分箱号接收模块,用于接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
    第一引擎计算模块,用于接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
    计算结果发送模块,用于将所述计算结果发送至所述服务终端,以指示所述服务终端对所述计算结果进行整合,得到页面数据;
    页面数据接收模块,用于接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
  9. 一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,其中,所述处理器执行所述计算机可读指令时实现如下步骤:
    根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
    将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
    接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
    接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
    将所述计算结果发送至所述服务终端,以指示所述服务终端对所述计算结果进行整合,得到页面数据;
    接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
  10. 如权利要求9所述的计算机设备,其中,所述根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到待分箱数据的分箱信息和数据分区之前,所述处理器执行所述计算机可读指令时还实现如下步骤:
    接收所述服务终端发送的预设的规则;
    采用所述预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据;
    采用均匀加密算法对所述规则化数据进行处理,得到待分箱数据。
  11. 如权利要求9所述的计算机设备,其中,所述接收所述服务终端返回的所述分箱号和请求访问指令之后,所述处理器执行所述计算机可读指令时还实现如下步骤:
    从所述数据分区中确定与所述分箱号对应的分区,得到目标分区;
    发送加密钥匙至所述服务终端中,以指示所述服务终端采用所述加密钥匙和第一私密钥匙对所述分箱号对应的样本信息进行加密,得到第一加密信息;
    接收所述服务终端发送的所述第一加密信息,采用第二私密钥匙对所述第一加密信息进行加密,得到第二加密信息;
    采用加密钥匙和第二私密钥匙对所述目标分区中的数据信息进行加密,得到第三加密信息;
    将所述第二加密信息和所述第三加密信息发送至所述服务终端中,以指示所述服务终端对所述第二加密信息和所述第三加密信息进行引擎计算,得到所述中间结果。
  12. 如权利要求9所述的计算机设备,其中,所述页面数据存储于区块链中,在所述接收所述服务终端返回的所述分箱号和请求访问指令之后,所述处理器执行所述计算机可读指令时还实现如下步骤:
    统计所述分箱号的接收次数,根据所述分箱号的接收次数,调整所述分箱号对应的数据分区的权重;
    若所述分箱号为第一分箱号,则提高所述分箱号对应的数据的权重,所述第一分箱号指的是接收次数高于预设范围的分箱号;
    若所述分箱号为第二分箱号,则降低所述分箱号对应的数据的权重,所述第二分箱号指的是接收次数低于预设范围的分箱号。
  13. 一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,其中,所述处理器执行所述计算机可读指令时实现如下步骤:
    接收数据支持终端发送的分箱信息,所述分箱信息为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的;
    根据所述分箱信息,对数据样本进行哈希运算,得到所述数据样本对应的分箱号,所述分箱号用于指示在所述数据支持终端中与所述分箱号对应的数据分区,所述数据分区为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理;
    发送所述分箱号和请求访问指令至所述数据支持终端,并对所述分箱号对应的样本信息和所述分箱号对应的所述数据分区的数据信息进行引擎计算,得到中间结果;
    发送所述中间结果至所述数据支持终端中,以指示所述数据支持终端对中间结果进行引擎计算,得到计算结果;
    接收所述数据支持终端发送的计算结果,并对所述计算结果进行整合,得到页面数据;
    将所述页面数据发送至所述数据支持终端,以指示所诉数据支持终端根据所述页面数据进行页面展示。
  14. 如权利要求13所述的计算机设备,其中,所述接收数据支持终端发送的分箱信息之前,所述处理器执行所述计算机可读指令时还实现如下步骤:
    发送预设的规则至所述数据支持终端中,以指示所述数据支持终端根据预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据。
  15. 一个或多个存储有计算机可读指令的可读存储介质,其中,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:
    根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到所述待分箱数据的分箱信息和数据分区;
    将所述分箱信息发送至服务终端,以指示所述服务终端根据所述分箱信息对数据样本进行哈希运算,以得到分箱号,所述分箱号用于指示对应的数据分区;
    接收所述服务终端返回的所述分箱号和请求访问指令,所述请求访问指令指示所述服务终端访问与所述分箱号对应的数据分区,对所述分箱号对应的样本信息和所述分箱号对应的数据分区的数据信息进行引擎计算,得到中间结果;
    接收所述服务终端发送的所述中间结果,并对所述中间结果进行引擎计算,得到计算结果;
    将所述计算结果发送至所述服务终端,以指示所述服务终端对所述计算结果进行整合,得到页面数据;
    接收所述服务终端发送的所述页面数据,以根据所述页面数据进行页面展示。
  16. 如权利要求15所述的可读存储介质,其中,所述根据预设的分箱策略对数据库中的待分箱数据进行分箱处理,得到待分箱数据的分箱信息和数据分区之前,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器还执行如下步骤:
    接收所述服务终端发送的预设的规则;
    采用所述预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据;
    采用均匀加密算法对所述规则化数据进行处理,得到待分箱数据。
  17. 如权利要求15所述的可读存储介质,其中,所述接收所述服务终端返回的所述分箱号和请求访问指令之后,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器还执行如下步骤:
    从所述数据分区中确定与所述分箱号对应的分区,得到目标分区;
    发送加密钥匙至所述服务终端中,以指示所述服务终端采用所述加密钥匙和第一私密钥匙对所述分箱号对应的样本信息进行加密,得到第一加密信息;
    接收所述服务终端发送的所述第一加密信息,采用第二私密钥匙对所述第一加密信息进行加密,得到第二加密信息;
    采用加密钥匙和第二私密钥匙对所述目标分区中的数据信息进行加密,得到第三加密信息;
    将所述第二加密信息和所述第三加密信息发送至所述服务终端中,以指示所述服务终端对所述第二加密信息和所述第三加密信息进行引擎计算,得到所述中间结果。
  18. 如权利要求15所述的可读存储介质,其中,所述页面数据存储于区块链中,在所述接收所述服务终端返回的所述分箱号和请求访问指令之后,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器还执行如下步骤:
    统计所述分箱号的接收次数,根据所述分箱号的接收次数,调整所述分箱号对应的数据分区的权重;
    若所述分箱号为第一分箱号,则提高所述分箱号对应的数据的权重,所述第一分箱号指的是接收次数高于预设范围的分箱号;
    若所述分箱号为第二分箱号,则降低所述分箱号对应的数据的权重,所述第二分箱号指的是接收次数低于预设范围的分箱号。
  19. 一个或多个存储有计算机可读指令的可读存储介质,其中,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:
    接收数据支持终端发送的分箱信息,所述分箱信息为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理后得到的;
    根据所述分箱信息,对数据样本进行哈希运算,得到所述数据样本对应的分箱号,所述分箱号用于指示在所述数据支持终端中与所述分箱号对应的数据分区,所述数据分区为所述数据支持终端根据预设的分箱策略对数据库中的待分箱数据进行分箱处理;
    发送所述分箱号和请求访问指令至所述数据支持终端,并对所述分箱号对应的样本信息和所述分箱号对应的所述数据分区的数据信息进行引擎计算,得到中间结果;
    发送所述中间结果至所述数据支持终端中,以指示所述数据支持终端对中间结果进行引擎计算,得到计算结果;
    接收所述数据支持终端发送的计算结果,并对所述计算结果进行整合,得到页面数据;
    将所述页面数据发送至所述数据支持终端,以指示所诉数据支持终端根据所述页面数据进行页面展示。
  20. 如权利要求19所述的可读存储介质,其中,所述接收数据支持终端发送的分箱信息之前,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:
    发送预设的规则至所述数据支持终端中,以指示所述数据支持终端根据预设的规则对数据库中数据的数据格式进行一致化操作,得到规则化数据。
PCT/CN2020/136016 2020-04-30 2020-12-14 页面数据生成方法、装置、计算机设备及存储介质 WO2021218177A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010365846.0 2020-04-30
CN202010365846.0A CN111666493B (zh) 2020-04-30 2020-04-30 页面数据生成方法、装置、计算机设备及存储介质

Publications (1)

Publication Number Publication Date
WO2021218177A1 true WO2021218177A1 (zh) 2021-11-04

Family

ID=72383055

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/136016 WO2021218177A1 (zh) 2020-04-30 2020-12-14 页面数据生成方法、装置、计算机设备及存储介质

Country Status (2)

Country Link
CN (1) CN111666493B (zh)
WO (1) WO2021218177A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111666493B (zh) * 2020-04-30 2024-05-03 平安科技(深圳)有限公司 页面数据生成方法、装置、计算机设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105187503A (zh) * 2015-08-07 2015-12-23 北京思特奇信息技术股份有限公司 一种支持数据分区的服务连接方法及系统
US20180260451A1 (en) * 2017-03-08 2018-09-13 Microsoft Technology Licensing, Llc Database query for histograms
CN110321347A (zh) * 2019-05-30 2019-10-11 上海数据交易中心有限公司 数据匹配方法及装置、存储介质、终端
CN110990883A (zh) * 2019-11-22 2020-04-10 金蝶软件(中国)有限公司 数据访问方法、装置、计算机可读存储介质和计算机设备
CN111666576A (zh) * 2020-04-29 2020-09-15 平安科技(深圳)有限公司 数据处理模型生成方法和装置、数据处理方法和装置
CN111666493A (zh) * 2020-04-30 2020-09-15 平安科技(深圳)有限公司 页面数据生成方法、装置、计算机设备及存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103246980B (zh) * 2012-02-02 2017-05-03 阿里巴巴集团控股有限公司 信息输出方法及服务器
CN107612982B (zh) * 2017-08-31 2019-06-18 武汉斗鱼网络科技有限公司 一种降低功能页面请求次数的方法、存储介质、设备及系统
CN110347493A (zh) * 2019-07-16 2019-10-18 广州虎牙科技有限公司 页面数据的处理方法、显示方法、装置、设备及存储介质
CN110727510A (zh) * 2019-09-25 2020-01-24 浙江大搜车软件技术有限公司 用户数据处理方法、装置、计算机设备和存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105187503A (zh) * 2015-08-07 2015-12-23 北京思特奇信息技术股份有限公司 一种支持数据分区的服务连接方法及系统
US20180260451A1 (en) * 2017-03-08 2018-09-13 Microsoft Technology Licensing, Llc Database query for histograms
CN110321347A (zh) * 2019-05-30 2019-10-11 上海数据交易中心有限公司 数据匹配方法及装置、存储介质、终端
CN110990883A (zh) * 2019-11-22 2020-04-10 金蝶软件(中国)有限公司 数据访问方法、装置、计算机可读存储介质和计算机设备
CN111666576A (zh) * 2020-04-29 2020-09-15 平安科技(深圳)有限公司 数据处理模型生成方法和装置、数据处理方法和装置
CN111666493A (zh) * 2020-04-30 2020-09-15 平安科技(深圳)有限公司 页面数据生成方法、装置、计算机设备及存储介质

Also Published As

Publication number Publication date
CN111666493A (zh) 2020-09-15
CN111666493B (zh) 2024-05-03

Similar Documents

Publication Publication Date Title
WO2021218167A1 (zh) 数据处理模型生成方法和装置、数据处理方法和装置
US11153072B2 (en) Processing blockchain data based on smart contract operations executed in a trusted execution environment
US10860710B2 (en) Processing and storing blockchain data under a trusted execution environment
US10644876B2 (en) Secure analytics using homomorphic encryption
US20190042786A1 (en) Query Processing with Adaptive Risk Decisioning
US11775656B2 (en) Secure multi-party information retrieval
CN112579606A (zh) 工作流数据处理方法、装置、计算机设备及存储介质
US11604608B2 (en) Blockchain transaction processing systems and methods
EP3961458A1 (en) Blockchain-based service processing methods, apparatuses, devices, and storage media
Taha et al. An improved security schema for mobile cloud computing using hybrid cryptographic algorithms
US20210311925A1 (en) Blockchain transaction processing systems and methods
WO2020253380A1 (zh) 数据加密方法、装置及终端设备
WO2021218177A1 (zh) 页面数据生成方法、装置、计算机设备及存储介质
CN114428784A (zh) 数据存取方法、装置、计算机设备及存储介质
CN114138849A (zh) 多租户数据权限控制方法、装置、计算机及可读存储介质
US10326833B1 (en) Systems and method for processing request for network resources
CN111291084A (zh) 样本id对齐方法、装置、设备及存储介质
US11500845B2 (en) Blockchain transaction processing systems and methods
WO2021114621A1 (zh) 基于人工智能的数据替换方法、装置、计算机设备和介质
US11870763B2 (en) Systems and methods for inter-system account identification
US20230046579A1 (en) Information security system and method for secure data transmission among user profiles using a blockchain network
CN114357024A (zh) 提升用户画像接口性能的方法、装置和计算机设备
CN116842541A (zh) 数据加解密处理方法、装置、计算机设备及存储介质
JP2019174621A (ja) 情報処理装置、システム、情報処理方法及びプログラム
JP2011141764A (ja) コンピューティング共有システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20933474

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20933474

Country of ref document: EP

Kind code of ref document: A1