WO2023029850A1 - Data processing method and apparatus, and electronic device and medium - Google Patents

Data processing method and apparatus, and electronic device and medium Download PDF

Info

Publication number
WO2023029850A1
WO2023029850A1 PCT/CN2022/109352 CN2022109352W WO2023029850A1 WO 2023029850 A1 WO2023029850 A1 WO 2023029850A1 CN 2022109352 W CN2022109352 W CN 2022109352W WO 2023029850 A1 WO2023029850 A1 WO 2023029850A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
data structure
source table
data model
model
Prior art date
Application number
PCT/CN2022/109352
Other languages
French (fr)
Chinese (zh)
Inventor
张祎
陈文航
陈昌源
罗旋
Original Assignee
北京火山引擎科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京火山引擎科技有限公司 filed Critical 北京火山引擎科技有限公司
Publication of WO2023029850A1 publication Critical patent/WO2023029850A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures

Definitions

  • the invention belongs to the technical field of computer processing, and in particular relates to a data processing method, device, electronic equipment and medium.
  • the accuracy of data analysis depends on the accuracy of the data model, which is obtained from the source data table (source table).
  • source table source data table
  • the structure of the source table is inconsistent with the structure of the data model, which in turn causes the accuracy of the data model to decrease or even fail to synchronize the data.
  • the embodiments of the present application provide a data processing method, device, electronic device, and medium, so as to update the structure of the data model when the data structure of the source table changes, and improve the accuracy of data analysis.
  • a data processing method comprising:
  • the first data structure of the data model is acquired, the data model is a corresponding data table when analyzing the data in the first source table, and the first data
  • the structure is the data structure corresponding to the data model before the data structure of the first source table changes;
  • the data structure of the first source table is the data structure corresponding to the first source table after the change ;
  • the first data structure of the data model is adjusted according to the matching result to obtain the second data structure of the data model.
  • a data processing device in the second aspect of the embodiment of the present application, includes:
  • An acquiring unit configured to acquire a first data structure of a data model in response to a change in the data structure of the first source table, where the data model is a corresponding data table when analyzing data in the first source table,
  • the first data structure is a data structure corresponding to the data model before the data structure of the first source table changes;
  • a matching unit configured to match the data structure in the first source table with the first data structure of the data model to obtain a matching result, where the data structure of the first source table is the first The data structure corresponding to the source table;
  • An adjustment unit configured to adjust the first data structure of the data model according to the matching result to obtain a second data structure of the data model.
  • an electronic device in the third aspect of the embodiment of the present application, includes: a processor and a memory;
  • said memory for storing instructions or computer programs
  • the processor is configured to execute the instructions or computer programs in the memory, so that the electronic device executes the data processing method described in the first aspect.
  • a computer-readable storage medium including instructions, which, when run on a computer, cause the computer to execute the data processing method described in the first aspect.
  • the data structure of the first source table can be monitored.
  • the first data structure of the data model is acquired.
  • the first data structure is the data structure corresponding to the data model before the data structure of the first source table changes.
  • the data model is used to analyze the data in the first source table, and the data model physically corresponds to a data table, and the data table is obtained according to the data in the first source table.
  • adjust the first data structure of the data model according to the matching result to obtain the second data structure of the data model.
  • Fig. 1 is a flow chart of a data processing method provided by the embodiment of the present application.
  • Fig. 2a is a schematic diagram of data structure adjustment of a data source table provided by the embodiment of the present application.
  • Fig. 2b is a schematic diagram of a comparison of data structure adjustment provided by the embodiment of the present application.
  • FIG. 2c is a schematic diagram of another data structure adjustment comparison provided by the embodiment of the present application.
  • Figure 3a is a data structure framework diagram of an automatically updated data model provided by the embodiment of the present application.
  • FIG. 3b is a data structure framework diagram of a manual update data model provided by the embodiment of the present application.
  • FIG. 4 is a structural diagram of a data processing device provided in an embodiment of the present application.
  • FIG. 5 is a structural diagram of an electronic device provided by an embodiment of the present application.
  • the data source table is the original table used to store data, which is the data on the user side.
  • Data model used to analyze the data in the source table, which physically corresponds to a bottom table.
  • Bottom table A data table used to store the structure of the data model and the data in the source table.
  • the structure of the data model is consistent with the structure of the bottom table. Among them, the reading speed of the data in the bottom table is higher than that of the data in the source table.
  • Synchronization task used to synchronize the data in the source table to the bottom table.
  • the user can generate a bottom table based on the data and related configuration of the source table to store the structure and data of the data model.
  • the synchronization task will automatically synchronize the new data from the source table to the bottom table.
  • the data structure of the source table changes, for example, a new field is added to the source table, because the structure of the bottom table has not changed accordingly, the data structure of the bottom table is inconsistent with the data structure of the source table, resulting in data loss and synchronization mission failed.
  • the first data structure of the data model is acquired.
  • the first data structure is the data structure corresponding to the data model before the data structure of the first source table changes, and the data structure of the first source table (the data structure after the change) and the first data structure of the data model Match and get the matching result.
  • the first data structure of the data model is adjusted according to the matching result to obtain the second data structure of the data model.
  • the data structure of the first source table is compared with the first data structure of the data model to obtain the comparison result , and adjust the first data structure of the data model according to the comparison result. Therefore, the second data structure of the data model is consistent with the data structure of the first source table, thereby ensuring the smooth progress of the synchronization task and improving the accuracy of data analysis.
  • FIG. 1 is a flow chart of a data processing method provided by the embodiment of the present application. As shown in Fig. 1, the method may include:
  • the data structure of the first source table can be monitored.
  • the first data structure of the data model is acquired.
  • the first data structure is the data structure corresponding to the data model before the data structure of the first source table changes.
  • the data model is a new data table generated according to the first source table, and the data table can analyze the data in the first source table. That is, the data included in the data model is consistent with the data in the first source table, but the data in the data model may have attribute information, such as life cycle.
  • the change of the data structure of the first source table may be operations such as adding fields, deleting fields, and modifying fields in the first source table. For example, as shown in Figure 2a, taking the modified field as an example, before modification, the field is password, and after modification, the field is pwd.
  • the data structure of the first source table is the data structure corresponding to the first source table after the change.
  • the matching result may include one or more of adding fields, deleting fields, and modifying fields. For example, as shown in FIG. 2b, the data structure of the first source table is compared with the first data structure of the data model, and the matching result is a modified field. As shown in 2c, the data structure of the first source table is compared with the first data structure of the data model, and the matching result is an added field.
  • the first data structure of the data model is adjusted according to the matching result to obtain the second data structure of the data model. Further, after the first data structure of the data model is adjusted, the data corresponding to the second data structure of the data model is updated according to the data corresponding to the data structure of the first source table, thereby completing the synchronization task.
  • the matching result when the matching result is adding a field, a corresponding field is added to the first data structure of the data model.
  • the matching result is to delete a field, delete the corresponding field in the first data structure of the data model.
  • the matching result is a modified field, the field before modification in the first data structure of the data model is deleted first, and then the field after modification is added in the first data structure of the data model. For example, if the field password in the first source table is changed to the field pwd, then when adjusting the first data structure of the data model, the field password is deleted first, and then the field pwd is added to obtain the second data structure of the data model.
  • one data model can correspond to multiple source tables.
  • the field name added and/or the modified field name in the data structure of the first source table is duplicated with the field name in the data structure of the second source table, and the first data structure of the data model is adjusted , then add the corresponding source table identifier after the field name to distinguish fields from different source tables.
  • a data model corresponds to a first source table and a second source table.
  • the field password in the first source table is changed to the field pwd, and the second source table includes the field pwd, then when the data model is modified, the field password of the first source table in the first data structure of the data model is modified is pwd.1, and the field pwd in the second source table in the first data structure of the data model is changed to pwd.2.
  • the first data structure of the data model may not be adjusted.
  • the task of updating the first data structure of the data model may be automatically triggered, or the user may be notified to perform manual updating.
  • manual update and automatic update are performed at the same time, it will not only cause waste of resources, but also may cause update errors.
  • an adjustment flag is added to avoid simultaneous execution of manual update and automatic update.
  • the adjustment flag bit may be modified to the second information. For example, modify the adjustment flag bit to "modifying".
  • the update operation is no longer performed because the flag is adjusted to be the second information at this time.
  • the adjustment flag bit is modified to the first information, for example, the adjustment flag bit is set to null or no modification.
  • the information corresponding to the adjustment flag bit is acquired first.
  • the information of the adjustment flag bit is the first information, it indicates that there is no other update operation currently, the information of the adjustment flag bit is changed to the second information, and the first data structure of the data model is adjusted.
  • the information of the adjustment flag is modified to the first information.
  • the adjustment flag bit is used to indicate whether the first data structure of the data model is being modified.
  • FIG. 3a is a processing flow of updating the first data structure of the data model automatically triggered in the synchronization task. First, it is determined whether the adjustment flag is being modified, and if not, the adjustment flag is configured as "modifying", and the first data structure of the data model is modified. After the modification is complete, execute the data update task. After executing the data update task, set the adjustment flag bit to "null". If the adjustment flag is "modifying", then end.
  • Fig. 3b is a processing flow of manually updating the first data structure of the data model. First judge whether the adjustment flag is being modified, if not, configure the adjustment flag as "modifying".
  • the adjustment flag bit is configured as "empty”. If the adjustment flag is "modifying”, then end.
  • the data structure of the first source table (the changed data structure) and the first data structure of the data model ( Compare the data structure corresponding to the data model before the data structure of the first source table changes, and obtain a comparison result. And adjust the first data structure of the data model according to the comparison result, so that the second data structure of the data model is consistent with the data structure of the first source table, thereby ensuring the smooth progress of the synchronization task and improving the accuracy of data analysis.
  • an embodiment of the present application provides a data processing device, which will be described below with reference to the accompanying drawings.
  • FIG. 4 is a structural diagram of a data processing device provided in the embodiment of the present application. As shown in FIG. 4, the device may include:
  • An acquisition unit 401 configured to acquire a first data structure of a data model in response to a change in the data structure of the first source table, where the data model is a corresponding data table when analyzing data in the first source table , the first data structure is the data structure corresponding to the data model before the data structure of the first source table changes;
  • the matching unit 402 is configured to match the data structure in the first source table with the first data structure of the data model to obtain a matching result.
  • the data structure of the first source table is the first data structure after the change.
  • the adjustment unit 403 is configured to adjust the first data structure of the data model according to the matching result to obtain a second data structure of the data model.
  • the matching result includes one or more of adding fields, deleting fields and modifying fields.
  • the adjustment unit 403 is specifically configured to delete the field before modification in the first data structure in the data model when the matching result is the modified field;
  • the modified field is added to the first data structure in the data model to obtain the second data structure of the data model.
  • the device further includes: an adding unit;
  • the adding unit is specifically used to, when the field name of the added field and/or the field name of the modified field is repeated with the field name in the second source table, the field name of the corresponding field in the second data structure of the data model A corresponding source table identifier is added afterwards, and the data model is a corresponding data table when analyzing the data in the second source table.
  • the device further includes: a modifying unit;
  • the acquiring unit is further configured to acquire information corresponding to the adjustment flag bit
  • a modifying unit configured to modify the adjustment flag bit to second information when the adjustment flag bit is the first information.
  • the modifying unit is further configured to modify the adjustment flag bit to the first information after obtaining the second data structure of the data model.
  • the device further includes: an updating unit;
  • the updating unit is configured to update the data corresponding to the second data structure of the data model according to the data corresponding to the data structure of the first source table.
  • FIG. 5 it shows a schematic structural diagram of an electronic device 500 suitable for implementing the embodiment of the present application.
  • the terminal equipment in the embodiment of the present application may include but not limited to mobile phones, notebook computers, digital broadcast receivers, PDA (Personal Digital Assistant, personal digital assistant), PAD (portable android device, tablet computer), PMP (Portable Media Player, portable multimedia player), mobile terminals such as vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital TVs (television, television sets), desktop computers, and the like.
  • the electronic device shown in FIG. 5 is only an example, and should not limit the functions and scope of use of this embodiment of the present application.
  • an electronic device 500 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 501, which may be randomly accessed according to a program stored in a read-only memory (ROM) 502 or loaded from a storage device 508.
  • ROM read-only memory
  • RAM random access memory
  • various appropriate actions and processes are executed by programs in the memory (RAM) 503 .
  • RAM random access memory
  • various programs and data necessary for the operation of the electronic device 500 are also stored.
  • the processing device 501, ROM 502, and RAM 503 are connected to each other through a bus 504.
  • An input/output (I/O) interface 505 is also connected to the bus 504 .
  • the following devices can be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speaker, vibration an output device 507 such as a computer; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509.
  • the communication means 509 may allow the electronic device 500 to perform wireless or wired communication with other devices to exchange data. While FIG. 5 shows electronic device 500 having various means, it is to be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.
  • the processes described above with reference to the flowcharts can be implemented as computer software programs.
  • the embodiments of the present application include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, where the computer program includes program code for executing the method shown in the flowchart.
  • the computer program may be downloaded and installed from a network via communication means 509 , or from storage means 508 , or from ROM 502 .
  • the processing device 501 the above-mentioned functions defined in the method of the embodiment of the present application are executed.
  • An embodiment of the present application provides a computer-readable medium on which a computer program is stored, wherein, when the program is executed by a processor, the data processing method as described in any of the foregoing embodiments is implemented.
  • the computer-readable medium mentioned above in this application may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
  • a computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device .
  • Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
  • the client and the server can communicate using any currently known or future network protocols such as HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), and can communicate with digital data in any form or medium
  • HTTP HyperText Transfer Protocol
  • the communication eg, communication network
  • Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network of.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being incorporated into the electronic device.
  • the above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device is made to execute the above-mentioned data processing method.
  • Computer program code for carrying out the operations of this application may be written in one or more programming languages, or combinations thereof, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages - such as the "C" language or similar programming languages.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).
  • LAN local area network
  • WAN wide area network
  • Internet service provider such as AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
  • each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions.
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.
  • the units involved in the embodiments described in the present application may be implemented by means of software or by means of hardware.
  • the name of the unit/module does not constitute a limitation on the unit itself under certain circumstances, for example, the voice data collection module can also be described as a "data collection module”.
  • FPGAs Field Programmable Gate Arrays
  • ASICs Application Specific Integrated Circuits
  • ASSPs Application Specific Standard Products
  • SOCs System on Chips
  • CPLD Complex Programmable Logical device
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device.
  • a machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • a machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing.
  • machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read only memory
  • EPROM or flash memory erasable programmable read only memory
  • CD-ROM compact disk read only memory
  • magnetic storage or any suitable combination of the foregoing.
  • each embodiment in this specification is described in a progressive manner, each embodiment focuses on the differences from other embodiments, and the same and similar parts of each embodiment can be referred to each other.
  • the system or device disclosed in the embodiment since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for relevant details, please refer to the description of the method part.
  • At least one (item) means one or more, and “multiple” means two or more.
  • “And/or” is used to describe the association relationship of associated objects, indicating that there can be three types of relationships, for example, “A and/or B” can mean: only A exists, only B exists, and A and B exist at the same time , where A and B can be singular or plural.
  • the character “/” generally indicates that the contextual objects are an “or” relationship.
  • At least one of the following” or similar expressions refer to any combination of these items, including any combination of single or plural items.
  • At least one item (piece) of a, b or c can mean: a, b, c, "a and b", “a and c", “b and c", or "a and b and c ", where a, b, c can be single or multiple.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Provided is a data processing method. The method comprises: in response to a change in the data structure of a first source table, acquiring a first data structure of a data model, wherein the first data structure is a data structure corresponding to the data model before the data structure of the first source table changes (S101); matching the data structure in the first source table with the first data structure of the data model, so as to obtain a matching result, wherein the data structure of the first source table is a data structure corresponding to the changed first source table (S102); and adjusting the first data structure of the data model according to the matching result, so as to obtain a second data structure of the data model (S103). It can be seen that, by means of the method provided in the present application, the data structure of a data model is kept consistent with the data structure of a first source table, thereby improving the accuracy of data analysis.

Description

一种数据处理方法、装置、电子设备和介质A data processing method, device, electronic equipment and medium
本申请要求于2021年9月1日提交中国国家知识产权局、申请号为202111022842.3、发明名称为“一种数据处理方法、装置、电子设备和介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202111022842.3 and the title of the invention "a data processing method, device, electronic device and medium" submitted to the State Intellectual Property Office of China on September 1, 2021, the entire content of which Incorporated in this application by reference.
技术领域technical field
本发明属于计算机处理技术领域,具体涉及一种数据处理方法、装置、电子设备和介质。The invention belongs to the technical field of computer processing, and in particular relates to a data processing method, device, electronic equipment and medium.
背景技术Background technique
随着大数据技术与应用的发展,企业管理的数据量越来越庞大,大数据分析已成为驱动企业业务发展的必备手段。数据分析的准确性取决于数据模型的准确性,数据模型是根据源数据表(源表)得到的。而当源数据表中的字段改变时,由于数据模型不能同步改变结构,导致源表结构和数据模型结构不一致,进而造成数据模型准确性下降甚至数据同步失败。With the development of big data technology and applications, the amount of data managed by enterprises is becoming larger and larger, and big data analysis has become an essential means to drive business development of enterprises. The accuracy of data analysis depends on the accuracy of the data model, which is obtained from the source data table (source table). However, when the fields in the source data table change, because the data model cannot change the structure synchronously, the structure of the source table is inconsistent with the structure of the data model, which in turn causes the accuracy of the data model to decrease or even fail to synchronize the data.
发明内容Contents of the invention
有鉴于此,本申请实施例提供一种数据处理方法、装置、电子设备和介质,以实现在源表的数据结构发生变化时,对数据模型的结构进行更新,提高数据分析的准确性。In view of this, the embodiments of the present application provide a data processing method, device, electronic device, and medium, so as to update the structure of the data model when the data structure of the source table changes, and improve the accuracy of data analysis.
为实现上述目的,本申请实施例提供的技术方案如下:In order to achieve the above purpose, the technical solutions provided by the embodiments of the present application are as follows:
在本申请实施例第一方面,提供了一种数据处理方法,所述方法包括:In the first aspect of the embodiment of the present application, a data processing method is provided, the method comprising:
响应于第一源表的数据结构发生变化,获取数据模型的第一数据结构,所述数据模型为对所述第一源表中的数据进行分析时所对应的数据表,所述第一数据结构为所述第一源表的数据结构发生变化前所述数据模型对应的数据结构;In response to a change in the data structure of the first source table, the first data structure of the data model is acquired, the data model is a corresponding data table when analyzing the data in the first source table, and the first data The structure is the data structure corresponding to the data model before the data structure of the first source table changes;
将所述第一源表的数据结构与所述数据模型的第一数据结构进行匹配,获得匹配结果,所述第一源表的数据结构为发生变化后所述第一源表对应的数据结构;Matching the data structure of the first source table with the first data structure of the data model to obtain a matching result, the data structure of the first source table is the data structure corresponding to the first source table after the change ;
根据所述匹配结果对所述数据模型的第一数据结构进行调整,获得所述数据模型的第二数据结构。The first data structure of the data model is adjusted according to the matching result to obtain the second data structure of the data model.
在本申请实施例第二方面,提供了一种数据处理装置,所述装置包括:In the second aspect of the embodiment of the present application, a data processing device is provided, and the device includes:
获取单元,用于响应于第一源表的数据结构发生变动,获取数据模型的第一数据结构,所述数据模型为对所述第一源表中的数据进行分析时所对应的数据表,所述第一数据结构为所述第一源表的数据结构发生变化前所述数据模型对应的数据结构;An acquiring unit, configured to acquire a first data structure of a data model in response to a change in the data structure of the first source table, where the data model is a corresponding data table when analyzing data in the first source table, The first data structure is a data structure corresponding to the data model before the data structure of the first source table changes;
匹配单元,用于将所述第一源表中的数据结构与所述数据模型的第一数据结构进行匹配,获得匹配结果,所述第一源表的数据结构为发生变化后所述第一源表对应的数据结构;A matching unit, configured to match the data structure in the first source table with the first data structure of the data model to obtain a matching result, where the data structure of the first source table is the first The data structure corresponding to the source table;
调整单元,用于根据所述匹配结果对所述数据模型的第一数据结构进行调整,获得所述数据模型的第二数据结构。An adjustment unit, configured to adjust the first data structure of the data model according to the matching result to obtain a second data structure of the data model.
在本申请实施例第三方面,提供了一种电子设备,所述设备包括:处理器和存储器;In the third aspect of the embodiment of the present application, an electronic device is provided, and the device includes: a processor and a memory;
所述存储器,用于存储指令或计算机程序;said memory for storing instructions or computer programs;
所述处理器,用于执行所述存储器中的所述指令或计算机程序,以使得所述电子设备执行第一方面所述的数据处理方法。The processor is configured to execute the instructions or computer programs in the memory, so that the electronic device executes the data processing method described in the first aspect.
在本申请实施例第四方面,提供了一种计算机可读存储介质,包括指令,当其在计算机上运行时,使得计算机执行第一方面所述的数据处理方法。In a fourth aspect of the embodiments of the present application, there is provided a computer-readable storage medium, including instructions, which, when run on a computer, cause the computer to execute the data processing method described in the first aspect.
由此可见,本申请实施例具有如下有益效果:It can be seen that the embodiment of the present application has the following beneficial effects:
本申请实施例可以对第一源表的数据结构进行监测。当监测到第一源表的数据结构发生变动时,获取数据模型的第一数据结构。该第一数据结构为第一源表的数据结构发生变化之前,数据模型所对应的数据结构。其中,数据模型用于对第一源表中的数据进行分析,该数据模型物理上对应一张数据表,该数据表是根据第一源表的数据获得的。将第一源表中的数据结构(发生变化后的数据结构)与数据模型的第一数据结构进行匹配,获得匹配结果。并根据匹配结果对数据模型的第一数据结构进行调整,获得数据模型的第二数据结构。可见,通过本申请实施例提供的方法,使得 数据模型的数据结构与第一源表的数据结构保持一致,从而提高数据分析的准确性。In this embodiment of the present application, the data structure of the first source table can be monitored. When it is detected that the data structure of the first source table changes, the first data structure of the data model is acquired. The first data structure is the data structure corresponding to the data model before the data structure of the first source table changes. Wherein, the data model is used to analyze the data in the first source table, and the data model physically corresponds to a data table, and the data table is obtained according to the data in the first source table. Match the data structure (the changed data structure) in the first source table with the first data structure of the data model to obtain a matching result. And adjust the first data structure of the data model according to the matching result to obtain the second data structure of the data model. It can be seen that, through the method provided by the embodiment of the present application, the data structure of the data model is kept consistent with the data structure of the first source table, thereby improving the accuracy of data analysis.
附图说明Description of drawings
附图用来提供对本发明的进一步理解,并且构成说明书的一部分,与本发明实施例一起用于解释本发明,并不构成对本发明的限制。在附图中:The accompanying drawings are used to provide a further understanding of the present invention, and constitute a part of the description, and are used together with the embodiments of the present invention to explain the present invention, and do not constitute a limitation to the present invention. In the attached picture:
图1为本申请实施例提供的一种数据处理方法流程图;Fig. 1 is a flow chart of a data processing method provided by the embodiment of the present application;
图2a为本申请实施例提供的一种数据源表的数据结构调整示意图;Fig. 2a is a schematic diagram of data structure adjustment of a data source table provided by the embodiment of the present application;
图2b为本申请实施例提供的一种数据结构调整对比示意图;Fig. 2b is a schematic diagram of a comparison of data structure adjustment provided by the embodiment of the present application;
图2c为本申请实施例提供的另一种数据结构调整对比示意图;FIG. 2c is a schematic diagram of another data structure adjustment comparison provided by the embodiment of the present application;
图3a为本申请实施例提供的一种自动更新数据模型的数据结构框架图;Figure 3a is a data structure framework diagram of an automatically updated data model provided by the embodiment of the present application;
图3b为本申请实施例提供的一种手动更新数据模型的数据结构框架图;FIG. 3b is a data structure framework diagram of a manual update data model provided by the embodiment of the present application;
图4为本申请实施例提供的一种数据处理装置结构图;FIG. 4 is a structural diagram of a data processing device provided in an embodiment of the present application;
图5为本申请实施例提供的一种电子设备结构图。FIG. 5 is a structural diagram of an electronic device provided by an embodiment of the present application.
具体实施方式Detailed ways
为使本申请的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本申请实施例作进一步详细的说明。可以理解的是,此处所描述的具体实施例仅仅用于解释本申请,并非对本申请的限定。另外,还需要说明的是,为便于描述,附图中仅示出了与本申请相关的部分,并非全部结构。In order to make the above objects, features and advantages of the present application more obvious and understandable, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods. It can be understood that the specific embodiments described here are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only parts relevant to the present application are shown in the drawings, not all structures.
为便于理解本申请实施例提供的技术方案,下面将先对本申请实施例所涉及的技术名词进行说明。In order to facilitate the understanding of the technical solutions provided by the embodiments of the present application, technical terms involved in the embodiments of the present application will first be described below.
源表:数据源表,用来存储数据的原始表,为用户侧的数据。Source table: The data source table is the original table used to store data, which is the data on the user side.
数据模型:用于对源表中的数据进行分析,其在物理上对应一张底表。Data model: used to analyze the data in the source table, which physically corresponds to a bottom table.
底表:用来存储数据模型的结构和源表中数据的数据表,数据模型的结构与底表的结构一致。其中,底表中数据的读取速度高于源表中数据的读取速度。Bottom table: A data table used to store the structure of the data model and the data in the source table. The structure of the data model is consistent with the structure of the bottom table. Among them, the reading speed of the data in the bottom table is higher than that of the data in the source table.
字段:为源表中的列名或底表的列名。Field: The column name in the source table or the column name in the bottom table.
同步任务:用于将源表中的数据同步到底表中。Synchronization task: used to synchronize the data in the source table to the bottom table.
在实际应用中,在获取到源表后,用户可以根据源表的数据和相关配置生 成一张底表,以用于存储数据模型的结构和数据。当源表中的数据更新时,同步任务会自动将新数据从源表中同步到底表。然而,当源表的数据结构发生变化时,例如,源表中增加新的字段,由于底表的结构未相应改变,导致底表的数据结构和源表的数据结构不一致,导致数据丢失以及同步任务失败。In practical applications, after obtaining the source table, the user can generate a bottom table based on the data and related configuration of the source table to store the structure and data of the data model. When the data in the source table is updated, the synchronization task will automatically synchronize the new data from the source table to the bottom table. However, when the data structure of the source table changes, for example, a new field is added to the source table, because the structure of the bottom table has not changed accordingly, the data structure of the bottom table is inconsistent with the data structure of the source table, resulting in data loss and synchronization mission failed.
基于此,本申请实施例提供的一种数据处理方法,当监测到第一源表的数据结构发生变化时,获取数据模型的第一数据结构。该第一数据结构为第一源表的数据结构发生变化之前,数据模型所对应的数据结构,并将第一源表的数据结构(发生变化后的数据结构)与数据模型的第一数据结构进行匹配,获得匹配结果。在获得匹配结果后,根据匹配结果对数据模型的第一数据结构进行调整,获得数据模型的第二数据结构。即,在监测到第一源表的数据结构发生变动且对数据模型中的数据进行同步之前,先对第一源表的数据结构和数据模型的第一数据结构进行比对,获得比对结果,并根据比对结果对数据模型的第一数据结构进行调整。从而,使得数据模型的第二数据结构与第一源表的数据结构一致,进而保证同步任务的顺利进行,提高数据分析的准确性。Based on this, in a data processing method provided by an embodiment of the present application, when a change in the data structure of the first source table is detected, the first data structure of the data model is acquired. The first data structure is the data structure corresponding to the data model before the data structure of the first source table changes, and the data structure of the first source table (the data structure after the change) and the first data structure of the data model Match and get the matching result. After the matching result is obtained, the first data structure of the data model is adjusted according to the matching result to obtain the second data structure of the data model. That is, before the data structure of the first source table is detected to be changed and the data in the data model is synchronized, the data structure of the first source table is compared with the first data structure of the data model to obtain the comparison result , and adjust the first data structure of the data model according to the comparison result. Therefore, the second data structure of the data model is consistent with the data structure of the first source table, thereby ensuring the smooth progress of the synchronization task and improving the accuracy of data analysis.
为便于理解,下面将结合附图对本申请实施例提供的技术方案进行说明。For ease of understanding, the technical solutions provided by the embodiments of the present application will be described below with reference to the accompanying drawings.
参见图1,该图为本申请实施例提供的一种数据处理方法流程图,如图1所示,该方法可以包括:Referring to Fig. 1, this figure is a flow chart of a data processing method provided by the embodiment of the present application. As shown in Fig. 1, the method may include:
S101:响应于第一源表的数据结构发生变化,获取数据模型的第一数据结构。S101: In response to a change in the data structure of the first source table, acquire a first data structure of the data model.
本实施例中,可以监测第一源表的数据结构。当监测到第一源表的数据结构发生变化时,则获取数据模型的第一数据结构。其中,第一数据结构为第一源表的数据结构发生变化之前,数据模型所对应的数据结构。数据模型为根据第一源表生成的新的数据表,该数据表可以对第一源表中的数据进行分析。即,数据模型中所包括的数据与第一源表中的数据一致,但数据模型中的数据可以具有属性信息,例如生命周期。其中,第一源表的数据结构发生变化可能为在第一源表中增加字段、删除字段以及修改字段等操作。例如图2a所示,以修改字段为例,修改之前,字段为password,修改后字段为pwd。In this embodiment, the data structure of the first source table can be monitored. When it is detected that the data structure of the first source table changes, the first data structure of the data model is acquired. Wherein, the first data structure is the data structure corresponding to the data model before the data structure of the first source table changes. The data model is a new data table generated according to the first source table, and the data table can analyze the data in the first source table. That is, the data included in the data model is consistent with the data in the first source table, but the data in the data model may have attribute information, such as life cycle. Wherein, the change of the data structure of the first source table may be operations such as adding fields, deleting fields, and modifying fields in the first source table. For example, as shown in Figure 2a, taking the modified field as an example, before modification, the field is password, and after modification, the field is pwd.
S102:将第一源表的数据结构与数据模型的第一数据结构进行匹配,获得匹配结果。S102: Match the data structure of the first source table with the first data structure of the data model to obtain a matching result.
在获取到数据模型的第一数据结构后,将第一源表的数据结构与数据模型的第一数据结构进行匹配,从而确定出数据模型的第一数据结构中与第一源表的数据结构不一致的内容,从而得到匹配结果。其中,第一源表的数据结构为发生变化后第一源表所对应的数据结构。其中,匹配结果可以包括增加字段、删除字段、修改字段中的一种或多种。例如,图2b所示,第一源表的数据结构与数据模型的第一数据结构比较,匹配结果为修改字段。如2c所示,第一源表的数据结构与数据模型的第一数据结构比较,匹配结果为增加字段。After obtaining the first data structure of the data model, match the data structure of the first source table with the first data structure of the data model, thereby determining the data structure of the first data structure of the data model and the first source table Inconsistent content, so as to get matching results. Wherein, the data structure of the first source table is the data structure corresponding to the first source table after the change. Wherein, the matching result may include one or more of adding fields, deleting fields, and modifying fields. For example, as shown in FIG. 2b, the data structure of the first source table is compared with the first data structure of the data model, and the matching result is a modified field. As shown in 2c, the data structure of the first source table is compared with the first data structure of the data model, and the matching result is an added field.
S103:根据匹配结果对数据模型的第一数据结构进行调整,获得数据模型的第二数据结构。S103: Adjust the first data structure of the data model according to the matching result to obtain a second data structure of the data model.
在确定出匹配结果后,根据匹配结果对数据模型的第一数据结构进行调整,获得数据模型的第二数据结构。进一步地,在调整完数据模型的第一数据结构后,根据第一源表的数据结构对应的数据,对数据模型的第二数据结构对应的数据进行更新,从而完成同步任务。After the matching result is determined, the first data structure of the data model is adjusted according to the matching result to obtain the second data structure of the data model. Further, after the first data structure of the data model is adjusted, the data corresponding to the second data structure of the data model is updated according to the data corresponding to the data structure of the first source table, thereby completing the synchronization task.
具体地,当匹配结果为增加字段时,在数据模型的第一数据结构中添加相应字段。当匹配结果为删除字段时,将数据模型的第一数据结构中相应字段进行删除。当匹配结果为修改字段时,先删除数据模型的第一数据结构中修改前的字段,再在数据模型的第一数据结构中添加修改后的字段。例如,将第一源表中的字段password修改为字段pwd,则在对数据模型的第一数据结构进行调整时,先删除字段password,再增加字段pwd,从而得到数据模型的第二数据结构。Specifically, when the matching result is adding a field, a corresponding field is added to the first data structure of the data model. When the matching result is to delete a field, delete the corresponding field in the first data structure of the data model. When the matching result is a modified field, the field before modification in the first data structure of the data model is deleted first, and then the field after modification is added in the first data structure of the data model. For example, if the field password in the first source table is changed to the field pwd, then when adjusting the first data structure of the data model, the field password is deleted first, and then the field pwd is added to obtain the second data structure of the data model.
需要说明的是,在一些应用场景中,一个数据模型可以对应多个源表。当出现第一源表的数据结构中所添加的字段名称和/或修改的字段名称与第二源表的数据结构中字段名称重复的情况下,且对数据模型的第一数据结构进行调整时,则在字段名称后中添加对应的源表标识,从而区分来自不同源表的字段。例如,数据模型对应第一源表和第二源表。其中,第一源表中的字段password改为字段pwd,而第二源表中包括字段pwd,则对数据模型进行修改时,将数据模型的第一数据结构中第一源表的字段password修改为pwd.1,以及将数据模型的第一数据结构中第二源表中的字段pwd修改为pwd.2。另外,当对第一源表进行删除操作时,则可以不调整数据模型的第一数据结构。It should be noted that, in some application scenarios, one data model can correspond to multiple source tables. When the field name added and/or the modified field name in the data structure of the first source table is duplicated with the field name in the data structure of the second source table, and the first data structure of the data model is adjusted , then add the corresponding source table identifier after the field name to distinguish fields from different source tables. For example, a data model corresponds to a first source table and a second source table. Among them, the field password in the first source table is changed to the field pwd, and the second source table includes the field pwd, then when the data model is modified, the field password of the first source table in the first data structure of the data model is modified is pwd.1, and the field pwd in the second source table in the first data structure of the data model is changed to pwd.2. In addition, when the delete operation is performed on the first source table, the first data structure of the data model may not be adjusted.
需要说明的是,在确定出匹配结果后,可以自动触发更新数据模型的第一数据结构的任务,也可以通知用户进行手动更新。当手动更新与自动更新同时执行时,不仅会造成资源浪费,也可能会引发更新错误。基于此,为解决上述问题,通过添加调整标志位的方式来避免手动更新和自动更新同时执行。具体地,如果自动更新的任务先发起,则可以将调整标志位修改为第二信息。例如,将调整标志位修改为“修改中”。当用户手动发起更新任务时,由于此时调整标志位为第二信息,则不再执行更新操作。当对数据模型的第一数据结构完成调整后,将调整标志位修改为第一信息,例如,将调整标志位设置为空或无修改。It should be noted that after the matching result is determined, the task of updating the first data structure of the data model may be automatically triggered, or the user may be notified to perform manual updating. When manual update and automatic update are performed at the same time, it will not only cause waste of resources, but also may cause update errors. Based on this, in order to solve the above-mentioned problems, an adjustment flag is added to avoid simultaneous execution of manual update and automatic update. Specifically, if the automatic update task is initiated first, the adjustment flag bit may be modified to the second information. For example, modify the adjustment flag bit to "modifying". When the user manually initiates the update task, the update operation is no longer performed because the flag is adjusted to be the second information at this time. After the adjustment of the first data structure of the data model is completed, the adjustment flag bit is modified to the first information, for example, the adjustment flag bit is set to null or no modification.
因此,在根据匹配结果对数据模型的第一数据结构进行调整之前,首先获取调整标志位所对应的信息。当该调整标志位的信息为第一信息时,表明当前不存在其它更新操作,则将调整标志位的信息修改为第二信息,并对数据模型的第一数据结构进行调整。在完成对数据模型的第一数据结构完成调整后,将调整标志位的信息修改为第一信息。其中,调整标志位用于指示数据模型的第一数据结构是否正在被修改。Therefore, before adjusting the first data structure of the data model according to the matching result, the information corresponding to the adjustment flag bit is acquired first. When the information of the adjustment flag bit is the first information, it indicates that there is no other update operation currently, the information of the adjustment flag bit is changed to the second information, and the first data structure of the data model is adjusted. After the adjustment of the first data structure of the data model is completed, the information of the adjustment flag is modified to the first information. Wherein, the adjustment flag bit is used to indicate whether the first data structure of the data model is being modified.
为便于理解调整标志位的处理实现,分别参见图3a和图3b所示。其中,图3a为同步任务中自动触发的更新数据模型的第一数据结构的处理流程。首先,判断调整标志位是否为修改中,如果否,则将调整标志位配置为“修改中”,并对数据模型的第一数据结构进行修改。修改完成后,执行数据更新任务。在执行完数据更新任务后,将调整标志位配置为“空”。如果调整标志位为“修改中”,则结束。图3b为手动更新数据模型的第一数据结构的处理流程。首先判断调整标志位是否为修改中,如果否,将调整标志位配置为“修改中”。手动修改数据模型的第一数据结构,并保存修改后的数据结构,即第二数据结构。在完成对数据模型的第一数据结构的修改后,将调整标志位配置为“空”。如果调整标志位为“修改中”,则结束。To facilitate the understanding of the implementation of the processing of adjusting the flag bits, refer to FIG. 3a and FIG. 3b respectively. Wherein, FIG. 3a is a processing flow of updating the first data structure of the data model automatically triggered in the synchronization task. First, it is determined whether the adjustment flag is being modified, and if not, the adjustment flag is configured as "modifying", and the first data structure of the data model is modified. After the modification is complete, execute the data update task. After executing the data update task, set the adjustment flag bit to "null". If the adjustment flag is "modifying", then end. Fig. 3b is a processing flow of manually updating the first data structure of the data model. First judge whether the adjustment flag is being modified, if not, configure the adjustment flag as "modifying". Manually modify the first data structure of the data model, and save the modified data structure, that is, the second data structure. After the modification of the first data structure of the data model is completed, the adjustment flag bit is configured as "empty". If the adjustment flag is "modifying", then end.
可见,在监测到第一源表的数据结构发生变动且对数据模型中的数据进行同步之前,先对第一源表的数据结构(变化后的数据结构)和数据模型的第一数据结构(为第一源表的数据结构发生变化前数据模型所对应的数据结构)进行比对,获得比对结果。并根据比对结果对数据模型的第一数据结构进行调整, 从而使得数据模型的第二数据结构与第一源表的数据结构一致,进而保证同步任务的顺利进行,提高数据分析的准确性。It can be seen that before the data structure of the first source table is detected to be changed and the data in the data model is synchronized, the data structure of the first source table (the changed data structure) and the first data structure of the data model ( Compare the data structure corresponding to the data model before the data structure of the first source table changes, and obtain a comparison result. And adjust the first data structure of the data model according to the comparison result, so that the second data structure of the data model is consistent with the data structure of the first source table, thereby ensuring the smooth progress of the synchronization task and improving the accuracy of data analysis.
基于上述方法实施例,本申请实施例提供了一种数据处理装置,下面将结合附图对该装置进行说明。Based on the foregoing method embodiments, an embodiment of the present application provides a data processing device, which will be described below with reference to the accompanying drawings.
参见图4,该图为本申请实施例提供的一种数据处理装置结构图,如图4所示,该装置可以包括:Referring to FIG. 4, this figure is a structural diagram of a data processing device provided in the embodiment of the present application. As shown in FIG. 4, the device may include:
获取单元401,用于响应于第一源表的数据结构发生变动,获取数据模型的第一数据结构,所述数据模型为对所述第一源表中的数据进行分析时所对应的数据表,所述第一数据结构为所述第一源表的数据结构发生变化前所述数据模型对应的数据结构;An acquisition unit 401, configured to acquire a first data structure of a data model in response to a change in the data structure of the first source table, where the data model is a corresponding data table when analyzing data in the first source table , the first data structure is the data structure corresponding to the data model before the data structure of the first source table changes;
匹配单元402,用于将所述第一源表中的数据结构与所述数据模型的第一数据结构进行匹配,获得匹配结果,所述第一源表的数据结构为发生变化后所述第一源表对应的数据结构;The matching unit 402 is configured to match the data structure in the first source table with the first data structure of the data model to obtain a matching result. The data structure of the first source table is the first data structure after the change. A data structure corresponding to a source table;
调整单元403,用于根据所述匹配结果对所述数据模型的第一数据结构进行调整,获得所述数据模型的第二数据结构。The adjustment unit 403 is configured to adjust the first data structure of the data model according to the matching result to obtain a second data structure of the data model.
在一种具体的实现方式中,所述匹配结果包括增加字段、删除字段和修改字段中的一种或多种。In a specific implementation manner, the matching result includes one or more of adding fields, deleting fields and modifying fields.
在一种具体的实现方式中,所述调整单元403,具体用于在所述匹配结果为所述修改字段时,删除所述数据模型中的第一数据结构中修改前的字段;在所述数据模型中的第一数据结构中添加修改后的字段,获得所述数据模型的第二数据结构。In a specific implementation manner, the adjustment unit 403 is specifically configured to delete the field before modification in the first data structure in the data model when the matching result is the modified field; The modified field is added to the first data structure in the data model to obtain the second data structure of the data model.
在一种具体的实现方式中,所述装置还包括:添加单元;In a specific implementation manner, the device further includes: an adding unit;
所述添加单元,具体用于在增加字段的字段名称和/或修改字段的字段名称与第二源表中的字段名称重复时,在所述数据模型的第二数据结构中相应字段的字段名称后添加对应的源表标识,所述数据模型为对所述第二源表中的数据进行分析时所对应的数据表。The adding unit is specifically used to, when the field name of the added field and/or the field name of the modified field is repeated with the field name in the second source table, the field name of the corresponding field in the second data structure of the data model A corresponding source table identifier is added afterwards, and the data model is a corresponding data table when analyzing the data in the second source table.
在一种具体的实现方式中,所述装置还包括:修改单元;In a specific implementation manner, the device further includes: a modifying unit;
所述获取单元,还用于获取调整标志位所对应的信息;The acquiring unit is further configured to acquire information corresponding to the adjustment flag bit;
修改单元,用于在调整标志位为第一信息时,将所述调整标志位修改为第 二信息。A modifying unit, configured to modify the adjustment flag bit to second information when the adjustment flag bit is the first information.
在一种具体的实现方式中,所述修改单元,还用于在获得所述数据模型的第二数据结构后,将所述调整标志位修改为所述第一信息。In a specific implementation manner, the modifying unit is further configured to modify the adjustment flag bit to the first information after obtaining the second data structure of the data model.
在一种具体的实现方式中,所述装置还包括:更新单元;In a specific implementation manner, the device further includes: an updating unit;
所述更新单元,用于根据所述第一源表的数据结构所对应的数据,对所述数据模型的第二数据结构所对应的数据进行更新。The updating unit is configured to update the data corresponding to the second data structure of the data model according to the data corresponding to the data structure of the first source table.
需要说明的是,本实施例中各个单元的实现可以参见上述方法实施例的相关描述,本实施例在此不再赘述。It should be noted that, for implementation of each unit in this embodiment, reference may be made to relevant descriptions of the foregoing method embodiments, and details are not repeated in this embodiment.
下面参考图5,其示出了适于用来实现本申请实施例的电子设备500的结构示意图。本申请实施例中的终端设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(Personal Digital Assistant,个人数字助理)、PAD(portable android device,平板电脑)、PMP(Portable Media Player,便携式多媒体播放器)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV(television,电视机)、台式计算机等等的固定终端。图5示出的电子设备仅仅是一个示例,不应对本申请实施例的功能和使用范围带来任何限制。Referring to FIG. 5 , it shows a schematic structural diagram of an electronic device 500 suitable for implementing the embodiment of the present application. The terminal equipment in the embodiment of the present application may include but not limited to mobile phones, notebook computers, digital broadcast receivers, PDA (Personal Digital Assistant, personal digital assistant), PAD (portable android device, tablet computer), PMP (Portable Media Player, portable multimedia player), mobile terminals such as vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital TVs (television, television sets), desktop computers, and the like. The electronic device shown in FIG. 5 is only an example, and should not limit the functions and scope of use of this embodiment of the present application.
如图5所示,电子设备500可以包括处理装置(例如中央处理器、图形处理器等)501,其可以根据存储在只读存储器(ROM)502中的程序或者从存储装置508加载到随机访问存储器(RAM)503中的程序而执行各种适当的动作和处理。在RAM503中,还存储有电子设备500操作所需的各种程序和数据。处理装置501、ROM 502以及RAM 503通过总线504彼此相连。输入/输出(I/O)接口505也连接至总线504。As shown in FIG. 5, an electronic device 500 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 501, which may be randomly accessed according to a program stored in a read-only memory (ROM) 502 or loaded from a storage device 508. Various appropriate actions and processes are executed by programs in the memory (RAM) 503 . In the RAM 503, various programs and data necessary for the operation of the electronic device 500 are also stored. The processing device 501, ROM 502, and RAM 503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to the bus 504 .
通常,以下装置可以连接至I/O接口505:包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置506;包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置507;包括例如磁带、硬盘等的存储装置508;以及通信装置509。通信装置509可以允许电子设备500与其他设备进行无线或有线通信以交换数据。虽然图5示出了具有各种装置的电子设备500,但是应理解的是,并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。Typically, the following devices can be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speaker, vibration an output device 507 such as a computer; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication means 509 may allow the electronic device 500 to perform wireless or wired communication with other devices to exchange data. While FIG. 5 shows electronic device 500 having various means, it is to be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.
特别地,根据本申请的实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本申请的实施例包括一种计算机程序产品,其包括承载在非暂态计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信装置509从网络上被下载和安装,或者从存储装置508被安装,或者从ROM502被安装。在该计算机程序被处理装置501执行时,执行本申请实施例的方法中限定的上述功能。In particular, according to the embodiments of the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments of the present application include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, where the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via communication means 509 , or from storage means 508 , or from ROM 502 . When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present application are executed.
本申请实施例提供的电子设备与上述实施例提供的数据处理方法属于同一发明构思,未在本实施例中详尽描述的技术细节可参见上述实施例,并且本实施例与上述实施例具有相同的有益效果。The electronic device provided in the embodiment of the present application and the data processing method provided in the above embodiment belong to the same inventive concept. For technical details not described in detail in this embodiment, please refer to the above embodiment, and this embodiment has the same features as the above embodiment. Beneficial effect.
本申请实施例提供一种计算机可读介质,其上存储有计算机程序,其中,所述程序被处理器执行时实现如上述任一实施例所述的数据处理方法。An embodiment of the present application provides a computer-readable medium on which a computer program is stored, wherein, when the program is executed by a processor, the data processing method as described in any of the foregoing embodiments is implemented.
需要说明的是,本申请上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本申请中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本申请中,计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:电线、光缆、RF(射频)等等,或者上述的任意合适的组合。It should be noted that the computer-readable medium mentioned above in this application may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
在一些实施方式中,客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol,超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信,并且可以与任意形式或介质的数字数据通信(例如,通信网络)互连。通信网络的示例包括局域网(“LAN”),广域网(“WAN”),网际网(例如,互联网)以及端对端网络(例如,ad hoc端对端网络),以及任何当前已知或未来研发的网络。In some embodiments, the client and the server can communicate using any currently known or future network protocols such as HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), and can communicate with digital data in any form or medium The communication (eg, communication network) interconnections. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network of.
上述计算机可读介质可以是上述电子设备中所包含的;也可以是单独存在,而未装配入该电子设备中。The above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being incorporated into the electronic device.
上述计算机可读介质承载有一个或者多个程序,当上述一个或者多个程序被该电子设备执行时,使得该电子设备执行上述数据处理方法。The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device is made to execute the above-mentioned data processing method.
可以以一种或多种程序设计语言或其组合来编写用于执行本申请的操作的计算机程序代码,上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。Computer program code for carrying out the operations of this application may be written in one or more programming languages, or combinations thereof, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages - such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).
附图中的流程图和框图,图示了按照本申请各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.
描述于本申请实施例中所涉及到的单元可以通过软件的方式实现,也可以通过硬件的方式来实现。其中,单元/模块的名称在某种情况下并不构成对该单元本身的限定,例如,语音数据采集模块还可以被描述为“数据采集模块”。The units involved in the embodiments described in the present application may be implemented by means of software or by means of hardware. Wherein, the name of the unit/module does not constitute a limitation on the unit itself under certain circumstances, for example, the voice data collection module can also be described as a "data collection module".
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如,非限制性地,可以使用的示范类型的硬件逻辑部件包括:现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。The functions described herein above may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), System on Chips (SOCs), Complex Programmable Logical device (CPLD) and so on.
在本申请的上下文中,机器可读介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In the context of the present application, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
需要说明的是,本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的系统或装置而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。It should be noted that each embodiment in this specification is described in a progressive manner, each embodiment focuses on the differences from other embodiments, and the same and similar parts of each embodiment can be referred to each other. As for the system or device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for relevant details, please refer to the description of the method part.
应当理解,在本申请中,“至少一个(项)”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,用于描述关联对象的关联关系,表示可以存在三种关系,例如,“A和/或B”可以表示:只存在A,只存在B以及同时存在A和B三种情况,其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项(个)”或其类似表达,是指这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b或c中的至少一项(个),可以表示:a,b,c,“a和b”,“a和c”,“b和c”,或“a和b和c”,其中a,b,c可以是单个,也可以是多个。It should be understood that in this application, "at least one (item)" means one or more, and "multiple" means two or more. "And/or" is used to describe the association relationship of associated objects, indicating that there can be three types of relationships, for example, "A and/or B" can mean: only A exists, only B exists, and A and B exist at the same time , where A and B can be singular or plural. The character "/" generally indicates that the contextual objects are an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one item (piece) of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c ", where a, b, c can be single or multiple.
还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来 将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should also be noted that in this article, relational terms such as first and second etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or operations Any such actual relationship or order exists between. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.
对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本申请。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本申请的精神或范围的情况下,在其它实施例中实现。因此,本申请将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, the present application will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

  1. 一种数据处理方法,其特征在于,所述方法包括:A data processing method, characterized in that the method comprises:
    响应于第一源表的数据结构发生变化,获取数据模型的第一数据结构,所述数据模型为对所述第一源表中的数据进行分析时所对应的数据表,所述第一数据结构为所述第一源表的数据结构发生变化前所述数据模型对应的数据结构;In response to a change in the data structure of the first source table, the first data structure of the data model is acquired, the data model is a corresponding data table when analyzing the data in the first source table, and the first data The structure is the data structure corresponding to the data model before the data structure of the first source table changes;
    将所述第一源表的数据结构与所述数据模型的第一数据结构进行匹配,获得匹配结果,所述第一源表的数据结构为发生变化后所述第一源表对应的数据结构;Matching the data structure of the first source table with the first data structure of the data model to obtain a matching result, the data structure of the first source table is the data structure corresponding to the first source table after the change ;
    根据所述匹配结果对所述数据模型的第一数据结构进行调整,获得所述数据模型的第二数据结构。The first data structure of the data model is adjusted according to the matching result to obtain the second data structure of the data model.
  2. 根据权利要求1所述的方法,其特征在于,所述匹配结果包括增加字段、删除字段和修改字段中的一种或多种。The method according to claim 1, wherein the matching result includes one or more of adding fields, deleting fields and modifying fields.
  3. 根据权利要求2所述的方法,其特征在于,所述根据所述匹配结果对所述数据模型的第一数据结构进行调整,获得所述数据模型的第二数据结构,包括:The method according to claim 2, wherein the adjusting the first data structure of the data model according to the matching result to obtain the second data structure of the data model comprises:
    在所述匹配结果为所述修改字段时,删除所述数据模型中的第一数据结构中修改前的字段;When the matching result is the modified field, delete the field before modification in the first data structure in the data model;
    在所述数据模型中的第一数据结构中添加修改后的字段,获得所述数据模型的第二数据结构。The modified field is added to the first data structure in the data model to obtain the second data structure of the data model.
  4. 根据权利要求2或3所述的方法,其特征在于,所述方法还包括:The method according to claim 2 or 3, characterized in that the method further comprises:
    在增加字段的字段名称和/或修改字段的字段名称与第二源表中的字段名称重复时,在所述数据模型的第二数据结构中相应字段的字段名称后添加对应的源表标识,所述数据模型为对所述第二源表中的数据进行分析时所对应的数据表。When the field name of the added field and/or the field name of the modified field is repeated with the field name in the second source table, the corresponding source table identifier is added after the field name of the corresponding field in the second data structure of the data model, The data model is a corresponding data table when analyzing the data in the second source table.
  5. 根据权利要求1所述的方法,其特征在于,在根据所述匹配结果对所述数据模型的第一数据结构进行调整,获得所述数据模型的第二数据结构之前,所述方法还包括:The method according to claim 1, wherein, before adjusting the first data structure of the data model according to the matching result to obtain the second data structure of the data model, the method further comprises:
    获取调整标志位所对应的信息,所述调整标志位用于指示所述数据模 型的第一数据结构是否正在被修改;Obtain the information corresponding to the adjustment flag, and the adjustment flag is used to indicate whether the first data structure of the data model is being modified;
    在所述调整标志位为第一信息时,将所述调整标志位修改为第二信息。When the adjustment flag bit is the first information, modify the adjustment flag bit to the second information.
  6. 根据权利要求5所述的方法,其特征在于,所述方法还包括:The method according to claim 5, wherein the method further comprises:
    在获得所述数据模型的第二数据结构后,将所述调整标志位修改为所述第一信息。After obtaining the second data structure of the data model, modify the adjustment flag bit to the first information.
  7. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, further comprising:
    根据所述第一源表的数据结构所对应的数据,对所述数据模型的第二数据结构所对应的数据进行更新。The data corresponding to the second data structure of the data model is updated according to the data corresponding to the data structure of the first source table.
  8. 一种数据处理装置,其特征在于,所述装置包括:A data processing device, characterized in that the device comprises:
    获取单元,用于响应于第一源表的数据结构发生变动,获取数据模型的第一数据结构,所述数据模型为对所述第一源表中的数据进行分析时所对应的数据表,所述第一数据结构为所述第一源表的数据结构发生变化前所述数据模型对应的数据结构;An acquiring unit, configured to acquire a first data structure of a data model in response to a change in the data structure of the first source table, where the data model is a corresponding data table when analyzing data in the first source table, The first data structure is a data structure corresponding to the data model before the data structure of the first source table changes;
    匹配单元,用于将所述第一源表中的数据结构与所述数据模型的第一数据结构进行匹配,获得匹配结果,所述第一源表的数据结构为发生变化后所述第一源表对应的数据结构;A matching unit, configured to match the data structure in the first source table with the first data structure of the data model to obtain a matching result, where the data structure of the first source table is the first The data structure corresponding to the source table;
    调整单元,用于根据所述匹配结果对所述数据模型的第一数据结构进行调整,获得所述数据模型的第二数据结构。An adjustment unit, configured to adjust the first data structure of the data model according to the matching result to obtain a second data structure of the data model.
  9. 一种电子设备,所述设备包括:处理器和存储器;An electronic device comprising: a processor and a memory;
    所述存储器,用于存储指令或计算机程序;said memory for storing instructions or computer programs;
    所述处理器,用于执行所述存储器中的所述指令或计算机程序,以使得所述电子设备执行权利要求1-7任一项所述的数据处理方法。The processor is configured to execute the instructions or computer programs in the memory, so that the electronic device executes the data processing method according to any one of claims 1-7.
  10. 一种计算机可读存储介质,包括指令,当其在计算机上运行时,使得计算机执行以上权利要求1-7任一项所述的数据处理方法。A computer-readable storage medium, including instructions, which, when run on a computer, cause the computer to execute the data processing method described in any one of claims 1-7 above.
PCT/CN2022/109352 2021-09-01 2022-08-01 Data processing method and apparatus, and electronic device and medium WO2023029850A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111022842.3A CN113722326A (en) 2021-09-01 2021-09-01 Data processing method and device, electronic equipment and medium
CN202111022842.3 2021-09-01

Publications (1)

Publication Number Publication Date
WO2023029850A1 true WO2023029850A1 (en) 2023-03-09

Family

ID=78680785

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/109352 WO2023029850A1 (en) 2021-09-01 2022-08-01 Data processing method and apparatus, and electronic device and medium

Country Status (2)

Country Link
CN (1) CN113722326A (en)
WO (1) WO2023029850A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116893912A (en) * 2023-08-01 2023-10-17 广州汽车集团股份有限公司 Inter-core communication method, system, device, equipment and medium for vehicle-mounted software

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113722326A (en) * 2021-09-01 2021-11-30 北京火山引擎科技有限公司 Data processing method and device, electronic equipment and medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104063409A (en) * 2013-04-11 2014-09-24 腾讯科技(深圳)有限公司 Field adding method and system of database
US20180232382A1 (en) * 2017-02-15 2018-08-16 Sap Se Multi-procedure support in data migration
CN109634587A (en) * 2018-12-04 2019-04-16 上海碳蓝网络科技有限公司 A kind of method and apparatus generating storage script and data loading
CN110019539A (en) * 2017-07-14 2019-07-16 北京京东尚科信息技术有限公司 A kind of method and apparatus that the data of data warehouse are synchronous
CN111367924A (en) * 2020-02-26 2020-07-03 杭州数梦工场科技有限公司 Data synchronization method and device, electronic equipment and storage medium
CN112948473A (en) * 2019-11-26 2021-06-11 北京京东尚科信息技术有限公司 Data processing method, device and system of data warehouse and storage medium
CN113722326A (en) * 2021-09-01 2021-11-30 北京火山引擎科技有限公司 Data processing method and device, electronic equipment and medium
CN114116673A (en) * 2021-11-30 2022-03-01 平安科技(深圳)有限公司 Data migration method based on artificial intelligence and related equipment

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10866938B2 (en) * 2016-07-29 2020-12-15 Sap Se Automated reshaping and restructuring of storage structures
CN108959564B (en) * 2018-07-04 2020-11-27 玖富金科控股集团有限责任公司 Data warehouse metadata management method, readable storage medium and computer device
CN111190905A (en) * 2019-12-31 2020-05-22 北京奇才天下科技有限公司 Database table processing method and device and electronic equipment
CN113190517B (en) * 2021-06-30 2021-10-22 北京德风新征程科技有限公司 Data integration method and device, electronic equipment and computer readable medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104063409A (en) * 2013-04-11 2014-09-24 腾讯科技(深圳)有限公司 Field adding method and system of database
US20180232382A1 (en) * 2017-02-15 2018-08-16 Sap Se Multi-procedure support in data migration
CN110019539A (en) * 2017-07-14 2019-07-16 北京京东尚科信息技术有限公司 A kind of method and apparatus that the data of data warehouse are synchronous
CN109634587A (en) * 2018-12-04 2019-04-16 上海碳蓝网络科技有限公司 A kind of method and apparatus generating storage script and data loading
CN112948473A (en) * 2019-11-26 2021-06-11 北京京东尚科信息技术有限公司 Data processing method, device and system of data warehouse and storage medium
CN111367924A (en) * 2020-02-26 2020-07-03 杭州数梦工场科技有限公司 Data synchronization method and device, electronic equipment and storage medium
CN113722326A (en) * 2021-09-01 2021-11-30 北京火山引擎科技有限公司 Data processing method and device, electronic equipment and medium
CN114116673A (en) * 2021-11-30 2022-03-01 平安科技(深圳)有限公司 Data migration method based on artificial intelligence and related equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116893912A (en) * 2023-08-01 2023-10-17 广州汽车集团股份有限公司 Inter-core communication method, system, device, equipment and medium for vehicle-mounted software
CN116893912B (en) * 2023-08-01 2024-05-17 广州汽车集团股份有限公司 Inter-core communication method, system, device, equipment and medium for vehicle-mounted software

Also Published As

Publication number Publication date
CN113722326A (en) 2021-11-30

Similar Documents

Publication Publication Date Title
WO2023029850A1 (en) Data processing method and apparatus, and electronic device and medium
WO2022007855A1 (en) Method and device for updating reference document, electronic device, and storage medium
WO2023273579A1 (en) Model training method and apparatus, speech recognition method and apparatus, and medium and device
WO2023056934A1 (en) Data processing method and apparatus, and electronic device
WO2021190129A1 (en) Method and device for page processing, electronic device, and computer-readable storage medium
WO2020168878A1 (en) Data caching method and device, terminal, and storage medium
WO2023029854A1 (en) Data query method and apparatus, storage medium, and electronic device
WO2022135547A1 (en) Service operation method and apparatus, electronic device, and computer storage medium
US20240095389A1 (en) Information processing method and apparatus, terminal, and storage medium
WO2023179509A1 (en) Data access apparatus and method, and readable medium and electronic device
CN115757400A (en) Data table processing method and device, electronic equipment and computer readable medium
CN111163336B (en) Video resource pushing method and device, electronic equipment and computer readable medium
WO2022233311A1 (en) Display method and apparatus, and electronic device
CN110852720A (en) Document processing method, device, equipment and storage medium
WO2023202556A1 (en) Document editing method and apparatus, and device and storage medium
WO2023124910A1 (en) Data processing method and apparatus, and electronic device and storage medium
WO2023131263A1 (en) Group member adding method and apparatus, device, and medium
WO2023056841A1 (en) Data service method and apparatus, and related product
WO2023116469A1 (en) Information processing method and apparatus, terminal, and storage medium
WO2023124937A1 (en) Spreadsheet data validation method and apparatus, device, and medium
WO2023001281A1 (en) Table data processing method and apparatus, terminal, and storage medium
WO2022017458A1 (en) Data synchronization method and apparatus, electronic device, and medium
WO2023284674A1 (en) Message selection method and apparatus, and device
WO2022242441A1 (en) Spreadsheet importing method, apparatus, and device, and medium
WO2022206254A1 (en) So file repairing method and apparatus, device, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22862991

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE