WO2019196272A1 - 数据立方体发布方法、装置、电子设备和存储介质 - Google Patents

数据立方体发布方法、装置、电子设备和存储介质 Download PDF

Info

Publication number
WO2019196272A1
WO2019196272A1 PCT/CN2018/099156 CN2018099156W WO2019196272A1 WO 2019196272 A1 WO2019196272 A1 WO 2019196272A1 CN 2018099156 W CN2018099156 W CN 2018099156W WO 2019196272 A1 WO2019196272 A1 WO 2019196272A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
source data
target source
refresh
publishing
Prior art date
Application number
PCT/CN2018/099156
Other languages
English (en)
French (fr)
Inventor
宋剑锋
杨勇
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2019196272A1 publication Critical patent/WO2019196272A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Definitions

  • the present invention relates to the field of data processing technologies, and in particular, to a data cube publishing method, apparatus, electronic device, and storage medium.
  • the data cube is usually manually refreshed and released, or automatically executed by using a scheduled task, but for the task of mass refreshing or publishing, both manual publishing and scheduled task publishing are required.
  • a data cube publishing method comprising:
  • a data cube publishing device comprising:
  • the obtaining unit is configured to arbitrarily select an operating environment from the multi-live system, and obtain target source data from the selected running environment;
  • the obtaining unit is further configured to: when determining that the target source data acquisition is completed, acquiring a refresh parameter of the target source data;
  • a refreshing unit configured to refresh the target source data according to a refresh parameter of the target source data to generate a target data cube
  • the obtaining unit is further configured to acquire a current publishing task of each running environment in the multiple living system
  • the obtaining unit is further configured to obtain, from two subdirectories configured in each running environment, a current publishing directory of each currently published task;
  • a publishing unit configured to publish the target data cube to the current publishing directory of each running environment obtained
  • a configuration unit configured to, after completing each current publishing task, configure a publishing directory of a next publishing task in each running environment as another subdirectory in each running environment except the current publishing directory, and
  • the data source of the report of the target data cube is configured as the current release directory.
  • An electronic device comprising:
  • a memory instructions stored in the memory are executed by the processor to implement the data cube publishing method.
  • a non-volatile readable storage medium the instructions stored in the non-volatile readable storage medium being executed by a processor in an electronic device to implement the data cube publishing method.
  • the present invention randomly selects an operating environment from the multi-active system, and obtains target source data from the selected operating environment; and when determining that the target source data is acquired, acquiring the target source data.
  • Refreshing parameters refreshing the target source data according to the refresh parameter of the target source data to generate a target data cube; acquiring a current publishing task of each running environment in the multiple living system; configuring from each operating environment Obtaining the current publishing directory of each currently published task in the two subdirectories; publishing the target data cube to the current publishing directory of each running environment acquired; after completing each current publishing task, each will be
  • the release directory of the next release task in the running environment is configured as another subdirectory except the current release directory in each running environment, and the data source of the report of the target data cube is configured as the current release directory. .
  • the invention can make the data access process of the report and the release process of the target data cube independent of each other, and does not affect each other.
  • FIG. 1 is an application environment diagram of a preferred embodiment of a method for implementing a data cube according to the present invention.
  • FIG. 2 is a flow chart of a preferred embodiment of a data cube publishing method of the present invention.
  • Figure 3 is a schematic diagram of data warehousing technology.
  • FIG. 4 is a functional block diagram of a preferred embodiment of a data cube publishing apparatus of the present invention.
  • FIG. 5 is a schematic structural diagram of an electronic device according to a preferred embodiment of a method for distributing a data cube according to the present invention.
  • FIG. 1 is an application environment diagram of a preferred embodiment of a method for implementing a data cube according to the present invention.
  • the multi-active system 2 comprises at least two operating environments, the electronic device 1 being in communication with the multi-active system 2.
  • the data of each operating environment in the multi-active system 2 is synchronized, so that the user's access results to each operating environment in the multi-active system 2 are consistent.
  • the electronic device 1 is configured to acquire target source data from respective operating environments in the multi-active system 2 to generate a target data cube.
  • FIG. 2 is a flow chart of a preferred embodiment of the data cube publishing method of the present invention.
  • the order of the steps in the flowchart may be changed according to different requirements, and some steps may be omitted.
  • the data cube publishing method is applied to one or more electronic devices 1 which are devices capable of automatically performing numerical calculation and/or information processing according to an instruction set or stored in advance, the hardware of which includes However, it is not limited to a microprocessor, an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a digital signal processor (DSP), an embedded device, or the like.
  • ASIC application specific integrated circuit
  • FPGA field-programmable gate array
  • DSP digital signal processor
  • embedded device or the like.
  • the electronic device 1 can be any electronic product that can interact with a user, such as a personal computer, a tablet, a smart phone, a personal digital assistant (PDA), a game machine, an interactive network television. (Internet Protocol Television, IPTV), smart wearable devices, etc.
  • a personal computer such as a personal computer, a tablet, a smart phone, a personal digital assistant (PDA), a game machine, an interactive network television. (Internet Protocol Television, IPTV), smart wearable devices, etc.
  • PDA personal digital assistant
  • IPTV Internet Protocol Television
  • smart wearable devices etc.
  • the electronic device 1 may also comprise a network device and/or a user device.
  • the network device includes, but is not limited to, a single network server, a server group composed of multiple network servers, or a Cloud Computing-based cloud composed of a large number of hosts or network servers.
  • the network in which the electronic device 1 is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), and the like.
  • the Internet includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), and the like.
  • VPN virtual private network
  • the electronic device 1 arbitrarily selects an operating environment from the multi-active system 2, and acquires target source data from the selected operating environment.
  • the multi-active system 2 includes at least two operating environments. Specifically, the data of each operating environment in the multi-active system 2 is synchronized, so that the user is in the multi-active system. The access results of each running environment are consistent, so that when a running environment crashes, other operating environments can directly take over and continue to work normally.
  • the electronic device 1 randomly selects an operating environment from the multiple active system 2, and obtains target source data from the selected operating environment, including:
  • the electronic device 1 selects an operating environment from the multi-active system 2 by using an Extract-Transform-Load (ETL), and acquires target source data from the selected operating environment.
  • ETL Extract-Transform-Load
  • the data warehouse technology mainly includes three steps of extracting, transforming, and loading.
  • the extraction refers to a process of obtaining data from a source database of each operating environment;
  • the conversion refers to cleaning and conversion of data, and after the conversion, data that does not meet the condition or error can be filtered out, and the data is simultaneously Converted to the required format;
  • the loading refers to the process of loading the converted data into the local database as the target source data.
  • the target source data refers to source data used to generate a target data cube
  • the target source data may be two-dimensional plane data, or may be at least one table data or the like. Specifically, the concept of the target data cube will be explained later.
  • the electronic device 1 acquires a refresh parameter of the target source data.
  • the refresh parameters of the target source data include, but are not limited to, one or a combination of the following:
  • a refresh time of the target source data a refresh frequency of the target source data, a refresh model of an application of the target source data, a name of a data cube generated after the target source data is refreshed, and the target source data Refresh method, etc.
  • the refresh mode of the target source data includes an incremental refresh or a full refresh.
  • the full-quantity refresh refers to extracting full-service data for refreshing, and compared to the full-quantity refresh, the incremental refresh refers to refreshing each time the incremental data of the specified time period is refreshed, and the specified
  • the time period has a fixed frequency, such as: day, week, month, and the like.
  • the incremental refresh refresh data volume is small, the refresh rate is fast, and the full refresh report access speed is faster.
  • the refresh mode may be selected according to requirements, and the present invention is not limited.
  • the electronic device 1 refreshes the target source data according to a refresh parameter of the target source data to generate a target data cube.
  • the electronic device 1 refreshes the target source data according to the refresh parameter of the target source data, and generating the target data cube includes:
  • the electronic device 1 acquires a current time, and acquires a refresh time from a refresh parameter of the target source data, and when the current time matches the acquired refresh time, the electronic device 1 refreshes from the target source data. Obtaining a refresh mode in the parameter, the electronic device 1 refreshes the target source data according to the acquired refresh mode, and generates a target data cube, and the electronic device 1 obtains a refreshed result from the refresh parameter of the target source data.
  • the name of the data cube, and name the target data cube based on the name of the data cube generated after the refresh.
  • the electronic device 1 when the electronic device 1 acquires the current time is 7, if the refresh time obtained from the refresh parameter of the target source data is 7 o'clock every day, the electronic device 1 re-refreshed parameters from the target source data.
  • the refresh mode is obtained. If the refresh mode is a full-scale refresh, the electronic device 1 refreshes the target source data in a full-scale refresh manner, and uses the name A of the data cube generated after the acquired refresh.
  • the target data cube is named A.
  • the refreshing may include a task of performing a refresh operation on the refresh of the COGNOS model by using an OLAP (Online Analytical Processing) data extraction conversion engine (Transformer) of COGNOS.
  • OLAP Online Analytical Processing
  • Transformer Transformer
  • the latest data is obtained from a specified data source to form a data cube, and the formed data cube is used for providing the report as a local data source.
  • the electronic device 1 will automatically acquire and execute the publishing task.
  • the target data cube is a multi-dimensional matrix, which allows the user to explore and analyze the data set from multiple angles, so that not only the required information but also the required information can be acquired. Additional information.
  • the electronic device 1 can refresh the two-dimensional plane data into multi-dimensional stereo data by refreshing the target source data, thereby more satisfying the user's demand for data.
  • the method further includes:
  • the electronic device 1 When the electronic device 1 detects that the target source data refresh fails and/or the target source data has data supplementation, the electronic device 1 prompts a designated person to manually refresh the target source data.
  • the data supplement may affect the authenticity and availability of the data. Therefore, when the target source data refresh failure is detected and/or the target source data has data supplementation, The electronic device 1 can prompt the designated person to manually refresh the target source data, and avoid the influence of the subsequent tasks by means of human intervention, so that the execution of the task has greater flexibility.
  • the manner of prompting may include, but is not limited to, one or a combination of the following:
  • the designated person may also actively monitor the refresh process. Specifically, the designated person may monitor the working state of the refresh process in real time, or periodically query the working state of the refresh process, which is not limited by the present invention. .
  • the electronic device 1 may perform the above refresh operation by connecting a refreshing device, which is not limited in the present invention.
  • the electronic device 1 acquires a current publishing task of each operating environment in the multiple living system.
  • the current publishing task refers to a process of copying the target data cube to a specified server of each running environment, where the designated server refers to a local server.
  • the electronic device 1 makes the data access more convenient and fast by copying the target data cube to the designated server of each running environment, and does not need to connect other databases, thereby avoiding the influence of performance pressure and input and output restrictions. data access.
  • the electronic device 1 acquires a current release directory of each currently published task from two subdirectories configured in each running environment.
  • the method before the electronic device 1 obtains the current release directory of each currently published task from the two subdirectories configured in each running environment, the method further includes:
  • the electronic device 1 configures two subdirectories for each operating environment.
  • the electronic device 1 is configured to store the target data cube from two subdirectories configured in each running environment for access by a corresponding report.
  • the electronic device 1 obtains a current release directory of each currently published task from two subdirectories configured in each running environment, including:
  • the electronic device 1 selects one of the two subdirectories configured in each running environment as the current publishing directory of each currently published task.
  • the two subdirectories configured in each running environment are subdirectories B and subdirectories C.
  • the electronic device 1 may select one of the subdirectories B and the subdirectories C as the current publishing directory of each currently published task.
  • the electronic device 1 uses the subdirectory that is not used in the last sub-directory of each of the two environments configured in the running environment as the current publishing directory of each currently publishing task.
  • the two subdirectories configured in each running environment are subdirectories B and subdirectories C.
  • the electronic device 1 obtains the last time the task was released in each running environment.
  • the subdirectory used is the subdirectory C, and therefore, the electronic device 1 can use the subdirectory C in each running environment as the current publishing directory of each currently published task.
  • the electronic device 1 can implement the round-trip publishing of the two sub-directories configured in each running environment, and provide conditions for subsequent report access, and the specific implementation manner will be detailed in the subsequent steps.
  • the electronic device 1 publishes the target data cube to the obtained current publishing directory of each running environment.
  • the target data cube is stored in a local database corresponding to each running environment, and is used as a local data source.
  • the electronic device 1 can directly read the data in the target data cube in each running environment, without connecting to other databases to obtain data, thereby improving the Data read speed.
  • the electronic device 1 After completing each current publishing task, the electronic device 1 configures a publishing directory of a next publishing task in each running environment as another subdirectory except the current publishing directory in each running environment. And configuring a data source of the report of the target data cube as the current release directory.
  • the electronic device 1 publishes the target data cube to a subdirectory C in each running environment, and then configures a publishing directory of the next publishing task in each running environment as The subdirectory B in each running environment, and the data source of the report of the target data cube is configured as a subdirectory C in each running environment.
  • the electronic device 1 configures a data source of the report of the target data cube to the current publishing directory, including:
  • the electronic device 1 invokes a packaged specified SDK (Software Development Kit) interface to configure a data source of the report of the target data cube as the current release directory.
  • SDK Software Development Kit
  • the present invention does not limit the specified SDK interface of the package.
  • the electronic device 1 configures a data source of the report of the target data cube as the current publishing directory for access by the report of the target data cube.
  • the target data cube when the target data cube performs the next publishing task, it is published to another subdirectory in each running environment except the current publishing directory.
  • the electronic device 1 will use the current publishing directory as a data source, such that two sub-directories of each running environment are used as a publishing object and one as an access object, thereby the data access process of the report and The publishing process of the target data cube is separated, so that the data access process of the report and the publishing process of the target data cube are independent of each other and do not affect each other.
  • the electronic device 1 can also configure the data source of the report of the target data cube as the newly released subdirectory, thereby ensuring that the data accessed each time is the latest data.
  • the embodiment can also realize synchronization of data in multiple operating environments, and achieve the effect of living in different places, so that when one of the operating environments is faulty or the service is suspended, other operating environments can directly take over as usual, avoiding A failure of the operating environment causes the overall business interruption, further avoiding the user's economic loss and resource loss, so that the user can continue to normally access and use the system without abnormality.
  • the present invention can arbitrarily select an operating environment from a multi-live system, and obtain target source data from the selected operating environment; and when it is determined that the target source data acquisition is completed, obtain a refresh of the target source data. And refreshing the target source data according to the refresh parameter of the target source data to generate a target data cube; acquiring a current publishing task of each running environment in the multiple living system; and configuring two from each operating environment Obtaining a current publishing directory of each current publishing task in a subdirectory; publishing the target data cube to the current publishing directory of each running environment obtained; after completing each current publishing task, each running environment The release directory of the next release task is configured as another subdirectory in each running environment except the current release directory, and the data source of the report of the target data cube is configured as the current release directory. Therefore, the present invention enables the data access process of the report and the release process of the target data cube to be independent of each other without affecting each other.
  • the data cube issuing device 11 includes an obtaining unit 110, a refreshing unit 111, a publishing unit 112, a configuration unit 113, and a prompting unit 114.
  • the module/unit referred to in the present invention refers to a series of computer readable instruction segments that can be executed by the processor 13 and that are capable of performing fixed functions, which are stored in the memory 12. In this embodiment, the functions of the respective modules/units will be detailed in the subsequent embodiments.
  • the obtaining unit 110 arbitrarily selects an operating environment from the multi-active system 2, and acquires target source data from the selected operating environment.
  • the multi-active system 2 includes at least two operating environments. Specifically, the data of each operating environment in the multi-active system 2 is synchronized, so that the user is in the multi-active system. The access results of each running environment are consistent, so that when a running environment crashes, other operating environments can directly take over and continue to work normally.
  • the acquiring unit 110 arbitrarily selects an operating environment from the multiple living system 2, and obtains the target source data from the selected operating environment, including:
  • the obtaining unit 110 uses a data warehouse technology to arbitrarily select an operating environment from the multi-active system 2, and obtain target source data from the selected operating environment.
  • the data warehouse technology mainly includes three steps of extracting, transforming, and loading.
  • the extraction refers to a process of obtaining data from a source database of each operating environment;
  • the conversion refers to cleaning and conversion of data, and after the conversion, data that does not meet the condition or error can be filtered out, and the data is simultaneously Converted to the required format;
  • the loading refers to the process of loading the converted data into the local database as the target source data.
  • the target source data refers to source data used to generate a target data cube
  • the target source data may be two-dimensional plane data, or may be at least one table data or the like. Specifically, the concept of the target data cube will be explained later.
  • the acquiring unit 110 acquires a refresh parameter of the target source data.
  • the refresh parameters of the target source data include, but are not limited to, one or a combination of the following:
  • a refresh time of the target source data a refresh frequency of the target source data, a refresh model of an application of the target source data, a name of a data cube generated after the target source data is refreshed, and the target source data Refresh method, etc.
  • the refresh mode of the target source data includes an incremental refresh or a full refresh.
  • the full-quantity refresh refers to extracting full-service data for refreshing, and compared to the full-quantity refresh, the incremental refresh refers to refreshing each time the incremental data of the specified time period is refreshed, and the specified
  • the time period has a fixed frequency, such as: day, week, month, and the like.
  • the incremental refresh refresh data volume is small, the refresh speed is fast, and the full refresh report access speed is faster.
  • the refresh mode may be selected according to requirements, and the present invention is not limited.
  • the refresh unit 111 refreshes the target source data according to the refresh parameter of the target source data to generate a target data cube.
  • the refreshing unit 111 refreshes the target source data according to the refresh parameter of the target source data, and generating the target data cube includes:
  • the refreshing unit 111 acquires the current time, and acquires a refresh time from the refresh parameter of the target source data. When the current time matches the acquired refresh time, the refresh unit 111 refreshes the target source data.
  • the refreshing mode is obtained by refreshing the target source data according to the acquired refresh mode to generate a target data cube, and the refreshing unit 111 obtains the refreshed generated data from the refresh parameter of the target source data.
  • the name of the data cube, and name the target data cube based on the name of the data cube generated after the refresh.
  • the refreshing unit 111 when the refreshing unit 111 acquires the current time is 7, if the refresh time acquired from the refresh parameter of the target source data is 7:00 every day, the refreshing unit 111 further refresh parameters from the target source data.
  • the refresh mode is obtained. If the refresh mode is a full-scale refresh, the refresh unit 111 refreshes the target source data in a full-scale refresh manner, and uses the name A of the data cube generated after the acquired refresh.
  • the target data cube is named A.
  • the refreshing may include a task of performing a refresh operation on the refresh of the COGNOS model using the OLAP data extraction conversion engine of COGNOS. Specifically, by refreshing the COGNOS model, the latest data is obtained from a specified data source to form a data cube, and the formed data cube is used for providing the report as a local data source. When the refresh is completed, the electronic device 1 will automatically acquire and execute the publishing task.
  • the target data cube is a multi-dimensional matrix, which allows the user to explore and analyze the data set from multiple angles, so that not only the required information but also the required information can be acquired. Additional information.
  • the refresh unit 111 can refresh the two-dimensional plane data into multi-dimensional stereo data by refreshing the target source data, thereby more satisfying the user's demand for data.
  • the method further includes:
  • the prompting unit 114 prompts the designated person to manually refresh the target source data.
  • the data supplement may affect the authenticity and availability of the data. Therefore, when the target source data refresh failure is detected and/or the target source data has data supplementation, The prompting unit 114 may prompt the designated person to manually refresh the target source data, and avoid the influence of the subsequent tasks by means of human intervention, so that the execution of the task has greater flexibility.
  • the manner of prompting may include, but is not limited to, one or a combination of the following:
  • the designated person may also actively monitor the refresh process. Specifically, the designated person may monitor the working state of the refresh process in real time, or periodically query the working state of the refresh process, which is not limited by the present invention. .
  • the refresh unit 111 may perform the above refresh operation by connecting a refreshing device, which is not limited in the present invention.
  • the obtaining unit 110 acquires a current publishing task of each running environment in the multiple living system.
  • the current publishing task refers to a process of copying the target data cube to a specified server of each running environment, where the designated server refers to a local server.
  • the publishing unit 112 makes the data access more convenient and fast by copying the target data cube to the designated server of each running environment, without connecting other databases, thereby avoiding data access due to performance pressure and input and output restrictions. .
  • the obtaining unit 110 acquires a current publishing directory of each currently published task from two subdirectories configured in each running environment.
  • the method further includes:
  • the configuration unit 113 configures two subdirectories for each operating environment.
  • the configuration unit 113 is configured to store the target data cube from two subdirectories configured in each running environment for access by the corresponding report.
  • the obtaining unit 110 obtains a current release directory of each currently published task from two subdirectories configured in each running environment, including:
  • the obtaining unit 110 selects one of the two subdirectories configured in each running environment as the current publishing directory of each currently published task.
  • the two subdirectories configured in each running environment are subdirectories B and subdirectories C.
  • the two subdirectories configured in each running environment are empty directories. Therefore, the obtaining unit 110 may select one subdirectory from the subdirectory B and the subdirectory C as the current publishing directory of each currently published task.
  • the obtaining unit 110 uses the subdirectory that is not used when the task was last published in the two subdirectories configured in each running environment as the current publishing directory of each current publishing task.
  • the two subdirectories configured in each running environment are subdirectories B and subdirectories C.
  • the electronic device 1 obtains the last time the task was released in each running environment.
  • the subdirectory used is the subdirectory C, and therefore, the obtaining unit 110 can use the subdirectory C in each running environment as the current publishing directory of each currently published task.
  • the electronic device 1 can implement the round-trip publishing of the two sub-directories configured in each running environment, and provide conditions for subsequent report access, and the specific implementation manner will be detailed in the subsequent steps.
  • the publishing unit 112 publishes the target data cube to the currently published directory of each of the acquired runtime environments.
  • the target data cube is stored in a local database corresponding to each running environment, and is used as a local data source.
  • the electronic device 1 can directly read the data in the target data cube in each running environment, without connecting to other databases to obtain data, thereby improving the Data read speed.
  • the configuration unit 113 configures a publishing directory of the next publishing task in each running environment as another subdirectory in each running environment except the current publishing directory, and
  • the data source of the report of the target data cube is configured as the current release directory.
  • the publishing unit 112 publishes the target data cube to the subdirectory C in each running environment, thereby configuring the publishing directory of the next publishing task in each running environment as The subdirectory B in each running environment, and the data source of the report of the target data cube is configured as a subdirectory C in each running environment.
  • the configuration unit 113 configures a data source of the report of the target data cube to the current release directory, including:
  • the configuration unit 113 calls the specified SDK interface of the package, and configures a data source of the report of the target data cube as the current release directory.
  • the present invention does not limit the specified SDK interface of the package.
  • the configuration unit 113 configures a data source of the report of the target data cube as the current release directory for access by the report of the target data cube.
  • the target data cube when the target data cube performs the next publishing task, it is published to another subdirectory in each running environment except the current publishing directory.
  • the electronic device 1 will use the current publishing directory as a data source, such that two sub-directories of each running environment are used as a publishing object and one as an access object, thereby the data access process of the report and The publishing process of the target data cube is separated, so that the data access process of the report and the publishing process of the target data cube are independent of each other and do not affect each other.
  • the configuration unit 113 may also configure the data source of the report of the target data cube as the newly released subdirectory, thereby ensuring that the data accessed each time is the latest data.
  • the embodiment can also realize synchronization of data in multiple operating environments, and achieve the effect of living in different places, so that when one of the operating environments is faulty or the service is suspended, other operating environments can directly take over as usual, avoiding A failure of the operating environment causes the overall business interruption, further avoiding the user's economic loss and resource loss, so that the user can continue to normally access and use the system without abnormality.
  • the present invention can arbitrarily select an operating environment from a multi-live system, and obtain target source data from the selected operating environment; and when it is determined that the target source data acquisition is completed, obtain a refresh of the target source data. And refreshing the target source data according to the refresh parameter of the target source data to generate a target data cube; acquiring a current publishing task of each running environment in the multiple living system; and configuring two from each operating environment Obtaining a current publishing directory of each current publishing task in a subdirectory; publishing the target data cube to the current publishing directory of each running environment obtained; after completing each current publishing task, each running environment The release directory of the next release task is configured as another subdirectory in each running environment except the current release directory, and the data source of the report of the target data cube is configured as the current release directory. Therefore, the present invention enables the data access process of the report and the release process of the target data cube to be independent of each other without affecting each other.
  • FIG. 5 is a schematic structural diagram of an electronic device according to a preferred embodiment of the present invention for implementing a data cube publishing method.
  • the electronic device 1 is a device capable of automatically performing numerical calculation and/or information processing according to an instruction set or stored in advance, and the hardware includes, but not limited to, a microprocessor, an application specific integrated circuit (ASIC). ), Field-Programmable Gate Array (FPGA), Digital Signal Processor (DSP), embedded devices, etc.
  • ASIC application specific integrated circuit
  • FPGA Field-Programmable Gate Array
  • DSP Digital Signal Processor
  • the electronic device 1 can also be, but is not limited to, any electronic product that can interact with a user through a keyboard, a mouse, a remote controller, a touch panel, or a voice control device, such as a personal computer, a tablet, or a smart phone. , Personal Digital Assistant (PDA), game consoles, Internet Protocol Television (IPTV), smart wearable devices, etc.
  • PDA Personal Digital Assistant
  • IPTV Internet Protocol Television
  • the electronic device 1 can also be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server.
  • the network in which the electronic device 1 is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), and the like.
  • the Internet includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), and the like.
  • VPN virtual private network
  • the electronic device 1 includes, but is not limited to, a memory 12, a processor 13, and computer readable instructions stored in the memory 12 and executable on the processor 13. , for example, the data cube publisher.
  • the schematic diagram is merely an example of the electronic device 1, does not constitute a limitation on the electronic device 1, may include more or less components than those illustrated, or combine some components, or different. Components such as the electronic device 1 may also include input and output devices, network access devices, buses, and the like.
  • the processor 13 may be a central processing unit (CPU), or may be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.
  • the general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, and the processor 13 is an operation core and a control center of the electronic device 1, and connects the entire electronic device by using various interfaces and lines. Each part of 1 and an operating system of the electronic device 1 and various installed applications, program codes, and the like.
  • the processor 13 executes an operating system of the electronic device 1 and various types of installed applications.
  • the processor 13 executes the application to implement the steps in the foregoing embodiments of the data cube publishing method, such as steps S10, S11, S12, S13, S14, S15, and S16 shown in FIG.
  • the processor 13 implements the functions of each module/unit in each device embodiment when the computer readable instructions are executed, for example, arbitrarily selecting an operating environment from a multi-active system, and obtaining from the selected operating environment.
  • Target source data when it is determined that the target source data acquisition is completed, acquiring a refresh parameter of the target source data; refreshing the target source data according to the refresh parameter of the target source data to generate a target data cube; Describe the current publishing task of each running environment in the multi-live system; obtain the current publishing directory of each currently publishing task from the two subdirectories configured in each running environment; and publish the target data cube to each acquired running In the current publishing directory of the environment; after completing each current publishing task, configuring the publishing directory of the next publishing task in each running environment as another child in each running environment except the current publishing directory a directory and configuring a data source of the report of the target data cube as the current publishing directory.
  • the computer readable instructions may be partitioned into one or more modules/units, the one or more modules/units being stored in the memory 12 and executed by the processor 13 to The present invention has been completed.
  • the one or more modules/units may be a series of computer readable instruction segments capable of performing a particular function for describing the execution of the computer readable instructions in the electronic device 1.
  • the computer readable instructions may be divided into an acquisition unit 110, a refresh unit 111, a distribution unit 112, a configuration unit 113, and a prompt unit 114.
  • the memory 12 can be used to store the computer readable instructions and/or modules, which are stored or executed in a memory 12 by running or executing computer readable instructions and/or modules stored in the memory 12.
  • the internal data implements various functions of the electronic device 1.
  • the memory 12 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; Stores data created based on the use of the phone (such as audio data, phone book, etc.).
  • the memory 12 may include a high-speed random access memory, and may also include a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (SD).
  • a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (SD).
  • SSD secure digital
  • flash card at least one disk storage device, flash device, or other volatile solid state storage device.
  • the memory 12 may be an external memory and/or an internal memory of the electronic device 1. Further, the memory 12 may be a circuit having a storage function in a physical form, such as a RAM (Random-Access Memory), a FIFO (First In First Out), or the like. Alternatively, the memory 12 may also be a memory having a physical form such as a memory stick, a TF card, or the like.
  • the modules/units integrated by the electronic device 1 can be stored in a non-volatile readable storage medium if implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the present invention implements all or part of the processes in the foregoing embodiments, and may also be implemented by instructing related hardware by computer readable instructions, which may be stored in a non-volatile In reading a storage medium, the computer readable instructions, when executed by a processor, implement the steps of the various method embodiments described above.
  • the computer readable instructions comprise computer readable instruction code, which may be in the form of source code, an object code form, an executable file or some intermediate form or the like.
  • the non-transitory readable medium may include any entity or device capable of carrying the computer readable instruction code, a recording medium, a USB flash drive, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read only memory (ROM, Read-Only Memory), Random Access Memory (RAM), electrical carrier signals, telecommunications signals, and software distribution media.
  • Non-volatile readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, Volatile readable media does not include electrical carrier signals and telecommunication signals.
  • the memory 12 in the electronic device 1 stores a plurality of instructions to implement a data cube publishing method
  • the processor 13 can execute the plurality of instructions to implement: arbitrarily selecting from a multi-live system. a running environment, and acquiring target source data from the selected running environment; acquiring the refresh parameter of the target source data when determining that the target source data acquisition is completed; and performing the target according to the refresh parameter of the target source data
  • the source data is refreshed to generate a target data cube; the current publishing task of each running environment in the multiple living system is obtained; and the current publishing directory of each currently publishing task is obtained from two subdirectories configured in each running environment;
  • the target data cube is published to the current publishing directory of each running environment acquired; after each current publishing task is completed, the publishing directory of the next publishing task in each running environment is configured as each running environment. Another subdirectory other than the current published directory, and the data source of the report of the target data cube Configured as the current publishing directory.
  • the processor 13 further executes a plurality of instructions including:
  • the data warehouse technology is used to randomly select an operating environment from the multi-live system, and obtain the target source data from the selected operating environment.
  • the refresh parameter of the target source data includes one or a combination of the following:
  • a refresh time of the target source data a refresh frequency of the target source data, a refresh model of an application of the target source data, a name of a data cube generated after the target source data is refreshed, and the target source data Refresh method.
  • the processor 13 further executes a plurality of instructions including:
  • the target source data is refreshed according to the acquired refresh mode to generate a target data cube.
  • the processor 13 further executes a plurality of instructions including:
  • the designated person is prompted to manually refresh the target source data.
  • the processor 13 further executes a plurality of instructions including:
  • the processor 13 further executes a plurality of instructions including:
  • the encapsulated specified SDK interface is invoked, and the data source of the report of the target data cube is configured as the current release directory.
  • modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of hardware plus software function modules.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明提供一种数据立方体发布方法、装置、电子设备和存储介质。所述数据立方体发布方法通过在多活系统中的每个运行环境中分别配置两个子目录,然后依次轮流配置两个子目录一个作为发布的对象,一个作为访问的对象,从而将报表的数据访问过程与所述目标数据立方体的发布过程分开,使报表的数据访问过程与所述目标数据立方体的发布过程相互独立,互不影响。

Description

数据立方体发布方法、装置、电子设备和存储介质
本申请要求于2018年04月10日提交中国专利局,申请号为201810316070.6发明名称为“数据立方体发布方法、装置、电子设备和存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及数据处理技术领域,尤其涉及一种数据立方体发布方法、装置、电子设备和存储介质。
背景技术
现有技术方案中,数据立方体通常采用手动刷新及发布的方式,或者是使用计划任务自动执行的方式,但是,针对于大批量的刷新或发布的任务需求,由于手工发布和计划任务发布都需要大量重复配置工作,且数据立方体文件的拷贝需要相当的时间,因此不是无缝衔接的,上述发布方式则很难满足需求。
发明内容
鉴于以上内容,有必要提供一种数据立方体发布方法、装置、电子设备和存储介质,能使报表的数据访问过程与所述目标数据立方体的发布过程相互独立,互不影响。
一种数据立方体发布方法,所述方法包括:
从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;
当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;
根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;
获取所述多活系统中每个运行环境的当前发布任务;
从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;
将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;
在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布 目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
一种数据立方体发布装置,所述装置包括:
获取单元,用于从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;
所述获取单元,还用于当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;
刷新单元,用于根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;
所述获取单元,还用于获取所述多活系统中每个运行环境的当前发布任务;
所述获取单元,还用于从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;
发布单元,用于将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;
配置单元,用于在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
一种电子设备,所述电子设备包括:
处理器;及
存储器,存储在所述存储器中的指令被所述处理器执行以实现所述数据立方体发布方法。
一种非易失性可读存储介质,所述非易失性可读存储介质中存储的指令被电子设备中的处理器执行以实现所述数据立方体发布方法。
由以上技术方案可以看出,本发明从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;获取所述多活系统中每个运行环境的当前发布任务;从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发 布目录。利用本发明能使报表的数据访问过程与所述目标数据立方体的发布过程相互独立,互不影响。
附图说明
图1是本发明实现数据立方体发布方法的较佳实施例的应用环境图。
图2是本发明数据立方体发布方法的较佳实施例的流程图。
图3是数据仓库技术的示意图。
图4是本发明数据立方体发布装置的较佳实施例的功能模块图。
图5是本发明实现数据立方体发布方法的较佳实施例的电子设备的结构示意图。
具体实施方式
为了使本发明的目的、技术方案和优点更加清楚,下面结合附图和具体实施例对本发明进行详细描述。
如图1所示,图1是本发明实现数据立方体发布方法的较佳实施例的应用环境图。所述多活系统2包括至少两个运行环境,所述电子设备1与所述多活系统2相通信。
其中,所述多活系统2中的每个运行环境的数据是同步的,使用户对所述多活系统2中每个运行环境的访问结果均保持一致。
所述电子设备1用于从所述多活系统2中的各个运行环境中获取目标源数据,以生成目标数据立方体。
如图2所示,是本发明数据立方体发布方法的较佳实施例的流程图。根据不同的需求,该流程图中步骤的顺序可以改变,某些步骤可以省略。
所述数据立方体发布方法应用于一个或者多个电子设备1中,所述电子设备1是一种能够按照事先设定或存储的指令,自动进行数值计算和/或信息处理的设备,其硬件包括但不限于微处理器、专用集成电路(Application Specific Integrated Circuit,ASIC)、可编程门阵列(Field-Programmable Gate Array,FPGA)、数字处理器(Digital Signal Processor,DSP)、嵌入式设备等。
所述电子设备1可以是任何一种可与用户进行人机交互的电子产品,例如,个人计算机、平板电脑、智能手机、个人数字助理(Personal Digital Assistant,PDA)、游戏机、交互式网络电视(Internet Protocol Television,IPTV)、智能式穿戴式设备等。
所述电子设备1还可以包括网络设备和/或用户设备。其中,所述网络设备包括,但不限于单个网络服务器、多个网络服务器组成的服务器组或基于 云计算(Cloud Computing)的由大量主机或网络服务器构成的云。
所述电子设备1所处的网络包括但不限于互联网、广域网、城域网、局域网、虚拟专用网络(Virtual Private Network,VPN)等。
S10,所述电子设备1从多活系统2中任意选取一个运行环境,并从选取的运行环境中获取目标源数据。
在本实施例中,所述多活系统2中包括至少两个运行环境,具体地,所述多活系统2中的每个运行环境的数据是同步的,使用户对所述多活系统中每个运行环境的访问结果均保持一致,这样,当一个运行环境崩溃时,其他运行环境能够直接接替,继续正常工作。
优选地,所述电子设备1从多活系统2中任意选取一个运行环境,并从选取的运行环境中获取目标源数据包括:
所述电子设备1采用数据仓库技术(Extract-Transform-Load,ETL)从多活系统2中任意选取一个运行环境,并从选取的运行环境中获取目标源数据。
如图3所示,是数据仓库技术的示意图。具体地,所述数据仓库技术主要包括抽取(Extract)、转换(Transform)及装载(Load)三个步骤。所述抽取是指从每个运行环境的源数据库中获得数据的过程;所述转换是指对数据的清洗和转换,经过所述转换,可以过滤掉不符合条件或者错误的数据,同时将数据转换为需要的格式;所述装载是指将转换后的数据加载到本地数据库作为所述目标源数据的过程。
在本实施例中,所述目标源数据是指用于生成目标数据立方体(data cube)的源数据,所述目标源数据可以是二维的平面数据,也可以是至少一张表格数据等。具体地,所述目标数据立方体的概念将在后文中进行解释。
S11,当确定所述目标源数据获取完成时,所述电子设备1获取所述目标源数据的刷新参数。
优选地,所述目标源数据的刷新参数包括,但不限于以下一种或者多种的组合:
所述目标源数据的刷新时间、所述目标源数据的刷新频率、所述目标源数据的应用的刷新模型、对所述目标源数据刷新后生成的数据立方体的名称、所述目标源数据的刷新方式等。
具体地,所述目标源数据的刷新方式包括增量刷新或者全量刷新。
其中,所述全量刷新是指提取全业务量数据进行刷新,而相比于所述全量刷新,所述增量刷新是指每次刷新提取指定时间段的增量数据进行刷新,且所述指定时间段具有固定频率,如:日、周、月等。所述增量刷新的刷新 数据量较少,刷新速度快,而所述全量刷新的报表访问速度更快。
需要说明的是,在实际应用中,可以根据需要选择刷新方式,本发明不做限制。
S12,所述电子设备1根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体。
优选地,所述电子设备1根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体包括:
所述电子设备1获取当前时间,及从所述目标源数据的刷新参数中获取刷新时间,当所述当前时间与获取的刷新时间匹配时,所述电子设备1从所述目标源数据的刷新参数中获取刷新方式,所述电子设备1根据获取的刷新方式对所述目标源数据进行刷新,生成目标数据立方体,所述电子设备1从所述目标源数据的刷新参数中获取刷新后生成的数据立方体的名称,并根据获取的刷新后生成的数据立方体的名称为所述目标数据立方体命名。
例如:所述电子设备1获取当前时间为7时,如果从所述目标源数据的刷新参数中获取的刷新时间为每天7时,则所述电子设备1再从所述目标源数据的刷新参数中获取刷新方式,若所述刷新方式为全量刷新,则所述电子设备1以全量刷新的方式对所述目标源数据进行刷新,并以获取到的刷新后生成的数据立方体的名称A将所述目标数据立方体命名为A。
在本实施例中,所述刷新可以包括使用COGNOS(康格诺)的OLAP(Online Analytical Processing,联机分析处理)数据抽取转换引擎(Transformer)对COGNOS模型的刷新进行刷新操作的任务。具体地,通过刷新所述COGNOS模型,从指定数据源获取到最新的数据,形成数据立方体,形成的所述数据立方体用于提供给报表作为本地数据源使用。当刷新完成后,所述电子设备1将自动获取并执行发布任务。
在本实施例中,所述目标数据立方体是一种多维矩阵,让用户从多个角度探索和分析数据集,从而不仅可以获取到需要的信息,也可以获取到与所述需要的信息相关联的其他信息。
在本实施例中,所述电子设备1通过对所述目标源数据进行刷新,可以将二维的平面数据刷新为多维的立体数据,更加满足用户对数据的需求。
优选地,在所述电子设备1根据所述目标源数据的刷新参数对所述目标源数据进行刷新时,所述方法还包括:
当所述电子设备1检测到所述目标源数据刷新失败及/或所述目标源数据有数据补录时,所述电子设备1提示指定人员对所述目标源数据进行手动刷新。
具体地,由于刷新失败会影响后续的发布任务,数据补录会影响数据的真实性及可用性,因此,当检测到所述目标源数据刷新失败及/或所述目标源数据有数据补录时,所述电子设备1可以提示指定人员对所述目标源数据进行手动刷新,通过人为介入的方式,避免影响后续任务的进行,使任务的执行具有更大的灵活性。
具体地,提示的方式可以包括,但不限于以下一种或者多种的组合:
语音提示、弹窗提示、短信提示、电话提示、邮件提示等等。
当然,所述指定人员也可以对上述刷新过程进行主动监控,具体地,所述指定人员可以实时监控所述刷新过程的作业状态,也可以定时查询所述刷新过程的作业状态,本发明不作限制。
需要说明的是,在其他实施例中,所述电子设备1也可以通过连接一个刷新机器进行上述刷新操作,本发明不作限制。
S13,所述电子设备1获取所述多活系统中每个运行环境的当前发布任务。
在本实施例中,所述当前发布任务是指将所述目标数据立方体拷贝至每个运行环境的指定服务器的过程,其中,所述指定服务器是指本地的服务器。这样,所述电子设备1通过将所述目标数据立方体拷贝至每个运行环境的指定服务器,使数据访问更加方便、快捷,而不需要再连接其他数据库,避免由于性能压力及输入输出的限制影响数据访问。
S14,所述电子设备1从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录。
在本实施例中,在所述电子设备1从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录前,所述方法还包括:
所述电子设备1为每个运行环境配置两个子目录。
具体地,所述电子设备1从每个运行环境中配置的两个子目录用于存储所述目标数据立方体,以供对应的报表进行访问。
优选地,所述电子设备1从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录包括:
当每个当前发布任务是首次发布时,所述电子设备1从每个运行环境中配置的两个子目录中任选一个子目录作为每个当前发布任务的当前发布目录。
例如:每个运行环境中配置的两个子目录为子目录B及子目录C,当所述当前发布任务是首次发布时,也就是说,每个运行环境中配置的两个子目录均为空目录,因此,所述电子设备1可以从所述子目录B及所述子目录C 中任选一个子目录作为每个当前发布任务的当前发布目录。
当每个当前发布任务不是首次发布时,所述电子设备1将每个运行环境中配置的两个子目录中上次发布任务时未使用的子目录作为每个当前发布任务的当前发布目录。
例如:每个运行环境中配置的两个子目录为子目录B及子目录C,当所述当前发布任务不是首次发布时,所述电子设备1获取到每个运行环境中上次发布任务时未使用的子目录为所述子目录C,因此,所述电子设备1可以将每个运行环境中的子目录C作为每个当前发布任务的当前发布目录。
通过上述实施方式,所述电子设备1可以实现每个运行环境中配置的两个子目录的轮流发布,为后续报表访问提供条件,具体实现方式将在后续步骤中详述。
S15,所述电子设备1将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中。
通过上述实施方式,相当于将所述目标数据立方体存储于每个运行环境对应的本地数据库中,并作为本地数据源。这样,在后续有报表要进行数据的访问时,所述电子设备1即可在每个运行环境中直接读取所述目标数据立方体中的数据,而不需要连接其他数据库获取数据,从而提高了数据读取速度。
S16,在完成每个当前发布任务后,所述电子设备1将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
例如:在完成每个当前发布任务后,所述电子设备1将所述目标数据立方体发布至每个运行环境中的子目录C,进而将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中的所述子目录B,并将所述目标数据立方体的报表的数据源配置为每个运行环境中的子目录C。
优选地,所述电子设备1将所述目标数据立方体的报表的数据源配置为所述当前发布目录包括:
所述电子设备1调用封装的指定SDK(Software Development Kit,软件开发工具包)接口,将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
具体地,本发明对所述封装的指定SDK接口不做限制。
通过上述实施方式,所述电子设备1将所述目标数据立方体的报表的数据源配置为所述当前发布目录,以供所述目标数据立方体的报表进行访问。
进一步地,在所述目标数据立方体进行下一次发布任务时,将发布至每个运行环境中除所述当前发布目录之外的另一个子目录中,此时,如果所述目标数据立方体的报表需要访问数据,所述电子设备1将以所述当前发布目录为数据源,这样,每个运行环境的两个子目录一个作为发布的对象,一个作为访问的对象,从而将报表的数据访问过程与所述目标数据立方体的发布过程分开,使报表的数据访问过程与所述目标数据立方体的发布过程相互独立,互不影响。
通过上述实施方式,所述电子设备1还可以将所述目标数据立方体的报表的数据源配置为最新发布的子目录,从而保证每次访问的数据均为最新数据。
进一步地,本实施方式还可以实现多个运行环境中数据的同步,达到异地多活的效果,这样,当其中一个运行环境故障或者是中止服务时,其他运行环境可以直接接替照常运行,避免由于一个运行环境故障造成整体业务中断,进一步避免了用户的经济损失及资源损失,使用户在对异常无感知的情况下继续正常访问及使用系统。
综上所述,本发明能从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;获取所述多活系统中每个运行环境的当前发布任务;从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。因此,本发明能使报表的数据访问过程与所述目标数据立方体的发布过程相互独立,互不影响。
如图4所示,是本发明数据立方体发布装置的较佳实施例的功能模块图。所述数据立方体发布装置11包括获取单元110、刷新单元111、发布单元112、配置单元113及提示单元114。本发明所称的模块/单元是指一种能够被处理器13所执行,并且能够完成固定功能的一系列计算机可读指令段,其存储在存储器12中。在本实施例中,关于各模块/单元的功能将在后续的实施例中详述。
获取单元110从多活系统2中任意选取一个运行环境,并从选取的运行环境中获取目标源数据。
在本实施例中,所述多活系统2中包括至少两个运行环境,具体地,所述多活系统2中的每个运行环境的数据是同步的,使用户对所述多活系统中每个运行环境的访问结果均保持一致,这样,当一个运行环境崩溃时,其他运行环境能够直接接替,继续正常工作。
优选地,所述获取单元110从多活系统2中任意选取一个运行环境,并从选取的运行环境中获取目标源数据包括:
所述获取单元110采用数据仓库技术从多活系统2中任意选取一个运行环境,并从选取的运行环境中获取目标源数据。
如图3所示,是数据仓库技术的示意图。具体地,所述数据仓库技术主要包括抽取(Extract)、转换(Transform)及装载(Load)三个步骤。所述抽取是指从每个运行环境的源数据库中获得数据的过程;所述转换是指对数据的清洗和转换,经过所述转换,可以过滤掉不符合条件或者错误的数据,同时将数据转换为需要的格式;所述装载是指将转换后的数据加载到本地数据库作为所述目标源数据的过程。
在本实施例中,所述目标源数据是指用于生成目标数据立方体(data cube)的源数据,所述目标源数据可以是二维的平面数据,也可以是至少一张表格数据等。具体地,所述目标数据立方体的概念将在后文中进行解释。
当确定所述目标源数据获取完成时,所述获取单元110获取所述目标源数据的刷新参数。
优选地,所述目标源数据的刷新参数包括,但不限于以下一种或者多种的组合:
所述目标源数据的刷新时间、所述目标源数据的刷新频率、所述目标源数据的应用的刷新模型、对所述目标源数据刷新后生成的数据立方体的名称、所述目标源数据的刷新方式等。
具体地,所述目标源数据的刷新方式包括增量刷新或者全量刷新。
其中,所述全量刷新是指提取全业务量数据进行刷新,而相比于所述全量刷新,所述增量刷新是指每次刷新提取指定时间段的增量数据进行刷新,且所述指定时间段具有固定频率,如:日、周、月等。所述增量刷新的刷新数据量较少,刷新速度快,而所述全量刷新的报表访问速度更快。
需要说明的是,在实际应用中,可以根据需要选择刷新方式,本发明不做限制。
刷新单元111根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体。
优选地,所述刷新单元111根据所述目标源数据的刷新参数对所述目标 源数据进行刷新,生成目标数据立方体包括:
所述刷新单元111获取当前时间,及从所述目标源数据的刷新参数中获取刷新时间,当所述当前时间与获取的刷新时间匹配时,所述刷新单元111从所述目标源数据的刷新参数中获取刷新方式,所述刷新单元111根据获取的刷新方式对所述目标源数据进行刷新,生成目标数据立方体,所述刷新单元111从所述目标源数据的刷新参数中获取刷新后生成的数据立方体的名称,并根据获取的刷新后生成的数据立方体的名称为所述目标数据立方体命名。
例如:所述刷新单元111获取当前时间为7时,如果从所述目标源数据的刷新参数中获取的刷新时间为每天7时,则所述刷新单元111再从所述目标源数据的刷新参数中获取刷新方式,若所述刷新方式为全量刷新,则所述刷新单元111以全量刷新的方式对所述目标源数据进行刷新,并以获取到的刷新后生成的数据立方体的名称A将所述目标数据立方体命名为A。
在本实施例中,所述刷新可以包括使用COGNOS的OLAP数据抽取转换引擎对COGNOS模型的刷新进行刷新操作的任务。具体地,通过刷新所述COGNOS模型,从指定数据源获取到最新的数据,形成数据立方体,形成的所述数据立方体用于提供给报表作为本地数据源使用。当刷新完成后,所述电子设备1将自动获取并执行发布任务。
在本实施例中,所述目标数据立方体是一种多维矩阵,让用户从多个角度探索和分析数据集,从而不仅可以获取到需要的信息,也可以获取到与所述需要的信息相关联的其他信息。
在本实施例中,所述刷新单元111通过对所述目标源数据进行刷新,可以将二维的平面数据刷新为多维的立体数据,更加满足用户对数据的需求。
优选地,在所述刷新单元111根据所述目标源数据的刷新参数对所述目标源数据进行刷新时,所述方法还包括:
当所述电子设备1检测到所述目标源数据刷新失败及/或所述目标源数据有数据补录时,提示单元114提示指定人员对所述目标源数据进行手动刷新。
具体地,由于刷新失败会影响后续的发布任务,数据补录会影响数据的真实性及可用性,因此,当检测到所述目标源数据刷新失败及/或所述目标源数据有数据补录时,所述提示单元114可以提示指定人员对所述目标源数据进行手动刷新,通过人为介入的方式,避免影响后续任务的进行,使任务的执行具有更大的灵活性。
具体地,提示的方式可以包括,但不限于以下一种或者多种的组合:
语音提示、弹窗提示、短信提示、电话提示、邮件提示等等。
当然,所述指定人员也可以对上述刷新过程进行主动监控,具体地,所述指定人员可以实时监控所述刷新过程的作业状态,也可以定时查询所述刷新过程的作业状态,本发明不作限制。
需要说明的是,在其他实施例中,所述刷新单元111也可以通过连接一个刷新机器进行上述刷新操作,本发明不作限制。
所述获取单元110获取所述多活系统中每个运行环境的当前发布任务。
在本实施例中,所述当前发布任务是指将所述目标数据立方体拷贝至每个运行环境的指定服务器的过程,其中,所述指定服务器是指本地的服务器。这样,发布单元112通过将所述目标数据立方体拷贝至每个运行环境的指定服务器,使数据访问更加方便、快捷,而不需要再连接其他数据库,避免由于性能压力及输入输出的限制影响数据访问。
所述获取单元110从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录。
在本实施例中,在所述获取单元110从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录前,所述方法还包括:
配置单元113为每个运行环境配置两个子目录。
具体地,所述配置单元113从每个运行环境中配置的两个子目录用于存储所述目标数据立方体,以供对应的报表进行访问。
优选地,所述获取单元110从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录包括:
当每个当前发布任务是首次发布时,所述获取单元110从每个运行环境中配置的两个子目录中任选一个子目录作为每个当前发布任务的当前发布目录。
例如:每个运行环境中配置的两个子目录为子目录B及子目录C,当所述当前发布任务是首次发布时,也就是说,每个运行环境中配置的两个子目录均为空目录,因此,所述获取单元110可以从所述子目录B及所述子目录C中任选一个子目录作为每个当前发布任务的当前发布目录。
当每个当前发布任务不是首次发布时,所述获取单元110将每个运行环境中配置的两个子目录中上次发布任务时未使用的子目录作为每个当前发布任务的当前发布目录。
例如:每个运行环境中配置的两个子目录为子目录B及子目录C,当所述当前发布任务不是首次发布时,所述电子设备1获取到每个运行环境中上次发布任务时未使用的子目录为所述子目录C,因此,所述获取单元110可 以将每个运行环境中的子目录C作为每个当前发布任务的当前发布目录。
通过上述实施方式,所述电子设备1可以实现每个运行环境中配置的两个子目录的轮流发布,为后续报表访问提供条件,具体实现方式将在后续步骤中详述。
发布单元112将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中。
通过上述实施方式,相当于将所述目标数据立方体存储于每个运行环境对应的本地数据库中,并作为本地数据源。这样,在后续有报表要进行数据的访问时,所述电子设备1即可在每个运行环境中直接读取所述目标数据立方体中的数据,而不需要连接其他数据库获取数据,从而提高了数据读取速度。
在完成每个当前发布任务后,所述配置单元113将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
例如:在完成每个当前发布任务后,所述发布单元112将所述目标数据立方体发布至每个运行环境中的子目录C,进而将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中的所述子目录B,并将所述目标数据立方体的报表的数据源配置为每个运行环境中的子目录C。
优选地,所述配置单元113将所述目标数据立方体的报表的数据源配置为所述当前发布目录包括:
所述配置单元113调用封装的指定SDK接口,将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
具体地,本发明对所述封装的指定SDK接口不做限制。
通过上述实施方式,所述配置单元113将所述目标数据立方体的报表的数据源配置为所述当前发布目录,以供所述目标数据立方体的报表进行访问。
进一步地,在所述目标数据立方体进行下一次发布任务时,将发布至每个运行环境中除所述当前发布目录之外的另一个子目录中,此时,如果所述目标数据立方体的报表需要访问数据,所述电子设备1将以所述当前发布目录为数据源,这样,每个运行环境的两个子目录一个作为发布的对象,一个作为访问的对象,从而将报表的数据访问过程与所述目标数据立方体的发布过程分开,使报表的数据访问过程与所述目标数据立方体的发布过程相互独立,互不影响。
通过上述实施方式,所述配置单元113还可以将所述目标数据立方体的 报表的数据源配置为最新发布的子目录,从而保证每次访问的数据均为最新数据。
进一步地,本实施方式还可以实现多个运行环境中数据的同步,达到异地多活的效果,这样,当其中一个运行环境故障或者是中止服务时,其他运行环境可以直接接替照常运行,避免由于一个运行环境故障造成整体业务中断,进一步避免了用户的经济损失及资源损失,使用户在对异常无感知的情况下继续正常访问及使用系统。
综上所述,本发明能从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;获取所述多活系统中每个运行环境的当前发布任务;从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。因此,本发明能使报表的数据访问过程与所述目标数据立方体的发布过程相互独立,互不影响。
如图5所示,是本发明实现数据立方体发布方法的较佳实施例的电子设备的结构示意图。
所述电子设备1是一种能够按照事先设定或存储的指令,自动进行数值计算和/或信息处理的设备,其硬件包括但不限于微处理器、专用集成电路(Application Specific Integrated Circuit,ASIC)、可编程门阵列(Field-Programmable Gate Array,FPGA)、数字处理器(Digital Signal Processor,DSP)、嵌入式设备等。
所述电子设备1还可以是但不限于任何一种可与用户通过键盘、鼠标、遥控器、触摸板或声控设备等方式进行人机交互的电子产品,例如,个人计算机、平板电脑、智能手机、个人数字助理(Personal Digital Assistant,PDA)、游戏机、交互式网络电视(Internet Protocol Television,IPTV)、智能式穿戴式设备等。
所述电子设备1还可以是桌上型计算机、笔记本、掌上电脑及云端服务器等计算设备。
所述电子设备1所处的网络包括但不限于互联网、广域网、城域网、局域网、虚拟专用网络(Virtual Private Network,VPN)等。
在本发明的一个实施例中,所述电子设备1包括,但不限于,存储器12、处理器13,以及存储在所述存储器12中并可在所述处理器13上运行的计算机可读指令,例如数据立方体发布程序。
本领域技术人员可以理解,所述示意图仅仅是电子设备1的示例,并不构成对电子设备1的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件,例如所述电子设备1还可以包括输入输出设备、网络接入设备、总线等。
所称处理器13可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等,所述处理器13是所述电子设备1的运算核心和控制中心,利用各种接口和线路连接整个电子设备1的各个部分,及执行所述电子设备1的操作系统以及安装的各类应用程序、程序代码等。
所述处理器13执行所述电子设备1的操作系统以及安装的各类应用程序。所述处理器13执行所述应用程序以实现上述各个数据立方体发布方法实施例中的步骤,例如图1所示的步骤S10、S11、S12、S13、S14、S15及S16。
或者,所述处理器13执行所述计算机可读指令时实现上述各装置实施例中各模块/单元的功能,例如:从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;获取所述多活系统中每个运行环境的当前发布任务;从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
示例性的,所述计算机可读指令可以被分割成一个或多个模块/单元,所述一个或者多个模块/单元被存储在所述存储器12中,并由所述处理器13执行,以完成本发明。所述一个或多个模块/单元可以是能够完成特定功能的一系列计算机可读指令段,该指令段用于描述所述计算机可读指令在所述电子 设备1中的执行过程。例如,所述计算机可读指令可以被分割成获取单元110、刷新单元111、发布单元112、配置单元113及提示单元114。
所述存储器12可用于存储所述计算机可读指令和/或模块,所述处理器13通过运行或执行存储在所述存储器12内的计算机可读指令和/或模块,以及调用存储在存储器12内的数据,实现所述电子设备1的各种功能。所述存储器12可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器12可以包括高速随机存取存储器,还可以包括非易失性存储器,例如硬盘、内存、插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)、至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
所述存储器12可以是电子设备1的外部存储器和/或内部存储器。进一步地,所述存储器12可以是集成电路中没有实物形式的具有存储功能的电路,如RAM(Random-Access Memory,随机存取存储器)、FIFO(First In First Out,)等。或者,所述存储器12也可以是具有实物形式的存储器,如内存条、TF卡(Trans-flash Card)等等。
所述电子设备1集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个非易失性可读取存储介质中。基于这样的理解,本发明实现上述实施例方法中的全部或部分流程,也可以通过计算机可读指令来指令相关的硬件来完成,所述的计算机可读指令可存储于一非易失性可读存储介质中,该计算机可读指令在被处理器执行时,可实现上述各个方法实施例的步骤。
其中,所述计算机可读指令包括计算机可读指令代码,所述计算机可读指令代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述非易失性可读介质可以包括:能够携带所述计算机可读指令代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、电载波信号、电信信号以及软件分发介质等。需要说明的是,所述非易失性可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减,例如在某些司法管辖区,根据立法和专利实践,非易失性可读介质不包括电载波信号和电信信号。
结合图2,所述电子设备1中的所述存储器12存储多个指令以实现一种数据立方体发布方法,所述处理器13可执行所述多个指令从而实现:从多活 系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;获取所述多活系统中每个运行环境的当前发布任务;从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
根据本发明优选实施例,所述处理器13还执行多个指令包括:
采用数据仓库技术从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据。
根据本发明优选实施例,所述目标源数据的刷新参数包括以下一种或者多种的组合:
所述目标源数据的刷新时间、所述目标源数据的刷新频率、所述目标源数据的应用的刷新模型、对所述目标源数据刷新后生成的数据立方体的名称、所述目标源数据的刷新方式。
根据本发明优选实施例,所述处理器13还执行多个指令包括:
获取当前时间,及从所述目标源数据的刷新参数中获取刷新时间;
当所述当前时间与获取的刷新时间匹配时,从所述目标源数据的刷新参数中获取刷新方式;
根据获取的刷新方式对所述目标源数据进行刷新,生成目标数据立方体。
根据本发明优选实施例,所述处理器13还执行多个指令包括:
当检测到所述目标源数据刷新失败及/或所述目标源数据有数据补录时,提示指定人员对所述目标源数据进行手动刷新。
根据本发明优选实施例,所述处理器13还执行多个指令包括:
当每个当前发布任务是首次发布时,从每个运行环境中配置的两个子目录中任选一个子目录作为每个当前发布任务的当前发布目录;
当每个当前发布任务不是首次发布时,将每个运行环境中配置的两个子目录中上次发布任务时未使用的子目录作为每个当前发布任务的当前发布目录。
根据本发明优选实施例,所述处理器13还执行多个指令包括:
调用封装的指定SDK接口,将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
具体地,所述处理器13对上述指令的具体实现方法可参考图2对应实施例中相关步骤的描述,在此不赘述。
在本发明所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能模块的形式实现。
对于本领域技术人员而言,显然本发明不限于上述示范性实施例的细节,而且在不背离本发明的精神或基本特征的情况下,能够以其他的具体形式实现本发明。
因此,无论从哪一点来看,均应将实施例看作是示范性的,而且是非限制性的,本发明的范围由所附权利要求而不是上述说明限定,因此旨在将落在权利要求的等同要件的含义和范围内的所有变化涵括在本发明内。不应将权利要求中的任何附关联图标记视为限制所涉及的权利要求。
此外,显然“包括”一词不排除其他单元或步骤,单数不排除复数。系统权利要求中陈述的多个单元或装置也可以由一个单元或装置通过软件或者硬件来实现。第二等词语用来表示名称,而并不表示任何特定的顺序。
最后应说明的是,以上实施例仅用以说明本发明的技术方案而非限制,尽管参照较佳实施例对本发明进行了详细说明,本领域的普通技术人员应当理解,可以对本发明的技术方案进行修改或等同替换,而不脱离本发明技术方案的精神和范围。

Claims (20)

  1. 一种数据立方体发布方法,其特征在于,所述方法包括:
    从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;
    当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;
    根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;
    获取所述多活系统中每个运行环境的当前发布任务;
    从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;
    将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;
    在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
  2. 如权利要求1所述的数据立方体发布方法,其特征在于,所述从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据包括:
    采用数据仓库技术从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据。
  3. 如权利要求1所述的数据立方体发布方法,其特征在于,所述目标源数据的刷新参数包括以下一种或者多种的组合:
    所述目标源数据的刷新时间、所述目标源数据的刷新频率、所述目标源数据的应用的刷新模型、对所述目标源数据刷新后生成的数据立方体的名称、所述目标源数据的刷新方式。
  4. 如权利要求1所述的数据立方体发布方法,其特征在于,所述根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体包括:
    获取当前时间,及从所述目标源数据的刷新参数中获取刷新时间;
    当所述当前时间与获取的刷新时间匹配时,从所述目标源数据的刷新参数中获取刷新方式;
    根据获取的刷新方式对所述目标源数据进行刷新,生成目标数据立方体。
  5. 如权利要求1所述的数据立方体发布方法,其特征在于,在根据所述目标源数据的刷新参数对所述目标源数据进行刷新时,所述方法还包括:
    当检测到所述目标源数据刷新失败及/或所述目标源数据有数据补录时, 提示指定人员对所述目标源数据进行手动刷新。
  6. 如权利要求1所述的数据立方体发布方法,其特征在于,所述从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录包括:
    当每个当前发布任务是首次发布时,从每个运行环境中配置的两个子目录中任选一个子目录作为每个当前发布任务的当前发布目录;
    当每个当前发布任务不是首次发布时,将每个运行环境中配置的两个子目录中上次发布任务时未使用的子目录作为每个当前发布任务的当前发布目录。
  7. 如权利要求1所述的数据立方体发布方法,其特征在于,所述将所述目标数据立方体的报表的数据源配置为所述当前发布目录包括:
    调用封装的指定SDK接口,将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
  8. 一种数据立方体发布装置,其特征在于,所述装置包括:
    获取单元,用于从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;
    所述获取单元,还用于当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;
    刷新单元,用于根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;
    所述获取单元,还用于获取所述多活系统中每个运行环境的当前发布任务;
    所述获取单元,还用于从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;
    发布单元,用于将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;
    配置单元,用于在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
  9. 一种电子设备,其特征在于,所述电子设备包括存储器及处理器,所述存储器用于存储至少一个计算机可读指令,所述处理器用于执行所述至少一个计算机可读指令以实现以下步骤:
    从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;
    当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;
    根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;
    获取所述多活系统中每个运行环境的当前发布任务;
    从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;
    将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;
    在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
  10. 如权利要求9所述的电子设备,其特征在于,所述从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据包括:
    采用数据仓库技术从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据。
  11. 如权利要求9所述的电子设备,其特征在于,所述目标源数据的刷新参数包括以下一种或者多种的组合:
    所述目标源数据的刷新时间、所述目标源数据的刷新频率、所述目标源数据的应用的刷新模型、对所述目标源数据刷新后生成的数据立方体的名称、所述目标源数据的刷新方式。
  12. 如权利要求9所述的电子设备,其特征在于,所述根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体包括:
    获取当前时间,及从所述目标源数据的刷新参数中获取刷新时间;
    当所述当前时间与获取的刷新时间匹配时,从所述目标源数据的刷新参数中获取刷新方式;
    根据获取的刷新方式对所述目标源数据进行刷新,生成目标数据立方体。
  13. 如权利要求9所述的电子设备,其特征在于,在根据所述目标源数据的刷新参数对所述目标源数据进行刷新时,所述方法还包括:
    当检测到所述目标源数据刷新失败及/或所述目标源数据有数据补录时,提示指定人员对所述目标源数据进行手动刷新。
  14. 如权利要求9所述的电子设备,其特征在于,所述从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录包括:
    当每个当前发布任务是首次发布时,从每个运行环境中配置的两个子目录中任选一个子目录作为每个当前发布任务的当前发布目录;
    当每个当前发布任务不是首次发布时,将每个运行环境中配置的两个子目录中上次发布任务时未使用的子目录作为每个当前发布任务的当前发布目录。
  15. 一种非易失性可读存储介质,其特征在于,其特征在于,所述非易失性可读存储介质存储有至少一个计算机可读指令,所述至少一个计算机可读指令被处理器执行时实现以下步骤:
    从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据;
    当确定所述目标源数据获取完成时,获取所述目标源数据的刷新参数;
    根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体;
    获取所述多活系统中每个运行环境的当前发布任务;
    从每个运行环境中配置的两个子目录中获取每个当前发布任务的当前发布目录;
    将所述目标数据立方体发布至获取的每个运行环境的所述当前发布目录中;
    在完成每个当前发布任务后,将每个运行环境中下一个发布任务的发布目录配置为每个运行环境中除所述当前发布目录之外的另一个子目录,并将所述目标数据立方体的报表的数据源配置为所述当前发布目录。
  16. 如权利要求15所述的存储介质,其特征在于,所述从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据包括:
    采用数据仓库技术从多活系统中任意选取一个运行环境,并从选取的运行环境中获取目标源数据。
  17. 如权利要求15所述的存储介质,其特征在于,所述目标源数据的刷新参数包括以下一种或者多种的组合:
    所述目标源数据的刷新时间、所述目标源数据的刷新频率、所述目标源数据的应用的刷新模型、对所述目标源数据刷新后生成的数据立方体的名称、所述目标源数据的刷新方式。
  18. 如权利要求15所述的存储介质,其特征在于,所述根据所述目标源数据的刷新参数对所述目标源数据进行刷新,生成目标数据立方体包括:
    获取当前时间,及从所述目标源数据的刷新参数中获取刷新时间;
    当所述当前时间与获取的刷新时间匹配时,从所述目标源数据的刷新参数中获取刷新方式;
    根据获取的刷新方式对所述目标源数据进行刷新,生成目标数据立方体。
  19. 如权利要求15所述的存储介质,其特征在于,在根据所述目标源数据的刷新参数对所述目标源数据进行刷新时,所述方法还包括:
    当检测到所述目标源数据刷新失败及/或所述目标源数据有数据补录时,提示指定人员对所述目标源数据进行手动刷新。
  20. 如权利要求15所述的存储介质,其特征在于,所述从每个运行环境 中配置的两个子目录中获取每个当前发布任务的当前发布目录包括:
    当每个当前发布任务是首次发布时,从每个运行环境中配置的两个子目录中任选一个子目录作为每个当前发布任务的当前发布目录;
    当每个当前发布任务不是首次发布时,将每个运行环境中配置的两个子目录中上次发布任务时未使用的子目录作为每个当前发布任务的当前发布目录。
PCT/CN2018/099156 2018-04-10 2018-08-07 数据立方体发布方法、装置、电子设备和存储介质 WO2019196272A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810316070.6 2018-04-10
CN201810316070.6A CN108595552B (zh) 2018-04-10 2018-04-10 数据立方体发布方法、装置、电子设备和存储介质

Publications (1)

Publication Number Publication Date
WO2019196272A1 true WO2019196272A1 (zh) 2019-10-17

Family

ID=63621591

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/099156 WO2019196272A1 (zh) 2018-04-10 2018-08-07 数据立方体发布方法、装置、电子设备和存储介质

Country Status (2)

Country Link
CN (1) CN108595552B (zh)
WO (1) WO2019196272A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112527785A (zh) * 2020-12-16 2021-03-19 平安银行股份有限公司 数据补录方法、装置、电子设备及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106021486A (zh) * 2016-05-18 2016-10-12 广东源恒软件科技有限公司 一种基于大数据的数据多维分析处理方法
CN106897303A (zh) * 2015-12-18 2017-06-27 北京国双科技有限公司 数据查询方法及装置
US9824133B1 (en) * 2014-06-20 2017-11-21 Amazon Technologies, Inc. Cloud analytics marketplace

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6707454B1 (en) * 1999-07-01 2004-03-16 Lucent Technologies Inc. Systems and methods for visualizing multi-dimensional data in spreadsheets and other data structures
US7610300B2 (en) * 2004-11-30 2009-10-27 International Business Machines Corporation Automated relational schema generation within a multidimensional enterprise software system
CN103065256A (zh) * 2004-12-23 2013-04-24 华为技术有限公司 一种广告业务信息发布系统及其发布方法
US8887224B2 (en) * 2005-03-09 2014-11-11 Vudu, Inc. Updating content libraries by transmitting release data
CN100487700C (zh) * 2006-07-11 2009-05-13 阿里巴巴集团控股有限公司 数据仓库中的数据处理方法及系统
US8078749B2 (en) * 2008-01-30 2011-12-13 Microsoft Corporation Synchronization of multidimensional data in a multimaster synchronization environment with prediction
US8121975B2 (en) * 2008-02-20 2012-02-21 Panorama Software Inc. Creating pivot tables from tabular data
CN101452485A (zh) * 2008-12-31 2009-06-10 中国建设银行股份有限公司 一种基于关系数据库生成多维立方体的方法及装置
CN101853283B (zh) * 2010-05-21 2012-01-04 南京邮电大学 面向多维数据的语义索引对等网络的构建方法
US8683480B2 (en) * 2011-06-01 2014-03-25 International Business Machines Corporation Resource allocation for a plurality of resources for a dual activity system
CN102752394B (zh) * 2012-07-13 2015-10-21 携程计算机技术(上海)有限公司 面向集群站点的发布控制方法和系统
CN103902259A (zh) * 2012-12-25 2014-07-02 富泰华工业(深圳)有限公司 网站发布系统及方法
JP2015060280A (ja) * 2013-09-17 2015-03-30 株式会社日立システムズ データ提供システムおよびデータ提供方法
CN104572746B (zh) * 2013-10-24 2018-03-20 世纪禾光科技发展(北京)有限公司 一种矩阵式信息发布及访问方法和系统
AU2015327722A1 (en) * 2014-09-29 2017-04-20 Royal Bank Of Canada Secure processing of data
US10055888B2 (en) * 2015-04-28 2018-08-21 Microsoft Technology Licensing, Llc Producing and consuming metadata within multi-dimensional data
US10528540B2 (en) * 2015-05-11 2020-01-07 AtScale, Inc. Dynamic aggregate generation and updating for high performance querying of large datasets
US10319044B2 (en) * 2015-10-24 2019-06-11 Oracle International Corporation Transaction functionality in a multidimensional database
CN107767242A (zh) * 2016-08-15 2018-03-06 平安科技(深圳)有限公司 账务数据处理方法及账务数据处理装置
CN108713205B (zh) * 2016-08-22 2022-11-11 甲骨文国际公司 用于自动映射与数据流环境一起使用的数据类型的系统和方法
CN106506588A (zh) * 2016-09-23 2017-03-15 北京许继电气有限公司 多地多中心的数据中心双活方法和系统
CN107301206A (zh) * 2017-06-01 2017-10-27 华南理工大学 一种基于预运算的分布式olap分析方法及系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9824133B1 (en) * 2014-06-20 2017-11-21 Amazon Technologies, Inc. Cloud analytics marketplace
CN106897303A (zh) * 2015-12-18 2017-06-27 北京国双科技有限公司 数据查询方法及装置
CN106021486A (zh) * 2016-05-18 2016-10-12 广东源恒软件科技有限公司 一种基于大数据的数据多维分析处理方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112527785A (zh) * 2020-12-16 2021-03-19 平安银行股份有限公司 数据补录方法、装置、电子设备及存储介质
CN112527785B (zh) * 2020-12-16 2023-07-21 平安银行股份有限公司 数据补录方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN108595552B (zh) 2022-09-27
CN108595552A (zh) 2018-09-28

Similar Documents

Publication Publication Date Title
JP6865219B2 (ja) 連続クエリ処理におけるイベントバッチ処理、出力シーケンス化、およびログベースの状態記憶
JP6887544B2 (ja) イベント処理のための動的に型付けされたビッグデータによるイベントの充実化
JP7316341B2 (ja) ストリームデータにおける空間変化検出器
US10255108B2 (en) Parallel execution of blockchain transactions
CN109997126B (zh) 事件驱动提取、变换、加载(etl)处理
US11412343B2 (en) Geo-hashing for proximity computation in a stream of a distributed system
US10291704B2 (en) Networked solutions integration using a cloud business object broker
JP2022058578A (ja) 分散イベント処理システムにおけるデータシリアライズ
JP6521973B2 (ja) 多重入力データストリームにわたるパターンマッチング
WO2019178979A1 (zh) 报表数据查询方法、装置、存储介质和服务器
TW202002587A (zh) 基於區塊鏈的資料處理方法和裝置
EP3032442B1 (en) Modeling and simulation of infrastructure architecture for big data
US20160274874A1 (en) Method and apparatus for processing request
US10545941B1 (en) Hash based data processing
Kreps I heart logs: Event data, stream processing, and data integration
US20120330991A1 (en) Context- And Version-Aware Facade For Database Queries
US20210103592A1 (en) Heartbeat propagation in a distributed stream processing system
CN112632035A (zh) 面向自主可控数据库迁移方法及存储介质
JP2022058669A (ja) 自動時間進行についての処理タイムスタンプおよびハートビートイベント
US10691653B1 (en) Intelligent data backfill and migration operations utilizing event processing architecture
US10565202B2 (en) Data write/import performance in a database through distributed memory
WO2019196272A1 (zh) 数据立方体发布方法、装置、电子设备和存储介质
EP3420471A1 (en) Query response using mapping to parameterized report
JP2011113103A (ja) マルチテナント型コンピュータシステム
WO2019196276A1 (zh) 报表同步方法、电子设备及存储介质

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 01/02/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18914244

Country of ref document: EP

Kind code of ref document: A1