WO2022179123A1 - Procédé et appareil de mise à jour et de présentation de données, dispositif électronique et support de stockage - Google Patents
Procédé et appareil de mise à jour et de présentation de données, dispositif électronique et support de stockage Download PDFInfo
- Publication number
- WO2022179123A1 WO2022179123A1 PCT/CN2021/123894 CN2021123894W WO2022179123A1 WO 2022179123 A1 WO2022179123 A1 WO 2022179123A1 CN 2021123894 W CN2021123894 W CN 2021123894W WO 2022179123 A1 WO2022179123 A1 WO 2022179123A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- update
- original
- preset
- data set
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000005457 optimization Methods 0.000 claims abstract description 27
- 238000013507 mapping Methods 0.000 claims abstract description 18
- 238000012545 processing Methods 0.000 claims description 43
- 230000002159 abnormal effect Effects 0.000 claims description 35
- 238000010586 diagram Methods 0.000 claims description 23
- 230000008676 import Effects 0.000 claims description 22
- 238000003379 elimination reaction Methods 0.000 claims description 14
- 239000000284 extract Substances 0.000 claims description 14
- 230000008030 elimination Effects 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 7
- 238000005516 engineering process Methods 0.000 abstract description 5
- 230000006870 function Effects 0.000 description 14
- 238000004422 calculation algorithm Methods 0.000 description 13
- 238000012360 testing method Methods 0.000 description 13
- 238000007726 management method Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000002146 bilateral effect Effects 0.000 description 4
- 230000003068 static effect Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000000717 retained effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2308—Concurrency control
- G06F16/2315—Optimistic concurrency control
- G06F16/2322—Optimistic concurrency control using timestamps
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
Definitions
- the embodiments of the present application provide a data update and display method.
- the execution subject of the data update and display method includes, but is not limited to, at least one of the electronic devices that can be configured to execute the method provided by the embodiments of the present application, such as a server and a terminal.
- the data update and display method can be executed by software or hardware installed in a terminal device or a server device, and the software can be a blockchain platform.
- the server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, and the like.
- performing deduplication processing on the data in the target table to obtain deduplication data including:
- the data import module 101 obtains the original data set through the following operations, imports the original data set into a preset database, and maps the original data set to the original table:
- the source database may be a database such as MySQL, oracle, etc.
- a database eg, a SqlServer database
- the preset database may be a hive database, and the hive database may directly map the original data set to an original table.
- the preset open source tool can use the currently disclosed Sqoop tool.
- a preset time interval may be set, the time stamp is automatically updated by using the time interval, and the source database is continuously extracted by using the preset open source tool by automatically updating the time stamp.
- the data in the hive database is mapped to the original table.
- the data import module 101 extracts the data in the source database to the preset database by using a preset open source tool through the following operations, and maps the data to the original table:
- the updated data is imported into the target table through the association relationship.
- G is the outlier, is the average value of the deduplicated data
- S is the standard deviation of the deduplicated data
- Y min is the smallest data in the deduplicated data.
- the data optimization module 104 obtains a standard data set through the following operations:
- L(x i ) is the filling value
- xi is the i-th missing value position in the de-abnormal data
- ⁇ is a preset probability parameter
- n is the number of missing value positions
- ⁇ ) is the conditional probability of the position of the ith missing value.
- the electronic device 1 may further include a user interface, and the user interface may be a display (Display), an input unit (eg, a keyboard (Keyboard)), optionally, the user interface may also be a standard wired interface or a wireless interface.
- the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, and the like.
- the display may also be appropriately called a display screen or a display unit, which is used for displaying information processed in the electronic device 1 and for displaying a visualized user interface.
- the modules/units integrated in the electronic device 1 may be stored in a computer-readable storage medium.
- the computer-readable storage medium may be volatile or non-volatile.
- the computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, removable hard disk, magnetic disk, optical disk, computer memory, Read-Only Memory (ROM, Read-Only Memory) ).
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
L'invention concerne un procédé de mise à jour et de présentation de données consistant à : apparier un ensemble de données d'origine pour former une table d'origine ; obtenir des données de mise à jour en fonction de la table d'origine créée et d'une table cible, puis extraire les données de mise à jour vers une table de mise à jour ; créer une relation d'association en fonction de la table de mise à jour et de la table cible, puis importer les données de mise à jour dans la table cible ; effectuer une optimisation de données sur des données dans la table cible afin d'obtenir un ensemble de données standard ; acquérir et analyser un fichier de configuration prédéfini afin d'obtenir des structures de présentation de données et une norme de division de type de données, puis combiner les structures de présentation de données afin d'obtenir un modèle de présentation de données ; et remplir l'ensemble de données standard dans le modèle de présentation de données afin d'obtenir un graphe de présentation de données. La présente demande se rapporte également à la technologie des chaînes de blocs. Le graphe de présentation de données peut être stocké dans un nœud d'une chaîne de blocs. L'invention concerne également un appareil de mise à jour et de présentation de données, ainsi qu'un dispositif électronique et un support de stockage lisible par ordinateur, qui permettent de résoudre le problème lié à l'efficacité relativement faible de la présentation de données.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110209088.8 | 2021-02-24 | ||
| CN202110209088.8A CN112883042A (zh) | 2021-02-24 | 2021-02-24 | 数据更新及展示方法、装置、电子设备及存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2022179123A1 true WO2022179123A1 (fr) | 2022-09-01 |
Family
ID=76054757
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/123894 WO2022179123A1 (fr) | 2021-02-24 | 2021-10-14 | Procédé et appareil de mise à jour et de présentation de données, dispositif électronique et support de stockage |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112883042A (fr) |
| WO (1) | WO2022179123A1 (fr) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115827620A (zh) * | 2023-01-10 | 2023-03-21 | 住房和城乡建设部信息中心(住房和城乡建设部住房信息管理中心) | 建筑设施汇交数据的质检方法、装置、设备及存储介质 |
| CN117009755A (zh) * | 2023-10-07 | 2023-11-07 | 国仪量子(合肥)技术有限公司 | 波形数据的处理方法、计算机可读存储介质和电子设备 |
| CN117370325A (zh) * | 2023-10-19 | 2024-01-09 | 杭州数亮科技股份有限公司 | 一种基于大数据采集分析的数据中台系统 |
| CN117474392A (zh) * | 2023-10-30 | 2024-01-30 | 北京香田智能科技有限公司 | 一种种植户潜力分析系统 |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112883042A (zh) * | 2021-02-24 | 2021-06-01 | 深圳壹账通智能科技有限公司 | 数据更新及展示方法、装置、电子设备及存储介质 |
| CN113901127B (zh) * | 2021-09-30 | 2022-06-24 | 深圳图为技术有限公司 | 数据管理和展示方法、装置及设备 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110110001A (zh) * | 2019-05-10 | 2019-08-09 | 八戒科技服务有限公司 | 服务成果数据处理方法、装置、存储介质及系统 |
| US20200117659A1 (en) * | 2016-06-22 | 2020-04-16 | Palantir Technologies Inc. | Visual analysis of data using sequenced dataset reduction |
| CN111221897A (zh) * | 2019-11-18 | 2020-06-02 | 上海维谛信息科技有限公司 | 一种可视化视图展示方法及装置 |
| CN112115143A (zh) * | 2020-09-15 | 2020-12-22 | 招商局金融科技有限公司 | 数据自动更新及同步方法、装置、电子设备及存储介质 |
| CN112883042A (zh) * | 2021-02-24 | 2021-06-01 | 深圳壹账通智能科技有限公司 | 数据更新及展示方法、装置、电子设备及存储介质 |
-
2021
- 2021-02-24 CN CN202110209088.8A patent/CN112883042A/zh active Pending
- 2021-10-14 WO PCT/CN2021/123894 patent/WO2022179123A1/fr active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200117659A1 (en) * | 2016-06-22 | 2020-04-16 | Palantir Technologies Inc. | Visual analysis of data using sequenced dataset reduction |
| CN110110001A (zh) * | 2019-05-10 | 2019-08-09 | 八戒科技服务有限公司 | 服务成果数据处理方法、装置、存储介质及系统 |
| CN111221897A (zh) * | 2019-11-18 | 2020-06-02 | 上海维谛信息科技有限公司 | 一种可视化视图展示方法及装置 |
| CN112115143A (zh) * | 2020-09-15 | 2020-12-22 | 招商局金融科技有限公司 | 数据自动更新及同步方法、装置、电子设备及存储介质 |
| CN112883042A (zh) * | 2021-02-24 | 2021-06-01 | 深圳壹账通智能科技有限公司 | 数据更新及展示方法、装置、电子设备及存储介质 |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115827620A (zh) * | 2023-01-10 | 2023-03-21 | 住房和城乡建设部信息中心(住房和城乡建设部住房信息管理中心) | 建筑设施汇交数据的质检方法、装置、设备及存储介质 |
| CN117009755A (zh) * | 2023-10-07 | 2023-11-07 | 国仪量子(合肥)技术有限公司 | 波形数据的处理方法、计算机可读存储介质和电子设备 |
| CN117009755B (zh) * | 2023-10-07 | 2023-12-19 | 国仪量子(合肥)技术有限公司 | 波形数据的处理方法、计算机可读存储介质和电子设备 |
| CN117370325A (zh) * | 2023-10-19 | 2024-01-09 | 杭州数亮科技股份有限公司 | 一种基于大数据采集分析的数据中台系统 |
| CN117370325B (zh) * | 2023-10-19 | 2024-05-28 | 杭州数亮科技股份有限公司 | 一种基于大数据采集分析的数据中台系统 |
| CN117474392A (zh) * | 2023-10-30 | 2024-01-30 | 北京香田智能科技有限公司 | 一种种植户潜力分析系统 |
| CN117474392B (zh) * | 2023-10-30 | 2024-05-03 | 北京香田智能科技有限公司 | 一种种植户潜力分析系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112883042A (zh) | 2021-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022179123A1 (fr) | Procédé et appareil de mise à jour et de présentation de données, dispositif électronique et support de stockage | |
| CN112052242B (zh) | 数据查询方法、装置、电子设备及存储介质 | |
| CN111813963B (zh) | 知识图谱构建方法、装置、电子设备及存储介质 | |
| WO2019127821A1 (fr) | Procédé et appareil de réalisation d'un rapport de visualisation, dispositif terminal et support de stockage | |
| CN111159220B (zh) | 用于输出结构化查询语句的方法和装置 | |
| CN106874247B (zh) | 一种报表生成方法及装置 | |
| WO2022048210A1 (fr) | Procédé et appareil de reconnaissance d'entités nommées, dispositif électronique et support de stockage lisible | |
| CN110750654A (zh) | 知识图谱获取方法、装置、设备和介质 | |
| CN112115143B (zh) | 数据自动更新及同步方法、装置、电子设备及存储介质 | |
| CN112115152B (zh) | 数据增量更新及查询方法、装置、电子设备及存储介质 | |
| US11789940B2 (en) | Natural language interface to databases | |
| WO2022100032A1 (fr) | Procédé et appareil de visualisation d'analyse de système, dispositif électronique et support de stockage lisible par ordinateur | |
| WO2022048362A1 (fr) | Procédé et appareil de stockage de données, dispositif électronique, et support de stockage | |
| US11442930B2 (en) | Method, apparatus, device and storage medium for data aggregation | |
| WO2021254046A1 (fr) | Procédé et dispositif d'interrogation d'informations | |
| CN114610747A (zh) | 数据查询方法、装置、设备及存储介质 | |
| US12111839B1 (en) | Entity matching with machine learning fuzzy logic | |
| CN112579621A (zh) | 数据展示方法、装置、电子设备及计算机存储介质 | |
| CN114925143A (zh) | 逻辑模型血缘关系的描述方法、装置、设备、介质及产品 | |
| US9665618B2 (en) | Information retrieval from a database system | |
| CN112597171B (zh) | 表格关系可视化方法、装置、电子设备及存储介质 | |
| WO2022179122A1 (fr) | Procédé et appareil de stockage de données utilisant des mégadonnées, et dispositif électronique et support de stockage | |
| WO2021208700A1 (fr) | Procédé et appareil de sélection de données vocales, dispositif électronique et support d'enregistrement | |
| CN111339290A (zh) | 一种文本分类方法和系统 | |
| US11810022B2 (en) | Contact center call volume prediction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21927547 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 071223) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 21927547 Country of ref document: EP Kind code of ref document: A1 |