SG11201809623YA - Hive table scanning method, device, computer apparatus and storage medium - Google Patents

Hive table scanning method, device, computer apparatus and storage medium

Info

Publication number
SG11201809623YA
SG11201809623YA SG11201809623YA SG11201809623YA SG11201809623YA SG 11201809623Y A SG11201809623Y A SG 11201809623YA SG 11201809623Y A SG11201809623Y A SG 11201809623YA SG 11201809623Y A SG11201809623Y A SG 11201809623YA SG 11201809623Y A SG11201809623Y A SG 11201809623YA
Authority
SG
Singapore
Prior art keywords
update cycle
hive table
storage medium
computer apparatus
scanning method
Prior art date
Application number
SG11201809623YA
Inventor
Haitao Chen
Cun Yan
Original Assignee
Ping An Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Technology Shenzhen Co Ltd filed Critical Ping An Technology Shenzhen Co Ltd
Publication of SG11201809623YA publication Critical patent/SG11201809623YA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2308—Concurrency control
    • G06F16/2315—Optimistic concurrency control
    • G06F16/2322—Optimistic concurrency control using timestamps
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application

Abstract

The present application discloses a Hive table scanning method, device, computer apparatus and storage medium, wherein the method includes: acquiring an update cycle of a Hive table; determining an update cycle level corresponding to the update cycle; determining a target scanning rule corresponding to the update cycle according to a preset correspondence table between the update cycle level and a preset scanning rule; and performing scan statistics to the Hive table according to the target scanning rule.
SG11201809623YA 2018-01-12 2018-02-24 Hive table scanning method, device, computer apparatus and storage medium SG11201809623YA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810030843.4A CN108108490B (en) 2018-01-12 2018-01-12 Hive table scan method, apparatus, computer equipment and storage medium
PCT/CN2018/077125 WO2019136797A1 (en) 2018-01-12 2018-02-24 Hive table scanning method and device, computer apparatus, and storage medium

Publications (1)

Publication Number Publication Date
SG11201809623YA true SG11201809623YA (en) 2019-08-27

Family

ID=62218547

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201809623YA SG11201809623YA (en) 2018-01-12 2018-02-24 Hive table scanning method, device, computer apparatus and storage medium

Country Status (4)

Country Link
US (1) US11048680B2 (en)
CN (1) CN108108490B (en)
SG (1) SG11201809623YA (en)
WO (1) WO2019136797A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11314741B2 (en) * 2017-08-01 2022-04-26 Salesforce.Com, Inc. Metadata-based statistics-oriented processing of queries in an on-demand environment
CN110489478A (en) * 2019-08-27 2019-11-22 恩亿科(北京)数据科技有限公司 A kind of method and device of data scanning
CN111078691B (en) * 2019-11-22 2024-04-16 湖南水羊科技有限公司 Processing method and related device for managing report data
CN111984659B (en) * 2020-07-28 2023-07-21 招联消费金融有限公司 Data updating method, device, computer equipment and storage medium

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013096887A1 (en) * 2011-12-23 2013-06-27 Amiato, Inc. Scalable analysis platform for semi-structured data
US9569491B2 (en) * 2013-09-13 2017-02-14 Nec Corporation MISO (multistore-online-tuning) system
JP2015095067A (en) * 2013-11-12 2015-05-18 株式会社東芝 Data transmission device, data transmission method, and program
CN105677650B (en) * 2014-11-18 2019-06-25 中国移动通信集团公司 A kind of data cached storage method and device
US9659047B2 (en) * 2014-12-03 2017-05-23 Netapp, Inc. Data deduplication utilizing extent ID database
CN104731900A (en) * 2015-03-19 2015-06-24 浪潮集团有限公司 Hive scheduling method and device
CN105550293B (en) * 2015-12-11 2018-01-16 深圳市华讯方舟软件技术有限公司 A kind of backstage method for refreshing based on Spark SQL big data processing platforms
CN105808653B (en) * 2016-02-26 2019-08-09 广州品唯软件有限公司 A kind of data processing method and device based on user tag system
US20160364655A1 (en) * 2016-04-07 2016-12-15 Shahzad Muhammad System to generate Logical Design for MPP Clusters using self-learning model
GB201615745D0 (en) * 2016-09-15 2016-11-02 Gb Gas Holdings Ltd System for analysing data relationships to support query execution
CN107273433A (en) * 2017-05-22 2017-10-20 努比亚技术有限公司 A kind of file scanning method, equipment and computer-readable recording medium

Also Published As

Publication number Publication date
CN108108490A (en) 2018-06-01
WO2019136797A1 (en) 2019-07-18
CN108108490B (en) 2019-08-27
US11048680B2 (en) 2021-06-29
US20190332591A1 (en) 2019-10-31

Similar Documents

Publication Publication Date Title
SG11201809623YA (en) Hive table scanning method, device, computer apparatus and storage medium
ES2965954T3 (en) Echo cancellation method and apparatus based on time delay estimation
PH12019502321A1 (en) Picture-based vehicle loss assessment method and apparatus, and electronic device
SG11201906123VA (en) Method for random access and terminal device
PH12020550738A1 (en) Blockchain-based transaction processing method and apparatus, and electronic device
PH12019500977A1 (en) Image-based vehicle damage determining method, apparatus, and electronic device
MX2016005636A (en) Picture processing method and apparatus.
MY187576A (en) Image processing method and apparatus
SG11201904533UA (en) Method, apparatus and system for detecting abnormal behavior of user
MX357644B (en) Method and device for color adjustment.
MX356575B (en) Localization of a wireless user equipmentdevice in a target zone.
MY192152A (en) Method and device for providing wireless access point
MX350670B (en) Method and device for recognizing user behavior.
MX2015009735A (en) Automatic cleaning device quiet operation method and device, and electronic apparatus.
PH12019501593A1 (en) Method and device for random access
MX2016012387A (en) Three-dimensional measurement system for marked line for adhering sole to upper and three-dimensional measurement method therefor.
MX2016002624A (en) Information pushing method, apparatus, device and system.
MX2022001384A (en) Data processing method, apparatus, device, and storage medium.
MY190612A (en) Plant monitoring apparatus
EP3889915A3 (en) Method and apparatus for generating virtual avatar, device, medium and computer program product
MX2015005034A (en) Gated upgrade method and apparatus.
MX2017005398A (en) Iris image acquisition method and apparatus, and iris recognition device.
BR112015031939A2 (en) device, system and method for processing information and program for the same
BR112017004483A2 (en) method for checking a geometry of an electrode
SG11201811808VA (en) Database data modification request processing method and apparatus