SG11201704732PA - Vector processing for segmentation hash values calculation - Google Patents

Vector processing for segmentation hash values calculation

Info

Publication number
SG11201704732PA
SG11201704732PA SG11201704732PA SG11201704732PA SG11201704732PA SG 11201704732P A SG11201704732P A SG 11201704732PA SG 11201704732P A SG11201704732P A SG 11201704732PA SG 11201704732P A SG11201704732P A SG 11201704732PA SG 11201704732P A SG11201704732P A SG 11201704732PA
Authority
SG
Singapore
Prior art keywords
hash values
vector processing
values calculation
segmentation hash
segmentation
Prior art date
Application number
SG11201704732PA
Inventor
Yehonatan David
Yair Toaff
Michael Hirsch
Original Assignee
Huawei Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Tech Co Ltd filed Critical Huawei Tech Co Ltd
Publication of SG11201704732PA publication Critical patent/SG11201704732PA/en

Links

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6017—Methods or arrangements to increase the throughput
    • H03M7/6023—Parallelization
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/334—Query execution
    • G06F16/3347—Query execution using vector based model
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24568—Data stream processing; Continuous queries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/30003—Arrangements for executing specific machine instructions
    • G06F9/30007—Arrangements for executing specific machine instructions to perform operations on data operands
    • G06F9/30036—Instructions to perform operations on packed data, e.g. vector, tile or matrix operations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38—Concurrent instruction execution, e.g. pipeline or look ahead
    • G06F9/3867—Concurrent instruction execution, e.g. pipeline or look ahead using instruction pipelines
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3084—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method
    • H03M7/3091—Data deduplication
    • H03M7/3095—Data deduplication using variable length segments

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Computer Security & Cryptography (AREA)
  • Mathematical Physics (AREA)
  • Image Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Multi Processors (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
SG11201704732PA 2016-04-19 2016-04-19 Vector processing for segmentation hash values calculation SG11201704732PA (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2016/058673 WO2017182063A1 (en) 2016-04-19 2016-04-19 Vector processing for segmentation hash values calculation

Publications (1)

Publication Number Publication Date
SG11201704732PA true SG11201704732PA (en) 2017-11-29

Family

ID=55809098

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201704732PA SG11201704732PA (en) 2016-04-19 2016-04-19 Vector processing for segmentation hash values calculation

Country Status (6)

Country Link
US (1) US10459961B2 (en)
EP (2) EP3726732A1 (en)
JP (1) JP6420489B2 (en)
CN (1) CN107534445B (en)
SG (1) SG11201704732PA (en)
WO (1) WO2017182063A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD927802S1 (en) * 2019-11-25 2021-08-10 Fna Group, Inc. Pressure washer
CN111090397B (en) * 2019-12-12 2021-10-22 苏州浪潮智能科技有限公司 Data deduplication method, system, equipment and computer readable storage medium
CN117555903B (en) * 2024-01-05 2024-04-09 珠海星云智联科技有限公司 Data processing method, computer equipment and medium

Family Cites Families (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996025801A1 (en) 1995-02-17 1996-08-22 Trustus Pty. Ltd. Method for partitioning a block of data into subblocks and for storing and communicating such subblocks
US6704730B2 (en) 2000-02-18 2004-03-09 Avamar Technologies, Inc. Hash file system and method for use in a commonality factoring system
AU2003207856A1 (en) 2002-02-04 2003-09-02 Cataphora, Inc A method and apparatus to visually present discussions for data mining purposes
US8504791B2 (en) 2007-01-26 2013-08-06 Hicamp Systems, Inc. Hierarchical immutable content-addressable memory coprocessor
US8407428B2 (en) 2010-05-20 2013-03-26 Hicamp Systems, Inc. Structured memory coprocessor
US20100125569A1 (en) 2008-11-18 2010-05-20 Yahoo! Inc. System and method for autohyperlinking and navigation in url based context queries
US9805123B2 (en) 2008-11-18 2017-10-31 Excalibur Ip, Llc System and method for data privacy in URL based context queries
US8060492B2 (en) 2008-11-18 2011-11-15 Yahoo! Inc. System and method for generation of URL based context queries
US8032508B2 (en) 2008-11-18 2011-10-04 Yahoo! Inc. System and method for URL based query for retrieving data related to a context
US8024317B2 (en) 2008-11-18 2011-09-20 Yahoo! Inc. System and method for deriving income from URL based context queries
US8601222B2 (en) 2010-05-13 2013-12-03 Fusion-Io, Inc. Apparatus, system, and method for conditional and atomic storage operations
US9747105B2 (en) * 2009-12-17 2017-08-29 Intel Corporation Method and apparatus for performing a shift and exclusive or operation in a single instruction
CN103098015B (en) 2010-09-30 2015-11-25 日本电气株式会社 Storage system
US8904126B2 (en) 2010-11-16 2014-12-02 Actifio, Inc. System and method for performing a plurality of prescribed data management functions in a manner that reduces redundant access operations to primary storage
US8396905B2 (en) 2010-11-16 2013-03-12 Actifio, Inc. System and method for improved garbage collection operations in a deduplicated store by tracking temporal relationships among copies
US8299944B2 (en) 2010-11-16 2012-10-30 Actifio, Inc. System and method for creating deduplicated copies of data storing non-lossy encodings of data directly in a content addressable store
US8402004B2 (en) 2010-11-16 2013-03-19 Actifio, Inc. System and method for creating deduplicated copies of data by tracking temporal relationships among copies and by ingesting difference data
US9858155B2 (en) 2010-11-16 2018-01-02 Actifio, Inc. System and method for managing data with service level agreements that may specify non-uniform copying of data
US8843489B2 (en) 2010-11-16 2014-09-23 Actifio, Inc. System and method for managing deduplicated copies of data using temporal relationships among copies
US8788769B2 (en) 2010-11-16 2014-07-22 Actifio, Inc. System and method for performing backup or restore operations utilizing difference information and timeline state information
US8417674B2 (en) 2010-11-16 2013-04-09 Actifio, Inc. System and method for creating deduplicated copies of data by sending difference data between near-neighbor temporal states
US8332372B2 (en) * 2010-12-16 2012-12-11 International Business Machines Corporation Method and system for processing data
US8966191B2 (en) 2011-03-18 2015-02-24 Fusion-Io, Inc. Logical interface for contextual storage
US9563555B2 (en) 2011-03-18 2017-02-07 Sandisk Technologies Llc Systems and methods for storage allocation
US8935506B1 (en) 2011-03-31 2015-01-13 The Research Foundation For The State University Of New York MemX: virtualization of cluster-wide memory
US9157876B2 (en) 2011-07-25 2015-10-13 Electro Scientific Industries, Inc. Method and apparatus for characterizing objects and monitoring manufacturing processes
US8874863B2 (en) 2011-08-01 2014-10-28 Actifio, Inc. Data replication system
US8849759B2 (en) 2012-01-13 2014-09-30 Nexenta Systems, Inc. Unified local storage supporting file and cloud object access
JP5500309B2 (en) 2011-09-07 2014-05-21 日本電気株式会社 Storage device
US20130087297A1 (en) 2011-10-10 2013-04-11 Lori Wolin VertiQuiet
JP5838927B2 (en) 2011-10-14 2016-01-06 Tdk株式会社 Multilayer ceramic electronic components
WO2013086040A2 (en) 2011-12-05 2013-06-13 Doyenz Incorporated Universal pluggable cloud disaster recovery system
USD680519S1 (en) 2012-03-14 2013-04-23 Yamaha Corporation Digital mixer
US9075710B2 (en) 2012-04-17 2015-07-07 SanDisk Technologies, Inc. Non-volatile key-value store
US20130311433A1 (en) 2012-05-17 2013-11-21 Akamai Technologies, Inc. Stream-based data deduplication in a multi-tenant shared infrastructure using asynchronous data dictionaries
WO2013192198A2 (en) 2012-06-18 2013-12-27 Actifio, Inc. Enhanced data management virtualization system
USD676167S1 (en) 2012-07-13 2013-02-12 Litek Enterprise Co., Ltd. Exterior surface configuration of vehicular headlight
US9548908B2 (en) 2012-08-21 2017-01-17 Cisco Technology, Inc. Flow de-duplication for network monitoring
WO2014081727A1 (en) * 2012-11-20 2014-05-30 Denninghoff Karl L Search and navigation to specific document content
US9678975B2 (en) 2013-03-15 2017-06-13 International Business Machines Corporation Reducing digest storage consumption in a data deduplication system
JP2016524220A (en) 2013-05-14 2016-08-12 アクテフィオ，インク． Efficient data replication and garbage collection prediction
CN103281538B (en) * 2013-06-06 2016-01-13 上海交通大学 Based on the inner frame coding method of rolling Hash and block rank infra-frame prediction
US9286314B2 (en) * 2013-07-15 2016-03-15 International Business Machines Corporation Applying a maximum size bound on content defined segmentation of data
US9244830B2 (en) * 2013-07-15 2016-01-26 Globalfoundries Inc. Hierarchical content defined segmentation of data
USD737528S1 (en) 2013-09-18 2015-08-25 Alfred Kaercher Gmbh & Co. Kg High pressure cleaner
US9665437B2 (en) 2013-11-18 2017-05-30 Actifio, Inc. Test-and-development workflow automation
US20150161194A1 (en) 2013-12-06 2015-06-11 Actifio, Inc. System and method for rapid estimation of data similarity
US20150228004A1 (en) 2014-02-07 2015-08-13 Kristin Kaye Bednarek Smart Device Apps and Incentives For Encouraging The Creation and Sharing Electronic Lists To Imrpove Targeted Marketing While Preserving User Anonymity
US20150227890A1 (en) 2014-02-07 2015-08-13 Kristin Kaye Bednarek Communications system and smart device apps supporting segmented order distributed distribution system
US20150227601A1 (en) 2014-02-13 2015-08-13 Actifio, Inc. Virtual data backup
US10133572B2 (en) * 2014-05-02 2018-11-20 Qualcomm Incorporated Techniques for serialized execution in a SIMD processing system
WO2015170333A2 (en) 2014-05-07 2015-11-12 Sankhya Technologies Private Limited Manifold system and synthesis of a manifold system from input models
USD756678S1 (en) 2014-05-19 2016-05-24 Ascion, Llc Adjustable bed
US9772916B2 (en) 2014-06-17 2017-09-26 Actifio, Inc. Resiliency director
US10803019B2 (en) * 2014-07-02 2020-10-13 International Business Machines Corporation Hash-based multi-tenancy in a deduplication system
US20160070714A1 (en) 2014-09-10 2016-03-10 Netapp, Inc. Low-overhead restartable merge operation with efficient crash recovery
US10248510B2 (en) 2014-09-16 2019-04-02 Actifio, Inc. Guardrails for copy data storage
US10127301B2 (en) 2014-09-26 2018-11-13 Oracle International Corporation Method and system for implementing efficient classification and exploration of data
US20160132523A1 (en) 2014-11-12 2016-05-12 Strato Scale Ltd. Exploiting node-local deduplication in distributed storage system
US10558690B2 (en) * 2015-07-06 2020-02-11 International Business Machines Corporation Multiple sub-string searching

Also Published As

Publication number Publication date
EP3726732A1 (en) 2020-10-21
CN107534445A (en) 2018-01-02
US10459961B2 (en) 2019-10-29
EP3251216A1 (en) 2017-12-06
US20170344559A1 (en) 2017-11-30
CN107534445B (en) 2020-03-10
JP6420489B2 (en) 2018-11-07
JP2018517947A (en) 2018-07-05
WO2017182063A1 (en) 2017-10-26

Similar Documents

Publication Publication Date Title
GB2560400B (en) Vector processing unit
SG10201702290WA (en) Plasma Processing Method
SG10201600648YA (en) Wafer processing system
GB2534580B (en) Image processing
GB201616402D0 (en) Image processing
GB201610967D0 (en) Vector
GB201616536D0 (en) Image processing
GB2546073B (en) Graphics processing
PT3432912T (en) High-transducing hsv vectors
GB201714811D0 (en) Image processing algorithm
SG11201704733VA (en) Concurrent segmentation using vector processing
GB2554669B (en) Image processing
GB2547242B (en) Graphics processing
SG10201702291PA (en) Plasma Processing Method
SG10201700763VA (en) Processing apparatus
GB2558234B (en) Image processing
GB201505434D0 (en) Cryptographic processing
SG10201704247PA (en) Wafer processing system
SG11201704732PA (en) Vector processing for segmentation hash values calculation
PL3523231T3 (en) Processing apparatus
SG10201702287RA (en) Plasma Processing Method
GB2558283B (en) Image processing
GB201513449D0 (en) Image processing
IL261309B (en) Processing vector instructions
GB201710049D0 (en) Image processing