US20150278155A1 - Identifying objects using a 3d scanning device, images, and 3d models - Google Patents
Identifying objects using a 3d scanning device, images, and 3d models Download PDFInfo
- Publication number
- US20150278155A1 US20150278155A1 US14/671,373 US201514671373A US2015278155A1 US 20150278155 A1 US20150278155 A1 US 20150278155A1 US 201514671373 A US201514671373 A US 201514671373A US 2015278155 A1 US2015278155 A1 US 2015278155A1
- Authority
- US
- United States
- Prior art keywords
- model data
- dimensional model
- features
- input
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/15—Correlation function computation including computation of convolution operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/26—Measuring arrangements characterised by the use of optical techniques for measuring angles or tapers; for testing the alignment of axes
-
- G06K9/52—
-
- G06K9/6201—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
- G06V10/993—Evaluation of the quality of the acquired pattern
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30168—Image quality inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/12—Acquisition of 3D measurements of objects
Definitions
- Embodiments may generally relate to conducting similarity searches of three-dimensional models.
- Some embodiments of the present invention may provide one or more benefits or advantages over the prior art.
- Some embodiments may relate to a method for identifying three-dimensional objects, comprising: providing a set of three-dimensional model data of a subject; converting the set of three-dimensional model data to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface; generating searchable parameters from features of the set of continuous simple surfaces; storing the searchable parameters in a database as metadata of the three-dimensional model data; providing a search interface adapted to receive three-dimensional model data as input for a search query, the search interface being adapted to formulate a search query from the input; and matching the search query to one or more records of the database and retrieving said records.
- RANSAC random
- the set of three-dimensional model data comprises a point cloud or a mesh.
- Embodiments may further comprise a step of extracting local geometric features directly from the set of three-dimensional model data of a subject without first converting the three-dimensional model data of a subject to a set of continuous simple surfaces.
- a user or an algorithm selects the features of the three-dimensional model data of a subject from which searchable parameters are generated, wherein the selected features are less than all of the features of the three-dimensional model data.
- the database is organized according to a pattern promoting efficient searching, the pattern being selected from one or more of organization according to feature size, feature type, or feature curvature.
- the database is organized according to a structure selected from one or more of relational, hierarchical, network, object-relational, object oriented, semi-structured, associative, Entity-Attribute-Value, or context model.
- the database contains simplified searchable parameters comprising one or more of a bag-of-words, or dimension reduction by Principal Component Analysis.
- the step of providing a search interface further comprises: converting the input to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface; generating a set of input features from the set of continuous simple surfaces; and formulating a query from the input features.
- RANSAC random sample consensus
- Embodiments may further comprise the step of extracting local geometric features directly from the input without first converting the input to a set of continuous simple surfaces.
- a user or an algorithm selects the features of the input for use in formulating a query, wherein the selected features are less than all of the features of the input.
- Some embodiments may relate to a method for identifying three-dimensional objects, comprising: providing a set of three-dimensional model data of a subject; converting the set of three-dimensional model data to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface; generating searchable parameters from features of the a set of continuous simple surfaces; extracting local geometric features directly from the set of three-dimensional model data of a subject without first converting the three-dimensional model data of a subject to a set of continuous simple surfaces; storing the searchable parameters in a database as metadata of the three-dimensional model data; providing a search interface adapted to receive three-dimensional model data as input for a
- Some embodiments may relate to a method for identifying three-dimensional objects, comprising: providing a set of three-dimensional model data of a subject; converting the set of three-dimensional model data to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface; generating searchable parameters from features of the a set of continuous simple surfaces; extracting local geometric features directly from the set of three-dimensional model data of a subject without first converting the three-dimensional model data of a subject to a set of continuous simple surfaces; storing the searchable parameters in a database as metadata of the three-dimensional model data; providing a search interface adapted to receive three-dimensional model data as input for a
- FIG. 1 is a flow diagram of a process according to an embodiment of the invention
- FIG. 2 is an illustration of acquiring three-dimensional model data of a subject using a 3D scanning device
- FIG. 3 is an illustration of extracting feature data from an 3D model data for formulating a query.
- FIG. 4 is a conceptual drawing of a search interface for inputting a query and viewing search results.
- Methods for identifying three-dimensional objects include the conversion of a set of three-dimensional model data to a set of continuous simple surfaces.
- Searchable parameters may be generated from features of the three-dimensional model data.
- the searchable parameters may be stored in a database as metadata of the three-dimensional model data.
- An interface may be provided to receive three-dimensional model data as an input for formulating a search query.
- the search query may be matched to records in the database which may be retrieved based on their similarity to the three-dimensional model data provided as input.
- FIG. 1 depicts a flow diagram 100 of an illustrative embodiment, wherein three-dimensional model data 110 is provided for the purpose of generating a three-dimensional model database for quick and efficient identification of three-dimensional objects.
- the three-dimensional model data may either be obtained from a 3D scanning device, from the device's on-board storage, or from a server where such data is pre-stored.
- the three-dimensional model data stored in the database or used as an input for a search may be in the form of a point cloud or mesh of a three-dimensional subject.
- any and all other forms of three-dimensional data representation, now known or developed in the future, that are capable of being converted to point cloud or mesh form may be used.
- the three-dimensional model data may further be converted to a set of continuous simple surfaces 112 by using a fitting method including but not limited to a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method. All of these methods are well understood in the art and their methodologies are incorporated herein by reference. Any simple surface including but not limited to a planar surface, cylindrical surface, spherical surface, sinusoidal surface, or a conic surface may be used to represent the three-dimensional data as the set of simple continuous surfaces.
- a fitting method including but not limited to a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method. All of these methods are well understood in the art and their methodologies are incorporated herein by reference.
- Any simple surface including but not limited to a planar
- the searchable parameters may be generated 114 based on the representation of 3D model data as features of the set of simple continuous surfaces.
- local geometric features may be directly extracted from the set of three-dimensional model data of a subject without first converting the data to a set of continuous simple surfaces. This direct feature extraction may permit 3D representations other than point cloud or mesh data to be used for generating searchable parameters.
- the searchable parameters may be generated based on manual feature selection by the user and/or automatically (including algorithmically). Either all or less than all features may be selected for generating searchable parameters based on specific objectives of database creation and specific use case. For instance, where the use case is a database of orthotic inserts for shoes, and the query is formulated from a 3D model of a patient's foot, the relevant searchable parameters may be related to describing the curvature of the foot arch, foot length, foot width, etc. Similarly, a user of an embodiment may select certain features or portions of a 3D model of a patient's foot from which search parameters will be formulated.
- searchable parameters may be stored in a database 116 as metadata.
- the metadata may describe the object mathematically based on its features as calculated from the set of simple surfaces and/or through direct extraction from the 3D model data.
- the metadata may be used for comparison of the inputted three-dimensional model data with the data stored on the database.
- the stored metadata includes information such as dimensions, surface features, creator/manufacturer details of the three-dimensional objects, etc.
- the database may also include local geometric features.
- the local geometric features extracted may include but are not limited to principal curvatures, average geodesic distances, heat kernel signatures, wave kernel signatures, shape contexts, spin images, features generated by Principal Component Analysis of the mesh graph, bounding box dimensions, mesh homology, and features generated by combining the aforementioned features or similar features in a manner known to a person skilled in the art.
- the local geometric features are extracted after the conversion of the inputted three-dimensional model data into a set of continuous simple surfaces.
- local geometric features are extracted from the input directly, without first converting the input into a set of continuous simple surfaces.
- the database may be organized based on one or more of feature size, feature type, or feature curvature, and may be arranged/ordered from the largest to the smallest or vice versa to improve search speed.
- the database can also be organized based one or more of relational, hierarchical, network, object-relational, object oriented, semi-structured, associative, entity-attribute value, or context model.
- a person skilled in the art will be able to determine the most efficient database structure based on the requirements.
- the three-dimensional model data may have complex features, and efficient storing and searching would necessitate the use of simplified descriptors. In such scenarios, methods like bag-of-words, or dimension reduction by Principal Component Analysis may be used to reduce the complexity of the searchable parameters.
- the objective of the method provided herein is to find one or more objects that match with the object provided by the user.
- the process of search begins with the input of a search query 118 .
- the search query is inputted 118 as 3D model data.
- the 3D model data may be generated through a 3D scanner. Any other methods of generating a 3D model data well known in the art may also be used.
- the three-dimensional model data inputted may be in the form of a point cloud or mesh or any other form which may be capable of being converted to a point cloud or mesh.
- the search interface facilitates the generation of a set of input features and the formulation of a search query.
- the process of formulating a search query further includes the conversion of inputted three-dimensional model data to a set of continuous simple surfaces 112 by using a fitting method including but not limited to a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method.
- Any simple surface including but not limited to a planar surface, cylindrical surface, spherical surface, sinusoidal surface, or a conic surface may be used to represent the three-dimensional data as the set of simple continuous surfaces.
- local geometric features may be extracted after the conversion of the inputted three-dimensional model data into a set of continuous simple surfaces.
- local geometric features are extracted from the input directly, without first converting the input into a set of continuous simple surfaces.
- Some or all the elements extracted from the inputted three-dimensional model data may be used for formulating a search query.
- a user or an algorithm may select the number of features to be used for formulating a search query, instead of inputting all the features; based on the need for identification and matching of only a portion of a three-dimensional model data set. Such an option is desirable as the reduction in the number of selected features for the search facilitates in the reduction of the computation time and help in faster retrieval of search results.
- search query is formulated and inputted 118 , the query is matched with database records 120 . Based on the matching of the inputted search query to the database records 120 , search results are retrieved 122 . The retrieval of the search results 122 may be based on the matching of one or more features of the input with one or more records in the database.
- FIGS. 2 through 5 illustrate a method for the selection of a close matching insole for an athlete's footwear involving the steps of 3D scanning the athlete's foot to obtain three-dimensional model data, converting the athlete's foot into continuous simple surfaces, generating a set of input features and formulating a search query, comparing it to an insole database to match and retrieve search results based on similarity to database records.
- this figure depicts an illustrative embodiment 200 , wherein a three-dimensional scanner 210 is used to scan and obtain three-dimensional model data 216 of a real world subject 212 (a human foot).
- the three-dimensional model data 216 is obtained by scanning the subject 212 from various directions and orientations 214 . While FIG. 2 suggests a particular orientation of the scanner and scan path, one skilled in the art will appreciate that this is merely for the convenience of illustration and that an actual scanner path may differ significantly so as to include features on the sole of the foot.
- the 3D scanner 210 may be any known or future developed 3D scanner including but not limited to mobile devices, smart phones or tablets configured to scan and obtain three-dimensional model data.
- FIG. 3 depicts an illustrative embodiment 300 , wherein the three-dimensional model data of the real world subject 212 (a human foot) of FIG. 2 is represented in the form of a mesh 216 .
- This mesh representation may be further converted to a set of continuous simple surfaces (not shown). This conversion may be achieved by using a fitting method including but not limited to a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method.
- the 3 D scan can be represented in the form of a point cloud.
- a set of three features may be generated corresponding to the scanned three-dimensional model data 216 of a real world subject 212 .
- Reference numbers 312 , 314 and 316 represent relevant features of the scanned foot, i.e. the length, width and the arch of the right human foot respectively.
- a query may be formulated containing mathematical descriptions of one or more of the features that may be queried against insoles provided on the database (not shown).
- a user or an algorithm may select a subset of the total number of features to be used for formulating a search query instead of formulating a query from all of the features. Such an option may help to reduce the computation time and help in faster retrieval of search results.
- a database may provide a repository of 3D model data, e.g. of all insoles in inventory, with simplified searchable parameters to mitigate the amount of computation necessary for matching which may arise out of the mathematical complexity of the surface being searched.
- simplified searchable parameters may be one or more of bag-of-words, or dimension reduction by Principal Component Analysis. Such methods are known in the art and one skilled in the art would be capable of applying these methods to the present complexity problem.
- FIG. 4 depicts an illustrative embodiment 400 providing an input section 410 and an output section 412 .
- the user can input three-dimensional model data 216 for formulating a query.
- the user may also view search results 412 based on the similarity of the query to records contained in the database.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Geometry (AREA)
- Multimedia (AREA)
- Mathematical Analysis (AREA)
- Computational Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Databases & Information Systems (AREA)
- Algebra (AREA)
- Architecture (AREA)
- Computer Hardware Design (AREA)
- Processing Or Creating Images (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Image Generation (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
This application is drawn to methods for identifying three-dimensional objects. Methods disclosed herein may include converting 3D model data to a set of simple surfaces, and generating searchable parameters from the image data and/or the simple surfaces. The searchable parameters may be stored in a database as metadata. A searcher may construct a search query by providing 3D model data from which search parameters and features may be extracted and used to formulate a query.
Description
- A. Field of Invention
- Embodiments may generally relate to conducting similarity searches of three-dimensional models.
- B. Description of the Related Art
- While image capture technologies have existed for years, it is only relatively recently that the field of machine vision has developed to the point where computers are capable of decomposing images into elements. Furthermore the problem of matching complex shapes, such as body parts, to reference shapes is nontrivial and has been the subject of much research in recent years. Available methods are cumbersome and computation-intensive. Thus, there is a need in the art for methods having improved efficiency, accuracy, and/or resolution.
- Some embodiments of the present invention may provide one or more benefits or advantages over the prior art.
- Some embodiments may relate to a method for identifying three-dimensional objects, comprising: providing a set of three-dimensional model data of a subject; converting the set of three-dimensional model data to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface; generating searchable parameters from features of the set of continuous simple surfaces; storing the searchable parameters in a database as metadata of the three-dimensional model data; providing a search interface adapted to receive three-dimensional model data as input for a search query, the search interface being adapted to formulate a search query from the input; and matching the search query to one or more records of the database and retrieving said records.
- According to some embodiments the set of three-dimensional model data comprises a point cloud or a mesh.
- Embodiments may further comprise a step of extracting local geometric features directly from the set of three-dimensional model data of a subject without first converting the three-dimensional model data of a subject to a set of continuous simple surfaces.
- According to some embodiments a user or an algorithm selects the features of the three-dimensional model data of a subject from which searchable parameters are generated, wherein the selected features are less than all of the features of the three-dimensional model data.
- According to some embodiments the database is organized according to a pattern promoting efficient searching, the pattern being selected from one or more of organization according to feature size, feature type, or feature curvature.
- According to some embodiments the database is organized according to a structure selected from one or more of relational, hierarchical, network, object-relational, object oriented, semi-structured, associative, Entity-Attribute-Value, or context model.
- According to some embodiments the database contains simplified searchable parameters comprising one or more of a bag-of-words, or dimension reduction by Principal Component Analysis.
- According to some embodiments the step of providing a search interface further comprises: converting the input to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface; generating a set of input features from the set of continuous simple surfaces; and formulating a query from the input features.
- Embodiments may further comprise the step of extracting local geometric features directly from the input without first converting the input to a set of continuous simple surfaces.
- According to some embodiments a user or an algorithm selects the features of the input for use in formulating a query, wherein the selected features are less than all of the features of the input.
- Some embodiments may relate to a method for identifying three-dimensional objects, comprising: providing a set of three-dimensional model data of a subject; converting the set of three-dimensional model data to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface; generating searchable parameters from features of the a set of continuous simple surfaces; extracting local geometric features directly from the set of three-dimensional model data of a subject without first converting the three-dimensional model data of a subject to a set of continuous simple surfaces; storing the searchable parameters in a database as metadata of the three-dimensional model data; providing a search interface adapted to receive three-dimensional model data as input for a search query, the search interface being adapted to formulate a search query from the input; and matching the search query to one or more records of the database and retrieving said records.
- Some embodiments may relate to a method for identifying three-dimensional objects, comprising: providing a set of three-dimensional model data of a subject; converting the set of three-dimensional model data to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface; generating searchable parameters from features of the a set of continuous simple surfaces; extracting local geometric features directly from the set of three-dimensional model data of a subject without first converting the three-dimensional model data of a subject to a set of continuous simple surfaces; storing the searchable parameters in a database as metadata of the three-dimensional model data; providing a search interface adapted to receive three-dimensional model data as input for a search query; converting the input to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface; generating a set of input features from the set of continuous simple surfaces; formulating a query from the input features; and matching the search query to one or more records of the database and retrieving said records.
- Other benefits and advantages will become apparent to those skilled in the art to which it pertains upon reading and understanding of the following detailed specification.
- The invention may take physical form in certain parts and arrangement of parts, embodiments of which will be described in detail in this specification and illustrated in the accompanying drawings which form a part hereof and wherein:
-
FIG. 1 is a flow diagram of a process according to an embodiment of the invention; -
FIG. 2 is an illustration of acquiring three-dimensional model data of a subject using a 3D scanning device; -
FIG. 3 is an illustration of extracting feature data from an 3D model data for formulating a query; and -
FIG. 4 is a conceptual drawing of a search interface for inputting a query and viewing search results. - Methods for identifying three-dimensional objects include the conversion of a set of three-dimensional model data to a set of continuous simple surfaces. Searchable parameters may be generated from features of the three-dimensional model data. The searchable parameters may be stored in a database as metadata of the three-dimensional model data. An interface may be provided to receive three-dimensional model data as an input for formulating a search query. The search query may be matched to records in the database which may be retrieved based on their similarity to the three-dimensional model data provided as input.
- Referring now to the drawings wherein the showings are for purposes of illustrating embodiments of the invention only and not for purposes of limiting the same,
FIG. 1 depicts a flow diagram 100 of an illustrative embodiment, wherein three-dimensional model data 110 is provided for the purpose of generating a three-dimensional model database for quick and efficient identification of three-dimensional objects. The three-dimensional model data may either be obtained from a 3D scanning device, from the device's on-board storage, or from a server where such data is pre-stored. In one embodiment, the three-dimensional model data stored in the database or used as an input for a search may be in the form of a point cloud or mesh of a three-dimensional subject. Alternatively, any and all other forms of three-dimensional data representation, now known or developed in the future, that are capable of being converted to point cloud or mesh form may be used. - The three-dimensional model data may further be converted to a set of continuous
simple surfaces 112 by using a fitting method including but not limited to a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method. All of these methods are well understood in the art and their methodologies are incorporated herein by reference. Any simple surface including but not limited to a planar surface, cylindrical surface, spherical surface, sinusoidal surface, or a conic surface may be used to represent the three-dimensional data as the set of simple continuous surfaces. - Features of the three-dimensional model data may be analyzed in order to generate searchable parameters for the model data. The searchable parameters may be generated 114 based on the representation of 3D model data as features of the set of simple continuous surfaces. In another embodiment, local geometric features may be directly extracted from the set of three-dimensional model data of a subject without first converting the data to a set of continuous simple surfaces. This direct feature extraction may permit 3D representations other than point cloud or mesh data to be used for generating searchable parameters.
- The searchable parameters may be generated based on manual feature selection by the user and/or automatically (including algorithmically). Either all or less than all features may be selected for generating searchable parameters based on specific objectives of database creation and specific use case. For instance, where the use case is a database of orthotic inserts for shoes, and the query is formulated from a 3D model of a patient's foot, the relevant searchable parameters may be related to describing the curvature of the foot arch, foot length, foot width, etc. Similarly, a user of an embodiment may select certain features or portions of a 3D model of a patient's foot from which search parameters will be formulated.
- In one embodiment, searchable parameters may be stored in a
database 116 as metadata. The metadata may describe the object mathematically based on its features as calculated from the set of simple surfaces and/or through direct extraction from the 3D model data. Furthermore, the metadata may be used for comparison of the inputted three-dimensional model data with the data stored on the database. The stored metadata includes information such as dimensions, surface features, creator/manufacturer details of the three-dimensional objects, etc. The database may also include local geometric features. The local geometric features extracted may include but are not limited to principal curvatures, average geodesic distances, heat kernel signatures, wave kernel signatures, shape contexts, spin images, features generated by Principal Component Analysis of the mesh graph, bounding box dimensions, mesh homology, and features generated by combining the aforementioned features or similar features in a manner known to a person skilled in the art. In an embodiment, the local geometric features are extracted after the conversion of the inputted three-dimensional model data into a set of continuous simple surfaces. In another embodiment, local geometric features are extracted from the input directly, without first converting the input into a set of continuous simple surfaces. - Organization of the database is an important aspect to ensure efficient searching. In order to facilitate faster searches. For example, and without limitation, the database may be organized based on one or more of feature size, feature type, or feature curvature, and may be arranged/ordered from the largest to the smallest or vice versa to improve search speed. Based on the use case scenario, the database can also be organized based one or more of relational, hierarchical, network, object-relational, object oriented, semi-structured, associative, entity-attribute value, or context model. A person skilled in the art will be able to determine the most efficient database structure based on the requirements. Sometimes the three-dimensional model data may have complex features, and efficient storing and searching would necessitate the use of simplified descriptors. In such scenarios, methods like bag-of-words, or dimension reduction by Principal Component Analysis may be used to reduce the complexity of the searchable parameters.
- The objective of the method provided herein is to find one or more objects that match with the object provided by the user. And the process of search begins with the input of a
search query 118. The search query is inputted 118 as 3D model data. The 3D model data may be generated through a 3D scanner. Any other methods of generating a 3D model data well known in the art may also be used. In one embodiment, the three-dimensional model data inputted may be in the form of a point cloud or mesh or any other form which may be capable of being converted to a point cloud or mesh. - Once, the 3D model data corresponding to a real world 3D object is generated, the search interface facilitates the generation of a set of input features and the formulation of a search query. The process of formulating a search query further includes the conversion of inputted three-dimensional model data to a set of continuous
simple surfaces 112 by using a fitting method including but not limited to a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method. Any simple surface including but not limited to a planar surface, cylindrical surface, spherical surface, sinusoidal surface, or a conic surface may be used to represent the three-dimensional data as the set of simple continuous surfaces. In one embodiment, local geometric features may be extracted after the conversion of the inputted three-dimensional model data into a set of continuous simple surfaces. In an alternate embodiment, local geometric features are extracted from the input directly, without first converting the input into a set of continuous simple surfaces. - Some or all the elements extracted from the inputted three-dimensional model data may be used for formulating a search query. In another embodiment, a user or an algorithm may select the number of features to be used for formulating a search query, instead of inputting all the features; based on the need for identification and matching of only a portion of a three-dimensional model data set. Such an option is desirable as the reduction in the number of selected features for the search facilitates in the reduction of the computation time and help in faster retrieval of search results.
- Once, the search query is formulated and inputted 118, the query is matched with database records 120. Based on the matching of the inputted search query to the database records 120, search results are retrieved 122. The retrieval of the search results 122 may be based on the matching of one or more features of the input with one or more records in the database.
- In an example,
FIGS. 2 through 5 illustrate a method for the selection of a close matching insole for an athlete's footwear involving the steps of 3D scanning the athlete's foot to obtain three-dimensional model data, converting the athlete's foot into continuous simple surfaces, generating a set of input features and formulating a search query, comparing it to an insole database to match and retrieve search results based on similarity to database records. - With particular reference to
FIG. 2 , this figure depicts anillustrative embodiment 200, wherein a three-dimensional scanner 210 is used to scan and obtain three-dimensional model data 216 of a real world subject 212 (a human foot). The three-dimensional model data 216 is obtained by scanning the subject 212 from various directions andorientations 214. WhileFIG. 2 suggests a particular orientation of the scanner and scan path, one skilled in the art will appreciate that this is merely for the convenience of illustration and that an actual scanner path may differ significantly so as to include features on the sole of the foot. The3D scanner 210 may be any known or future developed 3D scanner including but not limited to mobile devices, smart phones or tablets configured to scan and obtain three-dimensional model data. -
FIG. 3 depicts anillustrative embodiment 300, wherein the three-dimensional model data of the real world subject 212 (a human foot) ofFIG. 2 is represented in the form of amesh 216. This mesh representation may be further converted to a set of continuous simple surfaces (not shown). This conversion may be achieved by using a fitting method including but not limited to a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method. In another embodiment, the 3D scan can be represented in the form of a point cloud. - In one embodiment, a set of three features (312, 314, and 316) may be generated corresponding to the scanned three-
dimensional model data 216 of areal world subject 212.Reference numbers - A database according to an embodiment of the invention may provide a repository of 3D model data, e.g. of all insoles in inventory, with simplified searchable parameters to mitigate the amount of computation necessary for matching which may arise out of the mathematical complexity of the surface being searched. Such simplified searchable parameters may be one or more of bag-of-words, or dimension reduction by Principal Component Analysis. Such methods are known in the art and one skilled in the art would be capable of applying these methods to the present complexity problem.
-
FIG. 4 depicts anillustrative embodiment 400 providing aninput section 410 and anoutput section 412. The user can input three-dimensional model data 216 for formulating a query. The user may also viewsearch results 412 based on the similarity of the query to records contained in the database. - It will be apparent to those skilled in the art that the above methods and apparatuses may be changed or modified without departing from the general scope of the invention. The invention is intended to include all such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
- Having thus described the invention, it is now claimed:
Claims (17)
1. A method for identifying three-dimensional objects, comprising:
providing a set of three-dimensional model data of a subject;
converting the set of three-dimensional model data to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface;
generating searchable parameters from features of the set of continuous simple surfaces;
storing the searchable parameters in a database as metadata of the three-dimensional model data;
providing a search interface adapted to receive three-dimensional model data as input for a search query, the search interface being adapted to formulate a search query from the input; and
matching the search query to one or more records of the database and retrieving said records.
2. The method of claim 1 , wherein the set of three-dimensional model data comprises a point cloud or a mesh.
3. The method of claim 1 , further comprising the step of extracting local geometric features directly from the set of three-dimensional model data of a subject without first converting the three-dimensional model data of a subject to a set of continuous simple surfaces.
4. The method of claim 1 , wherein a user or an algorithm selects the features of the three-dimensional model data of a subject from which searchable parameters are generated, wherein the selected features are less than all of the features of the three-dimensional model data.
5. The method of claim 1 , wherein the database is organized according to a pattern promoting efficient searching, the pattern being selected from one or more of organization according to feature size, feature type, or feature curvature.
6. The method of claim 5 , wherein the database is organized according to a structure selected from one or more of relational, hierarchical, network, object-relational, object oriented, semi-structured, associative, Entity-Attribute-Value, or context model.
7. The method of claim 1 , wherein the database contains simplified searchable parameters comprising one or more of a bag-of-words, or dimension reduction by Principal Component Analysis.
8. The method of claim 1 , wherein the step of providing a search interface further comprises:
converting the input to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface;
generating a set of input features from the set of continuous simple surfaces; and
formulating a query from the input features.
9. The method of claim 8 , further comprising the step of extracting local geometric features directly from the input without first converting the input to a set of continuous simple surfaces.
10. The method of claim 8 , wherein a user or an algorithm selects the features of the input for use in formulating a query, wherein the selected features are less than all of the features of the input.
11. A method for identifying three-dimensional objects, comprising:
providing a set of three-dimensional model data of a subject;
converting the set of three-dimensional model data to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface;
generating searchable parameters from features of the a set of continuous simple surfaces;
extracting local geometric features directly from the set of three-dimensional model data of a subject without first converting the three-dimensional model data of a subject to a set of continuous simple surfaces;
storing the searchable parameters in a database as metadata of the three-dimensional model data;
providing a search interface adapted to receive three-dimensional model data as input for a search query, the search interface being adapted to formulate a search query from the input; and
matching the search query to one or more records of the database and retrieving said records.
12. A method for identifying three-dimensional objects, comprising:
providing a set of three-dimensional model data of a subject;
converting the set of three-dimensional model data to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface;
generating searchable parameters from features of the a set of continuous simple surfaces;
extracting local geometric features directly from the set of three-dimensional model data of a subject without first converting the three-dimensional model data of a subject to a set of continuous simple surfaces;
storing the searchable parameters in a database as metadata of the three-dimensional model data;
providing a search interface adapted to receive three-dimensional model data as input for a search query;
converting the input to a set of continuous simple surfaces using a fitting method selected from one or more of a random sample consensus (RANSAC) method, an iterative closest point method, a least squares method, a Newtonian method, a quasi-Newtonian method, or an expectation-maximization method, wherein a simple surface comprises a planar surface, a cylindrical surface, a spherical surface, a sinusoidal surface, or a conic surface;
generating a set of input features from the set of continuous simple surfaces;
formulating a query from the input features; and
matching the search query to one or more records of the database and retrieving said records.
13. The method of claim 12 , wherein the set of three-dimensional model data comprises a point cloud or a mesh.
14. The method of claim 13 , wherein a user or an algorithm selects the features of the three-dimensional model data of a subject from which searchable parameters are generated, wherein the selected features are less than all of the features of the three-dimensional model data.
15. The method of claim 14 , wherein the database is organized according to a pattern promoting efficient searching, the pattern being selected from one or more of organization according to feature size, feature type, or feature curvature.
16. The method of claim 15 , wherein the database is organized according to a structure selected from one or more of relational, hierarchical, network, object-relational, object oriented, semi-structured, associative, Entity-Attribute-Value, or context model.
17. The method of claim 16 , wherein the database contains simplified searchable parameters comprising one or more of a bag-of-words, or dimension reduction by Principal Component Analysis.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/671,373 US20150278155A1 (en) | 2014-03-27 | 2015-03-27 | Identifying objects using a 3d scanning device, images, and 3d models |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201461971036P | 2014-03-27 | 2014-03-27 | |
US14/671,373 US20150278155A1 (en) | 2014-03-27 | 2015-03-27 | Identifying objects using a 3d scanning device, images, and 3d models |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150278155A1 true US20150278155A1 (en) | 2015-10-01 |
Family
ID=54189850
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/671,373 Abandoned US20150278155A1 (en) | 2014-03-27 | 2015-03-27 | Identifying objects using a 3d scanning device, images, and 3d models |
US14/671,749 Abandoned US20150279121A1 (en) | 2014-03-27 | 2015-03-27 | Active Point Cloud Modeling |
US14/672,048 Active 2035-11-14 US9841277B2 (en) | 2014-03-27 | 2015-03-27 | Graphical feedback during 3D scanning operations for obtaining optimal scan resolution |
US14/671,420 Abandoned US20150279087A1 (en) | 2014-03-27 | 2015-03-27 | 3d data to 2d and isometric views for layout and creation of documents |
US14/671,313 Abandoned US20150279075A1 (en) | 2014-03-27 | 2015-03-27 | Recording animation of rigid objects using a single 3d scanner |
Family Applications After (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/671,749 Abandoned US20150279121A1 (en) | 2014-03-27 | 2015-03-27 | Active Point Cloud Modeling |
US14/672,048 Active 2035-11-14 US9841277B2 (en) | 2014-03-27 | 2015-03-27 | Graphical feedback during 3D scanning operations for obtaining optimal scan resolution |
US14/671,420 Abandoned US20150279087A1 (en) | 2014-03-27 | 2015-03-27 | 3d data to 2d and isometric views for layout and creation of documents |
US14/671,313 Abandoned US20150279075A1 (en) | 2014-03-27 | 2015-03-27 | Recording animation of rigid objects using a single 3d scanner |
Country Status (1)
Country | Link |
---|---|
US (5) | US20150278155A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108921045A (en) * | 2018-06-11 | 2018-11-30 | 佛山科学技术学院 | A kind of space characteristics of threedimensional model extract and matching process and its device |
US20200051308A1 (en) * | 2018-08-10 | 2020-02-13 | Sheng-Yen Lin | Mesh rendering system, mesh rendering method and non-transitory computer readable medium |
US10860846B2 (en) * | 2015-08-18 | 2020-12-08 | Canon Kabushiki Kaisha | Information processing apparatus, information processing method and program |
Families Citing this family (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105469446A (en) * | 2014-09-05 | 2016-04-06 | 富泰华工业(深圳)有限公司 | Point cloud mesh simplification system and method |
US20160125638A1 (en) * | 2014-11-04 | 2016-05-05 | Dassault Systemes | Automated Texturing Mapping and Animation from Images |
EP3040946B1 (en) * | 2014-12-30 | 2019-11-13 | Dassault Systèmes | Viewpoint selection in the rendering of a set of objects |
US9866815B2 (en) * | 2015-01-05 | 2018-01-09 | Qualcomm Incorporated | 3D object segmentation |
CN105551078A (en) * | 2015-12-02 | 2016-05-04 | 北京建筑大学 | Method and system of virtual imaging of broken cultural relics |
US10049479B2 (en) | 2015-12-30 | 2018-08-14 | Dassault Systemes | Density based graphical mapping |
US10127333B2 (en) | 2015-12-30 | 2018-11-13 | Dassault Systemes | Embedded frequency based search and 3D graphical data processing |
US10360438B2 (en) | 2015-12-30 | 2019-07-23 | Dassault Systemes | 3D to 2D reimaging for search |
JP6906303B2 (en) * | 2015-12-30 | 2021-07-21 | ダッソー システムズDassault Systemes | Density-based graphical mapping |
US11138306B2 (en) * | 2016-03-14 | 2021-10-05 | Amazon Technologies, Inc. | Physics-based CAPTCHA |
CN106524920A (en) * | 2016-10-25 | 2017-03-22 | 上海建科工程咨询有限公司 | Application of field measurement in construction project based on three-dimensional laser scanning |
US10999602B2 (en) | 2016-12-23 | 2021-05-04 | Apple Inc. | Sphere projected motion estimation/compensation and mode decision |
CN106650700B (en) * | 2016-12-30 | 2020-12-01 | 上海联影医疗科技股份有限公司 | Die body, method and device for measuring system matrix |
US11259046B2 (en) | 2017-02-15 | 2022-02-22 | Apple Inc. | Processing of equirectangular object data to compensate for distortion by spherical projections |
US10924747B2 (en) | 2017-02-27 | 2021-02-16 | Apple Inc. | Video coding techniques for multi-view video |
US11093752B2 (en) | 2017-06-02 | 2021-08-17 | Apple Inc. | Object tracking in multi-view video |
US20190005709A1 (en) * | 2017-06-30 | 2019-01-03 | Apple Inc. | Techniques for Correction of Visual Artifacts in Multi-View Images |
US10754242B2 (en) | 2017-06-30 | 2020-08-25 | Apple Inc. | Adaptive resolution and projection format in multi-direction video |
CN107677221B (en) * | 2017-10-25 | 2024-03-19 | 贵州大学 | Plant leaf movement angle measuring method and device |
US10762595B2 (en) | 2017-11-08 | 2020-09-01 | Steelcase, Inc. | Designated region projection printing of spatial pattern for 3D object on flat sheet in determined orientation |
US10699404B1 (en) | 2017-11-22 | 2020-06-30 | State Farm Mutual Automobile Insurance Company | Guided vehicle capture for virtual model generation |
EP3496388A1 (en) | 2017-12-05 | 2019-06-12 | Thomson Licensing | A method and apparatus for encoding a point cloud representing three-dimensional objects |
CN112381919B (en) | 2019-07-29 | 2022-09-27 | 浙江商汤科技开发有限公司 | Information processing method, positioning method and device, electronic equipment and storage medium |
GB2586838B (en) * | 2019-09-05 | 2022-07-27 | Sony Interactive Entertainment Inc | Free-viewpoint method and system |
KR20210030147A (en) * | 2019-09-09 | 2021-03-17 | 삼성전자주식회사 | 3d rendering method and 3d rendering apparatus |
CN110610045A (en) * | 2019-09-16 | 2019-12-24 | 杭州群核信息技术有限公司 | Intelligent cloud processing system and method for generating three views by selecting cabinet and wardrobe |
US11074708B1 (en) * | 2020-01-06 | 2021-07-27 | Hand Held Products, Inc. | Dark parcel dimensioning |
JP7262655B2 (en) * | 2020-02-13 | 2023-04-21 | 三菱電機株式会社 | DIMENSIONING DEVICE, DIMENSIONING METHOD AND PROGRAM |
CN111443091B (en) * | 2020-04-08 | 2023-07-25 | 中国电力科学研究院有限公司 | Cable line tunnel engineering defect judging method |
CN111814691B (en) * | 2020-07-10 | 2022-01-21 | 广东电网有限责任公司 | Space expansion display method and device for transmission tower image |
CN116817771B (en) * | 2023-08-28 | 2023-11-17 | 南京航空航天大学 | Aerospace part coating thickness measurement method based on cylindrical voxel characteristics |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060085854A1 (en) * | 2004-10-19 | 2006-04-20 | Agrawal Subhash C | Method and system for detecting intrusive anomalous use of a software system using multiple detection algorithms |
US20090216393A1 (en) * | 2008-02-27 | 2009-08-27 | James Schimert | Data-driven anomaly detection to anticipate flight deck effects |
US20090276077A1 (en) * | 2008-04-30 | 2009-11-05 | Richard Good | Method and system for semiconductor process control and monitoring by using pca models of reduced size |
US20120155734A1 (en) * | 2009-08-07 | 2012-06-21 | Ucl Business Plc | Apparatus and method for registering two medical images |
US20140249961A1 (en) * | 2013-03-04 | 2014-09-04 | Adidas Ag | Interactive cubicle and method for determining a body shape |
US20150153476A1 (en) * | 2012-01-12 | 2015-06-04 | Schlumberger Technology Corporation | Method for constrained history matching coupled with optimization |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4319031B2 (en) | 2001-09-06 | 2009-08-26 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Object segmentation method and apparatus |
WO2006084385A1 (en) | 2005-02-11 | 2006-08-17 | Macdonald Dettwiler & Associates Inc. | 3d imaging system |
US7965868B2 (en) * | 2006-07-20 | 2011-06-21 | Lawrence Livermore National Security, Llc | System and method for bullet tracking and shooter localization |
US7768656B2 (en) | 2007-08-28 | 2010-08-03 | Artec Group, Inc. | System and method for three-dimensional measurement of the shape of material objects |
KR20090047172A (en) * | 2007-11-07 | 2009-05-12 | 삼성디지털이미징 주식회사 | Method for controlling digital camera for picture testing |
US8199988B2 (en) * | 2008-05-16 | 2012-06-12 | Geodigm Corporation | Method and apparatus for combining 3D dental scans with other 3D data sets |
EP2297705B1 (en) * | 2008-06-30 | 2012-08-15 | Thomson Licensing | Method for the real-time composition of a video |
EP2329630B1 (en) * | 2008-08-01 | 2012-02-08 | Gigle Networks SL | OFDM frame synchronisation method and system |
US8896607B1 (en) * | 2009-05-29 | 2014-11-25 | Two Pic Mc Llc | Inverse kinematics for rigged deformable characters |
US8817019B2 (en) * | 2009-07-31 | 2014-08-26 | Analogic Corporation | Two-dimensional colored projection image from three-dimensional image data |
US8085279B2 (en) * | 2009-10-30 | 2011-12-27 | Synopsys, Inc. | Drawing an image with transparent regions on top of another image without using an alpha channel |
WO2012115862A2 (en) * | 2011-02-22 | 2012-08-30 | 3M Innovative Properties Company | Space carving in 3d data acquisition |
EP2707834B1 (en) * | 2011-05-13 | 2020-06-24 | Vizrt Ag | Silhouette-based pose estimation |
US8724880B2 (en) * | 2011-06-29 | 2014-05-13 | Kabushiki Kaisha Toshiba | Ultrasonic diagnostic apparatus and medical image processing apparatus |
US9460542B2 (en) * | 2011-11-15 | 2016-10-04 | Trimble Navigation Limited | Browser-based collaborative development of a 3D model |
US9208550B2 (en) | 2012-08-15 | 2015-12-08 | Fuji Xerox Co., Ltd. | Smart document capture based on estimated scanned-image quality |
EP3022525B1 (en) | 2013-07-18 | 2020-04-29 | a.tron3d GmbH | Method of capturing three-dimensional (3d) information on a structure |
US20150070468A1 (en) | 2013-09-10 | 2015-03-12 | Faro Technologies, Inc. | Use of a three-dimensional imager's point cloud data to set the scale for photogrammetry |
-
2015
- 2015-03-27 US US14/671,373 patent/US20150278155A1/en not_active Abandoned
- 2015-03-27 US US14/671,749 patent/US20150279121A1/en not_active Abandoned
- 2015-03-27 US US14/672,048 patent/US9841277B2/en active Active
- 2015-03-27 US US14/671,420 patent/US20150279087A1/en not_active Abandoned
- 2015-03-27 US US14/671,313 patent/US20150279075A1/en not_active Abandoned
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060085854A1 (en) * | 2004-10-19 | 2006-04-20 | Agrawal Subhash C | Method and system for detecting intrusive anomalous use of a software system using multiple detection algorithms |
US20090216393A1 (en) * | 2008-02-27 | 2009-08-27 | James Schimert | Data-driven anomaly detection to anticipate flight deck effects |
US20090276077A1 (en) * | 2008-04-30 | 2009-11-05 | Richard Good | Method and system for semiconductor process control and monitoring by using pca models of reduced size |
US20120155734A1 (en) * | 2009-08-07 | 2012-06-21 | Ucl Business Plc | Apparatus and method for registering two medical images |
US20150153476A1 (en) * | 2012-01-12 | 2015-06-04 | Schlumberger Technology Corporation | Method for constrained history matching coupled with optimization |
US20140249961A1 (en) * | 2013-03-04 | 2014-09-04 | Adidas Ag | Interactive cubicle and method for determining a body shape |
Non-Patent Citations (1)
Title |
---|
Efficient RANSAC for Point-Cloud Shape Detection, COMPUTER GRAPHICS forum, Volume 26 (2007), number 2 pp. 214â226 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10860846B2 (en) * | 2015-08-18 | 2020-12-08 | Canon Kabushiki Kaisha | Information processing apparatus, information processing method and program |
CN108921045A (en) * | 2018-06-11 | 2018-11-30 | 佛山科学技术学院 | A kind of space characteristics of threedimensional model extract and matching process and its device |
US20200051308A1 (en) * | 2018-08-10 | 2020-02-13 | Sheng-Yen Lin | Mesh rendering system, mesh rendering method and non-transitory computer readable medium |
US10600230B2 (en) * | 2018-08-10 | 2020-03-24 | Sheng-Yen Lin | Mesh rendering system, mesh rendering method and non-transitory computer readable medium |
Also Published As
Publication number | Publication date |
---|---|
US20150279121A1 (en) | 2015-10-01 |
US20150279075A1 (en) | 2015-10-01 |
US20150276392A1 (en) | 2015-10-01 |
US20150279087A1 (en) | 2015-10-01 |
US9841277B2 (en) | 2017-12-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20150278155A1 (en) | Identifying objects using a 3d scanning device, images, and 3d models | |
CN104200240B (en) | A kind of Sketch Searching method based on content-adaptive Hash coding | |
Leng et al. | 3D object retrieval with multitopic model combining relevance feedback and LDA model | |
CN104199842B (en) | A kind of similar pictures search method based on local feature neighborhood information | |
Yang et al. | An improved Bag-of-Words framework for remote sensing image retrieval in large-scale image databases | |
Tipaldi et al. | Geometrical flirt phrases for large scale place recognition in 2d range data | |
Shah et al. | Deeply learnt hashing forests for content based image retrieval in prostate MR images | |
US20120117122A1 (en) | Optimized KD-Tree for Scalable Search | |
JP2009080796A (en) | Apparatus and method for three-dimensional model retrieval | |
Fu et al. | Automatic detection of lung nodules: false positive reduction using convolution neural networks and handcrafted features | |
Saavedra et al. | Sketch-based 3D Model Retrieval using Keyshapes for Global and Local Representation. | |
Rastogi et al. | Deep learning and big datatechnologies in medical image analysis | |
Santarossa et al. | MedRegNet: Unsupervised multimodal retinal-image registration with GANs and ranking loss | |
CN104142978B (en) | A kind of image indexing system and method based on multiple features and rarefaction representation | |
Yang et al. | Weakly supervised class-agnostic image similarity search based on convolutional neural network | |
CN102073738B (en) | Intelligent retrieval view selection-based three-dimensional object retrieval method and device | |
CN117009599A (en) | Data retrieval method and device, processor and electronic equipment | |
Benhabiles et al. | Convolutional neural network for pottery retrieval | |
Li et al. | Matching content-based saliency regions for partial-duplicate image retrieval | |
Lu et al. | Simple and efficient improvement of spin image for three-dimensional object recognition | |
Chen et al. | Measuring clothing image similarity with bundled features | |
Agarwal et al. | SketchBuddy: Context-aware sketch enrichment and enhancement | |
KR20160127369A (en) | System and method for searching image | |
Sipiran Mendoza | Local features for partial shape matching and retrieval | |
Bredow et al. | Image retrieval |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: KNOCKOUT CONCEPTS, LLC, OHIO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KUTTOTHARA, JACOB A;WATHEN, JOHN M;PADDOCK, STEVEN D;AND OTHERS;REEL/FRAME:035776/0299 Effective date: 20150528 Owner name: KNOCKOUT CONCEPTS, LLC, OHIO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MEYERS, STEPHEN B;REEL/FRAME:035776/0218 Effective date: 20150528 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |