US20200151937A1 - Method and system for construction project management using photo imaging measurements - Google Patents

Method and system for construction project management using photo imaging measurements Download PDF

Info

Publication number
US20200151937A1
US20200151937A1 US16/742,094 US202016742094A US2020151937A1 US 20200151937 A1 US20200151937 A1 US 20200151937A1 US 202016742094 A US202016742094 A US 202016742094A US 2020151937 A1 US2020151937 A1 US 2020151937A1
Authority
US
United States
Prior art keywords
project
materials
tools
program code
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/742,094
Inventor
William Ernest Miller
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US16/742,094 priority Critical patent/US20200151937A1/en
Publication of US20200151937A1 publication Critical patent/US20200151937A1/en
Priority to US17/183,704 priority patent/US20210183128A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/005General purpose rendering architectures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/56Information retrieval; Database structures therefor; File system structures therefor of still image data having vectorial format
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/36User authentication by graphic or iconic representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G06K9/00671
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0631Resource planning, allocation, distributing or scheduling for enterprises or organisations
    • G06Q10/06313Resource planning in a project environment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0621Item configuration or customization
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/64Three-dimensional objects
    • H04L29/06
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/012Dimensioning, tolerancing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00204Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/275Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/0077Types of the still picture apparatus
    • H04N2201/0081Image reader

Definitions

  • the present invention relates to a method and system for photo imaging and measurement, and more particularly, to a comprehensive small construction project management system.
  • photo imaging and measurement system operating on various computing devices, both mobile and desktop, that includes an an imaging recognition system.
  • the photo imaging and measurement system should allow users to scan and input various data related to construction projects. The system when manipulated would then produce lists of required tools and materials based on the construction project data.
  • the present invention is a method and system of photo imaging and measurement for use by do-it-yourselfers, handymen and small construction contractors. By performing various imaging based measurements and then processing the resultant data, the method and system produces lists of tools and materials needed to complete project bills of materials, invoices, and receipts. The present invention accomplishes these objectives.
  • a photo imaging and measurement Application operates on a Computing Device.
  • the Computing Device may be a Mobile, Desktop, Laptop, or other CPU device.
  • the Computing Device may comprise an iPhone, iPad, Android phone, Blackberry, Personal Computer, etc., but is not limited to these exclusive examples.
  • the PIM-P Application may be utilized in either offline mode or online mode.
  • offline mode login to and execution of the PIM-P Application occurs on the computing device. Once the Application is accessed, the default status of the system is “offline.” If the choice is made to remain offline, the Application prompts to perform “limited” system calibration local to the mobile/desktop computing device.
  • offline mode images, measurements and data may be collected and stored locally on the Computing Device, but cannot be fully processed until the system status enters online mode and the various system servers are accessed.
  • System calibration SaaS processing occurs in the “online” mode, when required data is collected on the Computing Device and relayed to the System Calibration Server via the Main Web Server. Data received and processed by the System Calibration Server is then stored in the System Calibrate RDB according to the calibration process used: either Frame of Reference; Point of Reference; or 3D Scan.
  • System processes and calculations occur in the “online” mode, when required data is collected on the Computing Device and relayed to the System Processes Server via the Main Web Server. Project Name, Photo Image, and Dimension measurements are processed by the System Processes Server, and then stored along with Project Guide URLs and Tools and Materials in the Project Information RDB.
  • the system notifies the PIM-P Application locally on the Computing Device to select a Project Guide. Selecting a Project Guide link from the displayed list, accesses the Vendor eCommerce Site, via the Main Web Server and the Retail Vendor Web Server in order to view the Project Guide “How To” video. At this point, the Retail Vendor eCommerce Site remains visibly open and accessible to the user while other system processes are carried out by the other remote SaaS functions.
  • the selected Project Guide data and a system prompt to calculate tools and materials quantities are sent via the Main Web Server to the System Processes Server.
  • the System Processes Server retrieves the project Dimensions and the recommended Tools and Materials from the Project Information RDB to calculate required project Tools and Materials quantities lists.
  • the Required Tools list prompts the System Process Server to access the Preferred Tool Vendor Web Server and Tool Sku RDB via the Main Web Server to retrieve and display in the Preferred Tool Vendor tools matching the Required Tools list, in the Application on the Computing Device.
  • Required Tools and Materials are now selected for purchase on the Retail Vendor eCommerce Site in standard “Shopping Cart” and “Checkout” format.
  • FIG. 1 is a system diagram depicting the system hardware, software and interfaces in accordance with an embodiment of the present invention
  • FIG. 2A is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention
  • FIG. 2B is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention.
  • FIG. 2C is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention.
  • FIG. 3 is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention.
  • FIG. 4 is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention.
  • FIG. 5 is a depiction of a photo imaging and measurement application in accordance with an embodiment of the present invention.
  • FIG. 1 is a diagram depicting the system hardware and software in accordance with an embodiment of the present invention.
  • a photo imaging and measurement Application 105 (PIM-P Application) operates on a Computing Device 100 which may be a Mobile, Desktop, Laptop, or other CPU device.
  • the Computing Device 100 may comprise an iPhone, iPad, Android phone, Blackberry, Personal Computer, etc., but is not limited to these exclusive examples.
  • the Computing Device 100 communicates with various networked servers via a wireless or hard-wired network interface.
  • the PIM-P Application 105 may be utilized in either offline mode or online mode.
  • offline mode login to and execution of the PIM-P Application 105 occurs on the Computing Device 100 .
  • the default status of the system is “offline.” If the choice is made to remain offline, the Application 105 prompts to perform “limited” system calibration local to the mobile/desktop computing device 100 , thus producing Limited Frame of Reference Data 103 ; Limited Point of Reference Data 107 ; Limited 3D Scan Data 113 .
  • images, measurements and data may be collected and stored locally on the Computing Device 100 , but cannot be fully processed until the system status enters online mode and the various system servers are accessed.
  • information stored on the Computing Device 100 may be exported to other computing devices including standard desktop/laptop computing devices in standard file formats including but not limited to .jpg, .xls, .doc, .ppt, .csv, .pdf etc., once the system status is “online.”
  • the Application 105 executes on the mobile device, while the remote system servers ( 130 , 155 , 190 ) function as a Software as a Service (SaaS) platform. Once the system status is online, any previously collected and stored calibration data, images, measurements etc. local to the Computing Device 100 will be automatically processed by the appropriate server and joined in the corresponding RDB.
  • SaaS Software as a Service
  • System calibration SaaS processing occurs in the “online” mode, when required data is collected on the Computing Device 100 and relayed to the System Calibration Server 130 via the Main Web Server 110 .
  • Data received and processed by the System Calibration Server 130 is then stored in the System Calibrate RDB 135 according to the calibration process used: either Frame of Reference 140 ; Point of Reference 145 ; or 3D Scan 150 .
  • System processes and calculations occur in the “online” mode, when required data is collected on the Computing Device 100 and relayed to the System Processes Server 155 via the Main Web Server 110 .
  • Project Name 165 , Photo Image 170 and Dimension measurements 180 are processed by the System Processes Server 155 and then stored along with Project Guide URLs 185 and Tools and Materials 187 in the Project Information RDB 160 .
  • the system notifies the PIM-P Application 105 locally on the Computing Device 100 to select a Project Guide.
  • the System Processes Server 155 points to the URLs 185 in the Project Information RDB 160 and displays in the PIM-P Application 105 on the Computing Device 100 , the list of Project Guide “How To” video links that correspond to the Project Name Data 165 and Photo Image Data 170 . Selecting a Project Guide link from the displayed list accesses the Vendor eCommerce Site 120 , via the Main Web Server 110 and the Retail Vendor Web Server 115 in order to view the Project Guide video. At this point, the Retail Vendor eCommerce Site 120 remains visibly open and accessible to the user while other system processes are carried out by the other remote SaaS functions.
  • a Project Guide “How To” video is selected and confirmed in the Application 105 , for processing use.
  • the selection of a Project Guide video prompts the system to calculate tools and materials quantities.
  • the prompt is sent via the Main Web Server 110 to the System Processes Server 155 .
  • the System Processes Server 155 retrieves the project Dimensions 180 and the recommended Tools and Materials 187 from the Project Information RDB 160 to calculate required project Tools and Materials 187 quantity lists.
  • the Required Tools 187 list prompts the System Process Server 160 to access the Preferred Tool Vendor Web Server 125 and Tool SKU RDB 128 via the Main Web Server 110 to retrieve and display in the Preferred Tool Vendor products matching the Required Tools 187 list, in the Application 105 on the Computing Device 100 .
  • Image Recognition SaaS processing occurs in the “online” mode, when required image and tag data are collected on the Computing Device 100 and relayed to the Image Recognition Server 190 via the Main Web Server 110 .
  • An Object Image 196 and Object Image Tag 199 are processed by the Image Recognition Server 155 and Image Recognition software then joined in the Image Recognition RDB 193 .
  • FIG. 2A illustrates a flowchart of the photo imaging and measurement application.
  • the user logs in with user name and password to the PIM-P user interface application 105 executing on the Computing Device 100 .
  • the PIM-P application 105 Home screen appears.
  • step 205 the Home screen presents the option to Go Online (Yes or No). Default is off-line. If Online is selected, processing continues at step 207 . If Offline is selected, processing continues at connector A.
  • step 207 the Main Web Server 110 is accessed.
  • the Main Web Server 110 ( FIG. 1 ), automatically passes control to the System Calibration Server 130 ( FIG. 1 ) and System Calibrate RDB 135 ( FIG. 1 ) to perform one or more selected System Calibration procedure(s) ( 210 , 220 , 225 ).
  • the User may choose one System Calibration procedure ( 210 , 220 , 225 ).
  • the User may utilize a combination of System Calibration procedures ( 210 , 220 , 225 ).
  • step 215 the User chooses the system calibration procedure(s) ( 210 , 220 , 225 ).
  • step 210 the System Calibration Server 130 performs System Calibration by Triangulation Frame of Reference 210 .
  • step 220 the System Calibration Server 130 performs System Calibration by Reference Object Point of Reference 220 .
  • step 225 the System Calibration Server 130 performs System Calibration by Target Object 3D Scan 225 .
  • step 227 on completion of System Calibration, the Application 105 returns to the PIM-P Application 105 Home screen to input the Project Name. Saving the Project Name sends information top the System Processes Server 155 ( FIG. 1 ) and Project Information RDB 160 ( FIG. 1 ).
  • step 230 on completion of Project Name, a photo image of the project is then added by either Capture New Photo Image 240 ( FIG. 2B ) or else Select Existing Photo Image 233 .
  • a photo image is captured and saved, and processing continues at step 243 .
  • a photo image may be captured by various devices including but not limited to a camera device intrinsic to the System Mobile Device 100 , another mobile device such as a cellular phone or a computing tablet, a camera device independent of the disclosed system hardware, or a scanning device which is independent of the disclosed system hardware.
  • the photo image may be transferred to the system Mobile Computing Device 100 by multiple methods including but not limited to; standard wireless or wired Internet connectivity, standard device-to-device direct wireless or hardwired connectivity.
  • the new photo image is saved to the System Processes Server 155 ( FIG. 1 ) and Project Information RDB 160 ( FIG. 1 ).
  • step 233 an existing photo image is selected. If Select Existing Photo is chosen, the photo may be selected from a local file on the mobile computing device, or selected from the System Processes Server 155 ( FIG. 1 ) and Project Information RDB 160 ( FIG. 1 ). Processing now continues at step 243 ( FIG. 2B ).
  • step 243 the Application 105 determines if the Photo Image Dimensions are entered. If the Photo Image Dimensions are entered, then the Application continues at step 250 . If the Photo Image Dimensions are not entered, the Application 105 proceeds to step 247 .
  • Photo Image Dimensions are inputted by selecting a dimension to be measured from a User Interface, then touching a display and “drawing” the length of the dimension being measured. The user may perform multiple touches around the perimeter of a hole or curved object, and then connect the touch points by drawing between them. This will identify to the system that the object being measured is other than a straight line. Completing and saving the image dimensions sends the information to the System Processes Server 155 ( FIG. 1 ) and Project Information RDB 160 ( FIG. 1 ).
  • step 250 after completing dimensions capture, from the Home screen, the image will be defined. If Photo Image is defined, the Application 105 proceeds to step 257 . If Photo Image is not defined, the Application proceeds to step 253 .
  • step 253 Define Photo Image means something like “hole” for a hole in a wall or “P-trap” for the plumbing trap under a sink.
  • This Photo Image definition also tags the image for use by the Image Recognition Server 190 ( FIG. 1 ) and Image Recognition RDB 193 ( FIG. 1 ).
  • the defined photo is saved as Photo Image Data 170 in the Project Information RDB 160 ( FIG. 1 ).
  • the Application 105 proceeds through connector F. Saving the image definition sends the information to the Image Recognition Server 190 ( FIG. 1 ) and the Image Recognition RDB 193 ( FIG. 1 ) via connector F as well as the System Processes Server 155 ( FIG. 1 ) and Project Information RDB 160 ( FIG. 1 ).
  • step 257 the User is prompted to select a Project Guide “How To” video.
  • a Project Guide “How To” video is maintained on the Retail Vendor eCommerce Site 120 and portrays methods, tools and materials to be utilized for completing the project, in the video being viewed for selection.
  • the user is prompted to select a Project Guide.
  • the combination of the Project Name Data 165 and Photo Image data 170 points the system to the appropriate Project Guide URL links 185 ( FIG. 1 ) in the Project Information RDB which when displayed and selected on the Mobile Computing Device 100 , then accesses the retail vendor's “How To” videos via the Main Web Server, 110 ( FIG. 1 ), the Retail Vendor Web Server 155 ( FIG. 1 ) and the Retail Vendor eCommerce Site 120 ( FIG. 1 ).
  • the Application 105 proceeds to step 263 and continues at connector H. If no Project Guide is selected, the Application 105 proceeds to step 260 .
  • step 260 no Project Guide has been selected. Based on calculations external to the system, anticipated tools and material quantities are manually entered and saved to the system. Saving this information sends it to the System Process Server 155 ( FIG. 1 ) and the Project Information RDB 160 ( FIG. 1 ).
  • the Application enters step 267 from connector I, or else it enters step 270 from connector E.
  • the Application 105 displays system-calculated materials and preferred tools lists.
  • the System Process Server 155 uses the system-calculated materials and tools requirements or the manually entered tools and materials list, the System Process Server 155 ( FIG. 1 ) directs the Main Web Server 110 ( FIG. 1 ) to the Retail Vendor Web Server 115 ( FIG. 1 ) and Retail Vendor eCommerce Site 120 ( FIG. 1 ). Tools and materials are selected and added to the Shopping Cart 270 and Checked Out 273 , on the Retail Vendor eCommerce site 120 ( FIG. 1 ).
  • the purchase is completed using an appropriately aligned Vendor Credit account or an independent Credit Card.
  • the project is then saved on the Mobile Computing Device 100 , and Project Information Server 160 .
  • an electronic receipt is transmitted from the Vendor eCommerce site 120 .
  • the Application 105 main system process now ends.
  • the Application 105 main system process now ends.
  • the Application 105 flow enters from connector A while in Off-line mode.
  • the PIM-P Application 105 provides limited calibration capability, local to the Computing Device 100 (steps 315 , 320 , 325 ).
  • the User chooses one or more system calibration procedures (steps 315 , 320 , 325 ).
  • the Application 105 performs limited System Calibration by Triangulation Frame of Reference 103 ( FIG. 1 ).
  • the Application 105 performs limited System Calibration by Point of Reference object 107 ( FIG. 1 ).
  • the Application 105 performs limited System Calibration by Target Object 3D Scan. 113 ( FIG. 1 ).
  • the Application 105 returns to the Application 105 home screen ( FIG. 1 ) to input a Project Name.
  • a photo image of the project is then added from a limited source file on the Computing Device 100 .
  • the User may select an existing image (step 345 ) or else capture a new photo image (step 340 ).
  • the User captures a new photo image.
  • a photo image may be captured by, but not limited to; a camera device which is intrinsic to the System Mobile Device 100 or other mobile device such as a cellular phone or computing tablet; a camera device which is independent of described system hardware or a scanning device which is independent of described system hardware.
  • the photo image may be transferred to the system Mobile Computing Device 100 by way of but not limited to; standard wireless or hardwire internet connectivity; standard device-to-device direct wireless or hardwired connectivity.
  • the Application 105 then proceeds to step 350 .
  • the User selects an existing photo image. If Select Existing Photo is chosen, the photo may be selected from a local file on the Computing Device 100 only.
  • the Application 105 proceeds to step 350 .
  • the User inputs Photo Image Dimensions by selecting the dimension to be measured from a user interface, then touching a Computing Device 100 screen and “drawing” the length of the dimension being measured. The User may first touch multiple points around the perimeter of a hole or curved object, then connect the touch points by drawing between them.
  • step 355 the User is prompted to Go Online. If “no” is answered, then the operation ends, project information is saved locally, and the Application 105 returns to the Home screen. If “yes” is answered, the Application proceeds to step 360 .
  • step 360 Define Photo Image is a forced command. This means that no further processing will occur online until the project image has been defined as outlined previously in step 253 .
  • Sub-process A ( FIG. 3 ) completes.
  • the Main Web Server is now accessed and enters Sub-process F ( FIG. 4 ).
  • Sub-process F accesses both the Image Recognition Server 190 ( FIG. 1 ) and the Image Recognition RDB 193 ( FIG. 1 ) as well as the System Processes Server 155 ( FIG. 1 ) and Project Information RDB 160 ( FIG. 1 ).
  • step 400 may be entered from either step 253 ( FIG. 2B ) or else from step 365 ( FIG. 3 , Sub-process A).
  • the defined (tagged) Photo Image is received at the Main Web Server 110 ( FIG. 1 ).
  • the Main Web Server identifies the tagged Photo Image data ( 196 , 199 ), and forwards it to the Image Recognition Server 190 ( FIG. 1 ) and the Image Recognition RDB 193 ( FIG. 1 ) for processing and storage by Image Recognition software (steps 405 , 410 ).
  • the Main Web Server also forwards the tagged Photo Image to the System Processes Server 155 ( FIG. 1 ) for project processing (steps 415 , 420 ).
  • Image dimensional calculations are stored with other related project data in the Project Information RDB 160 ( FIG. 1 ).
  • step 405 the tagged Photo Image is identified and processed by Image Recognition software.
  • the tagged Photo Image is then stored in the Image Recognition RDB 193 (step 410 ). This builds the Image Recognition RDB 193 for future improvement and “smart” system functionality via Image Recognition software capabilities.
  • step 415 the tagged Photo Image is sent to the System Processes Server 155 ( FIG. 1 ) where name, definition and dimensional details are processed and stored for further calculation.
  • step 420 the tagged Photo Image is stored and joined with Project details in the Project Information RDB 160 , including Name Data 165 , Image Data 170 , and Dimensions Data 180 ( FIG. 1 ).
  • Sub-process A completes and exits from connector G and enters the main system flow from connector G at step 257 ( FIG. 2B ).
  • the Application 105 enters from connector H into step 500 .
  • the System Processes Server 155 retrieves recommended tools and materials posted in the selected Project Guide video.
  • the System Processes Server 155 retrieves project Dimensions Data 180 from the Project Information RDB 160 ( FIG. 1 ) and calculates anticipated tools and materials quantities based on selected Project Guide recommendations and actual project measurements.
  • the System Processes Server 155 accesses the Preferred Tool Vendor Web Server 125 ( FIG. 1 ) and the Tool SKU RDB 128 ( FIG. 1 ) to retrieve and list Preferred Tool Vendor products matching recommended items.
  • Sub-process H When Sub-process H is complete, it re-enters the main system through connector I at step 267 ( FIG. 2C ).
  • Embodiments of the invention may be practiced as methods, systems or devices. Accordingly, embodiments may assume the form of a hardware implementation, a firmware implementation, an entirely software implementation or an implementation combining software, firmware and hardware aspects. The detailed description here is, therefore, not to be taken in a limiting sense.
  • the present invention also relates to an apparatus for performing the operations herein.
  • This apparatus may be specially constructed for the required purposes, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer.
  • a computer program may be stored in a computer readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, magnetic or optical cards, application specific integrated circuits (ASICs), or any type of media suitable for storing electronic instructions, and each coupled to a computer system bus.
  • the computers referred to in the specification may include a single processor or may be architectures employing multiple processor designs for increased computing capability.
  • Embodiments of the present disclosure are described here with reference to block diagrams and/or operational illustrations of methods, systems, and computer program products according to embodiments of the present disclosure.
  • the functions/acts noted in the blocks may occur out of the order as shown in any flowchart.
  • two blocks shown in succession may in fact be executed substantially concurrent or the blocks may sometimes be executed in the reverse order, depending upon the functionality or procedures involved.
  • not all of the blocks shown in any flowchart need to be performed and/or executed. For example, if a given flowchart has five blocks containing functions or procedures, it may be the case that only three of the five blocks are performed and/or executed. In this example, any of the three of the five blocks may be performed and/or executed.
  • the mobile or desktop computing device 100 may include a WIFI or wired network interface.
  • the Computing Device 100 may consist of any of a variety of electronic devices including but not limited to mobile telephones, cellular telephones; PDA's equipped with communication capabilities, and mobile computers or palm computers and desktop personal computers with various wireless or wired communication capabilities.
  • the desktop Computing Device 100 may be comprised of any of the standard devices available including but not limited to devices which support the Apple, Microsoft, or Android operating systems with interfaces to the Internet.
  • the Computing Device 100 may also provide common mobile communication functions such as placing telephone calls, email and texting.

Abstract

The present invention is a method and system of small construction project management by way of photo imaging and measurement capture for use by do-it-yourselfers, handymen and small contractors. The method and system operates on mobile computing devices and includes an image recognition system. By performing various imaging based measurements and then processing the resultant data, the method and system produces bills of materials. invoices, and receipts for the necessary tools and materials required by a construction project.

Description

    CROSS-REFERENCE TO RELATED APPLICATION(S)
  • The present application claims the benefit of co-pending U.S. application Ser. No. 14/625,790 filed on Feb. 19, 2015, which claims the benefit of U.S. provisional application No. 61/942,162, filed on Feb. 20, 2014, the entire disclosure of which is incorporated by reference as if set forth in its entirety herein.
  • FIELD OF INVENTION
  • The present invention relates to a method and system for photo imaging and measurement, and more particularly, to a comprehensive small construction project management system.
  • BACKGROUND
  • Do-it-yourselfers, handymen and small contractors are frequently involved with small construction projects that require various raw tools and materials that need to be obtained for the projects. The purchasing process for these raw tools and materials may frequently require various precise measurements and calculations to determine the correct bill of materials, which includes the correct list of tools, and a determination of the required quantities of materials.
  • There is a need by do-it-yourselfers, handymen and small contractors for a photo imaging and measurement system operating on various computing devices, both mobile and desktop, that includes an an imaging recognition system. The photo imaging and measurement system should allow users to scan and input various data related to construction projects. The system when manipulated would then produce lists of required tools and materials based on the construction project data.
  • The present invention is a method and system of photo imaging and measurement for use by do-it-yourselfers, handymen and small construction contractors. By performing various imaging based measurements and then processing the resultant data, the method and system produces lists of tools and materials needed to complete project bills of materials, invoices, and receipts. The present invention accomplishes these objectives.
  • SUMMARY
  • A photo imaging and measurement Application (PIM-P Application) operates on a Computing Device. In some embodiments of the invention, the Computing Device may be a Mobile, Desktop, Laptop, or other CPU device. The Computing Device may comprise an iPhone, iPad, Android phone, Blackberry, Personal Computer, etc., but is not limited to these exclusive examples. In one embodiment of the invention, the PIM-P Application may be utilized in either offline mode or online mode.
  • In offline mode, login to and execution of the PIM-P Application occurs on the computing device. Once the Application is accessed, the default status of the system is “offline.” If the choice is made to remain offline, the Application prompts to perform “limited” system calibration local to the mobile/desktop computing device. In offline mode, images, measurements and data may be collected and stored locally on the Computing Device, but cannot be fully processed until the system status enters online mode and the various system servers are accessed.
  • If the choice is made to go “online,” connection to the internet is made through a Main Web Server which receives and directs data and processing requests to the various system servers and relational data bases. The PIM-P Application is now able to access and integrate with the various system servers and the functional software capabilities, which are the remote Software as a Service (SaaS) platform.
  • System calibration SaaS processing occurs in the “online” mode, when required data is collected on the Computing Device and relayed to the System Calibration Server via the Main Web Server. Data received and processed by the System Calibration Server is then stored in the System Calibrate RDB according to the calibration process used: either Frame of Reference; Point of Reference; or 3D Scan.
  • System processes and calculations (SaaS processing) occur in the “online” mode, when required data is collected on the Computing Device and relayed to the System Processes Server via the Main Web Server. Project Name, Photo Image, and Dimension measurements are processed by the System Processes Server, and then stored along with Project Guide URLs and Tools and Materials in the Project Information RDB.
  • On completing the initial processing of Project Information above, the system notifies the PIM-P Application locally on the Computing Device to select a Project Guide. Selecting a Project Guide link from the displayed list, accesses the Vendor eCommerce Site, via the Main Web Server and the Retail Vendor Web Server in order to view the Project Guide “How To” video. At this point, the Retail Vendor eCommerce Site remains visibly open and accessible to the user while other system processes are carried out by the other remote SaaS functions.
  • The selected Project Guide data and a system prompt to calculate tools and materials quantities are sent via the Main Web Server to the System Processes Server. Based on the Project Guide video selected, the System Processes Server retrieves the project Dimensions and the recommended Tools and Materials from the Project Information RDB to calculate required project Tools and Materials quantities lists. The Required Tools list prompts the System Process Server to access the Preferred Tool Vendor Web Server and Tool Sku RDB via the Main Web Server to retrieve and display in the Preferred Tool Vendor tools matching the Required Tools list, in the Application on the Computing Device. Required Tools and Materials are now selected for purchase on the Retail Vendor eCommerce Site in standard “Shopping Cart” and “Checkout” format.
  • Other features and advantages of the present invention will become apparent from the following more detailed description, taken in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of the invention. Both the foregoing general description and the following detailed description are explanatory only and are not restrictive of the non-limiting embodiments as claimed.
  • BRIEF DESCRIPTION OF THE DRAWING(S)
  • The foregoing Summary as well as the following detailed description will be readily understood in conjunction with the appended drawings which illustrate embodiments of the invention. In the drawings:
  • FIG. 1 is a system diagram depicting the system hardware, software and interfaces in accordance with an embodiment of the present invention;
  • FIG. 2A is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention;
  • FIG. 2B is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention;
  • FIG. 2C is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention;
  • FIG. 3 is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention;
  • FIG. 4 is a flowchart of a photo imaging and measurement application in accordance with an embodiment of the present invention;
  • FIG. 5 is a depiction of a photo imaging and measurement application in accordance with an embodiment of the present invention.
  • DETAILED DESCRIPTION
  • Exemplary embodiments of the present inventions are depicted in the various drawing figures. Embodiments may be implemented in many different forms and should not be construed as limited to the embodiments described here. Rather, these embodiments are described so that this disclosure will be thorough and complete, and will fully convey the scope of the embodiments to those skilled in the art.
  • FIG. 1 is a diagram depicting the system hardware and software in accordance with an embodiment of the present invention. A photo imaging and measurement Application 105 (PIM-P Application) operates on a Computing Device 100 which may be a Mobile, Desktop, Laptop, or other CPU device. The Computing Device 100 may comprise an iPhone, iPad, Android phone, Blackberry, Personal Computer, etc., but is not limited to these exclusive examples. The Computing Device 100 communicates with various networked servers via a wireless or hard-wired network interface.
  • The PIM-P Application 105 may be utilized in either offline mode or online mode. In offline mode, login to and execution of the PIM-P Application 105 occurs on the Computing Device 100. Once the Application 105 is accessed, the default status of the system is “offline.” If the choice is made to remain offline, the Application 105 prompts to perform “limited” system calibration local to the mobile/desktop computing device 100, thus producing Limited Frame of Reference Data 103; Limited Point of Reference Data 107; Limited 3D Scan Data 113. In offline mode, images, measurements and data may be collected and stored locally on the Computing Device 100, but cannot be fully processed until the system status enters online mode and the various system servers are accessed. If needed, information stored on the Computing Device 100 may be exported to other computing devices including standard desktop/laptop computing devices in standard file formats including but not limited to .jpg, .xls, .doc, .ppt, .csv, .pdf etc., once the system status is “online.”
  • In online mode login to and execution of the PIM-P Application 105 occurs on the Computing Device 100. Once the PIM-P Application 105 is accessed, the default status of the system is “offline.” If the choice is made to go “online,” connection to the internet is made through a Main Web Server 110 which receives and directs data and processing requests to the various system servers (130, 155, 190) and relational data bases (135, 160, 193). The PIM-P Application 105, local to the Computing Device 100, is now able to access and integrate with the various system servers (130,155, 190) and the functional software capabilities. The Application 105 executes on the mobile device, while the remote system servers (130, 155, 190) function as a Software as a Service (SaaS) platform. Once the system status is online, any previously collected and stored calibration data, images, measurements etc. local to the Computing Device 100 will be automatically processed by the appropriate server and joined in the corresponding RDB.
  • System calibration SaaS processing occurs in the “online” mode, when required data is collected on the Computing Device 100 and relayed to the System Calibration Server 130 via the Main Web Server 110. Data received and processed by the System Calibration Server 130 is then stored in the System Calibrate RDB 135 according to the calibration process used: either Frame of Reference 140; Point of Reference 145; or 3D Scan 150.
  • System processes and calculations (SaaS processing) occur in the “online” mode, when required data is collected on the Computing Device 100 and relayed to the System Processes Server 155 via the Main Web Server 110. Project Name 165, Photo Image 170 and Dimension measurements 180 are processed by the System Processes Server 155 and then stored along with Project Guide URLs 185 and Tools and Materials 187 in the Project Information RDB 160.
  • On completing the initial processing of Project Information above, the system notifies the PIM-P Application 105 locally on the Computing Device 100 to select a Project Guide. The System Processes Server 155 points to the URLs 185 in the Project Information RDB 160 and displays in the PIM-P Application 105 on the Computing Device 100, the list of Project Guide “How To” video links that correspond to the Project Name Data 165 and Photo Image Data 170. Selecting a Project Guide link from the displayed list accesses the Vendor eCommerce Site 120, via the Main Web Server 110 and the Retail Vendor Web Server 115 in order to view the Project Guide video. At this point, the Retail Vendor eCommerce Site 120 remains visibly open and accessible to the user while other system processes are carried out by the other remote SaaS functions.
  • A Project Guide “How To” video is selected and confirmed in the Application 105, for processing use. The selection of a Project Guide video prompts the system to calculate tools and materials quantities. The prompt is sent via the Main Web Server 110 to the System Processes Server 155. Based on the Project Guide video selected, the System Processes Server 155 retrieves the project Dimensions 180 and the recommended Tools and Materials 187 from the Project Information RDB 160 to calculate required project Tools and Materials 187 quantity lists. The Required Tools 187 list prompts the System Process Server 160 to access the Preferred Tool Vendor Web Server 125 and Tool SKU RDB 128 via the Main Web Server 110 to retrieve and display in the Preferred Tool Vendor products matching the Required Tools 187 list, in the Application 105 on the Computing Device 100.
  • Required Tools and Materials are now selected for purchase on the Retail Vendor eCommerce Site 120 in standard “Shopping Cart” and “Checkout” format.
  • Image Recognition SaaS processing occurs in the “online” mode, when required image and tag data are collected on the Computing Device 100 and relayed to the Image Recognition Server 190 via the Main Web Server 110. An Object Image 196 and Object Image Tag 199 are processed by the Image Recognition Server 155 and Image Recognition software then joined in the Image Recognition RDB 193.
  • FIG. 2A illustrates a flowchart of the photo imaging and measurement application. In step 200, the user logs in with user name and password to the PIM-P user interface application 105 executing on the Computing Device 100. In step 203, after user login, the PIM-P application 105 Home screen appears.
  • In step 205, the Home screen presents the option to Go Online (Yes or No). Default is off-line. If Online is selected, processing continues at step 207. If Offline is selected, processing continues at connector A. At step 207, the Main Web Server 110 is accessed. In step 213, The Main Web Server 110 (FIG. 1), automatically passes control to the System Calibration Server 130 (FIG. 1) and System Calibrate RDB 135 (FIG. 1) to perform one or more selected System Calibration procedure(s) (210, 220, 225). In some embodiments, the User may choose one System Calibration procedure (210, 220, 225). In other embodiments, the User may utilize a combination of System Calibration procedures (210, 220, 225). At step 215, the User chooses the system calibration procedure(s) (210, 220, 225).
  • In step 210, the System Calibration Server 130 performs System Calibration by Triangulation Frame of Reference 210. In step 220, the System Calibration Server 130 performs System Calibration by Reference Object Point of Reference 220. In step 225, the System Calibration Server 130 performs System Calibration by Target Object 3D Scan 225.
  • In step 227, on completion of System Calibration, the Application 105 returns to the PIM-P Application 105 Home screen to input the Project Name. Saving the Project Name sends information top the System Processes Server 155 (FIG. 1) and Project Information RDB 160 (FIG. 1). In step 230, on completion of Project Name, a photo image of the project is then added by either Capture New Photo Image 240 (FIG. 2B) or else Select Existing Photo Image 233.
  • Referring to FIG. 2B, in step 240, a new photo image is captured and saved, and processing continues at step 243. A photo image may be captured by various devices including but not limited to a camera device intrinsic to the System Mobile Device 100, another mobile device such as a cellular phone or a computing tablet, a camera device independent of the disclosed system hardware, or a scanning device which is independent of the disclosed system hardware. The photo image may be transferred to the system Mobile Computing Device 100 by multiple methods including but not limited to; standard wireless or wired Internet connectivity, standard device-to-device direct wireless or hardwired connectivity. The new photo image is saved to the System Processes Server 155 (FIG. 1) and Project Information RDB 160 (FIG. 1).
  • In step 233, an existing photo image is selected. If Select Existing Photo is chosen, the photo may be selected from a local file on the mobile computing device, or selected from the System Processes Server 155 (FIG. 1) and Project Information RDB 160 (FIG. 1). Processing now continues at step 243 (FIG. 2B).
  • In FIG. 2B, (step 243), once a photo image is selected, the Application 105 determines if the Photo Image Dimensions are entered. If the Photo Image Dimensions are entered, then the Application continues at step 250. If the Photo Image Dimensions are not entered, the Application 105 proceeds to step 247. In step 247, Photo Image Dimensions are inputted by selecting a dimension to be measured from a User Interface, then touching a display and “drawing” the length of the dimension being measured. The user may perform multiple touches around the perimeter of a hole or curved object, and then connect the touch points by drawing between them. This will identify to the system that the object being measured is other than a straight line. Completing and saving the image dimensions sends the information to the System Processes Server 155 (FIG. 1) and Project Information RDB 160 (FIG. 1).
  • In step 250, after completing dimensions capture, from the Home screen, the image will be defined. If Photo Image is defined, the Application 105 proceeds to step 257. If Photo Image is not defined, the Application proceeds to step 253. In step 253, Define Photo Image means something like “hole” for a hole in a wall or “P-trap” for the plumbing trap under a sink. This Photo Image definition also tags the image for use by the Image Recognition Server 190 (FIG. 1) and Image Recognition RDB 193 (FIG. 1). The defined photo is saved as Photo Image Data 170 in the Project Information RDB 160 (FIG. 1). Once the Photo Image has been defined, the Application 105 proceeds through connector F. Saving the image definition sends the information to the Image Recognition Server 190 (FIG. 1) and the Image Recognition RDB 193 (FIG. 1) via connector F as well as the System Processes Server 155 (FIG. 1) and Project Information RDB 160 (FIG. 1).
  • In step 257, the User is prompted to select a Project Guide “How To” video. A Project Guide “How To” video is maintained on the Retail Vendor eCommerce Site 120 and portrays methods, tools and materials to be utilized for completing the project, in the video being viewed for selection. In step 257, the user is prompted to select a Project Guide. At this time, the combination of the Project Name Data 165 and Photo Image data 170 points the system to the appropriate Project Guide URL links 185 (FIG. 1) in the Project Information RDB which when displayed and selected on the Mobile Computing Device 100, then accesses the retail vendor's “How To” videos via the Main Web Server, 110 (FIG. 1), the Retail Vendor Web Server 155 (FIG. 1) and the Retail Vendor eCommerce Site 120 (FIG. 1). If a Project guide is selected, the Application 105 proceeds to step 263 and continues at connector H. If no Project Guide is selected, the Application 105 proceeds to step 260.
  • Selecting a Project Guide “How To” video from the Retail Vendor eCommerce Site prompts the System Processes Server 155 (FIG. 1) to Calculate Tools and Materials Quantities 263. The Application 105 then proceeds through connector H. In step 260, no Project Guide has been selected. Based on calculations external to the system, anticipated tools and material quantities are manually entered and saved to the system. Saving this information sends it to the System Process Server 155 (FIG. 1) and the Project Information RDB 160 (FIG. 1).
  • Referring to FIG. 2C, the Application enters step 267 from connector I, or else it enters step 270 from connector E. In step 267, the Application 105 displays system-calculated materials and preferred tools lists. In step 270, using the system-calculated materials and tools requirements or the manually entered tools and materials list, the System Process Server 155 (FIG. 1) directs the Main Web Server 110 (FIG. 1) to the Retail Vendor Web Server 115 (FIG. 1) and Retail Vendor eCommerce Site 120 (FIG. 1). Tools and materials are selected and added to the Shopping Cart 270 and Checked Out 273, on the Retail Vendor eCommerce site 120 (FIG. 1). The purchase is completed using an appropriately aligned Vendor Credit account or an independent Credit Card. The project is then saved on the Mobile Computing Device 100, and Project Information Server 160. In step 276, an electronic receipt is transmitted from the Vendor eCommerce site 120. The Application 105 main system process now ends. The Application 105 main system process now ends.
  • Referring to FIG. 3, the Application 105 flow enters from connector A while in Off-line mode. In step 310, while Off-line, the PIM-P Application 105 provides limited calibration capability, local to the Computing Device 100 ( steps 315, 320, 325). At step 310, the User chooses one or more system calibration procedures ( steps 315, 320, 325). In step 315, the Application 105 performs limited System Calibration by Triangulation Frame of Reference 103 (FIG. 1). In step 320, the Application 105 performs limited System Calibration by Point of Reference object 107 (FIG. 1). In step 325, the Application 105 performs limited System Calibration by Target Object 3D Scan. 113 (FIG. 1). In step 330, on completion of limited System Calibration, the Application 105 returns to the Application 105 home screen (FIG. 1) to input a Project Name.
  • In step 335, on completion of Project Name input (step 330), a photo image of the project is then added from a limited source file on the Computing Device 100. The User may select an existing image (step 345) or else capture a new photo image (step 340). In step 340, the User captures a new photo image. A photo image may be captured by, but not limited to; a camera device which is intrinsic to the System Mobile Device 100 or other mobile device such as a cellular phone or computing tablet; a camera device which is independent of described system hardware or a scanning device which is independent of described system hardware. The photo image may be transferred to the system Mobile Computing Device 100 by way of but not limited to; standard wireless or hardwire internet connectivity; standard device-to-device direct wireless or hardwired connectivity. The Application 105 then proceeds to step 350. In step 345, the User selects an existing photo image. If Select Existing Photo is chosen, the photo may be selected from a local file on the Computing Device 100 only. The Application 105 proceeds to step 350. In step 350, the User inputs Photo Image Dimensions by selecting the dimension to be measured from a user interface, then touching a Computing Device 100 screen and “drawing” the length of the dimension being measured. The User may first touch multiple points around the perimeter of a hole or curved object, then connect the touch points by drawing between them. This will identify to the system that the object being measured is other than a straight line. These dimensions will be saved locally on the Computing Device 100 until the Computing Device 100 is connected online to the System Processes Server 155 (FIG. 1) and Project Information Database 160 (FIG. 1).
  • In step 355, the User is prompted to Go Online. If “no” is answered, then the operation ends, project information is saved locally, and the Application 105 returns to the Home screen. If “yes” is answered, the Application proceeds to step 360. In step 360, Define Photo Image is a forced command. This means that no further processing will occur online until the project image has been defined as outlined previously in step 253.
  • In step 365, once an image is defined Sub-process A (FIG. 3) completes. The Main Web Server is now accessed and enters Sub-process F (FIG. 4). Sub-process F accesses both the Image Recognition Server 190 (FIG. 1) and the Image Recognition RDB 193 (FIG. 1) as well as the System Processes Server 155 (FIG. 1) and Project Information RDB 160 (FIG. 1).
  • Referring to FIG. 4, step 400 may be entered from either step 253 (FIG. 2B) or else from step 365 (FIG. 3, Sub-process A). The defined (tagged) Photo Image is received at the Main Web Server 110 (FIG. 1). The Main Web Server identifies the tagged Photo Image data (196, 199), and forwards it to the Image Recognition Server 190 (FIG. 1) and the Image Recognition RDB 193 (FIG. 1) for processing and storage by Image Recognition software (steps 405, 410). The Main Web Server also forwards the tagged Photo Image to the System Processes Server 155 (FIG. 1) for project processing (steps 415, 420). Image dimensional calculations are stored with other related project data in the Project Information RDB 160 (FIG. 1).
  • In step 405, the tagged Photo Image is identified and processed by Image Recognition software. The tagged Photo Image is then stored in the Image Recognition RDB 193 (step 410). This builds the Image Recognition RDB 193 for future improvement and “smart” system functionality via Image Recognition software capabilities.
  • In step 415 the tagged Photo Image is sent to the System Processes Server 155 (FIG. 1) where name, definition and dimensional details are processed and stored for further calculation. In step 420, the tagged Photo Image is stored and joined with Project details in the Project Information RDB 160, including Name Data 165, Image Data 170, and Dimensions Data 180 (FIG. 1). Once the System Processes Server 155 image processing is complete, Sub-process A completes and exits from connector G and enters the main system flow from connector G at step 257 (FIG. 2B).
  • Referring to FIG. 5, the Application 105 enters from connector H into step 500. In step 500 the System Processes Server 155 (FIG. 1) retrieves recommended tools and materials posted in the selected Project Guide video. In step 505 the System Processes Server 155 (FIG. 1) retrieves project Dimensions Data 180 from the Project Information RDB 160 (FIG. 1) and calculates anticipated tools and materials quantities based on selected Project Guide recommendations and actual project measurements. In step 510, based on a recommended tools list, the System Processes Server 155 (FIG. 1) accesses the Preferred Tool Vendor Web Server 125 (FIG. 1) and the Tool SKU RDB 128 (FIG. 1) to retrieve and list Preferred Tool Vendor products matching recommended items. When Sub-process H is complete, it re-enters the main system through connector I at step 267 (FIG. 2C).
  • Embodiments of the invention may be practiced as methods, systems or devices. Accordingly, embodiments may assume the form of a hardware implementation, a firmware implementation, an entirely software implementation or an implementation combining software, firmware and hardware aspects. The detailed description here is, therefore, not to be taken in a limiting sense.
  • Unless specifically stated otherwise here, it is intended that throughout the description, terms such as “processing” or “computing” or “calculating” or “determining” or “displaying” or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system memories or registers or other such information storage, transmission or display devices.
  • The present invention also relates to an apparatus for performing the operations herein. This apparatus may be specially constructed for the required purposes, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a computer readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, magnetic or optical cards, application specific integrated circuits (ASICs), or any type of media suitable for storing electronic instructions, and each coupled to a computer system bus. Furthermore, the computers referred to in the specification may include a single processor or may be architectures employing multiple processor designs for increased computing capability.
  • The processes and displays presented herein are not inherently related to any particular computer or other apparatus. General-purpose systems may be used with programs in accordance with the disclosure here, or more specialized apparatus may be utilized to perform the required method steps.
  • In addition, the present invention is not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any references to specific languages are provided for disclosure of enablement and best mode of the present invention.
  • Embodiments of the present disclosure are described here with reference to block diagrams and/or operational illustrations of methods, systems, and computer program products according to embodiments of the present disclosure. The functions/acts noted in the blocks may occur out of the order as shown in any flowchart. For example, two blocks shown in succession may in fact be executed substantially concurrent or the blocks may sometimes be executed in the reverse order, depending upon the functionality or procedures involved. Additionally, not all of the blocks shown in any flowchart need to be performed and/or executed. For example, if a given flowchart has five blocks containing functions or procedures, it may be the case that only three of the five blocks are performed and/or executed. In this example, any of the three of the five blocks may be performed and/or executed.
  • The mobile or desktop computing device 100 may include a WIFI or wired network interface. The Computing Device 100 may consist of any of a variety of electronic devices including but not limited to mobile telephones, cellular telephones; PDA's equipped with communication capabilities, and mobile computers or palm computers and desktop personal computers with various wireless or wired communication capabilities. The desktop Computing Device 100 may be comprised of any of the standard devices available including but not limited to devices which support the Apple, Microsoft, or Android operating systems with interfaces to the Internet. In addition to supporting the functionality of the present invention, the Computing Device 100 may also provide common mobile communication functions such as placing telephone calls, email and texting.
  • While embodiments of the invention have been described in detail above, the invention is not limited to those specific variations. The ascribed invention descriptions should be considered as merely exemplary illustrations set forth for a clear understanding of the principles of the invention. Further variations, modifications, extensions, or equivalents of the invention may be developed without departing from the scope of the invention. It is therefore intended that the invention not be limited to the particular embodiments disclosed as the best mode contemplated for carrying out this invention, but that the invention will include all the embodiments falling within the scope of the appended claims.

Claims (14)

What is claimed is:
1. A computerized method for providing construction project management, the method comprising:
receiving project data for a project from a remote device running a project management application, wherein the project data includes a project name and at least one image with dimension information;
identifying a list of project information guides for the project based on at least one of the project name, image and dimension information;
communicating the list of project information guides to the project management application and receiving back a selected project information guide;
calculating required construction tools and materials for the project based on the selected project information guide and dimension information; and
providing a point of sale interface accessible by the project management application for purchasing required construction tools and materials from an eCommerce vendor.
2. The method of claim 1, wherein receiving project data comprises receiving project data in a project information relational database.
3. The method of claim 1, wherein said project data further comprises:
one or more project information guide web site addresses;
one or more tools; and
one or more materials.
4. The method of claim 1, wherein identifying a list of project information guides comprises:
analyzing project name data and the at least one image with dimension data;
searching for URLs based on the analyzing;
forwarding a list of project guide video URLs to the project management application; and
receiving a selected project guide video URL.
5. The method of claim 1, further including inputting manually tools lists and materials lists from the project management application.
6. The method of claim 1, further comprising: performing photo image recognition, including:
acquiring one or more photo images;
identifying said photo images; and
tagging said photo images.
7. The method of claim 1, wherein calculating required construction tools and required materials comprises:
receiving recommended tools and recommended materials from said project information guides;
receiving project dimensions data; and
calculating required construction tools and materials.
8. The method of claim 1, wherein providing a point of sale interface for purchasing required construction tools and required materials comprises:
accessing a vendor eCommerce web server via network communications;
selecting required tools and required materials on said vendor eCommerce web server and communicating selected tools and materials to the project management application;
facilitating a transaction on said vendor eCommerce web server;
transmitting a transaction receipt to the project management application.
9. The method of claim 1, wherein said dimension information includes calibration information.
10. A computer program product stored on a computer readable storage medium, which when executed by a computer system provide construction project management, the computer program product comprising:
program code for receiving project data for a project from a remote device running a project management application, wherein the project data includes a project name and at least one image with dimension information;
program code identifying a list of project information guides for the project based on at least one of the project name, image and dimension information;
program code for communicating the list of project information guides to the project management application and receiving back a selected project information guide;
program code for calculating required construction tools and materials for the project based on the selected project information guide and dimension information; and
program code for providing a point of sale interface accessible by the project management application for purchasing required construction tools and materials from an eCommerce vendor.
11. The computer program product of claim 10, wherein the program code for identifying a list of project information guides comprises:
program code for analyzing project name data and the at least one image with dimension data;
program code for searching for URLs based on the analyzing;
program code for forwarding a list of project guide video URLs to the project management application; and
program code for receiving a selected project guide video URL.
12. The computer program product of claim 10, further comprising: program code for performing photo image recognition, including program code for:
acquiring one or more photo images;
identifying said photo images; and
tagging said photo images.
13. The computer program product of claim 10, wherein the program code for calculating required construction tools and required materials comprises program code for:
receiving recommended tools and recommended materials from said project information guides;
receiving dimension data; and
calculating required construction tools and materials.
14. The computer program product of claim 10, wherein program code for providing a point of sale interface for purchasing required construction tools and required materials comprises program code for:
accessing a vendor eCommerce web server via network communications;
selecting required tools and required materials on said vendor eCommerce web server and communicating selected tools and materials to the project management application;
facilitating a transaction on said vendor eCommerce web server; and
transmitting a transaction receipt to the project management application.
US16/742,094 2014-02-20 2020-01-14 Method and system for construction project management using photo imaging measurements Abandoned US20200151937A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US16/742,094 US20200151937A1 (en) 2014-02-20 2020-01-14 Method and system for construction project management using photo imaging measurements
US17/183,704 US20210183128A1 (en) 2014-02-20 2021-02-24 Method and system for construction project management using photo imaging measurements

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201461942162P 2014-02-20 2014-02-20
US14/625,790 US10540801B1 (en) 2014-02-20 2015-02-19 Method and system for construction project management using photo imaging measurements
US16/742,094 US20200151937A1 (en) 2014-02-20 2020-01-14 Method and system for construction project management using photo imaging measurements

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/625,790 Continuation US10540801B1 (en) 2014-02-20 2015-02-19 Method and system for construction project management using photo imaging measurements

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/183,704 Continuation-In-Part US20210183128A1 (en) 2014-02-20 2021-02-24 Method and system for construction project management using photo imaging measurements

Publications (1)

Publication Number Publication Date
US20200151937A1 true US20200151937A1 (en) 2020-05-14

Family

ID=69167203

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/625,790 Active 2038-05-18 US10540801B1 (en) 2014-02-20 2015-02-19 Method and system for construction project management using photo imaging measurements
US16/742,094 Abandoned US20200151937A1 (en) 2014-02-20 2020-01-14 Method and system for construction project management using photo imaging measurements

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/625,790 Active 2038-05-18 US10540801B1 (en) 2014-02-20 2015-02-19 Method and system for construction project management using photo imaging measurements

Country Status (1)

Country Link
US (2) US10540801B1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111311206B (en) * 2020-05-11 2020-09-18 温州开晨科技有限公司 Construction project ternary space relationship construction method, system and medium
WO2022149071A1 (en) * 2021-01-05 2022-07-14 Ron Zass Capturing and analysis of construction site images

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060015475A1 (en) 2000-10-25 2006-01-19 Birkner Charles C Integrated construction project management system with handheld computer and checklist
US7283975B2 (en) 2001-02-05 2007-10-16 Broughton W Curtis System and method for tracking and managing construction projects
US20020198755A1 (en) 2001-06-22 2002-12-26 Birkner Charles Christian Integrated quality assurance control system to manage construction projects
US7409392B2 (en) 2002-08-16 2008-08-05 Gcc, Inc. System and method for managing construction projects
US7835934B2 (en) 2003-05-21 2010-11-16 Warranty Management Technologies LLC System and method of work management
US7262783B2 (en) * 2004-03-03 2007-08-28 Virtual Iris Studios, Inc. System for delivering and enabling interactivity with images
US20110096174A1 (en) * 2006-02-28 2011-04-28 King Martin T Accessing resources based on capturing information from a rendered document
US8368749B2 (en) * 2006-03-27 2013-02-05 Ge Inspection Technologies Lp Article inspection apparatus
US7467222B2 (en) * 2006-05-12 2008-12-16 Shutterfly, Inc. Image ranking for imaging products and services
US8830239B2 (en) 2008-04-21 2014-09-09 Saleemz Holdings Pty Ltd Materials management system and method
US20100191611A1 (en) 2009-01-27 2010-07-29 Janos Biro Portable electronic construction estimator
US20100198652A1 (en) 2009-01-30 2010-08-05 Exact Logix Inc System for the Management of Construction Projects
EP2406767A4 (en) * 2009-03-12 2016-03-16 Google Inc Automatically providing content associated with captured information, such as information captured in real-time
US10332176B2 (en) * 2014-08-28 2019-06-25 Ebay Inc. Methods and systems for virtual fitting rooms or hybrid stores
US9026242B2 (en) * 2011-05-19 2015-05-05 Taktia Llc Automatically guided tools
US20130061142A1 (en) * 2011-09-07 2013-03-07 Solarcity Corporation Systems and Methods for Mobile Design Automation
US9152934B2 (en) 2011-11-22 2015-10-06 Ebidletting.Com Arrangements for administrating and managing a construction project
US9817839B2 (en) 2011-11-29 2017-11-14 Trimble Inc. Managing information at a construction site
WO2013096704A1 (en) * 2011-12-20 2013-06-27 Sadar 3D, Inc. Systems, apparatus, and methods for acquisition and use of image data
US20140095133A1 (en) * 2012-09-28 2014-04-03 General Electric Company Systems and methods for managing mechanical systems and components
US9336629B2 (en) * 2013-01-30 2016-05-10 F3 & Associates, Inc. Coordinate geometry augmented reality process
US10387807B2 (en) * 2013-03-11 2019-08-20 Transform Sr Brands Llc Systems and methods for providing and accessing visual product representations of a project
US9081917B2 (en) * 2013-03-14 2015-07-14 United States Infrastructure Management Company Systems and methods for advanced sanitary sewer infrastructure management
US20150120389A1 (en) * 2013-10-25 2015-04-30 Bluejay Mobile-Health, Inc. Interactive Guide Creation, Feedback Collection, And Management
CN104574454B (en) * 2013-10-29 2020-06-02 阿里巴巴集团控股有限公司 Image processing method and device
US20160300293A1 (en) * 2013-11-19 2016-10-13 Ron Nagar Device, system and method for designing a space
US20150186965A1 (en) * 2013-12-27 2015-07-02 Salsberg Paul Computerized device, system, and method for coordinating an outfit
US9299013B1 (en) * 2014-03-27 2016-03-29 Amazon Technologies, Inc. Visual task feedback for workstations in materials handling facilities
US10529009B2 (en) * 2014-06-25 2020-01-07 Ebay Inc. Digital avatars in online marketplaces
US20160042402A1 (en) * 2014-08-07 2016-02-11 Akshay Gadre Evaluating digital inventories
US20160226308A1 (en) * 2015-02-02 2016-08-04 David Valin Wall Paneling Construction Smart Apparatus and System

Also Published As

Publication number Publication date
US10540801B1 (en) 2020-01-21

Similar Documents

Publication Publication Date Title
US20210183128A1 (en) Method and system for construction project management using photo imaging measurements
US9773235B2 (en) Systems and methods facilitating in-aisle scanning
US10643267B2 (en) Retail purchasing computer system and method of operating same
US20200202362A1 (en) Nfc-based options selection
US20210333861A1 (en) Hands-free gestures for account authentication
US20220414753A1 (en) Systems and methods for location sensing for purchases
US20170177656A1 (en) Systems and methods for resolving data discrepancy
US11587151B1 (en) Seamless user retail experience based on location
US20200151937A1 (en) Method and system for construction project management using photo imaging measurements
US9646295B1 (en) Handsfree point-of-sale
US10567915B2 (en) System and methods of searching for an object using hyper-local location techniques
US20170220765A1 (en) System, method, and non-transitory computer-readable storage media for mobile check-out in retail store
US9569800B2 (en) Paperless receipt device
US10627977B2 (en) Systems, devices, and methods for distributed processing for preauthorized payment
KR101898279B1 (en) Payment method and system
US11593857B1 (en) Systems and methods for improving a shopping experience within a retail store
KR20160041102A (en) Coffee order system using the smart phone
AU2016338946A1 (en) Systems and methods for transactional document processing
US11354497B2 (en) Method and apparatus for servicing webpage requests
KR102425408B1 (en) Method, Apparatus and System of analyzing and processing data of online shopping
US20150339751A1 (en) Dynamic pricing model
US20160117664A1 (en) Systems and methods for associating object movement with a predetermined command for application in a transaction
KR20220070645A (en) System for recommending company based preference of user
KR20160046427A (en) Apparatus and method for ordering goods using near field communication
US20180165624A1 (en) Systems, devices, and methods for providing interactive pharmacy services

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION