WO2022255995A1

WO2022255995A1 - Augmented reality drilling, completion and production visualization system and synergy method based on holographic projection

Info

Publication number: WO2022255995A1
Application number: PCT/US2021/035325
Authority: WO
Inventors: Qijun ZENG; Dengpan XIE; Yuan Gao
Original assignee: Vertechs Energy Solutions Llc
Priority date: 2021-06-02
Filing date: 2021-06-02
Publication date: 2022-12-08

Abstract

An AR drilling, completion and production visualization system based on holographic projection and a synergy method are provided. The AR holographic projection based drilling, completion and production visualization system includes field data warehouse, networks, models engine, AR engine, and equipment which has industrial PC, society network infrastructure, and AR apparatus. The data warehouse provides the underneath input to the system, and models engine provides hydraulic calculation model, equipment failure analysis model, and event & accident identification model. The AR holographic projection provides real-time drilling, completion and production information in intuitionistic way to any users who have networks and wearable devices. Compared to current AR which combines real-world with virtual world by video capturing, AR holographic projection system only focus on real-time visualization and synergy with stakeholders, and is simple in system and convenient for setup thus has an extremely high practical value and improved cost-efficiency.

Description

AUGMENTED REALITY DRILLING, COMPLETION AND PRODUCTION VISUALIZATION SYSTEM AND SYNERGY METHOD BASED ON HOLOGRAPHIC PROJECTION

TECHNICAL FIELD

[0001] The present invention relates to the technical field of operations digitalization in the petroleum and natural gas industry, and in particular to, an integrated drilling, completion and production visualization system.

BACKGROUND

[0002] Augmented reality (AR) holographic projection may focus on mirroring real world upon computer-generated data, for example, by projecting augmentation information with real-world status for the intuitionistic display to end users, generally in real or near-real time. Today, the scope of AR holographic projection may be expanded to broad application areas, such as digital twins of operations, training, and entertainment to name a few. As such, there may be increasing interest in providing seamless projection of augmentation information with real-world scenes.

[0003] However, AR may present challenges such as new challenges for end user experience, and in particular, for appropriately displaying the augmentation information especially in view of its use with wearable devices or computers. Further, current methods or techniques for displaying data on such devices, unfortunately, may not be suitable or thought out in the petroleum and natural gas industry. For example, current methods or techniques for displaying augmentation information on wearable devices may be arbitrary, may display or provide an excessive amount of information from the augmentation that may overwhelm a user, and/or the like. US 2011/164163 A1 discloses an augmented reality device which can receive live video of a real-world, physical environment on a touch sensitive surface. One or more objects can be identified in the live video. An information layer can be generated related to the objects including annotations made by a user through the touch sensitive surface. The information layer and live video can be combined in a display of the device. US 2014/058319 discloses a computer program products for providing an AR display and/or user interface which combines real-world video and a virtual object for presenting augmentation information in connection with a region of the real world video of interest ("region of interest") to a user. The AR display limited target region with the option of adding attendant augmentation information. Both stressed the combination of augmentation information and real-world, while augmentation information self is quite valuable to enhance drilling efficiency and improve safety performance in the petroleum and natural gas industry. Extensive data flow of videos and field mapping bring high risks of overloading the wearable devices for end users. SUMMARY

[0004] An object of the present invention is to provide an AR holographic projection based drilling, completion and production visualization system, that addresses problems presented in the prior part, namely, overwhelmed AR information to a user, abstract drilling, completion and production information in field which hindered informative decisions, complicated apparatus, and, relatively high cost. The AR holographic projection is able to provide real-time drilling, completion and production information in intuitionistic way to any users who have networks and wearable devices. Moreover, it is simple in system and convenient for setup thus has an extremely high practical value and improved cost-efficiency.

[0005] Another object of the present invention is to provide a synergy method, that addresses problems presented at current drilling, completion and production site in the petroleum and natural gas industry, for examples, limited experts working at site for increasing challenged operations especially in accidents, and communication difficulties to quick put stakeholders in one page at emergency scenarios in regular video and/or voice discussion, thus result in late decision-making and are prone to aggravating emergency, and misunderstanding of operations and are prone to leading to time-consuming and even wrong decisions.

[0006] A further object of the present invention is to provide a playback of drilling, completion and production operations in varied speed, addresses problems of losing 1^st hand operations data, i.e., staff positions in key operations, equipment status, orders implementation status, and operations parameters.

[0007] A further object of the present invention is to provide a training system with actual data, that addresses problems of simulation training in terms of operations and safety, namely, revealing actual accidents scenarios to test operators’ competences, and repeating high level of operations as benchmarks for operators to follow.

[0008] In order to achieve the above objects, the present invention adopts the following technical solutions.

[0009] The AR holographic projection based drilling, completion and production visualization system includes field data warehouse, networks, models engine, AR engine, and equipment which has industrial PC, society network infrastructure, and AR apparatus, wherein the data warehouse provides the underneath input to the system, and models engine provides hydraulic calculation model, equipment failure analysis model, and event & accident identification model.

[0010] A synergy method relies on AR apparatus which display dynamic field models, including but not limited to field equipment, sensors and subsurface well status, such as wellbore trajectory and lithological information beyond region limits through networks, wherein dynamic field models reflect real-time field operations and may be updated by one user adjustments. Meanwhile, dynamic field models provide forecasting of varied plans which help evaluate decisions instantly.

[0011] Preferably, the operations playback includes forwards and backwards way in adjustable speeds, wherein the former is to capture lessons learned and the later is to locate reasons of accidents or emergency situations. Meanwhile, playback mode may distinguish varied operations line, for example, drilling operation, casing operation, cementing operation, pressure test operation.

[0012] The training mode includes operations module and safety module, wherein operations module focuses on providing guidelines of best practices in production time and non-production time, and safety module stresses safety procedures & behaviors and “don’t” lessons to operators. All above is based on simulation of actual data with necessary amendments.

[0013] Preferably, all the system presents augmentation information generated from data warehouse and attendant augmentation information from new sources.

BRIEF DESCRIPTION OF THE DRAWINGS

[0014] FIG. 1 is a structural diagram of AR holographic projection based drilling, completion and production visualization system;

[0015] FIG. 2 is a structural diagram of a dynamic drilling field model;

[0016] FIG. 3 is a dynamic model of blow-out-preventor in AR holographic projection based drilling, completion and production visualization system;

[0017] FIG. 4 is a side view of the dynamic model of top drive in drilling field;

[0018] FIG. 5 is 3D view of the dynamic model of wellbore trajectories with production zone

[0019] FIG. 6 is a downhole bit view of drilling operations;

[0020] FIG. 7 is a block diagram illustrating an example of an AR holographic projection based drilling, completion and production visualization system;

DETAILED DESCRIPTION

[0021] The present invention will be illustrated in detail below with reference to the accompanying drawings.

[0022] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention is further illustrated in detail below with reference to the accompanying diagrams and drawings. It should be understood that specific embodiments described herein are only intended to explain the present invention instead of limiting the present invention. Further, embodiments and examples not specifically described herein may be practiced in lieu of, or in combination with, the embodiments and other examples described, disclosed or otherwise provided explicitly, implicitly and/or inherently (collectively "provided") herein.

[0023] As described herein, Augmented reality (AR) holographic projection may focus on mirroring real world upon computer-generated data, for example, by projecting augmentation information with real-world status for the intuitionistic display to end users, generally in real or near-real time. Today, the scope of AR holographic projection may be expanded to broad application areas, such as digital twins of operations, training, and entertainment to name a few. As such, there may be increasing interest in providing seamless projection of augmentation information with real-world scenes.

[0024] However, AR may present challenges such as new challenges for end user experience, and in particular, for appropriately displaying the augmentation information especially in view of its use with wearable devices or computers. Further, current methods or techniques for displaying data on such devices, unfortunately, may not be suitable or thought out in particularly in the petroleum and natural gas industry. For example, current methods or techniques for displaying augmentation information on wearable devices may be arbitrary, may display or provide an excessive amount of information from the augmentation that may overwhelm a user, and/or the like.

[0025] Examples herein may provide and/or describe methods and systems related to augmented reality holographic projection. In examples, such methods and systems for providing an augmented reality display and/or user interface that mirrors a view ("real-world view") of a real-world scene to a virtual world for presenting augmentation information in connection with a drilling and/or completion field to a user. The scope of virtual world may be larger than real world by adding further simulations, and real-world scope is set up by users. [0026] Specifically, the augmented reality holographic display may include a virtual object ("emphasizing virtual object") for visually emphasizing the drilling and/or completion field. The emphasizing virtual object may build the entire region of drilling and/or completion field. The emphasizing virtual object may be, for example, an outline, highlight, etc. of an element thereof (e.g., a real-world object depicted in the real-world view), meanwhile intuitionistic visualization of virtual object amendments to facilitate human understanding of real-world object.

[0027] The virtual object may be displayed on the augmented reality display in connection with the drilling and/or completion field at any number of appropriate locations. For example, the virtual object may be displayed away from real-world object. Alternatively and/or additionally, the virtual object may be displayed so as to not impact a real-world object associated with the drilling and/or completion field. The virtual object may be displayed so as not occlude another virtual object neighboring the drilling and/or completion field.. The virtual object may be displayed so as not occlude another virtual object. The virtual object may be displayed to occlude one or more objects (real-world or otherwise) outside the region of interest.

[0028] The virtual object may transition from one state to another state, and back again based on real-world state and simulation setup. For example, the virtual object may transition from the first state to the second state, and from the second state to the first state. The state change may be continuous or discontinuous. For example, the virtual object may transition from the slow move state to the fast move state by acceleration from the slow move state, and/or may transition from the fast move state to the slow move state by decelerating back to the slow move state. Alternatively, and/or additionally, the virtual object may transition from the slow move state to the fast move state by switching to a partially or fully accelerating state, and/or may transition from the fast move state to the slow move state by switching back to the slow move state. In some embodiments, the virtual object may transition from the slow move state to the fast move state by rupture away from other virtual object, and/or may transition from the fast move state to the slow move state by returning back to (e.g., changing simulation mode) the slow move state.

[0029] The simulation and training mode includes all operations and safety management in the drilling and/or completion field, for example, drilling, casing, cementing, rigging up/down, fracturing, perforation & plug, drills, blow-out, equipment maintenance.

[0030] The properties adjustment of virtual object and/or the status shift of virtual object are visible to all authorized end users, and they may discuss any interested adjustments, which are in 3D and/or 2D models, in real-time through mature networks.

Claims

CLAIMS What is claimed is:

1. A method for providing augmented information in an AR drilling, completion and production visualization system based on holographic projection (10) which comprises a staff & equipment positioning unit(310), a regular sensors & configuration system(320), and an AR holographic projection unit(200) comprising a display unite(210), an user recognition unit(220), an AR engine(230), a virtual object repository(240), a data collection unit(260), and a models engine(250) comprising hydraulic model, failure analysis model, downhole status model, event and accident identification model. The method comprising the steps of:

Generating# 1, at the staff & equipment positioning unit(310) and a regular sensors & configuration system(320), at least one of origin data input comprising position information and operations related data associated with at least one of the real-world objects;

Collecting, at the data collection unit(260), at least one of origin data is collected and stored;

Receiving, at the user recognition unit(220), additional user input comprising an indication of interest indicative of the user’s interest has minimally interested towards one end to fully interested towards the other end;

Generating#2, at the models engine(250), at least one of an information related to hydraulic pressure, downhole status modelling, equipment failure, event & accident identification associated with at least one of the real-world objects;

Generating#3, at the AR engine(230), an augmented information by mirroring the real-world view and at least one of a virtual object associated with the at least one of the real-world objects;

Controlling based on the received additional user input, at the models engine(250) and the AR engine(230), the acceleration and/or deceleration of at least one of virtual object in slow move state;

Displaying, on the display unit(210), the AR holographic projection with the at least one of virtual object in slow move state (include static) for presenting a summary representation of the augmented information of at least one of the real-world object

2. The method of claim 1, wherein the computing device comprises an eye tracking, hands tracking and voice recognition unit configured to generate the first interest indication value;

3. The method of claim 1, further comprising determining, at the device, an appropriate location for the virtual object corresponding to relative locations of real-world object on the display;

4. The method of claim 1, further comprising receiving, at the device, the further user input in connection with the virtual object, and comprises an indication of interest in the disposed virtual object in the AR display;

5. The method of claim 1, further comprising collecting, at the device, at least one of the operations related data is collected and stored;

6. The method of claim 1, further comprising generating, at the device, data input in connection with the 3D and/or 2D virtual object in the slow move state;

7. The method of claim 6, further comprising real-time calculating, at the device, at least one of the model information of drilling, completion and production field being calculated in associated to at least one of the virtual objects;

8. A device configured to process the method steps of claim 1 for providing augmentation information comprising an AR drilling & completion visualization system based on holographic projection having a staff & equipment positioning unit(310), a regular sensors & configuration system(320), and an AR holographic projection unit(200) comprising a display unit(210), an user recognition unit(220), an AR engine(230), a virtual object repository(240), a data collection unit(260), and a models engine(250);

9. The device of claim 8, wherein the virtual object transitions from the second state to the first state when further user input and/or data from data collection unit indicate that interest in the virtual object is detected;

10. The device of claim 8, wherein the object transitions are visible to anyone who is in display unit real time, and could discuss transitions via the device instantly;

11. The device of claim 9, wherein the virtual object transitions generated from inputs in controlled ways associated to at least one of the virtual objects.