CN116912962A - Well site inspection method and system, electronic equipment and storage medium - Google Patents

Well site inspection method and system, electronic equipment and storage medium Download PDF

Info

Publication number
CN116912962A
CN116912962A CN202310797899.3A CN202310797899A CN116912962A CN 116912962 A CN116912962 A CN 116912962A CN 202310797899 A CN202310797899 A CN 202310797899A CN 116912962 A CN116912962 A CN 116912962A
Authority
CN
China
Prior art keywords
patrol
target
inspection
personnel
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310797899.3A
Other languages
Chinese (zh)
Inventor
李涛
赵锦昱
孙明华
张国庆
李�诚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yantai Jereh Oilfield Services Group Co Ltd
Original Assignee
Yantai Jereh Oilfield Services Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yantai Jereh Oilfield Services Group Co Ltd filed Critical Yantai Jereh Oilfield Services Group Co Ltd
Priority to CN202310797899.3A priority Critical patent/CN116912962A/en
Publication of CN116912962A publication Critical patent/CN116912962A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/20Checking timed patrols, e.g. of watchman
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/20Administration of product repair or maintenance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Abstract

The application provides a well site inspection method and system, electronic equipment and a storage medium. The method comprises the following steps: acquiring target inspection information, wherein the target inspection information is obtained after an inspector inspects a target inspection point in a well site at a target moment; by personnel tracking of the inspection personnel, determining the target image position of the inspection personnel in the complete image of the well site when the target moment is reached; and determining a patrol result corresponding to the target patrol information according to the target image position and the target patrol point position of the target patrol point, wherein the target patrol point position is the position of the target patrol point in the complete image of the well site. The application can judge whether the patrol personnel carry out patrol according to the patrol requirements, thereby achieving the purpose of supervising the patrol actions of the patrol personnel.

Description

Well site inspection method and system, electronic equipment and storage medium
Technical Field
The present application relates to the field of image recognition technologies, and in particular, to a well site inspection method and system, an electronic device, and a storage medium.
Background
With the increase of the development quantity of oil fields, various oil-gas wells are numerous in quantity and unevenly distributed in different areas. According to the production management requirements of oil field companies, all oil-gas-water wells need to be inspected once every 4 hours, whether oil extraction workers inspect according to the period of 4 hours is required, except that the inspection can be performed at night by adopting the hanging inspection card with indefinite serial numbers, only the inspection records of the stations are inspected, but the inspection records cannot completely reflect the real inspection condition.
In the existing inspection mode, the inspection effectiveness of inspection personnel cannot be effectively monitored in real time, so that inspection results have the condition that inspection is not performed according to inspection requirements, and the inspection process which is not performed according to the requirements is difficult to trace.
Therefore, the related art has the problem that whether the patrol personnel carry out patrol according to the patrol request cannot be judged.
Disclosure of Invention
The application provides a well site inspection method and system, electronic equipment and a storage medium, which at least solve the problem that whether inspection personnel inspect according to inspection requirements cannot be judged in the related technology.
According to an aspect of an embodiment of the present application, there is provided a well site inspection method including:
acquiring target inspection information, wherein the target inspection information is obtained after an inspector inspects a target inspection point in a well site at a target moment;
the method comprises the steps of determining the target image position of the patrol personnel in a complete image of a well site when the target moment is obtained by personnel tracking of the patrol personnel;
and determining a patrol result corresponding to the target patrol information according to the target image position and the target patrol point position of the target patrol point, wherein the target patrol point position is the position of the target patrol point in the well site complete image, and the patrol result is used for indicating whether the target patrol information is effective or not.
Optionally, before the acquiring the target patrol information, the method further includes:
before the patrol personnel respond to a patrol worksheet to carry out patrol, acquiring the identity information of the patrol personnel, wherein the patrol worksheet is used for indicating a target personnel to carry out patrol on the well site;
and determining the image initial position of the patrol personnel on the complete image of the well site under the condition that the patrol personnel is determined to be the target personnel indicated by the patrol work order based on the patrol personnel identity information.
Optionally, before the acquiring the target patrol information, the method further includes:
acquiring a well site partial image obtained by image acquisition of the well site by each image acquisition device in a plurality of image acquisition devices;
preprocessing each well site partial image to obtain preprocessed images with image quality meeting preset requirements;
and splicing all the preprocessed images according to an overlapping area image to obtain a complete image of the well site, wherein the overlapping area image is characterized by at least two preprocessed images of the indicated well site partial area.
Optionally, in the foregoing method, after the obtaining a well site complete image of the well site by stitching all the preprocessed images according to the overlapping area image, the method further includes:
generating a patrol worksheet for indicating a target person to patrol the well site;
generating a complete inspection route according to the position of each point to be inspected in the complete image of the well site and the inspection sequence of each point to be inspected, wherein the well site comprises the points to be inspected;
and sending the inspection worksheet and the complete inspection route to the target personnel.
Optionally, in the foregoing method, the step of performing personnel tracking on the patrol personnel includes:
when the current activated image acquisition equipment performs personnel tracking on the patrol personnel and determines that the patrol personnel is located in an edge monitoring area corresponding to the current activated image acquisition equipment, triggering target candidate image acquisition equipment with a detection area covering the edge monitoring area to perform personnel tracking on the patrol personnel and obtain a plurality of candidate part patrol routes, wherein the edge monitoring area corresponding to the current activated image acquisition equipment is an area capable of performing image acquisition in the current activated image acquisition equipment, the target candidate image acquisition equipment also can perform image acquisition, and the candidate part patrol routes comprise: the activated image acquisition equipment performs personnel tracking on the part of the inspection route obtained by the personnel tracking on the inspection personnel, and the target candidate image acquisition equipment performs personnel tracking on the part of the inspection route obtained by the personnel tracking on the inspection personnel;
Determining a first target part inspection route in the complete image of the well site according to the candidate part inspection routes when the inspection personnel inspect in the edge monitoring area corresponding to the current activated image acquisition equipment;
when the appointed candidate image acquisition equipment in all target candidate image acquisition equipment determines that the patrol personnel image is positioned in an internal monitoring area corresponding to the appointed candidate image acquisition equipment, the appointed candidate image acquisition equipment is determined to be the latest activated image acquisition equipment, wherein the internal monitoring area corresponding to the appointed candidate image acquisition equipment is an area in the well site, only the appointed candidate image acquisition equipment can carry out image acquisition;
and carrying out personnel tracking on the route of the inspection personnel acting in the internal monitoring area of the latest activated image acquisition equipment through the latest activated image acquisition equipment to obtain a second target part inspection route in the complete image of the well site.
Optionally, as in the previous method, after the personnel tracking of the patrol personnel, the method further includes:
acquiring a historical inspection route before the first target part inspection route is determined;
The historical inspection route, the first target part inspection route and the second target part inspection route are connected to obtain a latest inspection route;
and comparing the latest routing inspection route with a complete routing inspection route to determine routing inspection route results for indicating whether the inspector inspects according to the complete routing inspection route, wherein the complete routing inspection route is used for indicating the routing inspection sequence of each point to be inspected in the well site.
Optionally, the method of any one of the preceding claims, wherein determining, according to the target image position and the target inspection point position of the target inspection point, an inspection result corresponding to the target inspection information includes:
determining a distance difference value of the patrol personnel relative to the target patrol point according to the target image position and the target patrol point position;
generating a patrol result for indicating that the patrol of the target patrol point meets the preset patrol requirement under the condition that the distance difference meets the preset distance requirement;
and under the condition that the distance difference value does not meet the preset distance requirement, generating a patrol result for indicating that the patrol of the target patrol point does not meet the preset patrol requirement and that the target patrol point is required to be subjected to patrol again.
According to another aspect of the embodiment of the present application, there is also provided a well site inspection system, including:
the system comprises an acquisition module, a detection module and a control module, wherein the acquisition module is used for acquiring target inspection information, wherein the target inspection information is obtained after an inspector inspects a target inspection point in a well field at a target moment;
the first determining module is used for determining the target image position of the inspection personnel in the well site complete image when the target moment is reached by personnel tracking of the inspection personnel, wherein the well site complete image is an integral image of the well site;
and the second determining module is used for determining a patrol result corresponding to the target patrol information according to the target image position and the target patrol point position of the target patrol point.
According to still another aspect of the embodiments of the present application, there is provided an electronic device including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory complete communication with each other through the communication bus; wherein the memory is used for storing a computer program; a processor for performing the method steps of any of the embodiments described above by running the computer program stored on the memory.
According to a further aspect of the embodiments of the present application there is also provided a computer readable storage medium having stored therein a computer program, wherein the computer program is arranged to perform the method steps of any of the embodiments described above when run.
In the embodiment of the application, personnel tracking is carried out on the patrol personnel, the target image position of the patrol personnel in the complete image of the well site when the target moment is determined, and the patrol result corresponding to the target patrol information is determined according to the target image position and the target patrol point position of the target patrol point; therefore, based on the position relation between the inspection personnel and the target inspection points in the complete image of the well site, the inspection result corresponding to the target inspection information is determined, and whether the inspection personnel inspect according to the inspection requirement can be judged, the purpose of supervising the inspection behavior of the inspection personnel is achieved, and the inspection process which does not inspect according to the requirement can be traced back in the later period.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the application or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a schematic flow diagram of an alternative wellsite inspection method in accordance with an embodiment of the present application;
FIG. 2 is a schematic flow diagram of an alternative wellsite inspection method in accordance with another embodiment of the present application;
FIG. 3 is a schematic diagram of an alternative fixed camera field of view in accordance with an embodiment of the present application;
FIG. 4 is a schematic diagram of an alternative pan-tilt camera field of view according to an embodiment of the present application;
FIG. 5 is a schematic flow chart of an alternative method for performing well site inspection using a fixed camera in accordance with an embodiment of the application;
FIG. 6 is a schematic flow chart of an alternative method for performing well site inspection using a pan-tilt camera in accordance with an embodiment of the application;
FIG. 7 is a block diagram of an alternative wellsite inspection system in accordance with an embodiment of the present application;
fig. 8 is a block diagram of an alternative electronic device in accordance with an embodiment of the present application.
Detailed Description
In order that those skilled in the art will better understand the present application, a technical solution in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, shall fall within the scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
According to one aspect of an embodiment of the application, a well site inspection method is provided. Alternatively, in this embodiment, the above-mentioned well site inspection method may be applied to a hardware environment formed by a terminal and a server. The server is connected with the terminal through a network, and can be used for providing services (such as data analysis service, data storage service and the like) for the terminal or a client installed on the terminal, and a database can be arranged on the server or independent of the server and used for providing data storage service for the server.
The network may include, but is not limited to, at least one of: wired network, wireless network. The wired network may include, but is not limited to, at least one of: a wide area network, a metropolitan area network, a local area network, and the wireless network may include, but is not limited to, at least one of: WIFI (Wireless Fidelity ), bluetooth. The terminal may not be limited to a PC, a mobile phone, a tablet computer, or the like.
The well site inspection method of the embodiment of the application can be executed by a server, a terminal or both. The well site inspection method performed by the terminal according to the embodiment of the application can also be performed by a client installed on the terminal.
Taking a server (e.g., a wellsite inspection system) as an example to execute the wellsite inspection method in this embodiment, fig. 1 is a wellsite inspection method according to an embodiment of the present application, including the following steps:
step S101, acquiring target inspection information, wherein the target inspection information is obtained after an inspection personnel inspects a target inspection point in a well site at a target moment.
The well site inspection method in the embodiment can be applied to a scene in which whether inspection personnel need to perform standard inspection according to inspection requirements, for example: whether the scene of the inspection information is uploaded after the inspection is really performed on the point to be inspected, and the like.
The inspection information may be information indicating an operation state of the inspection point, for example, valve opening, valve closing, and the like.
The target time may be a time at which the inspection personnel upload target inspection information to the wellsite inspection system.
In this embodiment, the patrol personnel may upload the target patrol information through the patrol handheld terminal, and the patrol handheld terminal may be used for: the inspection personnel can carry out well site inspection by holding an inspection handheld terminal, can carry out inspection point options on equipment, can scan codes of two-dimensional codes corresponding to the inspection points by calling out a code scanning function, and can edit the inspection items which are jumped out after the codes are scanned; uploading inspection information of each inspection point; and receiving a patrol feedback result of the well site patrol system.
Step S102, by carrying out personnel tracking on the patrol personnel, determining the target image position of the patrol personnel in the complete image of the well site when the target moment is reached.
Alternatively, personnel tracking of the inspection personnel may be performed by image acquisition devices, which may include, but are not limited to, fixed image acquisition devices (e.g., fixed cameras) and/or pan-tilt image acquisition devices (e.g., pan-tilt cameras).
The last step has determined that the patrol personnel upload the target patrol information at the target moment, so the target moment or the target moment, the patrol personnel should be near the target patrol point. Or can be agreed in advance, and the patrol personnel should upload the target patrol information near the target patrol point.
By personnel tracking the patrol personnel, the patrol personnel is determined in the image acquired in real time, so that the target image position of the patrol personnel in the complete image of the well site can be determined based on the acquired image when the target moment is reached.
The complete image of the well site can be an image which is obtained after shooting the well site to be inspected by the inspection personnel and can represent the whole well site, and meanwhile, the complete image of the well site can also indicate the position of each inspection point in the well site.
Alternatively, the wellsite is typically large and is difficult to capture in all directions by one image capture device, so that each image capture device can only capture a partial image of the wellsite.
Therefore, the target image position of the patrol personnel in the complete image of the well site can be determined by determining the position of the current well site part image of the patrol personnel in the complete image of the well site, which is acquired at the target moment, and the position of the patrol personnel in the current well site part image.
Step S103, determining a patrol result corresponding to the target patrol information according to the target image position and the target patrol point position of the target patrol point, wherein the target patrol point position is the position of the target patrol point in the complete image of the well site.
In general, the positions of the target inspection points in the complete image of the well site can be determined in a pre-labeling mode, and each inspection point can be identified in the complete image of the well site in advance in an image identification mode.
Thus, after the target image location and the target inspection point location are determined, a determination of the relative positional relationship (which may include, but is not limited to, direction, distance, etc.) between the inspector and the target inspection point at the target time may be made.
Furthermore, whether the patrol personnel patrol the target patrol points or not can be judged based on the relative position relation, and the target patrol information is obtained; thereby obtaining the inspection result.
The inspection result is used for indicating whether the target inspection information is valid or not.
For example: when the distance between the patrol personnel and the target patrol point reaches tens of meters or even hundreds of meters, the patrol personnel can be deduced that the patrol personnel do not carry out patrol on the target patrol point, and the uploaded target patrol information is most likely to be false-reported and does not accord with the actual condition of the target patrol point, and a patrol result for indicating that the target patrol information is invalid can be generated; under the condition that the distance between the patrol personnel and the target patrol points is only a few meters, the patrol personnel can be deduced to patrol the target patrol points and obtain corresponding target patrol information, and a patrol result for indicating that the target patrol information is effective can be generated.
According to the method, personnel tracking is carried out on the patrol personnel, when the target moment is reached, the target image position of the patrol personnel in the complete image of the well site is determined, and the patrol result corresponding to the target patrol information is determined according to the target image position and the target patrol point position of the target patrol point; therefore, based on the position relation between the inspection personnel and the target inspection points in the complete image of the well site, the inspection result corresponding to the target inspection information is determined, and whether the inspection personnel inspect according to the inspection requirement can be judged, the purpose of supervising the inspection behavior of the inspection personnel is achieved, and the inspection process which does not inspect according to the requirement can be traced back in the later period.
As an alternative embodiment, as the foregoing method, before the step S101 of obtaining the target inspection information uploaded by the inspector, the method further includes the following steps:
step S201, before an inspector inspects in response to an inspection work order, acquiring the identity information of the inspector, wherein the inspection work order is used for indicating a target person to inspect a well site;
that is, before the inspection personnel performs inspection, it is necessary to determine the identity of the inspection personnel, that is, whether the inspection personnel is a target person specified by the inspection work order through the inspection personnel identity information of the inspection personnel.
Step S202, under the condition that the patrol personnel is determined to be the target personnel indicated by the patrol worksheet based on the patrol personnel identity information, determining the initial image position of the patrol personnel on the complete image of the well site.
Determining that the patrol personnel is a target personnel indicated by the patrol work order based on the patrol personnel identity information; the identity information of the patrol personnel is consistent with the identity information of the target personnel; the person identity information may be face recognition information obtained by the foregoing example.
After determining that the inspection personnel is the target personnel, the inspection personnel can be subjected to image tracking detection to determine the actual position of the inspection personnel, and in the embodiment, the initial image position of the inspection personnel on the complete image of the well site is also determined.
The initial image position is the initial position of the inspection personnel on the complete image of the well site when the inspection personnel begin to inspect.
The method for determining the image initial position of the inspection personnel on the complete image of the well site comprises the following steps:
the manner of obtaining the inspector identity information of the inspector may include, but is not limited to:
1. the image acquisition equipment is used for carrying out reasoning and identification on the patrol personnel by using an image identification model of the patrol personnel to obtain the identity information of the patrol personnel; in all fixed image acquisition devices/all cloud deck image acquisition devices which are used for carrying out reasoning and identification on the patrol personnel by using the patrol personnel image identification model, the first fixed image acquisition device/cloud deck image acquisition device which is used for identifying the patrol personnel takes the image position of the patrol personnel in the fixed image acquisition device/cloud deck image acquisition device as the image initial position of the patrol personnel.
2. The method comprises the steps that a face recognition card punching machine can be installed at a fixed position before inspection, face recognition card punching is carried out on inspection personnel, the card punching machine is at least in the visual field range of certain image acquisition equipment, a card punching information is transmitted to a positioning and tracking module by a face recognition system after card punching, and the positioning and tracking module is communicated with the fixed image acquisition equipment/cradle head image acquisition equipment (the fixed image acquisition equipment/cradle head image acquisition equipment with the visual field comprising the card punching machine) so that the image acquisition equipment carries out personnel recognition model reasoning on the inspection personnel through an inspection personnel image recognition model to obtain the identity information of the inspection personnel; at the moment, if the fixed image acquisition equipment/cradle head image acquisition equipment with the visual field containing the card punching machine identifies the patrol personnel in front of the card punching machine, taking the position of the patrol personnel on the image as the image initial position of the patrol personnel; if no patrol personnel in front of the card punching machine are identified, the image initial position of the patrol personnel is taken in front of the card punching machine (the position of the card punching machine can be marked on the fixed image acquisition equipment/cradle head image acquisition equipment in advance).
3. And positioning triggering is carried out in a setting area, and the setting area is marked with the image position on a certain fixed image acquisition device/cradle head image acquisition device in advance at least in the visual field range of the certain fixed image acquisition device/cradle head image acquisition device. The actual buttons can be placed in the set area, and the patrol personnel send signals to the positioning and tracking module after clicking the buttons in the set area; or the patrol personnel walk to the set area to click a button on the patrol system software, and the signal is sent to the positioning and tracking module after clicking the button; the handheld terminal and the sensing device in the set area can also be used for determining whether the patrol personnel holding the handheld terminal is in the set area or not in a sensing mode, for example, the set sensing distance is within a range of 2 meters (namely, one optional preset range), and the handheld terminal or the sensing device in the set area sends signals to the positioning tracking module after sensing the signals. The positioning and tracking module is communicated with fixed image acquisition equipment/cloud deck image acquisition equipment (the fixed image acquisition equipment/cloud deck image acquisition equipment with the visual field comprising a button/sensing device) so that the image acquisition equipment can conduct personnel identification model reasoning through the personnel image identification model to obtain the identity information of the personnel to be inspected. At the moment, if the fixed image acquisition equipment/cradle head image acquisition equipment with the visual field containing the button/sensing device identifies the patrol personnel in the set area, taking the position of the patrol personnel identified on the image as the image initial position of the patrol personnel; if no patrol personnel in the set area are identified, the set area is used as the image initial position of the patrol personnel (the position of the card punching machine can be marked on the fixed image acquisition equipment in advance).
Furthermore, the image of the patrol personnel is acquired, and the image recognition model of the patrol personnel is obtained by marking, constructing a personnel recognition model and training the patrol personnel model.
Based on the initial image position, tracking the image target of the patrol personnel, and estimating and determining the image position of the patrol personnel in the current frame image by the same fixed image acquisition equipment according to the image position of the patrol personnel determined by the previous frame image and the image difference of the current frame image by using a frame difference method or a mean shift algorithm.
As an alternative embodiment, as the foregoing method, before the step S101 of obtaining the target inspection information uploaded by the inspector, the method further includes the following steps:
step S301, acquiring a well site partial image obtained by image acquisition of a well site by each image acquisition device in a plurality of image acquisition devices;
step S302, preprocessing each well site partial image to obtain a preprocessed image with image quality meeting preset requirements;
step S303, the whole well site image of the well site is obtained by splicing all the preprocessed images according to the overlapping area image, wherein the overlapping area image is characterized by at least two preprocessed images for the indicated part area of the well site.
In this embodiment, a complete image of the well site is obtained by image stitching.
Example 1, in the case where the image acquisition device employs a fixed camera, a complete image of the wellsite may be generated as follows:
(1) Fixed camera layout
A plurality of fixed cameras are arranged in the well site range, the field of view of each camera is used for realizing full coverage monitoring of the well site operation area, the common overlapping area of the adjacent fixed camera images is convenient for subsequent image stitching, and the layout can refer to a field view schematic diagram of the fixed cameras as shown in fig. 3.
(2) Image acquisition
After the fixed cameras are installed and distributed, a well site part image is acquired for each fixed camera.
(3) Image acquisition device image stitching
Image stitching is a technology for stitching a plurality of images (possibly images obtained by different time, different view angles or different sensors) with overlapping parts into a seamless panoramic image or a high-resolution image, and the image stitching technology mainly comprises three main steps: image preprocessing, image registration and image fusion.
Image preprocessing: and taking the two well site partial images as a reference image and an image to be spliced respectively, and performing geometric distortion correction, noise point suppression and other treatments on the two well site partial images so that the reference image and the image to be spliced have no obvious geometric distortion. The preprocessing of the image is mainly to make the image quality meet the image registration requirement (i.e., preprocessing requirement).
Image registration: extracting the characteristic information in the reference image and the image to be spliced which are selected and preprocessed; matching the feature information in the preprocessed reference image and the image to be spliced (can comprise feature point matching algorithms such as RANSAC, FLANN and the like); the homography matrix is calculated according to the feature matching result, and the calculation process is as follows: selecting a proper transformation model (optional models comprise rigid transformation, similarity transformation, affine transformation and projective transformation, and the patent selects projective transformation), determining parameters of the transformation model based on a coefficient method to be determined according to a matching result, and recording the parameters as a homography matrix.
And (3) image fusion: and stitching the preprocessed reference image and the image to be stitched according to the homography matrix obtained after the images are matched, and smoothing the stitched boundary to make the stitching naturally transition, so that a stitched image is obtained after stitching the preprocessed reference image and the image to be stitched.
And splicing all the preprocessed images according to the method and the overlapping area images to obtain a complete well site image of the well site.
In this embodiment, the actual process of image stitching is performed on the acquired image:
1) Taking two acquired preprocessed images (the two images have a common overlapping area image), respectively taking the two preprocessed images as a reference image and an image to be spliced, splicing the two preprocessed images into an image through image splicing, and recording the image as a new image to be spliced;
2) Taking a preprocessed image which has a common overlapping area image with a new image to be spliced as a new reference image, splicing the two images (namely the new image to be spliced and the new reference image) into an image by using the method of step 1, and recording the image as the new image to be spliced;
3) Continuing the step of 2);
4) Stopping stitching when the images which are not preprocessed except the new images to be stitched are stitched, marking the new images to be stitched as well site complete images, and calculating the homography matrix of each image relative to the well site complete images in the image stitching process.
Example 2, in the case that the image capturing device adopts the pan-tilt camera, the following method may be further adopted to generate a complete image of the wellsite (the image capturing device adopts the pan-tilt camera, and may use a plurality of pan-tilt cameras to perform full coverage monitoring on the wellsite operation area, and the pan-tilt rotation increases the monitoring range of the camera in the horizontal and pitching angles, so that the number of image capturing devices used for full coverage on the wellsite operation area may be reduced):
(1) Holder camera layout
The coverage area of the fixed camera is fixed and smaller, the cradle head camera can rotate in the horizontal direction and the pitching direction, the coverage area of the camera is increased by using the cradle head rotation of the cradle head camera, and the number of cameras in full coverage monitoring is reduced. The tracking range of each pan-tilt camera is divided according to the coverage range of the pan-tilt camera, the monitoring area of each camera is subjected to edge crossing coverage, and the layout can refer to a view schematic diagram of the pan-tilt camera as shown in fig. 4.
(2) Image acquisition of pan-tilt camera
The whole view image of the pan-tilt camera is acquired, and the acquisition process can be as follows: the pan-tilt camera respectively acquires a well site partial image at fixed intervals in the horizontal direction (0 to 360 degrees) and at fixed intervals in the pitching direction (-90 degrees to 90 degrees) (alternatively, the fixed intervals of the horizontal angle and the pitching angle are all 1 degree, and can be 2 degrees and the like). The pitching direction is fixed, the horizontal direction rotates at fixed intervals to collect part of images of a well site once, and the horizontal direction rotates for one circle and then stops rotating horizontally; the pitching direction rotates at fixed intervals and then keeps unchanged, a well site part image is collected once at fixed intervals in the horizontal direction, and the horizontal direction rotates for one circle to stop horizontal rotation; and the image acquisition of the cradle head camera is completed by the same method to obtain a pile of well site partial images.
(3) Image stitching
The well site partial images were processed and image stitched according to the method described in example 1, and the stitching process was the same as the image stitching process for full-coverage positioning of the fixed cameras, to obtain a complete image of the well site of a pan-tilt camera.
As an alternative embodiment, as in the foregoing method, after the step S302 of obtaining the complete image of the wellsite by stitching all the preprocessed images according to the overlapping area images, the method further includes the following steps:
step S401, generating a patrol worksheet for indicating a target person to patrol the well site.
That is, the inspection work order may indicate the person performing the inspection, and in addition, may indicate the time required to inspect, etc., which is not limited herein.
Step S402, a complete inspection route is generated according to the position of each point to be inspected in the complete image of the well site and the inspection sequence of each point to be inspected, wherein the well site comprises the points to be inspected.
After the well site complete image is determined, the position of each point to be inspected in the well site complete image can be determined; furthermore, the connection of the points to be inspected (for example, the connection of the points to be inspected according to the road between the points to be inspected in the complete image of the well site) can be performed according to the inspection sequence of the points to be inspected, so as to obtain a complete inspection route.
Step S403, the inspection worksheet and the complete inspection route are sent to the target personnel.
After the inspection work order and the complete inspection route are obtained, the inspection work order and the complete inspection route can be sent to inspection equipment corresponding to the target personnel (namely the aforementioned inspection handheld terminal, such as the inspection handheld terminal with the account number of the target personnel).
For example, taking the complete image of the well site as a patrol map, determining the position of the point to be patrol on the patrol map, drawing a complete patrol route on the patrol map, establishing a plurality of patrol items for each point to be patrol, and the like.
And sending the inspection information such as the inspection work order, the complete inspection route, the inspection item and the like to an inspection handheld terminal (which can be a mobile phone or a special handheld terminal) with the account number of the target person as the inspection instruction content.
In the inspection process, on one hand, each image acquisition device utilizes a trained personnel identification model to identify whether a specific inspection personnel exists in an image, whether the inspection personnel is a target personnel or not, and determines the position of the inspection personnel in a complete image of a well site; on the other hand, the inspection personnel cannot always be identified through the images and the identities of the inspection personnel are determined due to the reasons of angles, shielding and the like, so that the multi-image acquisition device can continuously track the targets of the inspection personnel after the identities of the inspection personnel are confirmed for the first time, the targets are tracked based on the context information of videos or image sequences, the appearance and the motion information of the targets are modeled, the motion state of the targets is predicted, the positions of the targets are determined, and in order to improve the precision, the personnel identification and the positioning can be performed by adopting the mode that the multi-image acquisition device continuously tracks the targets of the inspection personnel after the identities of the inspection personnel are confirmed for the first time before the inspection.
As an alternative embodiment, the step S102 of tracking the patrol personnel as the aforementioned method includes the following steps:
step S501, when the current activated image capturing device performs personnel tracking on the patrol personnel and determines that the patrol personnel is located in the edge monitoring area corresponding to the current activated image capturing device, the target candidate image capturing device with the detection area covering the edge monitoring area is triggered to perform personnel tracking on the patrol personnel and obtain a plurality of candidate part patrol routes, wherein the edge monitoring area corresponding to the current activated image capturing device is an area where the current activated image capturing device can perform image capturing, the target candidate image capturing device can also perform image capturing, and the plurality of candidate part patrol routes include: activating the image acquisition equipment to track part of the inspection route obtained by the personnel tracking of the inspection personnel and the target candidate image acquisition equipment to track part of the inspection route obtained by the personnel tracking of the inspection personnel;
step S502, determining a first target part inspection route in a complete image of a well site according to a plurality of candidate part inspection routes when an inspector inspects in an edge monitoring area corresponding to a current activated image acquisition device;
Step S503, when the designated candidate image acquisition equipment in all target candidate image acquisition equipment determines that the patrol personnel image is located in the internal monitoring area corresponding to the designated candidate image acquisition equipment, determining the designated candidate image acquisition equipment as the latest activated image acquisition equipment, wherein the internal monitoring area corresponding to the designated candidate image acquisition equipment is an area in the well site, in which only the designated candidate image acquisition equipment can perform image acquisition;
step S504, the route of the inspection personnel acting in the internal monitoring area of the latest activated image acquisition equipment is tracked by the latest activated image acquisition equipment, and a second target part inspection route in the complete image of the well site is obtained.
Example 3 when the image capturing apparatus is a fixed camera, as shown in fig. 5, the present embodiment can be implemented as follows:
the monitoring area of the fixed camera is divided into an inner monitoring area of the fixed camera and an edge monitoring area of the fixed camera according to whether or not there is a common overlapping area (cross coverage) with another image of the fixed camera. The internal monitoring area of the fixed camera is an area that can be monitored only by the fixed camera. The edge monitoring area of the fixed camera is a monitoring area where the fixed camera and other fixed cameras have a common overlapping area (cross coverage).
When only one fixed camera inferentially identifies the patrol personnel, the patrol personnel are positioned in the internal monitoring area of the fixed camera and perform corresponding processing; when a plurality of fixed cameras reasoning and identifying the patrol personnel, the patrol personnel are located in the edge monitoring area of the fixed cameras and perform corresponding processing.
After a fixed camera confirms a patrol personnel for the first time, when the patrol personnel is located in a monitoring area inside the fixed camera, personnel real-time image target tracking is carried out on the patrol personnel, the fixed camera is recorded as current activated image acquisition equipment, the target tracking obtains the image position of the patrol personnel in the current activated image acquisition equipment, the image position is transmitted to a positioning tracking module through wireless transmission, the image stitching process calculates homography matrixes of each fixed camera and a well site complete image, the homography matrixes comprise the current activated image acquisition equipment and the well site complete image, the image position of the patrol personnel in the current activated image acquisition equipment is converted into the image position of the patrol personnel in the well site complete image through the homography matrixes of the current activated image acquisition equipment and the well site complete image, and each image position of the patrol personnel in the well site complete image is connected according to time sequence, so that a section of image patrol route relative to the well site complete image can be obtained.
When the patrol personnel is located in the edge monitoring area of the current activated image acquisition equipment, the positioning and tracking module is notified through wireless communication, and the positioning and tracking module triggers other fixed cameras covering the edge monitoring area (namely, the appointed candidate image acquisition equipment) to determine the initial positions of the patrol personnel in the respective fixed cameras through wireless communication notification, wherein the mode of determining the initial positions of the other fixed cameras covering the edge monitoring area can comprise: the method 1 can be used for reasoning and identifying the patrol personnel based on the patrol personnel identification model, and determining the image positions of the patrol personnel in other fixed camera images covering the edge monitoring area; in the mode 2, according to the homography matrix of the current activated image acquisition device and the complete image of the well site, the homography matrix of each of the other fixed cameras covering the edge monitoring area and the complete image of the well site is respectively converted to obtain the rough image position of the inspection personnel in the images of the other fixed cameras covering the edge monitoring area, the rough image position is used as the initial position of the other fixed cameras covering the edge monitoring area, the other fixed cameras covering the edge monitoring area respectively track targets to obtain the real-time position of the inspection personnel on the images, the image positions are transmitted to the positioning and tracking module through wireless transmission, the image positions of each of the other fixed cameras covering the edge monitoring area are converted to the image positions of the complete image of the well site through the positioning and tracking module, the converted image positions of the different image acquisition devices are respectively connected to form a candidate part inspection route, the candidate part inspection routes are processed (the mean value or median value is selected) to obtain the first target part inspection route relative to the complete image of the well site, when the inspection personnel enters the internal monitoring area again, the fixed monitoring area, the target is not required to be removed by the fixed cameras, and the target tracking device is not required to be activated, and the target tracking device is not required to be changed. And the latest activated image acquisition equipment is used for carrying out personnel tracking on the route of the action of the patrol personnel in the internal monitoring area of the latest activated image acquisition equipment, so as to obtain a second target part patrol route.
In example 4, when the image capturing device is a pan-tilt camera, as shown in fig. 6, the following method may be adopted in this embodiment:
the cloud deck camera divides the monitoring range into an internal monitoring area and an edge monitoring area of the cloud deck camera according to whether the monitoring range and other cloud deck cameras have cross coverage. The internal monitoring area is an area which can be monitored only by the pan-tilt camera.
When the patrol personnel is located in a certain monitoring area in the cradle head camera, the personnel real-time target tracking is carried out on the patrol personnel, the cradle head camera is recorded as a current activated image acquisition device, the image position of the patrol personnel in the current activated image acquisition device is determined, the center position of the patrol personnel in the current activated image acquisition device is enabled to be adjusted through the cradle head angle, optionally, in order to reduce the rotation frequency of the cradle head camera, the center range of the image of the cradle head camera can be set, for example, the image range of the cradle head camera with 51 pixels is set, in the target tracking process, the position of the patrol personnel in the image of the cradle head camera exceeds the set center range, then the cradle head level and the pitching direction are enabled to rotate, the patrol personnel is located in the center position of the image of the cradle head camera, the image position of the patrol personnel in the complete image of the well field in the image shot according to the current level and pitching angle is obtained through determining a homography matrix of the image of the cradle head camera image and the complete image of the well field, and the image position of the patrol personnel in the complete image of the current level and pitching angle is transmitted to a positioning and well field tracking module through wireless transmission, and the image position is connected to obtain a complete image path corresponding to a complete image.
When the patrol personnel are located in the edge monitoring area of the tripod head camera, the positioning and tracking module is notified through wireless communication, the positioning and tracking module triggers the tripod head camera which is crossly covered with the edge monitoring area to rotate through wireless communication notification, one edge monitoring area can be two tripod head camera crossly covered areas or a plurality of tripod head camera crossly covered areas, all tripod head cameras which are crossly covered with the edge monitoring area rotate to the corresponding edge monitoring area, on one hand, personnel reasoning and identification can be carried out according to a model of the patrol personnel, and the position on an image is determined; the method can also determine the approximate image position of a patrol personnel in the pan-tilt camera covered by other existing areas according to homography matrixes of pan-tilt camera images and well site complete images under the current level and the pitching angle, the homography matrixes of images of the pan-tilt cameras and the well site complete images of the pan-tilt cameras are covered by other existing areas in a crossing mode, the position is used as an initial position of the pan-tilt camera covered by the other existing areas for target tracking, the pan-tilt cameras respectively track targets to track to obtain real-time positions of patrol personnel on the images, the image positions are transmitted to a positioning tracking module through wireless transmission, the positioning tracking module converts the image positions of the pan-tilt cameras to the image positions of the well site complete images, the converted image positions of the different pan-tilt cameras are respectively connected to form a section of image patrol paths (namely, candidate part patrol routes), the candidate part patrol routes are processed (can be selected to mean value or median processing) to obtain a section of image of the corresponding well site complete images (namely, the first part of the patrol personnel is enabled to be activated when the pan-tilt camera is in a certain initial position, the camera is enabled to be in a new state, and the camera is enabled to be in a state of the camera is activated.
As can be seen from the above, the positioning and tracking module is used in the present embodiment: the image positions of the patrol personnel at different image acquisition devices are determined through image recognition or target tracking, the image positions of the patrol personnel at the image acquisition devices are obtained through communication with the fixed camera/cradle head camera, the image positions of the patrol personnel at the image acquisition devices are converted into positions on the complete image of the well site, a series of image positions are connected relative to the spliced image to obtain an image patrol route, the communication triggers the different image acquisition devices to carry out image recognition and target tracking of the patrol personnel, and other image acquisition devices covering the edge area of the image acquisition devices are notified to prepare for target tracking when the patrol personnel are located in the edge area of the image acquisition devices.
As another alternative example, a pan-tilt camera may be used in combination with a fixed camera while performing wellsite coverage positioning.
As an optional embodiment, the method according to any one of the preceding claims, the step S103 of determining, according to the target image position and the target inspection point position of the target inspection point, an inspection result corresponding to the target inspection information includes the following steps:
step S601, determining a distance difference value of a patrol personnel relative to a target patrol point according to a target image position and a target patrol point position;
Step S602, under the condition that the distance difference value meets the preset distance requirement, generating a patrol result for indicating that patrol of the target patrol point meets the preset patrol requirement;
step S603, under the condition that the distance difference value does not meet the preset distance requirement, generating a patrol result for indicating that the patrol of the target patrol point does not meet the preset patrol requirement and that the patrol of the target patrol point is required to be performed again.
The distance difference can be obtained by comparing the target image position with the target inspection point position.
Before the inspection personnel does not finish inspection, different image acquisition equipment continuously tracks the target, the inspection personnel holds inspection handheld terminal hardware to scan the inspection equipment after reaching the target inspection point and edits each inspection item of the inspection point, after finishing editing, the inspection result is transmitted back to an inspection system in a wireless transmission mode, the inspection system is communicated with a positioning tracking module to obtain the target image position of the inspection personnel on an inspection map, the distance difference (which can be Euclidean distance, manhattan distance and the like) between the target inspection point position of the inspection point planned on the inspection map and the position of the inspection personnel tracked by the image acquisition equipment and the target image position on a complete image of the well field is calculated, whether the distance difference is within a distance error allowance range (namely, preset distance requirement, such as 5m, 3m and the like) is judged, if the distance error allowance range is met, the inspection result used for indicating the inspection requirement of the target inspection point is generated, the inspection point is continued to be inspected, if the distance error allowance range is exceeded, the target inspection information is judged to be required to be used for the target inspection again, and the target inspection is required to be invalid. The invalid inspection cause of the target inspection point is probably that the bar code actually pasted on the equipment is not corresponding to the bar code marked in the background database; or the inspection personnel can use the bar code stored by photographing to carry out inspection, and the inspection personnel does not reach the equipment needing inspection.
As an alternative example, the inspection items of the target inspection point may also be compared:
the inspection system performs automatic comparison of inspection items one by one, classifies the comparison results, and optionally classifies the comparison results into inspection normal items (normal values, normal ranges, normal phenomena and the like after inspection item comparison); inspection abnormal items (the numerical value is slightly abnormal after inspection item comparison, the operation is not influenced, and maintenance can be performed after the operation is completed or after a specified time is required); the inspection fault item is divided into an inspection fault item which can be directly removed and an inspection fault item which is not directly removed. The inspection fault item which can be directly removed (the abnormal condition that the on-site inspection personnel can directly maintain, such as that a certain valve is in an open state and is in a closed state at present, the on-site inspection personnel is prompted to open the valve); inspection fault items which cannot be directly removed (abnormal conditions that inspection personnel on site cannot directly maintain, such as oil leakage of a plunger pump, and the like).
The method can be realized through a patrol item comparison module: the inspection item comparison module is used for comparing the actual inspection item result with the standard inspection item set in advance, and the selectable comparison result is divided into inspection normal items, inspection abnormal items and inspection fault items. The cruising fault items comprise a patrol fault item which can be directly removed by a patrol personnel and a patrol fault item which cannot be directly removed by the patrol personnel).
Further, the inspection fault item in the target inspection point can be maintained:
when the inspection item comparison result in the inspection system is an inspection fault item which can not be maintained directly, transmitting the comparison result to the inspection handheld terminal through the wireless transmission module to remind inspection personnel to return, transmitting the comparison result to the positioning tracking module, communicating with the image acquisition equipment through wireless communication, canceling the personnel tracking of the image acquisition equipment or model reasoning and identifying functions of the inspection personnel, and waiting for maintenance of well site maintenance personnel; when the directly modifiable inspection fault item occurs, the comparison result is transmitted to the inspection handheld terminal in a wireless way to remind inspection personnel to carry out corresponding maintenance operation, the inspection item is edited by scanning codes again after the maintenance operation is completed, and the inspection item is uploaded again to wait for the inspection system to be compared again; when the inspection items are the inspection normal items or the inspection abnormal items, the comparison result is transmitted to the inspection handheld terminal in a wireless way to remind inspection personnel to continue inspection.
As shown in fig. 2, as an alternative embodiment, after the personnel tracking of the patrol personnel in step S102, the method further includes the following steps:
Step S701, obtaining a historical inspection route before determining the first target portion inspection route.
The historical inspection route may be an inspection route that the inspector has inspected before the first target portion inspection route is obtained.
Step S702, the latest routing inspection route is obtained by connecting the historical routing inspection route, the first target portion routing inspection route and the second target portion routing inspection route.
After the historical inspection route, the first target part inspection route and the second target part inspection route are obtained, all the inspection routes can be connected, so that the latest inspection route inspected by inspection personnel in the complete image of the well site can be obtained.
Step S703, determining a routing result for indicating whether the inspector inspects according to the complete routing by comparing the latest routing with the complete routing, wherein the complete routing is used for indicating the routing sequence of each point to be inspected in the well site.
After the latest routing inspection route is obtained, the latest routing inspection route can be compared with the complete routing inspection route, for example, the end point of the latest routing inspection route, namely the furthest position where an inspector is inspecting currently, can be determined firstly, then a segment routing inspection route between the starting point in the complete routing inspection route and the end point is determined, the similarity between the latest routing inspection route and the segment routing inspection route is calculated, and when the similarity meets the preset similarity requirements (such as 90%, 95% and the like), the routing inspection route result for indicating the inspector to inspect according to the complete routing inspection route can be determined; when the similarity does not meet the preset similarity requirement, a routing inspection route result for indicating that the inspector does not inspect according to the complete routing inspection route can be determined.
Optionally, the method of the embodiment may be implemented by a positioning comparison calculation module: the positioning comparison calculation module is communicated with the fixed camera and the cradle head camera to obtain a complete image of a well site of the image acquisition equipment and a patrol route of a patrol personnel relative to the complete image of the well site, and calculates a plane distance difference value between a patrol point position determined on the complete image of the well site and a target image position determined by the patrol personnel tracked by the image acquisition equipment; and calculating the distance difference value between the inspection route drawn in the inspection work order and the inspection route of the inspection personnel relative to the well site complete image.
It should be noted that, for simplicity of description, the foregoing method embodiments are all described as a series of acts, but it should be understood by those skilled in the art that the present application is not limited by the order of acts described, as some steps may be performed in other orders or concurrently in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required for the present application.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM (Read-Only Memory)/RAM (Random Access Memory), magnetic disk, optical disk), comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.
According to another aspect of the embodiment of the application, a well site inspection system for implementing the well site inspection method is also provided. FIG. 7 is a block diagram of an alternative wellsite inspection system, as shown in FIG. 7, in accordance with an embodiment of the present application, the system may include:
the acquisition module 1 is used for acquiring target inspection information, wherein the target inspection information is obtained after an inspection personnel inspects a target inspection point in a well site at a target moment;
the first determining module 2 is used for determining the target image position of the patrol personnel in the complete image of the well site when the target moment is reached by personnel tracking of the patrol personnel;
and the second determining module 3 is used for determining a routing inspection result corresponding to the target routing inspection information according to the target image position and the target routing inspection point position of the target routing inspection point, wherein the target routing inspection point position is the position of the target routing inspection point in the complete image of the well site.
It should be noted that, the acquisition module 1 in this embodiment may be used to perform the above-described step S101, the first determination module 2 in this embodiment may be used to perform the above-described step S102, and the second determination module 3 in this embodiment may be used to perform the above-described step S103.
The apparatus of this embodiment may further include, in addition to the above modules, modules for performing any of the methods of the embodiments of any of the above-described wellsite inspection methods.
It should be noted that the above modules are the same as examples and application scenarios implemented by the corresponding steps, but are not limited to what is disclosed in the above embodiments. It should be noted that the above modules may be implemented as part of an apparatus in a hardware environment implementing the method shown in fig. 1, and may be implemented by software, or may be implemented by hardware, where the hardware environment includes a network environment.
According to still another aspect of the embodiment of the present application, there is further provided an electronic device for implementing the above-mentioned well site inspection method, where the electronic device may be a server, a terminal, or a combination thereof.
According to another embodiment of the present application, there is also provided an electronic apparatus including: as shown in fig. 8, the electronic device may include: the device comprises a processor 1501, a communication interface 1502, a memory 1503 and a communication bus 1504, wherein the processor 1501, the communication interface 1502 and the memory 1503 are in communication with each other through the communication bus 1504.
A memory 1503 for storing a computer program;
The processor 1501, when executing the program stored in the memory 1503, performs the following steps:
step S101, target inspection information is obtained after inspection personnel inspect target inspection points in a well site at target time.
Step S102, by carrying out personnel tracking on the patrol personnel, determining the target image position of the patrol personnel in the complete image of the well site when the target moment is reached.
Step S103, determining a patrol result corresponding to the target patrol information according to the target image position and the target patrol point position of the target patrol point, wherein the target patrol point position is the position of the target patrol point in the complete image of the well site.
Alternatively, in the present embodiment, the above-described communication bus may be a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus, or an EISA (Extended Industry Standard Architecture ) bus, or the like. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus. The communication interface is used for communication between the electronic device and other devices.
The Memory may include random access Memory (Random Access Memory, RAM) or may include Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general purpose processor and may include, but is not limited to: CPU (Central Processing Unit ), NP (Network Processor, network processor), etc.; but also DSP (Digital Signal Processor ), ASIC (Application Specific Integrated Circuit, application specific integrated circuit), FPGA (Field-Programmable Gate Array, field programmable gate array) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.
The embodiment of the application also provides a computer readable storage medium, wherein the storage medium comprises a stored program, and the program executes the method steps of the method embodiment.
Alternatively, in the present embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a U disk, ROM, RAM, a mobile hard disk, a magnetic disk or an optical disk.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
The integrated units in the above embodiments may be stored in the above-described computer-readable storage medium if implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing one or more computer devices (which may be personal computers, servers or network devices, etc.) to perform all or part of the steps of the method described in the embodiments of the present application.
In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In several embodiments provided by the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, such as the division of the units, is merely a logical function division, and may be implemented in another manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution provided in the present embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application, which are intended to be comprehended within the scope of the present application.

Claims (10)

1. A method of wellsite inspection, comprising:
acquiring target inspection information, wherein the target inspection information is obtained after an inspector inspects a target inspection point in a well site at a target moment;
The method comprises the steps of determining the target image position of the patrol personnel in a complete image of a well site when the target moment is obtained by personnel tracking of the patrol personnel;
and determining a patrol result corresponding to the target patrol information according to the target image position and the target patrol point position of the target patrol point, wherein the target patrol point position is the position of the target patrol point in the well site complete image.
2. The method of claim 1, wherein prior to the acquiring the target patrol information, the method further comprises:
before the patrol personnel respond to a patrol worksheet to carry out patrol, acquiring the identity information of the patrol personnel, wherein the patrol worksheet is used for indicating a target personnel to carry out patrol on the well site;
and determining the image initial position of the patrol personnel on the complete image of the well site under the condition that the patrol personnel is determined to be the target personnel indicated by the patrol work order based on the patrol personnel identity information.
3. The method of claim 1, wherein prior to the acquiring the target patrol information, the method further comprises:
Acquiring a well site partial image obtained by image acquisition of the well site by each image acquisition device in a plurality of image acquisition devices;
preprocessing each well site partial image to obtain preprocessed images with image quality meeting preset requirements;
and splicing all the preprocessed images according to an overlapping area image to obtain a complete image of the well site, wherein the overlapping area image is characterized by at least two preprocessed images of the indicated well site partial area.
4. The method of claim 3, wherein after said obtaining a complete image of the wellsite at the wellsite by stitching all of the preprocessed images in accordance with the overlapping region images, the method further comprises:
generating a patrol worksheet for indicating a target person to patrol the well site;
generating a complete inspection route according to the position of each point to be inspected in the complete image of the well site and the inspection sequence of each point to be inspected, wherein the well site comprises the points to be inspected;
and sending the inspection worksheet and the complete inspection route to the target personnel.
5. The method of claim 1, wherein said personnel tracking of said inspector comprises:
when the current activated image acquisition equipment performs personnel tracking on the patrol personnel and determines that the patrol personnel is located in an edge monitoring area corresponding to the current activated image acquisition equipment, triggering target candidate image acquisition equipment with a detection area covering the edge monitoring area to perform personnel tracking on the patrol personnel and obtain a plurality of candidate part patrol routes, wherein the edge monitoring area corresponding to the current activated image acquisition equipment is an area capable of performing image acquisition in the current activated image acquisition equipment, the target candidate image acquisition equipment also can perform image acquisition, and the candidate part patrol routes comprise: the activated image acquisition equipment performs personnel tracking on the part of the inspection route obtained by the personnel tracking on the inspection personnel, and the target candidate image acquisition equipment performs personnel tracking on the part of the inspection route obtained by the personnel tracking on the inspection personnel;
determining a first target part inspection route in the complete image of the well site according to the candidate part inspection routes when the inspection personnel inspect in the edge monitoring area corresponding to the current activated image acquisition equipment;
When the appointed candidate image acquisition equipment in all target candidate image acquisition equipment determines that the patrol personnel image is positioned in an internal monitoring area corresponding to the appointed candidate image acquisition equipment, the appointed candidate image acquisition equipment is determined to be the latest activated image acquisition equipment, wherein the internal monitoring area corresponding to the appointed candidate image acquisition equipment is an area in the well site, only the appointed candidate image acquisition equipment can carry out image acquisition;
and carrying out personnel tracking on the route of the inspection personnel acting in the internal monitoring area of the latest activated image acquisition equipment through the latest activated image acquisition equipment to obtain a second target part inspection route in the complete image of the well site.
6. The method of claim 5, wherein after the personnel tracking of the patrol personnel, the method further comprises:
acquiring a historical inspection route before the first target part inspection route is determined;
the historical inspection route, the first target part inspection route and the second target part inspection route are connected to obtain a latest inspection route;
And comparing the latest routing inspection route with a complete routing inspection route to determine routing inspection route results for indicating whether the inspector inspects according to the complete routing inspection route, wherein the complete routing inspection route is used for indicating the routing inspection sequence of each point to be inspected in the well site.
7. The method according to any one of claims 1 to 6, wherein determining the inspection result corresponding to the target inspection information according to the target image position and the target inspection point position of the target inspection point includes:
determining a distance difference value of the patrol personnel relative to the target patrol point according to the target image position and the target patrol point position;
generating a patrol result for indicating that the patrol of the target patrol point meets the preset patrol requirement under the condition that the distance difference meets the preset distance requirement;
and under the condition that the distance difference value does not meet the preset distance requirement, generating a patrol result for indicating that the patrol of the target patrol point does not meet the preset patrol requirement and that the target patrol point is required to be subjected to patrol again.
8. A wellsite inspection system, comprising:
the system comprises an acquisition module, a detection module and a control module, wherein the acquisition module is used for acquiring target inspection information, wherein the target inspection information is obtained after an inspector inspects a target inspection point in a well field at a target moment;
the first determining module is used for determining the target image position of the patrol personnel in the complete image of the well site when the target moment is reached by personnel tracking of the patrol personnel;
and the second determining module is used for determining a patrol result corresponding to the target patrol information according to the target image position and the target patrol point position of the target patrol point, wherein the target patrol point position is the position of the target patrol point in the well site complete image.
9. An electronic device comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus, characterized in that,
the memory is used for storing a computer program;
the processor is configured to perform the method steps of any of claims 1 to 7 by running the computer program stored on the memory.
10. A computer-readable storage medium, characterized in that the storage medium has stored therein a computer program, wherein the computer program is arranged to perform the method steps of any of claims 1 to 7 when run.
CN202310797899.3A 2023-06-30 2023-06-30 Well site inspection method and system, electronic equipment and storage medium Pending CN116912962A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310797899.3A CN116912962A (en) 2023-06-30 2023-06-30 Well site inspection method and system, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310797899.3A CN116912962A (en) 2023-06-30 2023-06-30 Well site inspection method and system, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116912962A true CN116912962A (en) 2023-10-20

Family

ID=88363979

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310797899.3A Pending CN116912962A (en) 2023-06-30 2023-06-30 Well site inspection method and system, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116912962A (en)

Similar Documents

Publication Publication Date Title
Bang et al. UAV-based automatic generation of high-resolution panorama at a construction site with a focus on preprocessing for image stitching
Yang et al. Vision-based tower crane tracking for understanding construction activity
Soltani et al. Framework for location data fusion and pose estimation of excavators using stereo vision
CN110494861B (en) Image-based anomaly detection method and system
CN108012083A (en) Face acquisition method, device and computer-readable recording medium
CN101167086A (en) Human detection and tracking for security applications
CN107205366A (en) Same fish identification equipment, fish counting equipment, portable terminal, the recognition methods of same fish, fish method of counting, fish count predictions equipment, fish count predictions method, same fish identifying system, fish number system and the fish count predictions system counted for fish
CN107817750A (en) A kind of building monitoring system based on BIM
KR101988356B1 (en) Smart field management system through 3d digitization of construction site and analysis of virtual construction image
US8284292B2 (en) Probability distribution constructing method, probability distribution constructing apparatus, storage medium of probability distribution constructing program, subject detecting method, subject detecting apparatus, and storage medium of subject detecting program
KR20150083480A (en) System for managing facilities by using 3d stereoscopic images
CN114445780A (en) Detection method and device for bare soil covering, and training method and device for recognition model
Al-Sabbag et al. Enabling human–machine collaboration in infrastructure inspections through mixed reality
CN109800656B (en) Positioning method and related product
US20220083774A1 (en) Method and system for asset inspection using unmanned aerial vehicles
Guo et al. Visual pattern recognition supporting defect reporting and condition assessment of wastewater collection systems
CN109858319A (en) Image processing equipment and control method and non-transitory computer-readable storage media
CN116912962A (en) Well site inspection method and system, electronic equipment and storage medium
CN111966126A (en) Unmanned aerial vehicle patrol method and device and unmanned aerial vehicle
JP4985742B2 (en) Imaging system, method and program
Tang Development of a multiple-camera tracking system for accurate traffic performance measurements at intersections
KR20200141274A (en) Position Verification Method for Equipment Layout at 3D Design of Smart Factory
CN112802112B (en) Visual positioning method, device, server and storage medium
CN113065410A (en) Intelligent control method, system, medium and device for container drawing process
KR101702452B1 (en) A method and a system for providing cctv image applied augmented reality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination