CN115100285A - Wind power sensor installation method, device, equipment and readable storage medium - Google Patents
Wind power sensor installation method, device, equipment and readable storage medium Download PDFInfo
- Publication number
- CN115100285A CN115100285A CN202211023128.0A CN202211023128A CN115100285A CN 115100285 A CN115100285 A CN 115100285A CN 202211023128 A CN202211023128 A CN 202211023128A CN 115100285 A CN115100285 A CN 115100285A
- Authority
- CN
- China
- Prior art keywords
- wind power
- power sensor
- installation
- measuring point
- operator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E10/00—Energy generation through renewable energy sources
- Y02E10/70—Wind energy
- Y02E10/72—Wind turbines with rotation axis in wind direction
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Business, Economics & Management (AREA)
- Evolutionary Computation (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Medical Informatics (AREA)
- Human Resources & Organizations (AREA)
- General Health & Medical Sciences (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Strategic Management (AREA)
- Computer Graphics (AREA)
- Operations Research (AREA)
- Marketing (AREA)
- Economics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Emergency Management (AREA)
- Wind Motors (AREA)
Abstract
The application discloses a wind power sensor installation method, a device, equipment and a readable storage medium, wherein the method comprises the following steps: identifying characteristic information of the gear box based on AR technology to obtain the position of a measuring point of the wind power sensor; when detecting that an operator finishes the installation of the wind power sensor of the measuring point, acquiring a first image of the measuring point; inputting the first image to a measuring point installation state model to obtain an installation state model result; and determining and displaying the installation state information of the measuring points based on the installation state model result. According to the method and the device, the positions of the measuring points, the mounting method of the wind power sensor and the mounting state information of the measuring points after the wind power sensor is mounted are accurately determined, and the mounting accuracy of the wind power sensor is improved.
Description
Technical Field
The application relates to the field of wind power, in particular to a wind power sensor installation method, device and equipment and a readable storage medium.
Background
With the development of the wind power sensor installation technology, people have higher and higher requirements on the accuracy rate of the wind power sensor installation.
The traditional installation method of the wind power sensor mainly guides an operator to install the wind power sensor through a text installation specification, the installation experience of the operator is greatly depended on, and the installation accuracy of the wind power sensor is low due to the fact that the experience abundance degree of the operator and the character understanding capability are different.
Disclosure of Invention
In view of this, the present application provides a method, an apparatus, a device and a readable storage medium for installing a wind power sensor, and aims to improve the installation accuracy of the wind power sensor.
In order to achieve the above object, the present application provides a wind power sensor mounting method, including:
identifying characteristic information of the gear box based on AR technology to obtain the position of a measuring point of the wind power sensor;
when detecting that an operator finishes the installation of the wind power sensor of the measuring point, acquiring a first image of the measuring point;
inputting the first image to a measuring point installation state model to obtain an installation state model result;
and determining and displaying the installation state information of the measuring points based on the installation state model result.
Illustratively, the determining and displaying the installation state information of the measuring point comprises the following steps:
if the installation state information indicates that the wind power sensor is installed correctly, outputting first prompt information to remind the operator of completing installation correctly;
and if the installation state information indicates that the wind power sensor is not installed correctly, outputting second prompt information for reporting an error to remind the operator to reinstall the wind power sensor of the measuring point.
Exemplarily, the identifying characteristic information of the gearbox based on the AR technology and obtaining the positions of the measuring points of the wind power sensor include:
when a playing instruction input by the operator is received, playing an explanation video of the measuring point so that the operator can learn an installation method in the explanation video;
when a viewing instruction input by the operator is detected, displaying the sensor model of the measuring point on an interactive interface of a mobile phone so that the operator can check the mounted sensor;
and when an installation finishing instruction input by the operator is detected, determining that the operator finishes the installation of the measuring point.
Illustratively, the identifying characteristic information of the gearbox based on the AR technology before obtaining the measuring point position of the wind power sensor includes:
respectively acquiring images of a gear box and an air sensor;
extracting size information of the gear box and position information of a measuring point of the wind power sensor;
respectively building a gearbox model and a sensor model based on the image and the information;
associating the gearbox model and the sensor model with an environment, respectively.
For example, before inputting the first image to the survey point installation state model and obtaining the installation state model result, the method includes:
acquiring an image training sample with the measuring point correctly installed;
and performing iterative training on a preset training model based on the training sample to obtain the measuring point position state model.
Illustratively, the method further comprises:
when the wind power sensor needs to be maintained, acquiring a second image of the wind power sensor;
inputting the second image into a wind power sensor model, and determining and displaying a fault position of the wind power sensor so that the operator can maintain the fault position;
and determining the maintenance state information of the wind power sensor.
For example, the determining the maintenance state information of the wind power sensor includes:
when a maintenance finishing instruction input by the operator is detected, determining that the operator finishes the maintenance of the wind power sensor;
acquiring a third image of the wind power sensor;
inputting the third image into the wind power sensor model to obtain a wind power sensor model result;
determining maintenance state information of the wind power sensor based on a wind power sensor model result;
and if the maintenance state information indicates that the maintenance of the wind power sensor is not completed, outputting third prompt information for reporting an error to remind the operator to re-maintain the wind power sensor.
Illustratively, in order to achieve the above object, the present application further provides a wind power sensor mounting device, which includes:
the identification module is used for identifying the characteristic information of the gear box based on the AR technology to obtain the position of a measuring point of the wind power sensor;
the acquisition module is used for acquiring a first image of the measuring point when detecting that an operator finishes the installation of the wind power sensor of the measuring point;
the input module is used for inputting the first image to a measuring point installation state model to obtain an installation state model result;
and the determining module is used for determining and displaying the installation state information of the measuring point based on the installation state model result.
Illustratively, to achieve the above object, the present application further provides a wind power sensor installation apparatus, which includes a memory, a processor and a wind power sensor installation program stored on the memory and operable on the processor, wherein when being executed by the processor, the wind power sensor installation program implements the steps of the wind power sensor installation method as described above.
Illustratively, to achieve the above object, the present application further provides a computer readable storage medium, on which a wind power sensor installation program is stored, and the wind power sensor installation program, when executed by a processor, implements the steps of the wind power sensor installation method as described above.
Compared with the prior art, the wind power sensor installation method has the advantages that the wind power sensor installation accuracy is low due to the fact that installation experience and character understanding capability of operators are different when the operators are guided to install the wind power sensor by the aid of the installation specifications of the text version. The method is based on the AR technology, the characteristic information of the gearbox is identified, and the position of a measuring point of the wind power sensor is obtained; when detecting that an operator finishes the installation of the wind power sensor of the measuring point, acquiring a first image of the measuring point; inputting the first image to a measuring point installation state model to obtain an installation state model result; and determining and displaying the installation state information of the measuring points based on the installation state model result. By adopting the AR technology, the method enables operators to understand the positions of the measuring points and the installation method more visually and more accurately, and the installed measuring points are detected, so that the wrong installation of the measuring points is avoided. Therefore, the position of the measuring point, the installation method of the wind power sensor and the installation state information of the measuring point after the installation are accurately determined, and the installation accuracy of the wind power sensor is improved.
Drawings
FIG. 1 is a schematic flow chart of a first embodiment of a wind power sensor installation method according to the present application;
FIG. 2 is a schematic view of a gearbox model of a first embodiment of a wind sensor installation method of the present application;
fig. 3 is a schematic structural diagram of a hardware operating environment according to an embodiment of the present application.
The implementation, functional features and advantages of the object of the present application will be further explained with reference to the embodiments, and with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The application provides a wind power sensor installation method, and with reference to fig. 1, fig. 1 is a schematic flow diagram of a first embodiment of the wind power sensor installation method.
The present application provides an embodiment of a wind power sensor installation method, and it should be noted that although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in an order different from that shown or described here. For convenience of description, the following omits the execution of the main body to describe various steps of a wind power sensor installation method including:
and step S10, recognizing the characteristic information of the gear box based on the AR technology to obtain the position of the measuring point of the wind power sensor.
Illustratively, the characteristic information of the gearbox includes two-dimensional code information, label information, size information of the gearbox, and the like.
Exemplary wind power sensors integrated with the gearbox include low frequency acceleration sensors, vibration acceleration sensors, and the like.
Illustratively, the position of the measuring point comprises a radial horizontal position of the main bearing, an axial position of the main bearing, a radial horizontal position of the secondary planet wheel and the like.
In this embodiment, when going up, the operator wears a mobile phone with an AR-app (Augmented Reality-Application) built therein. The environment in the fan tower is scanned through the mobile phone, the characteristic information of the gear box is identified, and the AR model of the gear box is obtained. As shown in fig. 2, 201 is a gearbox model, 202 is a position of a measuring point of a wind power sensor, and 203 is an explanation video playing button. In the gearbox model, the positions of the measuring points of the wind power sensor are in a bright state in the gearbox model. And clicking a light spot corresponding to a measuring point in the gear box model, opening a 3D (three-dimensional) ring view of the measuring point, and viewing the environment of the measuring point at 360 degrees so as to enable an operator to determine the position of the corresponding measuring point according to the surrounding environment.
Illustratively, the identifying characteristic information of the gearbox based on the AR technology before obtaining the position of the measuring point of the wind power sensor comprises:
in this embodiment, the AR-app built in needs to be developed through the component of the ARcore, and in order to completely and accurately assist the worker in completing the installation of the wind power sensor, the AR-app needs to have 5 modules: the system comprises an environment recognition module, a motion tracking module, a model development module, a cloud anchor point module and a convolutional neural network module. The environment identification module adopts an Application Programming Interface (API) to photograph and record a required gearbox, and ensures light so as to identify relevant characteristics; the motion tracking module is used for completing the fixation of the model; the model development module is used for generating a gear box model, a wind power sensor model and a video explanation model; the cloud anchor point module is used for supporting multi-person collaborative installation, when one person plays the explanation video, the operator of the other mobile phone can also receive the content of the played video, and the measuring points marked to be installed can be synchronously checked; and the convolutional neural network module is used for determining whether the wind power sensor is correctly installed. The construction and refinement of the model can be accomplished by the following steps.
Step a1, images of the gearbox and wind sensor are acquired, respectively.
In this embodiment, images of a first preset number of gear boxes and images of a second preset number of wind power sensors are obtained, where the first preset number and the second preset number are set as needed, and this embodiment is not limited specifically.
Step a2, extracting the size information of the gear box and the position information of the measuring point of the wind power sensor.
In the embodiment, size information of the gearbox is extracted from the acquired images of the first preset number of gearboxes, the size information comprises length, width, height and the like of the gearbox, and a proportional relation among the sizes is obtained for establishing a gearbox model based on the proportional relation. And acquiring the position information of the wind power sensor from each image so as to pre-embed the position of the wind power sensor in the AR model.
Step a3, respectively building a gearbox model and a sensor model based on the image and the information.
In this embodiment, a gearbox model and a sensor model are built through AR software.
Step a4, associating the gearbox model and the sensor model with the environment, respectively.
When the gearbox is identified through the mobile phone, the model is placed in the environment, the relevant position is adjusted, an absolute path is set, and the situation that the position of the model is not influenced by the movement of the mobile phone is guaranteed. On the basis of correlation, the ARCore software can determine the position of the mobile phone relative to the surrounding world through parallel ranging and mapping, and the effect of model fixing is achieved.
Exemplarily, the identifying characteristic information of the gearbox based on the AR technology and obtaining the positions of the measuring points of the wind power sensor include:
and b1, when a playing instruction input by the operator is received, playing an explanation video of the measuring point so that the operator can learn the installation method in the explanation video.
In this embodiment, as shown in fig. 2, an operator clicks a play touch key of a measurement point in an AR model, triggers a play instruction of an AR-app, and plays an explanation video corresponding to the measurement point, so that the operator learns an installation method in the explanation video.
And b2, when a viewing instruction input by the operator is detected, displaying the sensor model of the measuring point on an interactive interface of a mobile phone so that the operator can check the mounted sensor.
In this embodiment, when an operator clicks the sensor model of the measurement point in the AR model, the sensor model of the measurement point is displayed on the interactive interface of the mobile phone, so that the operator can check the installed sensor.
And step b3, when the instruction of completing the installation input by the operator is detected, determining that the operator completes the installation of the measuring point.
In the embodiment, after the installation work of the wind power sensor at the measuring point is completed by an operator, and the installation is confirmed to be correct by comparing with a wind power sensor model in a mobile phone, the operator clicks a completed button of the mobile phone interactive interface.
And step S20, when detecting that the installation of the wind power sensor of the measuring point is completed by an operator, acquiring a first image of the measuring point.
In this embodiment, when it is detected that an operator completes installation of a wind power sensor of a measuring point, a first image of the measuring point is acquired to detect whether the wind power sensor is correctly installed, so that the operator is prevented from repeatedly going up to a tower to perform operation after mistaken installation.
And step S30, inputting the first image to a measuring point installation state model to obtain an installation state model result.
In this embodiment, the acquired first image is input to the measurement point installation state model, and comparison is performed to obtain an installation state model result.
For example, before inputting the first image to the measuring point installation state model and obtaining the installation state model result, the method includes:
step c1, acquiring an image training sample with the correctly installed measuring point position;
and c2, performing iterative training on a preset training model based on the training sample to obtain the measuring point position state model.
In this embodiment, the training process of the convolutional neural network is divided into two stages: the first stage is a stage of data propagation from a low level to a high level, namely a forward propagation stage; the second phase is a phase of training for propagating the error from the high level to the low level when the result obtained by forward propagation is different from the target result, namely, a backward propagation phase. And acquiring an image training sample of the wind power sensor at the measuring point, carrying out weight initialization on the image training sample, and carrying out forward propagation on the convolution layer, the down-sampling layer and the full-connection layer to obtain an output value. And calculating the error between the output value and the target value, and when the error is larger than the preset value, transmitting the error back to the network for recalculation until the error is smaller than the preset value. The preset value is set as required, and this embodiment is not particularly limited.
And step S40, determining and displaying the installation state information of the measuring point based on the installation state model result.
In this embodiment, the installation state information includes correct installation of the wind power sensor and incorrect installation of the wind power sensor.
Illustratively, the determining and displaying the installation state information of the measuring point comprises the following steps:
if the installation state information indicates that the wind power sensor is installed correctly, outputting first prompt information to remind the operator of completing installation correctly;
and if the installation state information indicates that the wind power sensor is not installed correctly, outputting second prompt information for error reporting to remind the operator to reinstall the wind power sensor of the measuring point.
In this embodiment, if an operator correctly installs the wind power sensor, first prompt information is displayed on a mobile phone interaction interface, where the first prompt information may be "correctly install", "complete and return" to remind the operator that installation is correctly completed, and after the operator clicks confirmation, the operator returns to an operation interface and displays "installation is completed" at the measurement point of the AR model; and if the wind power sensor is not correctly installed by the operator, displaying second prompt information on a mobile phone interaction interface to remind the operator to reinstall the wind power sensor of the measuring point until the wind power sensor of the measuring point is correctly installed.
Compared with the prior art, the wind power sensor installation method has the advantages that the wind power sensor installation accuracy is low due to the fact that installation experience and character comprehension capability of operators are different when the operators are guided to install the wind power sensor by the aid of installation specifications of text versions. The method is based on the AR technology, the characteristic information of the gear box is recognized, and the position of a measuring point of the wind power sensor is obtained; when detecting that an operator finishes the installation of the wind power sensor of the measuring point, acquiring a first image of the measuring point; inputting the first image to a measuring point installation state model to obtain an installation state model result; and determining and displaying the installation state information of the measuring points based on the installation state model result. By adopting the AR technology, the method enables operators to understand the positions of the measuring points and the installation method more visually and more accurately, and the installed measuring points are detected, so that the wrong installation of the measuring points is avoided. Therefore, the position of the measuring point, the installation method of the wind power sensor and the installation state information of the measuring point after the installation are accurately determined, and the installation accuracy of the wind power sensor is improved.
Exemplarily, based on the first embodiment of the installation method of the wind power sensor of the present application, a second embodiment is provided, and the method further includes:
step d1, when the wind power sensor needs to be maintained, acquiring a second image of the wind power sensor;
step d2, inputting the second image into a wind power sensor model, and determining and displaying the fault position of the wind power sensor so that the operator can maintain the fault position;
and d3, determining the maintenance state information of the wind power sensor.
In this embodiment, when the wind power sensor needs to be maintained, the wind power sensor that needs to be maintained is scanned or the image of the wind power sensor is shot by a mobile phone and compared with the wind power sensor model, the position that needs to be maintained is determined and displayed in the AR model in a light state, so that an operator can maintain the fault position. And after the maintenance is finished by the operating personnel, detecting the wind power sensor after the maintenance to determine whether the maintenance is finished correctly.
For example, the determining the maintenance state information of the wind power sensor includes:
step d31, when a maintenance finishing instruction input by the operator is detected, determining that the operator finishes the maintenance of the wind power sensor;
step d32, acquiring a third image of the wind power sensor;
step d33, inputting the third image into the wind power sensor model to obtain a wind power sensor model result;
step d34, determining maintenance state information of the wind power sensor based on the wind power sensor model result;
and d35, if the maintenance state information indicates that the maintenance of the wind power sensor is not completed, outputting third prompt information for error reporting to remind the operator to maintain the wind power sensor again.
In this embodiment, the operator clicks the "completed maintenance" button after completing the maintenance work. And acquiring an image of the wind power sensor after maintenance through the mobile phone, inputting the image into the wind power sensor model, comparing the image with the wind power sensor model, and determining whether the maintenance is correctly completed. If the operator completes the maintenance of the wind power sensor correctly, third prompt information is displayed on a mobile phone interaction interface, wherein the third prompt information can be 'correct maintenance', 'completion and return' to remind the operator that the maintenance is completed correctly, the operator returns to an operation interface after clicking confirmation, and the 'maintenance completion' is displayed at the measuring point of the AR model; and if the wind power sensor is not correctly maintained by the operator, displaying fourth prompt information on a mobile phone interactive interface so as to remind the operator to re-maintain the wind power sensor at the measuring point.
Compared with the prior art, the method has the advantages that the fault position is judged manually by operators, and the accuracy of maintenance or reinstallation of the wind power sensor is low due to the fact that the experience of manually judging the fault position and the maintenance experience are uneven.
Illustratively, the present application further provides a wind power sensor mounting apparatus, the wind power sensor mounting apparatus includes:
the identification module is used for identifying the characteristic information of the gear box based on the AR technology to obtain the position of a measuring point of the wind power sensor;
the first acquisition module is used for acquiring a first image of the measuring point when detecting that an operator finishes the installation of the wind power sensor of the measuring point;
the input module is used for inputting the first image to a measuring point installation state model to obtain an installation state model result;
and the first determining module is used for determining and displaying the installation state information of the measuring point based on the installation state model result.
Illustratively, the first determining module includes:
the first output submodule is used for outputting first prompt information to remind the operator of correctly finishing the installation if the installation state information indicates that the wind power sensor is correctly installed;
and the second output submodule is used for outputting second prompt information for error reporting if the installation state information indicates that the wind power sensor is not installed correctly, so as to remind the operator to reinstall the wind power sensor of the measuring point.
The wind power sensor mounting device further comprises:
the playing module is used for playing the explanation video of the measuring point when receiving a playing instruction input by the operator so that the operator can learn the installation method in the explanation video;
the display module is used for displaying the sensor model of the measuring point on an interactive interface of a mobile phone when a viewing instruction input by the operator is detected, so that the operator can check the mounted sensor;
and the second determining module is used for determining that the operator completes the installation of the measuring point when the installation completing instruction input by the operator is detected.
The wind power sensor mounting device further comprises:
the second acquisition module is used for respectively acquiring images of the gear box and the wind sensor;
the extraction module is used for extracting the size information of the gear box and the position information of a measuring point of the wind power sensor;
the building module is used for building a gear box model and a sensor model respectively based on the image and the information;
an association module for associating the gearbox model and the sensor model with an environment, respectively.
The wind power sensor mounting device further comprises:
the third acquisition module is used for acquiring an image training sample with the correctly installed measuring point position;
and the iteration module is used for carrying out iterative training on a preset training model based on the training sample to obtain the measuring point position state model.
The wind power sensor mounting device further comprises:
the fourth acquisition module is used for acquiring a second image of the wind power sensor when the wind power sensor needs to be maintained;
the third determining module is used for inputting the second image into a wind power sensor model, determining and displaying the fault position of the wind power sensor, so that the operator can maintain the fault position;
and the fourth determination module is used for determining the maintenance state information of the wind power sensor.
Illustratively, the fourth determining module includes:
the first determining submodule is used for determining that the operator completes maintenance of the wind power sensor when a maintenance completion instruction input by the operator is detected;
the acquisition submodule is used for acquiring a third image of the wind power sensor;
the input submodule is used for inputting the third image into the wind power sensor model to obtain a wind power sensor model result;
the second determining submodule is used for determining maintenance state information of the wind power sensor based on a wind power sensor model result;
and the third output submodule is used for outputting third prompt information for error reporting if the maintenance state information indicates that the maintenance of the wind power sensor is not completed, so as to remind the operator to maintain the wind power sensor again.
The specific implementation mode of the wind power sensor installation device is basically the same as that of each embodiment of the wind power sensor installation method, and is not repeated here.
In addition, this application still provides a wind-powered electricity generation sensor erection equipment. As shown in fig. 3, fig. 3 is a schematic structural diagram of a hardware operating environment according to an embodiment of the present application (except for the master controller, the slave controller, and the cellular network module).
For example, fig. 3 is a schematic structural diagram of a hardware operating environment of the wind power sensor installation device.
As shown in fig. 3, the wind power sensor installation apparatus may include a processor 301, a communication interface 302, a memory 303 and a communication bus 304, wherein the processor 301, the communication interface 302 and the memory 303 complete communication with each other through the communication bus 304, and the memory 303 is used for storing a computer program; the processor 301 is configured to implement the steps of the wind power sensor installation method when executing the program stored in the memory 303.
The communication bus 304 mentioned above for the wind power sensor installation device may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus 304 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface 302 is used for communication between the wind power sensor mounting device and other devices.
The Memory 303 may include a Random Access Memory (RMD) or a Non-Volatile Memory (NM), such as at least one disk Memory. Optionally, the memory 303 may also be at least one storage device located remotely from the processor 301.
The Processor 301 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
The specific implementation mode of the wind power sensor installation equipment is basically the same as that of each embodiment of the wind power sensor installation method, and is not described again here.
In addition, an embodiment of the present application further provides a computer-readable storage medium, where a wind power sensor installation program is stored on the computer-readable storage medium, and when being executed by a processor, the wind power sensor installation program implements the steps of the wind power sensor installation method described above.
The specific implementation manner of the computer-readable storage medium of the present application is substantially the same as that of each embodiment of the wind power sensor installation method, and is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method of the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better implementation. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, a device, or a network device) to execute the method according to the embodiments of the present application.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.
Claims (10)
1. A wind power sensor mounting method, characterized in that the method comprises:
identifying characteristic information of the gear box based on AR technology to obtain the position of a measuring point of the wind power sensor;
when detecting that an operator finishes the installation of the wind power sensor of the measuring point, acquiring a first image of the measuring point;
inputting the first image to a measuring point installation state model to obtain an installation state model result;
and determining and displaying the installation state information of the measuring points based on the installation state model result.
2. The method of claim 1, wherein said determining and presenting installation status information for said stations comprises:
if the installation state information indicates that the wind power sensor is installed correctly, outputting first prompt information to remind the operator of completing the installation correctly;
and if the installation state information indicates that the wind power sensor is not installed correctly, outputting second prompt information for error reporting to remind the operator to reinstall the wind power sensor of the measuring point.
3. The method of claim 1, wherein the identifying the characteristic information of the gearbox based on the AR technology after obtaining the position of the measuring point of the wind power sensor comprises:
when a playing instruction input by the operator is received, playing an explanation video of the measuring point so that the operator can learn an installation method in the explanation video;
when a viewing instruction input by the operator is detected, displaying the sensor model of the measuring point on an interactive interface of a mobile phone so that the operator can check the mounted sensor;
and when the installation finishing instruction input by the operator is detected, determining that the operator finishes the installation of the measuring point.
4. The method of claim 1, wherein the identifying characteristic information of the gearbox based on the AR technology before obtaining the measuring point position of the wind power sensor comprises:
respectively acquiring images of a gear box and an air sensor;
extracting size information of the gear box and position information of a measuring point of the wind power sensor;
respectively building a gearbox model and a sensor model based on the image and the information;
associating the gearbox model and the sensor model with an environment, respectively.
5. The method of claim 1, wherein inputting the first image to a site installation condition model before obtaining an installation condition model result comprises:
acquiring an image training sample with the measuring point correctly installed;
and performing iterative training on a preset training model based on the training sample to obtain the measuring point position state model.
6. The method of any of claims 1 to 5, further comprising:
when the wind power sensor needs to be maintained, acquiring a second image of the wind power sensor;
inputting the second image into a wind power sensor model, and determining and displaying a fault position of the wind power sensor so that the operator can maintain the fault position;
and determining the maintenance state information of the wind power sensor.
7. The method of claim 6, wherein the determining the maintenance status information for the wind power sensor comprises:
when a maintenance finishing instruction input by the operator is detected, determining that the operator finishes the maintenance of the wind power sensor;
acquiring a third image of the wind power sensor;
inputting the third image into the wind power sensor model to obtain a wind power sensor model result;
determining maintenance state information of the wind power sensor based on a wind power sensor model result;
and if the maintenance state information indicates that the maintenance of the wind power sensor is not completed, outputting third prompt information for reporting an error to remind the operator to re-maintain the wind power sensor.
8. A wind power sensor mounting apparatus, the apparatus comprising:
the identification module is used for identifying the characteristic information of the gear box based on the AR technology to obtain the position of a measuring point of the wind power sensor;
the acquisition module is used for acquiring a first image of the measuring point when detecting that an operator finishes the installation of the wind power sensor of the measuring point;
the input module is used for inputting the first image to a measuring point installation state model to obtain an installation state model result;
and the determining module is used for determining and displaying the installation state information of the measuring point based on the installation state model result.
9. Wind power sensor installation equipment, characterized in that it comprises a memory, a processor and a wind power sensor installation program stored on said memory and executable on said processor, said wind power sensor installation program, when executed by said processor, implementing the steps of the wind power sensor installation method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that a wind power sensor installation program is stored on the computer-readable storage medium, which when executed by a processor implements the steps of the wind power sensor installation method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211023128.0A CN115100285B (en) | 2022-08-25 | 2022-08-25 | Wind power sensor installation method, device, equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211023128.0A CN115100285B (en) | 2022-08-25 | 2022-08-25 | Wind power sensor installation method, device, equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115100285A true CN115100285A (en) | 2022-09-23 |
| CN115100285B CN115100285B (en) | 2022-12-09 |
Family
ID=83301592
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211023128.0A Active CN115100285B (en) | 2022-08-25 | 2022-08-25 | Wind power sensor installation method, device, equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115100285B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116451447A (en) * | 2023-03-31 | 2023-07-18 | 北京瑞风协同科技股份有限公司 | Sensor layout design method and system of vector model |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019094729A1 (en) * | 2017-11-09 | 2019-05-16 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for the industrial internet of things |
| US20190359300A1 (en) * | 2014-12-31 | 2019-11-28 | FLIR Belgium BVBA | Perimeter ranging sensor systems and methods |
| CN110657985A (en) * | 2019-10-11 | 2020-01-07 | 重庆邮电大学 | Gearbox fault diagnosis method and system based on singular value spectrum manifold analysis |
| US20200110935A1 (en) * | 2018-10-07 | 2020-04-09 | General Electric Company | Augmented reality system to map and visualize sensor data |
| CN112504339A (en) * | 2020-12-01 | 2021-03-16 | 北京鼎翰建筑有限公司 | Handheld volume side equipment based on AR |
| CN113516828A (en) * | 2021-09-15 | 2021-10-19 | 深圳市信润富联数字科技有限公司 | Drowning monitoring method, drowning monitoring device, drowning monitoring equipment and computer readable storage medium |
| CN113596249A (en) * | 2021-06-17 | 2021-11-02 | 荣耀终端有限公司 | Electronic apparatus and control method |
| CN113671489A (en) * | 2021-08-09 | 2021-11-19 | 珠海格力电器股份有限公司 | State reminding method and device, electronic equipment and computer readable storage medium |
| CN114201831A (en) * | 2021-12-13 | 2022-03-18 | 大连理工大学 | Rolling bearing working condition quantitative analysis method based on vibration signal real-time acquisition |
| CN114510027A (en) * | 2021-12-22 | 2022-05-17 | 中煤科工开采研究院有限公司 | Underground coal mine equipment inspection method and device based on AR technology |
-
2022
- 2022-08-25 CN CN202211023128.0A patent/CN115100285B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190359300A1 (en) * | 2014-12-31 | 2019-11-28 | FLIR Belgium BVBA | Perimeter ranging sensor systems and methods |
| WO2019094729A1 (en) * | 2017-11-09 | 2019-05-16 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for the industrial internet of things |
| US20200110935A1 (en) * | 2018-10-07 | 2020-04-09 | General Electric Company | Augmented reality system to map and visualize sensor data |
| CN110657985A (en) * | 2019-10-11 | 2020-01-07 | 重庆邮电大学 | Gearbox fault diagnosis method and system based on singular value spectrum manifold analysis |
| CN112504339A (en) * | 2020-12-01 | 2021-03-16 | 北京鼎翰建筑有限公司 | Handheld volume side equipment based on AR |
| CN113596249A (en) * | 2021-06-17 | 2021-11-02 | 荣耀终端有限公司 | Electronic apparatus and control method |
| CN113671489A (en) * | 2021-08-09 | 2021-11-19 | 珠海格力电器股份有限公司 | State reminding method and device, electronic equipment and computer readable storage medium |
| CN113516828A (en) * | 2021-09-15 | 2021-10-19 | 深圳市信润富联数字科技有限公司 | Drowning monitoring method, drowning monitoring device, drowning monitoring equipment and computer readable storage medium |
| CN114201831A (en) * | 2021-12-13 | 2022-03-18 | 大连理工大学 | Rolling bearing working condition quantitative analysis method based on vibration signal real-time acquisition |
| CN114510027A (en) * | 2021-12-22 | 2022-05-17 | 中煤科工开采研究院有限公司 | Underground coal mine equipment inspection method and device based on AR technology |
Non-Patent Citations (4)
| Title |
|---|
| 徐向阳等: "大功率船用齿轮箱试验模态分析", 《振动与冲击》 * |
| 王桂兰等: "基于结构分析的风机齿轮箱传感器配置研究", 《振动与冲击》 * |
| 王锋等: "基于数据驱动的动车组齿轮箱在线故障预报", 《振动.测试与诊断》 * |
| 陈道章等: "齿轮箱故障诊断的谱分析法", 《电子科技大学学报》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116451447A (en) * | 2023-03-31 | 2023-07-18 | 北京瑞风协同科技股份有限公司 | Sensor layout design method and system of vector model |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115100285B (en) | 2022-12-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2019204384B2 (en) | Determining image transforms without using image acquisition metadata | |
| CN112102646B (en) | Parking lot entrance positioning method and device in parking positioning and vehicle-mounted terminal | |
| WO2019150321A1 (en) | Improved augmented reality system | |
| García-Pereira et al. | A collaborative augmented reality annotation tool for the inspection of prefabricated buildings | |
| US10810018B2 (en) | Device with extensibility | |
| CN114155244B (en) | Defect detection method, device, equipment and storage medium | |
| CN115100285B (en) | Wind power sensor installation method, device, equipment and readable storage medium | |
| CN109901996B (en) | Auxiliary test method and device, electronic equipment and readable storage medium | |
| CN108427941B (en) | Method for generating face detection model, face detection method and device | |
| KR101989969B1 (en) | Contents experience system of architectural sites based augmented reality | |
| CN111428373A (en) | Product assembly quality detection method, device, equipment and storage medium | |
| CN111428374A (en) | Part defect detection method, device, equipment and storage medium | |
| KR20220168573A (en) | Computer-implemented method and system for generating a synthetic training data set for training a machine learning computer vision model | |
| US8413341B2 (en) | Vehicle measurement system with user interface | |
| CN113989616A (en) | Target detection method, device, equipment and storage medium | |
| CN110619497A (en) | Address checking method, device, electronic equipment and storage medium | |
| CN111507135A (en) | Face detection method and device, computer equipment and storage medium | |
| CN113553261A (en) | Software automation test method, equipment and computer readable storage medium | |
| CN108805121B (en) | License plate detection and positioning method, device, equipment and computer readable medium | |
| US20230206519A1 (en) | Freehand sketch image generating method and system for machine learning | |
| CN115393423A (en) | Target detection method and device | |
| CN114972500A (en) | Checking method, marking method, system, device, terminal, equipment and medium | |
| CN114419564A (en) | Vehicle pose detection method, device, equipment, medium and automatic driving vehicle | |
| CN111124862A (en) | Intelligent equipment performance testing method and device and intelligent equipment | |
| US9435888B1 (en) | Shape matching automatic recognition methods, systems and articles of manufacturing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |