CN113923439A - Wind power generation commanding and dispatching system and method based on AR application - Google Patents
Wind power generation commanding and dispatching system and method based on AR application Download PDFInfo
- Publication number
- CN113923439A CN113923439A CN202111344051.2A CN202111344051A CN113923439A CN 113923439 A CN113923439 A CN 113923439A CN 202111344051 A CN202111344051 A CN 202111344051A CN 113923439 A CN113923439 A CN 113923439A
- Authority
- CN
- China
- Prior art keywords
- wind power
- control terminal
- power generation
- head
- dispatching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing And Monitoring For Control Systems (AREA)
Abstract
The application discloses a wind power generation commanding and dispatching system and method based on AR application. The system comprises a head-wearing AR intelligent individual control terminal and a remote commanding and dispatching terminal, wherein the head-wearing AR intelligent individual control terminal is used for uploading a first visual angle picture of a worker in the routing inspection process through environment perception; the head-mounted AR intelligent individual control terminal is further used for displaying the operation flow of the wind power generation equipment on the wind power generation equipment to be inspected in an AR technology superposition mode within the sight range of the staff according to the received command dispatching instruction of the remote command dispatching end. The technical problem that remote dispatching and commanding cannot be carried out on the wind power plant of wind power generation is solved. By the aid of the method and the device, hands of operation and maintenance personnel in the wind power plant can be liberated, safety of work is improved, and field dynamics can be mastered in real time aiming at insufficient expert personnel and emergency treatment of emergency when complex or emergency is solved.
Description
Technical Field
The application relates to the field of commanding and dispatching in wind power generation, in particular to a wind power generation commanding and dispatching system and method based on AR application.
Background
Wind power generation has received increasing attention from all over as a new energy source with large-scale development potential.
Due to the fact that the geographical position of the wind power plant is remote relatively, the geographical environment is severe generally, and workers need to stay on the site for a long time. Meanwhile, the wind power plants are far away from each other, the number of fans in each wind power plant is large, the suppliers of various devices are different, and a plurality of potential safety hazards exist on the site.
Aiming at the problem that the remote dispatching command cannot be carried out on the wind power plant for wind power generation in the related technology, an effective solution is not provided at present.
Disclosure of Invention
The application mainly aims to provide a wind power generation commanding and dispatching system and method based on AR application, so as to solve the problem that remote dispatching and commanding cannot be carried out on a wind power plant for wind power generation, and an effective problem is not provided at present.
In order to achieve the above object, according to one aspect of the present application, a wind power generation commanding and scheduling system based on AR application is provided.
The wind power generation commanding and dispatching system based on the AR application comprises the following components: wear-type AR intelligence individual soldier control terminal, remote command dispatch end be used for to wear-type AR intelligence individual soldier control terminal sends remote command dispatch instruction, wear-type AR intelligence individual soldier control terminal is worn on the staff, the system includes: the head-mounted AR intelligent individual control terminal is used for uploading a first visual angle picture of a worker in the inspection process through environment perception; the head-mounted AR intelligent individual control terminal is further used for displaying the operation flow of the wind power generation equipment on the wind power generation equipment to be inspected in an AR technology superposition mode within the sight range of the staff according to the received command dispatching instruction of the remote command dispatching end.
Further, the system further comprises: the head-mounted AR intelligent individual control terminal is dynamically associated with the patrol record after splitting the collected video data based on a video data fusion algorithm carried by the head-mounted AR intelligent individual control terminal.
Further, wear-type AR intelligence individual soldier control terminal still is used for through predetermineeing functional component, realizes patrolling and examining the task, wherein, it includes one of following at least to patrol and examine in the task: face identification, personnel and object movement track tracking, operation environment knowledge sharing, it includes at least to predetermine the functional component: a bluetooth beacon.
Furthermore, the head-mounted AR intelligent individual control terminal is also used for receiving any one or more remote command and dispatching instructions in field polling, field maintenance, defect AR labeling and first visual angle monitoring of the wind power generation equipment to be polled, which are transmitted back by the command and dispatching terminal.
Furthermore, the head-mounted AR intelligent individual control terminal is further used for receiving the voice information sent by the remote commanding and dispatching terminal and the content digital information in the VR electronic whiteboard, and superposing the digital information on a target operation object in the visual field of the operator.
And further, the head-mounted AR intelligent individual control terminal is also used for giving an alarm in advance for misoperation of the target operation according to a monitoring result of the remote commanding and dispatching end on the target operation.
Further, the head-mounted AR intelligent individual control terminal is further used for guiding the operating personnel to complete standard field work in real time according to the received visual standard operation manual of the remote commanding and dispatching terminal, wherein the standard operation manual comprises characters, pictures, videos and animations acquired in the routing inspection process.
In order to achieve the above object, according to another aspect of the present application, a wind power generation commanding and scheduling method based on AR application is provided.
The wind power generation commanding and dispatching method based on the AR application comprises the following steps: wear-type AR intelligence individual soldier control terminal, remote command dispatch end is used for to wear-type AR intelligence individual soldier control terminal sends remote command dispatch instruction, wear-type AR intelligence individual soldier control terminal is worn on the staff, the method includes: uploading a first visual angle picture of a worker in the inspection process through environment perception; and according to the received command dispatching instruction of the remote command dispatching end, and according to the sight range of the staff, the operation flow aiming at the wind power generation equipment is displayed on the wind power generation equipment to be inspected in an overlapping mode through an AR technology.
Further, still include: and splitting the collected video data based on the carried video data fusion algorithm, and then dynamically associating the split video data with the inspection record.
Further, after the operation flow for the wind power generation equipment is displayed in an overlapping manner through an AR technology on the wind power generation equipment to be inspected within the sight range of the worker according to the received command scheduling instruction of the remote command scheduling terminal, the method further includes: and receiving the voice information sent by the remote command scheduling terminal and the content digital information in the VR electronic whiteboard, and superposing the digital information on a target operation object in the visual field of the operator.
In the embodiment of the application, the wind power generation commanding and dispatching system and method based on AR application adopts a head-mounted AR intelligent individual control terminal and a remote commanding and dispatching terminal, wherein the remote commanding and dispatching terminal is used for sending a remote commanding and dispatching instruction to the head-mounted AR intelligent individual control terminal, the head-mounted AR intelligent individual control terminal is worn on a worker, the head-mounted AR intelligent individual control terminal is used for uploading a first visual angle picture of the worker in the routing inspection process through environment perception through the head-mounted AR intelligent individual control terminal, and the system and method are also used for displaying the operation flow of the wind power generation equipment on the wind power generation equipment to be routed through AR technology in the sight range of the worker according to the received commanding and dispatching instruction of the remote commanding and dispatching terminal, therefore, the technical effect of improving the technology and safety level of wind power field operation, particularly improving the capability of a wind power enterprise for remotely processing the emergency burst problem is achieved, and the technical problem that the wind power plant for wind power generation cannot be remotely scheduled and commanded is solved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, serve to provide a further understanding of the application and to enable other features, objects, and advantages of the application to be more apparent. The drawings and their description illustrate the embodiments of the invention and do not limit it. In the drawings:
FIG. 1 is a schematic diagram of a hardware structure of a wind power generation commanding and dispatching system based on AR application according to an embodiment of the application;
FIG. 2 is a flow chart of a wind power generation commanding and scheduling method based on AR application according to an embodiment of the application;
FIG. 3 is a schematic structural diagram of a wind power generation commanding and dispatching system based on AR application according to an embodiment of the application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be used. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In this application, the terms "upper", "lower", "left", "right", "front", "rear", "top", "bottom", "inner", "outer", "middle", "vertical", "horizontal", "lateral", "longitudinal", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings. These terms are used primarily to better describe the present application and its embodiments, and are not used to limit the indicated devices, elements or components to a particular orientation or to be constructed and operated in a particular orientation.
Moreover, some of the above terms may be used to indicate other meanings besides the orientation or positional relationship, for example, the term "on" may also be used to indicate some kind of attachment or connection relationship in some cases. The specific meaning of these terms in this application will be understood by those of ordinary skill in the art as appropriate.
Furthermore, the terms "mounted," "disposed," "provided," "connected," and "sleeved" are to be construed broadly. For example, it may be a fixed connection, a removable connection, or a unitary construction; can be a mechanical connection, or an electrical connection; may be directly connected, or indirectly connected through intervening media, or may be in internal communication between two devices, elements or components. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.
Through this application, use AR technique to carry out equipment tour work, can be favorable to liberating fortune dimension personnel both hands, improve the security of work, to expert's personnel not enough when solving complicacy or emergency, emergency treatment of emergency masters scene developments in real time. The working efficiency and the working quality of workers are improved to a great extent. Meanwhile, the head-mounted computer can have good expansibility, can upgrade data acquisition of the comprehensive multi-sensor and detecting instrument to carry out edge calculation in the future, and assists problem analysis in real time.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
As shown in fig. 1, the structure specifically includes: the system comprises a worker 300, a head-mounted AR intelligent individual control terminal 100 and a remote commanding and dispatching terminal 200. Wherein, staff 300 patrols and examines preset position through wearing wear-type AR intelligence individual soldier control terminal 100 at wind power generation's scene. Remote command dispatch end 200 be used for to wear-type AR intelligence individual soldier control terminal 100 sends relevant remote scheduling instruction, thereby commands wear-type AR intelligence individual soldier control terminal 100, the field operation personnel pass through speech control, and retrieval equipment and service information are projected the show in wear-type AR intelligence individual soldier control terminal 100's near-to-eye display, and liberation both hands, noisy industrial environment are available. And the first visual angle operation video is displayed in real time for the user of the remote commanding and dispatching end 200, and the video information is automatically associated with the operation record and permanently stored in the background, so that the comprehensive, whole-process and dead-angle-free control field operation and service tracing are facilitated. The method has the advantages that the AR routing inspection, the remote expert field maintenance, the defect AR labeling, the first visual angle supervision and the like of the equipment are realized, management personnel can achieve the in-person command and scheduling, field operation personnel can be supported by background technology at the first time, and the defect processing time is shortened.
As shown in fig. 2, in an embodiment of the present application, a wind power generation commanding and scheduling system based on an AR application includes: wear-type AR intelligence individual soldier control terminal 100, remote command dispatch end 200 be used for to wear-type AR intelligence individual soldier control terminal 100 sends remote command dispatch instruction, wear-type AR intelligence individual soldier control terminal 100 is worn on the staff, the system includes: the head-mounted AR intelligent individual control terminal 100 is used for uploading a first visual angle picture of a worker in the inspection process through environment perception; the head-mounted AR intelligent individual control terminal 100 is further used for displaying the operation flow of the wind power generation equipment on the wind power generation equipment to be inspected in an AR technology superposition mode within the sight range of the staff according to the received command dispatching instruction of the remote command dispatching end.
During specific implementation, the head-mounted AR intelligent individual control terminal 100 uploads a first visual angle picture of a worker in a routing inspection process through environment perception. Real-time monitoring based on the first visual angle can improve the perception capability of the field operation environment and realize intelligent operation of knowledge sharing.
The head-mounted AR intelligent individual control terminal 100 displays the operation flow of the wind power generation equipment on the wind power generation equipment to be inspected through AR technology superposition within the sight range of the staff according to the received command dispatching instruction of the remote command dispatching end 200.
In an optional embodiment, the operational flow for the wind power plant comprises: the method comprises the following steps of routing inspection flow, wind power equipment AR routing inspection, remote expert field maintenance, defect AR labeling, first visual angle monitoring and the like.
In an alternative embodiment, the operator can directly transmit the scene with complicated scene to the remote centralized control center at the first view angle through the head-mounted AR intelligent individual control terminal 100, the operator (including the expert) of the remote commanding and dispatching terminal 200 can assist at any time and any place, since the first view angle of the operator is obtained to observe as if the operator is in the scene, the remote operator can visually superimpose the digital information on the operation object in the view of the operator through the voice and the augmented reality electronic whiteboard, the field operator can handle the troublesome problem as if the field operator obtains the guidance of the field expert, and the communication and communication cost is greatly reduced. Through the guidance of a remote expert AR, the risk of traveling infection is avoided, traveling is reduced, and personnel resources/cost are saved. Further, under the guidance of the remote expert AR, one expert can guide the operation of a plurality of field personnel.
From the above description, it can be seen that the following technical effects are achieved by the present application:
the method adopts a head-wearing AR intelligent individual control terminal and a remote commanding and dispatching terminal, wherein the remote commanding and dispatching terminal is used for sending a remote commanding and dispatching instruction to the head-wearing AR intelligent individual control terminal, the head-wearing AR intelligent individual control terminal is worn on a worker, the head-wearing AR intelligent individual control terminal is used for uploading a first visual angle picture of the worker in the routing inspection process through environment perception, the head-wearing AR intelligent individual control terminal is achieved, and the method is also used for displaying the operation flow of the wind power generation equipment through AR technology superposition on the wind power generation equipment to be routed within the sight range of the worker according to the received commanding and dispatching instruction of the remote commanding and dispatching terminal, so that the technical effect of improving the technology and safety level of wind power field operation, particularly the capability of a wind power enterprise for remotely processing emergency problems is realized, and then solved the technical problem that can't carry out remote dispatching commander to wind-powered electricity generation's wind-powered electricity generation field.
As a preference in the present embodiment, the system further includes: the head-mounted AR intelligent individual control terminal 100 splits the collected video data based on the video data fusion algorithm carried by the head-mounted AR intelligent individual control terminal and then dynamically associates the split video data with the patrol record.
In specific implementation, compared with a mode of uniformly processing by a central server in the conventional technology, the method can perform calculation processing locally based on the video data fusion algorithm carried by the head-mounted AR intelligent individual control terminal 100, so that the storage and calculation load of the central server can be reduced, the dependence on a network is reduced, resources are saved, and the technical effect of efficient operation of data fusion is ensured.
Further, the multi-channel video is logically divided, and dynamic association of the service information and the first visual angle audio and video information is realized, namely, the structured data and the unstructured data are organically fused. For example, when a user performs a patrol job: a user checks the polling record at the PC terminal, the head-mounted AR intelligent individual control terminal automatically splits the acquired video based on the video data fusion algorithm of edge calculation, and associates the video data fusion algorithm with the polling record to realize the fusion of the polling record and the video stream; when the user is looking over the video information, the system can also intelligently associate and push the patrol record.
As a preferred option in this embodiment, the head-mounted AR intelligent individual control terminal is further configured to implement an inspection task through a preset functional component, where the inspection task includes at least one of the following: face identification, personnel and object movement track tracking, operation environment knowledge sharing, it includes at least to predetermine the functional component: a bluetooth beacon.
In specific implementation, the typical problems in the operation process are avoided through the functions of face recognition, tracking of the movement tracks of the personnel and the object, sharing of the operation environment knowledge and the like, and the typical problems comprise that: non-work ticket members enter the station, construction phenomena are not proved, work responsible persons are out of duty, and the members cannot be traced after accidents occur. In addition, the in-place patrol identification and the wireless network real-time communication are carried out based on the Bluetooth beacon, so that the real-time synchronization of the wind power site and the centralized control center picture is realized, and front operating personnel and rear end command personnel coordinate to work.
Based on wear-type AR intelligence individual soldier control terminal has liberated staff and has patrolled and examined personnel's both hands promptly, when especially complicated troubleshooting trouble operation, makes its focus on and accomplishes the task, and according to the staff demand with information push to the eye at any time to improve operation security and work efficiency.
Preferably, in this embodiment, the head-mounted AR intelligent individual control terminal is further configured to receive any one or more remote command and dispatch instructions of on-site polling, on-site maintenance, defect AR labeling, and first view angle monitoring of the wind power generation equipment to be polled, which are returned by the command and dispatch terminal.
During specific implementation, the AR routing inspection, remote expert field maintenance, defect AR labeling, first visual angle supervision and the like of the equipment are realized, so that the workers can carry out on-the-spot command and scheduling, the field workers can obtain background technical support at the first time, and the defect processing time is shortened. The technology and the safety level of wind power field operation are improved, and particularly the capability of a wind power enterprise for remotely processing emergency burst problems is improved.
Preferably, in this embodiment, the head-mounted AR intelligent individual control terminal is further configured to receive the voice information sent by the remote command and dispatch terminal and the content digital information in the VR electronic whiteboard, and superimpose the digital information on the target operation object in the visual field of the operator.
In specific implementation, the first visual angle of the operator is obtained to observe the operator as if the operator is in the field, the remote expert visually superimposes the digital information on the operation object in the visual field of the operator through the voice and the augmented reality electronic whiteboard, the field operator just as if the field operator obtains guidance of the field expert to deal with the problem, and communication cost is reduced to a great extent.
As a preferred option in this embodiment, the head-mounted AR intelligent individual control terminal 100 is further configured to alarm in advance a misoperation of the target operation according to a monitoring result of the remote command scheduling end on the target operation.
During specific implementation, based on prevention alarming, the operation misoperation is alarmed through real-time monitoring of a key operation background and combination of software logic definition. Along with the accumulation of mass data, the danger which may occur is intelligently displayed in advance through the voice recognition function and the image recognition function of the head-mounted AR intelligent individual control terminal and the result obtained through big data prediction.
Preferably, in this embodiment, the head-mounted AR intelligent individual control terminal 100 is further configured to guide the operator to complete standard field work in real time according to the received visual standard operation manual of the remote commanding and dispatching terminal, where the standard operation manual includes characters, and/or pictures, and/or videos, and/or animations collected in the routing inspection process.
During specific implementation, transparent management and real-time supervision of the work of the wind power plant are realized. The staff of the remote commanding and dispatching end 200 can observe the working state of the staff anytime and anywhere, such as the working track, or remotely check the working condition with the first visual angle of the patrol staff. That is to say, the operation manual is visual, the system edits the existing inspection content (such as characters, pictures, videos and animations), the standard operation flow is formed by sequencing, the inspection content is converted into visual operation data, the iterative operation data can be updated rapidly and transmitted to the head-wearing AR intelligent individual soldier control terminal, and the operator is guided to complete the on-site work of the standard specification in real time. The sensing capability of the field operation environment is improved, and the intelligent operation of knowledge sharing is realized.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
There is also provided, in accordance with an embodiment of the present application, a method for implementing the above system, as shown in fig. 2, the method including: the method comprises the following steps: wear-type AR intelligence individual soldier control terminal, remote command dispatch end is used for to wear-type AR intelligence individual soldier control terminal sends remote command dispatch instruction, wear-type AR intelligence individual soldier control terminal is worn on the staff, the method includes:
step S201, uploading a first visual angle picture of a worker in a routing inspection process through environment perception;
and S202, according to the received command dispatching instruction of the remote command dispatching end, and according to the sight range of the staff, the operation flow aiming at the wind power generation equipment is displayed on the wind power generation equipment to be inspected in an overlaid mode through an AR technology.
The head-mounted AR intelligent individual control terminal 100 uploads a first visual angle picture of a worker in the inspection process through environment perception. Real-time monitoring based on the first visual angle can improve the perception capability of the field operation environment and realize intelligent operation of knowledge sharing.
The head-mounted AR intelligent individual control terminal 100 displays the operation flow of the wind power generation equipment on the wind power generation equipment to be inspected through AR technology superposition within the sight range of the staff according to the received command dispatching instruction of the remote command dispatching end 200.
In an optional embodiment, the operational flow for the wind power plant comprises: the method comprises the following steps of routing inspection flow, wind power equipment AR routing inspection, remote expert field maintenance, defect AR labeling, first visual angle monitoring and the like.
In an alternative embodiment, the operator can directly transmit the scene with complicated scene to the remote centralized control center at the first view angle through the head-mounted AR intelligent individual control terminal 100, the operator (including the expert) of the remote commanding and dispatching terminal 200 can assist at any time and any place, since the first view angle of the operator is obtained to observe as if the operator is in the scene, the remote operator can visually superimpose the digital information on the operation object in the view of the operator through the voice and the augmented reality electronic whiteboard, the field operator can handle the troublesome problem as if the field operator obtains the guidance of the field expert, and the communication and communication cost is greatly reduced.
As a preference in this embodiment, the method further includes: and splitting the collected video data based on the carried video data fusion algorithm, and then dynamically associating the split video data with the inspection record.
In specific implementation, compared with a mode of uniformly processing by a central server in the conventional technology, the method can perform calculation processing locally based on the video data fusion algorithm carried by the head-mounted AR intelligent individual control terminal 100, so that the storage and calculation load of the central server can be reduced, the dependence on a network is reduced, resources are saved, and the technical effect of efficient operation of data fusion is ensured.
Further, the multi-channel video is logically divided, and dynamic association of the service information and the first visual angle audio and video information is realized, namely, the structured data and the unstructured data are organically fused. For example, when a user performs a patrol job: a user checks the polling record at the PC terminal, the head-mounted AR intelligent individual control terminal automatically splits the acquired video based on the video data fusion algorithm of edge calculation, and associates the video data fusion algorithm with the polling record to realize the fusion of the polling record and the video stream; when the user is looking over the video information, the system can also intelligently associate and push the patrol record.
As a preferable preference in this embodiment, after displaying the operation flow for the wind power generation equipment to be inspected by superimposing, by using an AR technology, on the wind power generation equipment to be inspected within the sight range of the worker according to the received command scheduling instruction of the remote command scheduling terminal, the method further includes: and receiving the voice information sent by the remote command scheduling terminal and the content digital information in the VR electronic whiteboard, and superposing the digital information on a target operation object in the visual field of the operator.
In specific implementation, the first visual angle of the operator is obtained to observe the operator as if the operator is in the field, the remote expert visually superimposes the digital information on the operation object in the visual field of the operator through the voice and the augmented reality electronic whiteboard, the field operator just as if the field operator obtains guidance of the field expert to deal with the problem, and communication cost is reduced to a great extent.
In addition, the platform planning captures data in technical modes such as the internet of things LoT and artificial intelligence AI, and information is interacted in technical modes such as augmented reality AR, virtual reality VR and voice broadcast TTS. The field operation personnel retrieve the equipment and the service information through voice control and project and show in the near-eye display of the head-mounted intelligent individual-soldier AR control terminal, so that the hands are liberated, and the noisy industrial environment is available. The first visual angle operation video is displayed for a manager in real time, and the video information is automatically associated with the operation record and is permanently stored in the background, so that the comprehensive and whole-process no-dead-angle control field operation and service tracing are facilitated. The method has the advantages that the AR routing inspection, the remote expert field maintenance, the defect AR labeling, the first visual angle supervision and the like of the equipment are realized, management personnel can achieve the in-person command and scheduling, field operation personnel can be supported by background technology at the first time, and the defect processing time is shortened.
The method provided by the embodiment one of the present application can be executed in a mobile terminal, a computer terminal or a similar mobile device. Taking the operation on a mobile terminal as an example, fig. 3 is a hardware structure block diagram of the wind power generation commanding and scheduling method based on the AR application according to the embodiment of the present invention. As shown in fig. 3, the camera terminal may include one or more processors 102 (only one is shown in fig. 3) (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and optionally may further include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 3 is only an illustration, and is not intended to limit the structure of the camera terminal. For example, the camera terminal may also include more or fewer components than shown in fig. 3, or have a different configuration than shown in fig. 3.
The memory 104 may be used to store a computer program, for example, a software program and a module of an application software, such as a computer program corresponding to the privacy-blocking method for video surveillance in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the camera terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the camera terminal. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
It will be apparent to those skilled in the art that the modules or steps of the present application described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and they may alternatively be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, or fabricated separately as individual integrated circuit modules, or fabricated as a single integrated circuit module from multiple modules or steps. Thus, the present application is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A wind power generation command and dispatch system based on AR application is characterized by comprising: the remote commanding and dispatching terminal is used for sending a remote commanding and dispatching instruction to the head-mounted AR intelligent individual control terminal which is worn on a worker,
the head-mounted AR intelligent individual control terminal is used for uploading a first visual angle picture of a worker in the inspection process through environment perception;
the head-mounted AR intelligent individual control terminal is further used for displaying the operation flow of the wind power generation equipment on the wind power generation equipment to be inspected in an AR technology superposition mode within the sight range of the staff according to the received command dispatching instruction of the remote command dispatching end.
2. The system of claim 1, further comprising:
the head-mounted AR intelligent individual control terminal is dynamically associated with the patrol record after splitting the collected video data based on a video data fusion algorithm carried by the head-mounted AR intelligent individual control terminal.
3. The system according to claim 1 or 2, wherein the head-mounted AR intelligent individual control terminal is further configured to implement inspection tasks through preset functional components, wherein the inspection tasks at least include one of the following: face identification, personnel and object movement track tracking, operation environment knowledge sharing, it includes at least to predetermine the functional component: a bluetooth beacon.
4. The system according to claim 1 or 2, wherein the head-mounted AR intelligent individual control terminal is further configured to receive one or more remote command and dispatch instructions of on-site routing inspection, on-site maintenance, defect AR labeling and first visual angle monitoring of the wind power generation equipment to be routed, which are transmitted back by the command and dispatch terminal.
5. The system of claim 1, wherein the head-mounted AR intelligent individual control terminal is further configured to receive voice information sent by the remote command dispatcher terminal and digital information of content in the VR electronic whiteboard, and superimpose the digital information on a target operation object in a visual field of an operator.
6. The system of claim 1, wherein the head-mounted AR intelligent individual control terminal is further configured to alarm in advance misoperation of the target operation according to a monitoring result of the remote command scheduling end on the target operation.
7. The system according to claim 1, wherein the head-mounted AR intelligent individual control terminal is further configured to guide the operator to complete standard field work in real time according to a received visual standard operation manual of the remote commanding and dispatching terminal, wherein the standard operation manual includes characters, and/or pictures, and/or videos, and/or animations collected during the routing inspection process.
8. A wind power generation commanding and dispatching method based on AR application is characterized by comprising the following steps: wear-type AR intelligence individual soldier control terminal, remote command dispatch end is used for to wear-type AR intelligence individual soldier control terminal sends remote command dispatch instruction, wear-type AR intelligence individual soldier control terminal is worn on the staff, the method includes:
uploading a first visual angle picture of a worker in the inspection process through environment perception;
and according to the received command dispatching instruction of the remote command dispatching end, and according to the sight range of the staff, the operation flow aiming at the wind power generation equipment is displayed on the wind power generation equipment to be inspected in an overlapping mode through an AR technology.
9. The method of claim 8, further comprising:
and splitting the collected video data based on the carried video data fusion algorithm, and then dynamically associating the split video data with the inspection record.
10. The method according to claim 8, wherein after the operational flow for the wind power generation equipment to be inspected is displayed in an AR technology superposition manner on the wind power generation equipment according to the received command dispatching instruction of the remote command dispatching terminal within the sight range of the staff, the method further comprises the following steps:
and receiving the voice information sent by the remote command scheduling terminal and the content digital information in the VR electronic whiteboard, and superposing the digital information on a target operation object in the visual field of the operator.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111344051.2A CN113923439A (en) | 2021-11-15 | 2021-11-15 | Wind power generation commanding and dispatching system and method based on AR application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111344051.2A CN113923439A (en) | 2021-11-15 | 2021-11-15 | Wind power generation commanding and dispatching system and method based on AR application |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113923439A true CN113923439A (en) | 2022-01-11 |
Family
ID=79246337
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111344051.2A Pending CN113923439A (en) | 2021-11-15 | 2021-11-15 | Wind power generation commanding and dispatching system and method based on AR application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113923439A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107967562A (en) * | 2017-11-29 | 2018-04-27 | 国网山西省电力公司太原供电公司 | A kind of construction site job safety remote-control system and method |
| KR102074924B1 (en) * | 2019-08-08 | 2020-02-07 | 주식회사 글로벌제조혁신네트웍 | Smart Factory remote collaboration CMS system and drive method of the Same |
| CN112578907A (en) * | 2020-12-01 | 2021-03-30 | 国电湖南巫水水电开发有限公司 | Method and device for realizing remote guidance operation based on AR |
| CN112887651A (en) * | 2021-01-27 | 2021-06-01 | 昭通亮风台信息科技有限公司 | AR-based remote command method and system |
-
2021
- 2021-11-15 CN CN202111344051.2A patent/CN113923439A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107967562A (en) * | 2017-11-29 | 2018-04-27 | 国网山西省电力公司太原供电公司 | A kind of construction site job safety remote-control system and method |
| KR102074924B1 (en) * | 2019-08-08 | 2020-02-07 | 주식회사 글로벌제조혁신네트웍 | Smart Factory remote collaboration CMS system and drive method of the Same |
| CN112578907A (en) * | 2020-12-01 | 2021-03-30 | 国电湖南巫水水电开发有限公司 | Method and device for realizing remote guidance operation based on AR |
| CN112887651A (en) * | 2021-01-27 | 2021-06-01 | 昭通亮风台信息科技有限公司 | AR-based remote command method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109447048B (en) | Artificial intelligence early warning system | |
| CN108319234B (en) | Security management system, method, device, storage medium and information processing cloud platform | |
| CN110865917A (en) | AR technology-based electric power machine room inspection operation method, system and application | |
| CN110378606A (en) | Mobile visualization security management and control system | |
| CN107578487A (en) | A kind of cruising inspection system based on augmented reality smart machine | |
| CN111667230A (en) | Unmanned aerial vehicle autonomous inspection operation monitoring and analyzing system and method | |
| CN108510183A (en) | A kind of Power Line Inspection System based on unmanned plane | |
| CN112578907A (en) | Method and device for realizing remote guidance operation based on AR | |
| CN114093111B (en) | Forest fire rescue air-ground integrated command scheduling system and method | |
| CN111062504A (en) | AR technology-based intelligent power distribution station operation and maintenance system and method | |
| CN105404968A (en) | GIS based power transmission line center management system | |
| CN110568310A (en) | Visual online monitoring system for power transmission line | |
| CN112306233A (en) | Inspection method, inspection system and inspection management platform | |
| CN112565694A (en) | On-spot safety monitoring management system of building engineering | |
| CN112414469A (en) | Power patrol inspection and rush repair safety monitoring system based on Beidou space-time data sensing | |
| CN115865915A (en) | Unmanned aerial vehicle inspection image real-time identification method and system based on edge calculation | |
| CN113359842A (en) | Intelligent patrol control analysis system of 10kV power distribution network wireless charging unmanned aerial vehicle | |
| CN114092279A (en) | Full-service ubiquitous visual intelligent power operation and maintenance system | |
| CN202978437U (en) | Intelligent routing inspection system for transformer substations | |
| CN110137940A (en) | A kind of intelligent electric power managing and control system based on mobile visualization | |
| CN113923439A (en) | Wind power generation commanding and dispatching system and method based on AR application | |
| CN115797824A (en) | Unmanned aerial vehicle power construction violation identification method and device based on artificial intelligence | |
| CN103345721A (en) | Collaborative consultation system and method applied to portable scene emergency device | |
| CN110617856A (en) | Intelligent operation and inspection system | |
| CN114205562B (en) | Intelligent terminal and working method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |