WO2023078254A1 - Procédé et appareil de détermination de l'état ouvert/fermé d'un commutateur à lame, dispositif, support et produit - Google Patents

Procédé et appareil de détermination de l'état ouvert/fermé d'un commutateur à lame, dispositif, support et produit Download PDF

Info

Publication number
WO2023078254A1
WO2023078254A1 PCT/CN2022/129042 CN2022129042W WO2023078254A1 WO 2023078254 A1 WO2023078254 A1 WO 2023078254A1 CN 2022129042 W CN2022129042 W CN 2022129042W WO 2023078254 A1 WO2023078254 A1 WO 2023078254A1
Authority
WO
WIPO (PCT)
Prior art keywords
knife
image
closing
position area
preset
Prior art date
Application number
PCT/CN2022/129042
Other languages
English (en)
Chinese (zh)
Inventor
方嘉聪
肖少剑
龚浩
Original Assignee
珠海优特电力科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 珠海优特电力科技股份有限公司 filed Critical 珠海优特电力科技股份有限公司
Priority to GB2308674.7A priority Critical patent/GB2616993A/en
Priority to AU2022381656A priority patent/AU2022381656B2/en
Publication of WO2023078254A1 publication Critical patent/WO2023078254A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects

Definitions

  • the present disclosure relates to the technical field of rail transit, and in particular to a method, device, equipment, medium and product for determining the opening and closing state of a knife switch.
  • the traditional monitoring and management method of switch equipment is to judge the opening and closing status of the switch through whether the electricity is connected or physical and mechanical sensors.
  • This kind of knife switch confirmation method needs to add a sensor to the equipment body. Once the sensor fails, the opening and closing status of the knife switch cannot be determined, and the operating equipment needs to be shut down during maintenance or renovation.
  • the disclosure provides a method, device, equipment, medium and product for determining the opening and closing state of a knife switch, which are used to provide a method for confirming the opening and closing state of a knife switch to solve the problem that the opening and closing state of a knife switch cannot be determined when a sensor fails.
  • the first aspect of the present disclosure provides a method for determining the opening and closing state of a knife gate, including: acquiring a knife gate monitoring image; the knife gate monitoring image is that the camera device shoots the knife gate monitoring area according to the image sending instruction sent by the knife gate control device Generated and sent; the image sending instruction is generated by the knife gate control device within a preset time period for controlling the closing or opening of the knife gate; image features of multiple preset areas in the knife gate monitoring image are extracted
  • the plurality of preset areas at least include the closed position area where the knife switch is in the closed position state and the divided position area where the knife switch is located when the knife switch is in the divided state; monitor the knife switch
  • the image features of each preset area in the image are compared with the image features of the corresponding preset area of the preset knife gate template image for structural similarity; according to the result of the structural similarity comparison, the opening and closing status of the knife gate is determined.
  • the second aspect of the present disclosure provides a device for determining the opening and closing state of a knife gate, including: an acquisition module configured to acquire a knife gate monitoring image; the knife gate monitoring image is an image sending instruction sent by the camera device according to the knife gate control device It is generated and sent by photographing the knife gate monitoring area; the image sending instruction is generated by the knife gate control device within a preset time period for controlling the knife gate to close or disconnect; the extraction module is configured to extract the knife gate monitoring The image features of multiple preset areas in the image; the multiple preset areas at least include the closed position area where the knife switch is in the closed state and the branch position where the knife switch is in the divided state.
  • comparison module configured to carry out structural similarity comparison between the image features of each of the preset areas in the knife gate monitoring image and the image features of the preset knife gate template image corresponding to the preset area; determine the module, set In order to determine the opening and closing state of the knife switch according to the result of the structural similarity comparison.
  • the third aspect of the embodiments of the present disclosure provides an electronic device, including: a processor, and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory , so as to realize the method for determining the opening and closing state of the knife switch according to any one of the first aspect.
  • the fourth aspect of the embodiments of the present disclosure provides a computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to implement any one of the first aspect when executed by a processor.
  • the fifth aspect of the embodiments of the present disclosure provides a computer program product, including a computer program, and when the computer program is executed by a processor, the method for determining the opening and closing state of the knife switch described in any one of the first aspect is implemented.
  • the present disclosure provides a method, device, equipment, medium and product for determining the opening and closing state of a knife gate, the method comprising: acquiring a knife gate monitoring image; the knife gate monitoring image is an image sent by a camera device according to a knife gate control device The instruction is generated and sent by taking pictures of the knife gate monitoring area; the image sending instruction is generated by the knife gate control device within the preset time period for controlling the knife gate to close or disconnect; extracting multiple images from the knife gate monitoring image
  • the image characteristics of the preset area; the plurality of preset areas at least include the closing position area where the knife switch is in the closing state and the dividing position area where the knife switch is in the dividing state; Carry out structural similarity comparison between the image features of each of the preset areas in the knife gate monitoring image and the image features of the preset knife gate template image corresponding to the preset area; determine the opening and closing state of the knife gate according to the result of the structural similarity comparison .
  • the method for determining the opening and closing state of the knife switch of the present disclosure compares the structural similarity between the preset area of the knife switch monitoring image and the preset area of the preset knife switch template image, because the preset area at least includes when the knife switch is in the closing state.
  • FIG. 1 is a scene diagram that can realize the method for determining the opening and closing state of the knife switch of the present disclosure
  • FIG. 2 is a schematic flowchart of a method for determining the opening and closing state of a knife switch provided by the first embodiment of the present disclosure
  • FIG. 3 is a schematic flowchart of a method for determining the opening and closing state of a knife switch provided by the second embodiment of the present disclosure
  • FIG. 4 is a schematic diagram of a preset area of a method for determining the opening and closing state of a knife switch provided by the second embodiment of the present disclosure
  • FIG. 5 is a schematic diagram of the image alignment process of the method for determining the opening and closing state of the knife switch provided by the third embodiment of the present disclosure
  • Fig. 6 is a schematic diagram of the interaction process of the method for determining the opening and closing state of the knife switch provided by the fourth embodiment of the present disclosure
  • FIG. 7 is a schematic diagram of the image alignment process of the method for determining the opening and closing state of the knife switch provided by the fourth embodiment of the present disclosure.
  • Fig. 8 is a schematic structural diagram of a device for determining the opening and closing state of a knife switch provided by the fifth embodiment of the present disclosure
  • FIG. 9 is a schematic structural diagram of an electronic device provided by a sixth embodiment of the present disclosure.
  • Computer vision technology is a computer simulation of human visual process, which is a synthesis of image processing, artificial intelligence and pattern recognition technologies.
  • the monitoring and management of traditional knife switch equipment in the track needs to add sensors to the equipment body. Once the sensor fails, the opening and closing status of the knife switch cannot be determined, and the operating equipment needs to be shut down during maintenance or renovation. Therefore, the rail transit field needs A new method for confirming the opening and closing state of the knife switch, combined with computer vision technology to solve the problem that the opening and closing state of the knife switch cannot be determined when the sensor fails.
  • a new method for confirming the opening and closing state of the knife gate is needed to solve the problem that the opening and closing state of the knife gate cannot be determined when the sensor fails.
  • the knife gate monitoring image generated by the camera device shooting the knife gate monitoring area is obtained, and the image features of multiple preset areas in the knife gate monitoring image are extracted.
  • the plurality of preset areas at least include the closed position area where the knife switch is in the closed position and the divided position area where the knife switch is in the divided state when the knife switch is in the divided state.
  • the structural similarity comparison is performed between the image features of each preset area in the knife gate monitoring image and the image features of the preset knife gate template image corresponding to the preset area. According to the result of structural similarity comparison, the opening and closing state of the knife switch is determined. Therefore, no matter whether the sensor is faulty or not, the opening and closing state of the knife switch can be determined according to the comparison result.
  • the inventor proposes the technical solution of the present disclosure based on the above-mentioned inventive discoveries.
  • the following introduces the application scenarios of the method for determining the opening and closing state of the knife switch provided by the present disclosure.
  • 1 is an electronic device
  • 2 is a knife switch control device
  • 3 is a knife switch device
  • 4 is a camera device.
  • the network architecture of the application scenario corresponding to the method for determining the opening and closing state of the knife switch provided in the present disclosure includes: an electronic device 1 , a knife switch control device 2 , a knife switch device 3 and a camera device 4 .
  • the knife switch control device 2 can control the closing or opening of the knife switch device 3
  • the camera device 4 can photograph the knife switch monitoring area including the knife switch device 3 .
  • the knife switch control device 2 controls the knife switch of the knife switch device 3 to close or open, the knife switch device 3 will feed back the operation information of the knife switch through the sensor set in the period.
  • the knife gate control device 2 will send an image sending instruction to the camera device 4 within a preset time period, such as 5 seconds, so that the camera device 4 will send the knife gate monitoring image generated by shooting the knife gate monitoring area to the electronic equipment 1.
  • the electronic device 1 extracts image features of multiple preset regions in the knife gate monitoring image after acquiring the knife gate monitoring image.
  • the multiple preset areas at least include the closed position area where the knife switch is in the closed position and the divided position area where the knife switch is in the divided state when the knife switch is in the divided state.
  • the electronic device 1 compares the image features of each preset area in the knife gate monitoring image with the image features of the preset knife gate template image corresponding to the preset area for structural similarity, and determines the knife gate classification according to the result of the structural similarity comparison. combined state. After the electronic device 1 determines the opening and closing state of the knife switch, it can send the opening and closing state of the knife switch to the knife control device 2 so that the knife control device 2 can further determine the opening and closing state of the knife switch according to the opening and closing state of the knife switch and the operation information of the knife switch. The gate opening and closing state.
  • Fig. 2 is a schematic flowchart of the method for determining the opening and closing state of the knife switch provided by the first embodiment of the present disclosure. As shown in Fig. The opening and closing state determination device can be integrated in the electronic device. Then the method for determining the opening and closing state of the knife switch provided in this embodiment includes the following steps:
  • Step S101 acquiring a monitoring image of a knife switch.
  • the knife gate monitoring image is generated and sent by the camera device to photograph the knife gate monitoring area according to the image sending instruction sent by the knife gate control device.
  • the image sending instruction is generated by the knife switch control device within a preset time period for controlling the closing or opening of the knife switch.
  • the photographing device may photograph the knife gate monitoring area including the knife gate in real time, or may photograph the knife gate monitoring area after receiving an image sending instruction, which is not limited in this embodiment.
  • the knife gate control device will send an image sending instruction to the shooting device, so that the shooting device will send the knife gate monitoring image generated by shooting the knife gate monitoring area to The device for determining the opening and closing state of the knife switch.
  • the preset time period can be set according to actual needs. For example, it takes 4 seconds for the knife gate to be fully closed to completely separated, then the preset time period can be set to 4 seconds or 5 seconds, etc., thereby reducing the image taken by the shooting device. is the probability that the switch is in a state between fully closed and fully open.
  • Step S102 extracting image features of a plurality of preset areas in the knife gate monitoring image.
  • the plurality of preset areas at least include the closed position area where the knife switch is in the closed position and the divided position area where the knife switch is in the divided state when the knife switch is in the divided state.
  • the extracted image feature can be extracted scale-invariant feature transform (English full name: Scale-invariant feature transform, English abbreviation: SIFT) feature, so that the extracted feature is more stable, and it can also make the follow-up and The structural similarity comparison between preset knife gate template images is more stable.
  • scale-invariant feature transform English full name: Scale-invariant feature transform, English abbreviation: SIFT
  • the closed position area where the knife switch is located when the knife switch is in the closed position refers to the position area where the knife switch is located when it is fully closed.
  • the division position area where the knife switch is located when the knife switch is in the divided state refers to the position area where the knife switch is located when the knife switch is in the complete division state.
  • the preset area is shown in dotted line boxes a and b in Fig. 4, wherein, the dotted line box a can refer to the area where the knife switch is located when the knife switch is in the divided state, and the dotted line box b can refer to the area where the knife switch is in the closed state.
  • the preset area needs to include at least the closed position area where the knife switch is in the closed state and the divided position area where the knife switch is in the divided state, so that in the subsequent and preset knife gate template When the images are compared, it is judged whether the opening and closing state of the knife switch is the closing state, the dividing state, or whether it is neither in the closing state nor in the dividing state.
  • Step S103 comparing the image features of each preset area in the knife gate monitoring image with the image features of the corresponding preset area of the preset knife gate template image for structural similarity.
  • the preset knife gate template image refers to pre-captured images of the knife gate in various states, such as the template image taken when the knife gate is in the closing state and the template image taken when the knife gate is in the dividing state. After a single configuration of the preset knife gate template image, the original configuration can be reused without model training, which improves configuration efficiency.
  • Structural similarity is used to compare the similarity between two images.
  • the English abbreviation of structural similarity is: SSIM, and the full English name is: structural similarity index, which is an index to measure the similarity of two images.
  • Step S104 determining the opening and closing state of the knife switch according to the result of the structural similarity comparison.
  • the structural similarity can determine the similarity between the knife gate monitoring image and the preset knife gate template image, and can determine whether the knife gate in the knife gate monitoring image is in the preset knife gate template image according to the similarity The status of the knife switch, so as to determine the opening and closing status of the knife switch in the monitoring image of the knife switch.
  • An embodiment of the present disclosure provides a method for determining an opening and closing state of a knife switch, the method comprising: acquiring a monitoring image of a knife switch.
  • the knife gate monitoring image is generated and sent by the camera device to photograph the knife gate monitoring area according to the image sending instruction sent by the knife gate control device.
  • the image sending instruction is generated by the knife switch control device within a preset time period for controlling the closing or opening of the knife switch.
  • the image features of multiple preset areas in the knife gate monitoring image are extracted.
  • the plurality of preset areas at least include the closed position area where the knife switch is in the closed position and the divided position area where the knife switch is in the divided state when the knife switch is in the divided state.
  • Structural similarity comparisons are made between the image features of each preset area in the knife gate monitoring image and the image features of the preset knife gate template image corresponding to the preset area. According to the result of structural similarity comparison, the opening and closing state of the knife switch is determined.
  • the method for determining the opening and closing state of the knife gate in the embodiment of the present disclosure compares the structural similarity between the preset area of the knife gate monitoring image and the preset area of the preset knife gate template image, because the preset area at least includes The close position area where the knife switch is in the state and the minute position area where the knife switch is in the split state. Therefore, no matter whether the sensor is faulty or not, the knife switch where the knife switch is located can be determined according to the comparison result. Split state.
  • Figure 3 is a schematic flow chart of the method for determining the opening and closing state of the knife switch provided by the second embodiment of the present disclosure. As shown in Figure 3, the method for determining the opening and closing state of the knife switch provided by this embodiment is provided in the previous embodiment of the present disclosure. On the basis of the determination method of the opening and closing state of the knife switch, each step is further refined. Then, the method for determining the opening and closing state of the knife switch provided in this embodiment includes the following steps.
  • Step S201 acquiring a monitoring image of a knife switch.
  • the knife gate monitoring image is generated and sent by the camera device to photograph the knife gate monitoring area according to the image sending instruction sent by the knife gate control device.
  • the image sending instruction is generated by the knife switch control device within a preset time period for controlling the closing or opening of the knife switch.
  • step 201 is similar to the implementation manner of step 101 in the previous embodiment of the present disclosure, and will not be repeated here.
  • Step S202 obtaining the coordinate range of each preset area in the preset knife gate template image in the preset knife gate template image.
  • the preset knife switch template image is a pre-shot closing template image when the knife switch is in a closing state and a dividing template image when the knife switch is in a separating state.
  • the closing template image includes the closing position area when the knife switch is in the closing state and the dividing position area when the knife switch is in the closing state.
  • the divider template image includes the closing position area when the knife switch is in the divider state and the divider position area when the knife switch is in the divider state.
  • each preset area when configuring the preset knife gate template image, each preset area will be represented in the form of a coordinate range.
  • the preset area can be in the form of a square area, as shown by dashed boxes a and b in FIG. 4 , or it can be set in a circle or other shapes.
  • the closing template image may further include: an image of the closing position area when the knife switch is in the closing position area, and an image of the dividing position area when the knife switch is in the closing position area.
  • the dividing template image may also include: an image of the closing position area when the knife switch is in the dividing position area, and an image of the dividing position area when the knife switch is in the dividing position area.
  • Step S203 extracting image features corresponding to preset areas in the knife gate monitoring image according to each coordinate range.
  • the corresponding preset area in the knife gate monitoring image can be extracted according to each coordinate range of the preset knife gate template image. Image features of the set area.
  • the image feature corresponding to the preset area in the knife gate monitoring image may also be extracted in other ways, which is not limited in this embodiment.
  • the preset area is the closed position area where the knife switch is in the closed state and the divided position area where the knife switch is in the divided state when the knife switch is in the closed state.
  • Step S204 comparing the closing position area in the knife gate monitoring image with the closing position area in the closing template image and the closing position area in the quantization template image respectively, so as to determine the closing position area comparison result.
  • the purpose of comparing the structural similarity of the closing position area in the knife gate monitoring image with the closing position area in the closing template image and the closing position area in the sub-position template image is to determine the Whether there is a knife switch in the closed position area in the image.
  • the dotted line box b area is the close position area in the preset area. When the knife switch is in the close position state, there is a knife switch in the dotted line box b area, and when the knife switch is in the split state, the dotted line There is no knife switch in the box b area.
  • Structural similarity is expressed in numerical form, generally the value is between 0 and 1, and the larger the value, the higher the degree of similarity.
  • structural similarity between the closing position area in the knife gate monitoring image and the closing position area in the closing template image is greater, it means that there is a knife gate in the closing position area.
  • Step S205 performing structural similarity comparison between the quantile position area in the knife gate monitoring image and the quantile position area in the closing template image and the quantile position area in the quantile template image, so as to determine the quantile position area comparison result.
  • the structural similarity comparison between the quantile position area in the knife gate monitoring image and the quantile position area in the closing template image and the quantile position area in the quantizing template image is to determine the Whether there is a knife gate in the quantile position area in the image.
  • the dotted line box a area is the division position area in the preset area. When the knife switch is in the division state, there is a knife switch in the dotted line box a area, and when the knife switch is in the close position, the dotted line There is no knife gate in the box a area.
  • the quantile position area is determined in a similar way to the close position area.
  • the structural similarity between the quantile position area in the knife gate monitoring image and the quantile position area in the quantile template image is greater, it represents the quantile position.
  • Step S206 determining the opening and closing state of the knife switch according to the comparison result of the closed position area and the comparison result of the divided position area.
  • the determination of the opening and closing state of the knife switch according to the comparison result of the closing position area and the comparison result of the dividing position area can be specifically as follows:
  • the comparison result of the closing position area is that there is a knife switch in the closing position area, and the comparison result of the closing position area is that there is no knife switch in the closing position area, then it is determined that the knife switch is in the closing state.
  • the comparison result of the close position area is that there is no knife switch in the close position area
  • the comparison result of the split position area is that there is a knife switch in the split position area
  • the comparison result of the closing position area is that there is no knife switch in the closing position area, and the comparison result of the closing position area is that there is no knife switch in the closing position area, then it is determined that the knife switch state is in a non-separating and non-closing state.
  • Step S207 sending the opening and closing state of the knife switch to the knife switch control device, so that the knife switch control device determines the opening and closing state of the knife switch for a second time according to the opening and closing state of the knife switch and the operation information of the knife switch fed back by the sensor.
  • the opening and closing state of the knife switch can be sent to the knife switch control device, so that the knife switch control device can determine the opening and closing state of the knife switch according to the opening and closing state of the knife switch and the knife switch operation information fed back by the sensor, so as to improve the certainty.
  • the accuracy and stability of the opening and closing state of the knife switch can be sent to the knife switch control device, so that the knife switch control device can determine the opening and closing state of the knife switch according to the opening and closing state of the knife switch and the knife switch operation information fed back by the sensor, so as to improve the certainty.
  • FIG. 5 is a schematic diagram of the image alignment process of the method for determining the opening and closing state of the knife switch provided by the third embodiment of the present disclosure. As shown in FIG. Based on the method for determining the opening and closing state of the knife gate provided in the example, an image alignment process is added, and the image alignment process includes the following steps.
  • Step S301 extracting the image features of the monitor image of the knife gate and the image features of the preset knife gate template image.
  • the SIFT feature is preferable for extracting the image feature of the knife gate monitoring image, which can better improve the matching degree of the image feature pair and the stability of the transformation matrix.
  • Step S302 matching the image features of the monitor image of the knife gate with the image features of the preset knife gate template image to generate a plurality of image feature pairs.
  • An image feature pair is a feature pair consisting of two image features that match.
  • the matching method can use FLANN (Chinese: fast nearest neighbor search package, English full name: Fast Library for Approximate Nearest Neighbors) or BF (Chinese is violence, English full name: Brute Force) algorithm to further improve the accuracy of matching image feature pairs sex and stability.
  • FLANN Fast nearest neighbor search package, English full name: Fast Library for Approximate Nearest Neighbors
  • BF Chiinese is violence, English full name: Brute Force
  • step S303 a transformation matrix between the knife gate monitoring image and the preset knife gate template image is determined according to a plurality of image feature pairs and a preset projection transformation algorithm.
  • the preset projection transformation algorithm can use the RANSAC robust solution algorithm, which is called Random Sample Consensus in English, so as to determine a more stable and accurate transformation matrix.
  • the transformation matrix between the knife gate monitoring image and the preset knife gate template image is determined according to the multiple image feature pairs and a preset projection transformation algorithm.
  • the matching degree between the knife gate monitoring image and the preset knife gate template image is too low, and the next knife gate monitoring image can be used for image alignment.
  • Step S304 correcting the monitoring image of the knife gate according to the transformation matrix, so that the corrected monitoring image of the knife gate is aligned with the preset knife gate template image.
  • the correcting process is performed on the monitoring image of the knife gate because the rail vehicle is likely to generate relatively large vibrations during actual operation, thereby causing an angle deviation of the photographing device. If the shooting device produces an angular offset, the captured knife switch monitoring image will also have an angle offset problem, which will affect the subsequent determination of the opening and closing status of the knife switch. Therefore, the problem of angular deviation of the shooting device can be solved by correcting the monitoring image of the knife gate.
  • the second determination of the status of the knife switch by the knife switch control device is used as an example for illustration.
  • the knife switch control device adopts the control device in the commonly used one-key sequence control system, which is represented by one-key sequence control in the figure.
  • the photographing device adopted in this embodiment is a camera.
  • the one-button sequential control system sends a signal to control the closing or opening of the knife switch, and after waiting for a few seconds, the knife switch moves in place, and the sensor in the knife switch device will feedback the operation information of the knife switch, that is, whether it is closed or divided.
  • the one-button sequential control system will send an image sending command to the camera, so that the camera can transmit the captured knife switch monitoring image to the knife switch opening and closing state determination device to judge the knife switch opening and closing state, and return the result to the one-button sequence control system.
  • the one-button sequential control system integrates the status discrimination information of the sensor and the switch opening and closing status determination device, and obtains the opening and closing status of the switch comprehensively, and completes the double confirmation of the opening and closing of the switch.
  • the images of the knife switch in the opening and closing positions are intercepted for labeling configuration. After a single configuration is completed, the original configuration can be reused without model training.
  • the device for determining the opening and closing state of the knife gate obtains the knife gate monitoring image that needs to determine the knife gate state from the camera, extracts the SIFT feature of the image, and then uses the FLANN or BF algorithm to match the SIFT features of the knife gate monitoring image and the template image, Get pairs of feature points. At this time, judge whether the number of feature point pairs is greater than or equal to 10, if not, wait for the next image input by the camera, if so, use the RANSAC robust solution algorithm to find the knife gate monitoring
  • the transformation matrix M of the image to the template image Perform affine or projective transformation on the knife gate monitoring image according to M, align the two images, correct the angle offset of the camera, and complete the image alignment.
  • the structural similarity comparison is carried out between the knife gate monitoring image and the template image.
  • SSIM similarity comparison it is obtained whether there is a knife switch in the a and b areas, so as to judge the opening and closing status of the knife switch. Discrimination of the opening and closing state is shown in Table 1.
  • the device for determining the opening and closing state of the knife switch After reading the corresponding state from Table 1, the device for determining the opening and closing state of the knife switch sends the opening and closing state of the knife switch to the one-key sequence control system.
  • Fig. 8 is a schematic structural diagram of the device for determining the opening and closing state of the knife switch provided by the fifth embodiment of the present disclosure.
  • the device 400 for determining the opening and closing state of the knife switch includes:
  • the obtaining module 401 is configured to obtain the monitoring image of the knife gate.
  • the knife gate monitoring image is generated and sent by the camera device to photograph the knife gate monitoring area according to the image sending instruction sent by the knife gate control device.
  • the image sending instruction is generated by the knife switch control device within a preset time period for controlling the closing or opening of the knife switch.
  • the extraction module 402 is configured to extract image features of multiple preset areas in the knife gate monitoring image.
  • the plurality of preset areas at least include the closed position area where the knife switch is in the closed position and the divided position area where the knife switch is in the divided state when the knife switch is in the divided state.
  • the comparison module 403 is configured to perform structural similarity comparison between the image features of each preset area in the knife gate monitoring image and the image features of the preset knife gate template image corresponding to the preset area.
  • the determination module 404 is configured to determine the opening and closing state of the knife switch according to the result of the structural similarity comparison.
  • the device for determining the opening and closing state of the knife switch provided in this embodiment can implement the technical solution of the method embodiment shown in FIG. 2 , and its realization principle and technical effect are similar to those of the method embodiment shown in FIG. 2 , so details will not be repeated here.
  • the device for determining the opening and closing state of the knife switch provided in the present disclosure further refines the device for determining the opening and closing state of the knife switch 400 on the basis of the device for determining the opening and closing state of the knife switch provided in the previous embodiment.
  • the extraction module 402 is specifically set as:
  • the coordinate range of each preset area in the preset knife gate template image in the preset knife gate template image is acquired.
  • the image features corresponding to the preset area in the knife gate monitoring image are extracted according to each coordinate range.
  • the preset area includes the closed position area where the knife switch is in the closed state and the divided position area where the knife switch is in the divided state when the knife switch is in the divided state.
  • the preset knife gate template image is a pre-shot closing template image when the knife gate is in a closing state and a dividing template image when the knife gate is in a dividing state.
  • the closing template image includes the closing position area when the knife switch is in the closing state and the dividing position area when the knife switch is in the closing state.
  • the divider template image includes the closing position area when the knife switch is in the divider state and the divider position area when the knife switch is in the divider state.
  • the comparison module 403 is set to:
  • Structural similarity comparisons were carried out between the closing position area in the knife gate monitoring image and the closing position area in the closing template image and the closing position area in the quantized template image, so as to determine the comparison result of the closing position area.
  • Structural similarity comparisons are made between the quantile position area in the knife gate monitoring image and the quantile position area in the closing template image and the quantile position area in the quantile template image to determine the comparison result of the quantile position area.
  • the comparison module 403 compares the closing position area in the knife gate monitoring image with the closing position area in the closing template image and the closing position area in the sub-positioning template image respectively in a similar structure. Sex comparison to determine the zygomatic position area comparison result, set to:
  • the structural similarity between the closing position area in the knife gate monitoring image and the closing position area in the closing template image is greater than the closing position area in the knife gate monitoring image and the closing position area in the split template image If there is structural similarity between them, it is determined that there is a knife switch in the closing position area as a result of the comparison of the closing position area. If the structural similarity between the closing position area in the knife gate monitoring image and the closing position area in the closing template image is smaller than the closing position area in the knife gate monitoring image and the closing position area in the split template image If there is structural similarity between them, it is determined that there is no knife gate in the closing position area as a result of the comparison.
  • the comparison module 403 compares the quantile position area in the knife gate monitoring image with the quantile position area in the closing template image and the quantile position area in the quantizing template image.
  • the specific settings are:
  • the structural similarity between the quantile position area in the knife gate monitoring image and the quantile position area in the closing template image is greater than the quantile position area in the knife gate monitoring image and the quantile position area in the quantizing template image If there is structural similarity between them, it is determined that there is no knife gate in the quantile position area as a result of the comparison. If the structural similarity between the quantile position area in the knife gate monitoring image and the quantile position area in the closing template image is smaller than the quantile position area in the knife gate monitoring image and the quantile position area in the quantizing template image If there is structural similarity between them, it is determined that there is a knife gate in the quantile position area as a result of the comparison of the quantile position area.
  • the determining module 404 is set to:
  • the comparison result of the closing position area is that there is a knife switch in the closing position area, and the comparison result of the closing position area is that there is no knife switch in the closing position area, then it is determined that the knife switch is in the closing state. If the comparison result of the close position area is that there is no knife switch in the close position area, and the comparison result of the split position area is that there is a knife switch in the split position area, then it is determined that the knife switch state is in the split state. If the comparison result of the closing position area is that there is no knife switch in the closing position area, and the comparison result of the closing position area is that there is no knife switch in the closing position area, then it is determined that the knife switch state is in a non-separating and non-closing state.
  • the device 400 for determining the opening and closing state of the knife switch further includes:
  • the image alignment module is configured to extract the image features of the monitor image of the knife gate and the image features of the preset knife gate template image. Match the image features of the knife gate monitoring image with the image features of the preset knife gate template image to generate multiple image feature pairs.
  • a transformation matrix between the knife gate monitoring image and the preset knife gate template image is determined according to a plurality of image feature pairs and a preset projection transformation algorithm.
  • the knife gate monitoring image is corrected according to the transformation matrix, so that the corrected knife gate monitoring image is aligned with the preset knife gate template image.
  • the image alignment module determines the transformation matrix between the knife gate monitoring image and the preset knife gate template image according to a plurality of image feature pairs and a preset projection transformation algorithm, it is set as:
  • the transformation matrix between the knife gate monitoring image and the preset knife gate template image is determined according to the multiple image feature pairs and a preset projection transformation algorithm.
  • the device 400 for determining the opening and closing state of the knife switch further includes:
  • the secondary determination module is configured to send the opening and closing state of the knife switch to the knife switch control device, so that the knife switch control device can secondarily determine the opening and closing state of the knife switch according to the opening and closing state of the knife switch and the operation information of the knife switch fed back by the sensor.
  • the device for determining the opening and closing state of the knife switch provided in this embodiment can implement the technical solution of the method embodiment shown in Fig. 2-Fig. 7, and its realization principle and technical effect are similar to those of the method embodiment shown in Fig. 2-Fig. Let me repeat them one by one.
  • the present disclosure also provides an electronic device, a computer-readable storage medium, and a computer program product.
  • FIG. 9 is a schematic structural diagram of an electronic device provided by a sixth embodiment of the present disclosure.
  • the electronic device is intended to be in various forms of digital computers suitable for knife-opening state determination training, such as laptop computers, personal digital assistants, and other suitable computers.
  • digital computers suitable for knife-opening state determination training, such as laptop computers, personal digital assistants, and other suitable computers.
  • the components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.
  • the electronic device includes: a processor 501 and a memory 502 .
  • the various components are interconnected using different buses and can be mounted on a common motherboard or otherwise as desired.
  • a processor may process instructions for execution within an electronic device.
  • the memory 502 is a non-transitory computer-readable storage medium provided in the present disclosure.
  • the memory stores instructions executable by at least one processor, so that at least one processor executes the method for determining the opening and closing state of the knife switch provided in the present disclosure.
  • the non-transitory computer-readable storage medium of the present disclosure stores computer instructions, and the computer instructions are used to make the computer execute the method for determining the opening and closing state of the knife switch provided in the present disclosure.
  • the memory 502 as a non-transitory computer-readable storage medium, can be configured to store non-transitory software programs, non-transitory computer-executable programs and modules, such as program instructions/ modules (for example, the acquisition module 401, the extraction module 402, the comparison module 403 and the determination module 404 shown in FIG. 8).
  • the processor 501 executes various functional applications and data processing of the server by running non-transient software programs, instructions and modules stored in the memory 502, that is, implements the method for determining the opening and closing state of the switch in the above method embodiments.
  • this embodiment also provides a computer product.
  • the electronic device can execute the method for determining the opening and closing state of the knife switch in the above embodiment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Constituent Portions Of Griding Lathes, Driving, Sensing And Control (AREA)
  • Spinning Or Twisting Of Yarns (AREA)
  • Electrical Discharge Machining, Electrochemical Machining, And Combined Machining (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

La présente divulgation utilise un procédé et un appareil de détermination de l'état ouvert/fermé d'un commutateur à lame ; un dispositif ; un milieu ; et un produit. Le procédé consiste : à acquérir une image de surveillance de commutateur à lame ; à extraire, de l'image de surveillance de commutateur à lame, des caractéristiques d'image d'une pluralité de zones prédéfinies, comprenant au moins une zone de fermeture, occupée par un commutateur à lame en état de fermeture, et une zone d'ouverture, occupée par le commutateur à lame en état d'ouverture ; à effectuer une comparaison de similarité de structure entre les caractéristiques d'image des zones prédéfinies de l'image de surveillance de commutateur à lame et une caractéristique d'image d'une zone prédéfinie correspondant à une image de modèle prédéfini de commutateur à lame ; et à déterminer l'état ouvert/fermé du commutateur à lame, selon un résultat de comparaison de similarité de structure.
PCT/CN2022/129042 2021-11-08 2022-11-01 Procédé et appareil de détermination de l'état ouvert/fermé d'un commutateur à lame, dispositif, support et produit WO2023078254A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB2308674.7A GB2616993A (en) 2021-11-08 2022-11-01 Method and apparatus for determining open/closed state of knife switch, and device, medium and product
AU2022381656A AU2022381656B2 (en) 2021-11-08 2022-11-01 Method and apparatus for determining open/closed state of knife switch, and device, medium and product

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111314122.4 2021-11-08
CN202111314122.4A CN114220068B (zh) 2021-11-08 2021-11-08 刀闸分合状态确定方法、装置、设备、介质及产品

Publications (1)

Publication Number Publication Date
WO2023078254A1 true WO2023078254A1 (fr) 2023-05-11

Family

ID=80696642

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/129042 WO2023078254A1 (fr) 2021-11-08 2022-11-01 Procédé et appareil de détermination de l'état ouvert/fermé d'un commutateur à lame, dispositif, support et produit

Country Status (4)

Country Link
CN (1) CN114220068B (fr)
AU (1) AU2022381656B2 (fr)
GB (1) GB2616993A (fr)
WO (1) WO2023078254A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114220068B (zh) * 2021-11-08 2023-09-01 珠海优特电力科技股份有限公司 刀闸分合状态确定方法、装置、设备、介质及产品

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102262734A (zh) * 2011-01-07 2011-11-30 浙江省电力公司 判别刀闸开合与否的方法及其系统
CN108009551A (zh) * 2017-11-21 2018-05-08 武汉中元华电软件有限公司 适用于电力作业机器人的电力刀闸分合位状态识别方法
CN111126253A (zh) * 2019-12-23 2020-05-08 国网福建省电力有限公司 基于图像识别的刀闸状态检测方法
CN114220068A (zh) * 2021-11-08 2022-03-22 珠海优特电力科技股份有限公司 刀闸分合状态确定方法、装置、设备、介质及产品

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509100B (zh) * 2011-10-26 2013-06-19 山东电力研究院 一种基于图像模式识别的刀闸分合可靠性识别方法
US9576221B2 (en) * 2014-07-09 2017-02-21 Ditto Labs, Inc. Systems, methods, and devices for image matching and object recognition in images using template image classifiers
CN106250902A (zh) * 2016-07-29 2016-12-21 武汉大学 基于图像特征模板匹配的电力系统开关状态检测方法
JP6857586B2 (ja) * 2017-10-02 2021-04-14 富士フイルム株式会社 画像抽出装置，画像抽出方法および画像抽出プログラムならびにそのプログラムを格納した記録媒体
CN108460727A (zh) * 2018-03-28 2018-08-28 中南大学 一种基于投影几何与sift特征的图像拼接方法
CN109711567A (zh) * 2018-12-14 2019-05-03 珠海优特电力科技股份有限公司 检修工作安全措施信息自动生成方法和系统
CN110555824B (zh) * 2019-07-22 2022-07-08 深圳供电局有限公司 开关位置判别方法及开关位置检测系统的控制方法
CN110599446B (zh) * 2019-07-26 2022-06-17 深圳供电局有限公司 隔离开关合闸位置判别方法
CN112004012A (zh) * 2020-08-26 2020-11-27 西安咏圣达电子科技有限公司 一种开关柜运行状态管理检测系统、方法、计算机设备
US11048773B1 (en) * 2021-01-26 2021-06-29 Coupang Corp. Systems and methods for modeling item similarity and correlating item information
CN113033578B (zh) * 2021-03-30 2023-05-16 上海星定方信息科技有限公司 基于多尺度特征匹配的图像校准方法、系统、终端及介质
CN113592923B (zh) * 2021-06-30 2024-03-29 国网浙江省电力有限公司营销服务中心 一种基于深度局部特征匹配的批图像配准方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102262734A (zh) * 2011-01-07 2011-11-30 浙江省电力公司 判别刀闸开合与否的方法及其系统
CN108009551A (zh) * 2017-11-21 2018-05-08 武汉中元华电软件有限公司 适用于电力作业机器人的电力刀闸分合位状态识别方法
CN111126253A (zh) * 2019-12-23 2020-05-08 国网福建省电力有限公司 基于图像识别的刀闸状态检测方法
CN114220068A (zh) * 2021-11-08 2022-03-22 珠海优特电力科技股份有限公司 刀闸分合状态确定方法、装置、设备、介质及产品

Also Published As

Publication number Publication date
CN114220068B (zh) 2023-09-01
CN114220068A (zh) 2022-03-22
AU2022381656A1 (en) 2023-07-06
AU2022381656B2 (en) 2024-06-20
GB202308674D0 (en) 2023-07-26
GB2616993A (en) 2023-09-27

Similar Documents

Publication Publication Date Title
US11200404B2 (en) Feature point positioning method, storage medium, and computer device
US9928405B2 (en) System and method for detecting and tracking facial features in images
US10936911B2 (en) Logo detection
CN109145759B (zh) 车辆属性识别方法、装置、服务器及存储介质
US11164323B2 (en) Method for obtaining image tracking points and device and storage medium thereof
WO2020199480A1 (fr) Procédé et dispositif de reconnaissance de mouvement corporel
WO2019042426A1 (fr) Procédé et appareil de traitement de scène en réalité augmentée, et support de stockage informatique
He et al. Iterative Grassmannian optimization for robust image alignment
WO2020082258A1 (fr) Procédé et appareil de suivi multi-objectif en temps réel, et dispositif électronique
KR20190054702A (ko) 영상에서 객체의 행동을 인식하는 방법 및 그 장치
US20210342593A1 (en) Method and apparatus for detecting target in video, computing device, and storage medium
WO2023078254A1 (fr) Procédé et appareil de détermination de l'état ouvert/fermé d'un commutateur à lame, dispositif, support et produit
CN113298158B (zh) 数据检测方法、装置、设备及存储介质
WO2018121414A1 (fr) Dispositif électronique, procédé et appareil de reconnaissance d'image cible
WO2021169625A1 (fr) Procédé et appareil de détection de photographie de réseau reproduite, dispositif informatique et support de mémoire
WO2023123923A1 (fr) Procédé d'identification de poids de corps humain, dispositif d'identification de poids de corps humain, dispositif informatique, et support
US11594073B2 (en) Face recognition method and face recognition device
US11403877B2 (en) Face recognition method and electronic device using same
CN110766077A (zh) 证据链图像中特写图筛选方法、装置和设备
WO2020019457A1 (fr) Procédé et appareil d'appariement d'instruction d'utilisateur, dispositif informatique et support de stockage
CN112836682B (zh) 视频中对象的识别方法、装置、计算机设备和存储介质
US12020444B2 (en) Production line monitoring method and monitoring system thereof
CN111178162B (zh) 图像识别方法、装置、计算机设备和存储介质
WO2023060575A1 (fr) Procédé et appareil de reconnaissance d'images, dispositif électronique et support de stockage
KR102101481B1 (ko) 인공지능 기반의 휴대용 보안영상 학습장치 및 방법

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 202308674

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20221101

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22889277

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022381656

Country of ref document: AU

Date of ref document: 20221101

Kind code of ref document: A