WO2018166149A1 - 一种造波机运行状态的视频监测装置及方法 - Google Patents

一种造波机运行状态的视频监测装置及方法 Download PDF

Info

Publication number
WO2018166149A1
WO2018166149A1 PCT/CN2017/101121 CN2017101121W WO2018166149A1 WO 2018166149 A1 WO2018166149 A1 WO 2018166149A1 CN 2017101121 W CN2017101121 W CN 2017101121W WO 2018166149 A1 WO2018166149 A1 WO 2018166149A1
Authority
WO
WIPO (PCT)
Prior art keywords
wave
board
making
point
points
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/101121
Other languages
English (en)
French (fr)
Inventor
杜海
孟娟
李木国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dalian University of Technology
Original Assignee
Dalian University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dalian University of Technology filed Critical Dalian University of Technology
Priority to US16/311,590 priority Critical patent/US10605694B2/en
Publication of WO2018166149A1 publication Critical patent/WO2018166149A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M10/00—Hydrodynamic testing; Arrangements in or on ship-testing tanks or water tunnels
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
    • B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
    • B01L3/00—Containers or dishes for laboratory use, e.g. laboratory glassware; Droppers
    • B01L3/50—Containers for the purpose of retaining a material to be analysed, e.g. test tubes
    • B01L3/508—Rigid containers without fluid transport within
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06—Management of faults, events, alarms or notifications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/22—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks comprising specially adapted graphical user interfaces [GUI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
    • Y02E10/00—Energy generation through renewable energy sources
    • Y02E10/30—Energy from the sea, e.g. using wave energy or salinity gradient

Definitions

  • the invention belongs to the field of motion monitoring, and relates to the monitoring problem of the running state of the wave-making board in the wave-making machine, in particular to a video monitoring device and method for the running state of the wave-making machine.
  • the lower position machine converts the time series value control signal of each wave plate operation into an irregular position pulse control signal through a dedicated motion control interface, and outputs it to the servo power source, and simultaneously drives the servo actuator to drive the wave plate to correspondingly Exercise to push the water to create waves.
  • the servo motor encoder detects the motion track of the push plate in real time and feeds it back to the servo power supply to ensure that the push wave board can accurately track the running of the given signal of the computer.
  • the feedback signal is simultaneously fed back to the motion control interface, and the lower position machine can monitor accordingly.
  • the running state of the wave board is used for inquiry by the host computer.
  • the motion quality of the wave plate directly affects the quality of the wave simulation and the rationality of the wave making experiment.
  • the drive alarms to the lower position control machine, and the lower position machine notifies the upper machine error number while stopping the operation of the motor controlled by the local machine.
  • the host computer receives the fault, all the lower computers are stopped, and the fault type is displayed at the same time as the alarm. However, this is the way to handle failures under normal conditions.
  • the wave generator runs for a long time.
  • the connection between the application layer programs is broken, so that the upper computer cannot obtain the error message, but continues.
  • Make waves In this case, the wave data in the experimental pool is inaccurate, the experimental conclusion is invalid, and immediate shutdown is required.
  • the information feedback of the encoder or the displacement sensor is used, and the data transmission mode from the lower computer to the upper computer is used.
  • the method of fault feedback is completely integrated in the control loop. Once an abnormal situation occurs, the experimenter controlling the host computer cannot obtain the fault information in time, so as to reduce the experiment efficiency.
  • a monitoring method for the operating state of the wave generator is needed to evaluate the wave-making state in operation in real time.
  • the video surveillance method is not only independent of the wave-making control system, but also has the characteristics of convenient installation, non-contact, and full-field measurement, so it is more suitable for monitoring on the wave-making site.
  • the present invention relates to image processing for the monitoring of the operating state of the wave-making system in a marine engineering laboratory. Combining technology with waveboard motion tracking, a video monitoring method for the operating state of the wave generator is proposed.
  • a video monitoring device for operating state of a wave machine includes a computer, a camera with a fixed focus lens, a triangular bracket with a pan/tilt head, a plurality of circular red LED lights, and a drive control circuit board; the camera is fixed on the triangular bracket, Arranged on the outside of the experimental pool, the optical axis and the direction of movement of the wave-making plate are at an angle to each other, and connected to the computer through the transmission wire; a circular red LED lamp is arranged on each wave-making plate in the visible area And each LED is connected to the drive control circuit board, and the LED drive control circuit board is connected to the computer through the RS232 interface; each wave board is a mark point, and when the wave machine is in the running state monitoring, the camera is firstly The captured image is detected by the marker point, and the center position is calculated; then the position of each marker point is tracked in the dynamic video, and the operation state of each wave-making board is evaluated according to the motion state of the marker point.
  • a video monitoring method for the running state of a wave machine the steps are as follows:
  • Step A After the circular red LED lamp is mounted on the wave-making board, the shooting position of the camera is arranged such that the motion of the wave-making board forms a certain angle with the optical axis of the camera; and the object distance and the aperture of the lens are adjusted. Make the scene clear;
  • Step B System calibration is required for the first run.
  • the PC controls the drive control circuit board to illuminate all the circular red LED lights, and at the same time controls the wave plate to return to the initial position; the camera captures one frame of the scene and passes the image binary.
  • the method extracts the coordinates P a of all the illuminated marking points in the initial state of the wave making plate, and numbers the marking points in order of near and far; after that, the PC controls the wave making plate to move to the maximum stroke, and takes a scene image.
  • the line segments are equal to each other P a 'P b ' 1
  • the perspective transformation matrix M 3 ⁇ 3 is recorded.
  • a two-dimensional coordinate plane is set, the x-axis of which coincides with la a ', and the y-axis coincides with P a 'P b ' i .
  • Step C At the same time as starting the wave making process, all the circular red LED lights are illuminated; the camera is set to enter the equal interval continuous acquisition mode.
  • Step D Perform binarization analysis on the current image, and perform position extraction of the identification point in the W ROI area, and modify the position of the identification point by using the perspective transformation matrix M 3 ⁇ 3 .
  • Step E comparing the position of the current identification point with the position of the previous moment, if the position change does not occur, the identification point of the number is first recorded; along the y axis, the position of each identification point at the current moment is adjacent to the neighbor The position of the identification point is compared, and the difference between the positions is calculated. If the difference of the neighbor position is greater than the set threshold T, the identification point of the number is recorded twice.
  • Step F If a certain marker point is continuously recorded twice, the wave plate of the number is faulty, and the wave-making board under the number of the first record adjacent to it is also determined to be faulty.
  • Step G When a fault occurs, the computer displays an alarm and closes the wave making program. At this time, the control drive control circuit board closes all the identification lights of the wave board except for the fault. If no fault occurs, step D-E is repeated until the wave making experiment is completed, all the indicator lights are turned off, and the monitoring program stops running.
  • the LED marking points are first installed at the same position of each wave-making board; then the camera is arranged and the system is scaled; then the automatic monitoring of the program is started, and the marking points are continuously detected and the position is obtained during the measurement; Finally, according to the current identification point location and the previous moment location and spatial neighbors The relationship between the positions judges the running state of the wave board.
  • the invention has the beneficial effects that the wave board operation monitoring is independent of the wave making control system, and the operation of the wave board is monitored in real time through a non-contact image measuring method.
  • the wave-making board is identified by LED, and the position of the identification point in each frame image is obtained through image perspective correction and binarization analysis, and the running state of the wave-making board is judged according to the comparison between different time points and different spatial position identification points. It effectively reduces the error rate of the wave-making control system for the monitoring of the wave-making plate, and greatly improves the experimental efficiency of the simulated wave-making.
  • FIG. 1 is a schematic structural view of a video monitoring apparatus of the present invention.
  • a video monitoring method for the running state of the wave making machine by a computer 1; a camera 2 with a fixed focus lens; a triangular bracket with a pan/tilt 4; The LED round bead 5 and the drive control circuit board 3 are composed.
  • the camera 2 is fixed to the tripod 4 and disposed outside the experimental pool 6, the optical axis of which is at an angle to the direction of movement of the wave making plate 7, and is connected to the computer 1 through a transmission wire.
  • a circular red LED lamp 5 is arranged on each of the wave-making plates 7 in the visible area, and each of the LEDs is connected to the drive control circuit board 3.
  • the LED drive control board 3 is connected to the computer 1 via an RS232 interface.
  • the image captured by the camera 2 is first detected and the center position is calculated. Then, the position of each marker point is tracked in the dynamic video, and the operation of each wave-making board 7 is evaluated based on the motion state of the marker point.
  • the specific method is described as follows:
  • Step A After the LED lamp 5 is mounted on the wave board 7, the shooting position of the camera 2 is clothed. The movement of the wave making plate 7 is formed at a certain angle with the optical axis of the camera 2. At the same time, the object distance and aperture of the lens are adjusted to make the scene image clear.
  • Step B System calibration is required for the first run.
  • the computer 1 controls the LED drive board 3 to illuminate all of the LED identification lamps 5 while controlling the wave making plate 7 to return to the initial position.
  • the camera 2 collects a frame image of the scene, and extracts the coordinates P a of all the light-emitting mark points 5 when the wave-making board 7 is initialized by the image binarization method, and numbers the mark points 5 in order of near and far.
  • the PC 1 controls the wave making plate 7 to move to the maximum stroke, takes a scene image, and extracts the coordinates P b of all the marker points 5.
  • the position of the identified landmark is corresponding to the identification point number.
  • a two-dimensional coordinate plane is set, the x-axis of which coincides with la a ', and the y-axis coincides with P a 'P b ' i .
  • Step C At the same time as the wave making process is started, all the identification lights 5 are illuminated. Set camera 2 to enter the equal interval continuous acquisition mode.
  • Step D Perform binarization analysis on the current image, and perform location extraction of the marker point 5 in the W ROI region. At the same time, the position of the identification point is modified by using the perspective transformation matrix M 3 ⁇ 3 .
  • Step E Compare the position of the current identification point with the position of the previous moment. At this time, if the position change does not occur, the identification point of the number is recorded for the first time. Each point of the current moment along the y axis The position is compared with the location of the neighbor's identification point, and the difference between the positions is calculated. At this time, if the difference in the neighbor position is greater than the set threshold T, the marked point of the number is secondarily recorded.
  • Step F If a certain marker point 5 is continuously recorded twice, the wave-making plate 7 of the number is faulty, and the wave-making plate 7 under the number of the first recording which is sequentially adjacent to it is similarly determined to be faulty.
  • Step G When a fault occurs, the computer displays an alarm and simultaneously closes the wave making program. At this time, the LED driving board 3 is controlled to turn off all the identification lamps 5 of the wave making board 7 except for the fault. If no fault occurs, step D-E is repeated until the wave making experiment is completed, all the indicator lights 5 are turned off, and the monitoring program stops running.
  • the LED marking point 5 is first installed at the same position of each wave-making board 7 before monitoring; then the camera 2 is arranged and system calibration is performed; then the automatic monitoring of the program is started, and the marking point 5 is continuously detected during the measurement. Obtaining its position; finally, determining the running state of the wave-making board 7 according to the relationship between the current identification point position and the previous time position and the spatial neighbor position.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Fluid Mechanics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Analytical Chemistry (AREA)
  • Clinical Laboratory Science (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Hematology (AREA)
  • General Health & Medical Sciences (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

属于运动监测技术领域，提供了一种造波机运行状态的视频监测装置及方法。在造波机运行状态监测时，首先对摄像机采集的图像进行标志点检测，并计算中心位置。然后在动态的视频中追踪每个标志点的位置，并根据标志点的运动状态来评估每块造波板的运行情况。将造波板运行监测独立于造波控制系统之外，并通过非接触的图像测量方式实时监测造波板的运行情况。以LED来标识造波板，通过图像透视校正和二值化分析来获取每帧图像中标识点的位置，并根据不同时刻、不同空间位置标识点之间的对比来判断造波板的运行状态，有效地降低了造波控制系统对造波板运行监测的出错率，大幅度提高了模拟造波的实验效率。

Description

一种造波机运行状态的视频监测装置及方法 技术领域
本发明属于运动监测领域，涉及到造波机中造波板运行状态的监测问题，特别涉及一种造波机运行状态的视频监测装置及方法。
背景技术
在海洋工程研究领域，无论是海洋采油平台的设计、海洋能发电装置的研制、还是海底管线的铺设以及海洋安防工程的建设往往都离不开实验室研究阶段，即均需要将实验模型放在波流水槽、水池中进行设计验证。造波机便是此过程中必不可少的一种实验仪器设备[1-4]，该设备可以在有限的空间内模拟出海洋中多种类型的波浪形式，为海洋装备的研制提供实验验证的仿真环境。
模拟波浪的过程中，造波系统中多块造波板被协同控制运动，从而产生不同的波浪形式。然而无论是推板式还是摇板式造波，其控制的原理是一致的：首先对目标谱设定波浪模拟的参数，上位机根据系统的传递函数，计算出每块造波板运行的时间序列值控制信号，同时将该信号通过专用网络传送到相应的下位机。当下位机接收到上位主控机的控制信号后，启动造波程序开始造波。下位机通过专用运动控制接口，将每块造波板运行的时间序列值控制信号转换成不规则的位置脉冲控制信号，并输出到伺服电源，同时驱动伺服作动器带动造波板作相应的运动，从而推动水体产生波浪。伺服电机编码器实时测出推板的运动轨迹，并反馈到伺服电源，以确保推波板能准确地跟踪计算机给定信号运行，该反馈信号同时反馈到运动控制接口，下位机可以据此监测造波板的运行状态，并供上位机查询。
从上面的造波机运行机理可以看出，造波板的运动质量直接影响到了波浪模拟的品质以及造波实验的合理性。同时也可以看出，当造波板运行出现故障 时，驱动器向下位控制机报警，下位机在停止本机控制的电机运转的同时通知上位机错误号。当上位机接到故障后，停止所有下位机，并在报警的同时显示故障类型。然而，这是正常情况下的故障处理方式。在海工实验中，造波机长时间运行，在有些情况下，当驱动器损坏或控制程序异常退出时，由于应用层程序之间的连接断掉，致使上位机无法获得错误信息，而依然继续造波。这种情况下，实验水池内的波浪数据是不准确的，实验结论是无效的，需要即时停机。然而，对于现今的造波控制系统而言，均利用编码器或位移传感器的信息反馈，从下位机到上位机的数据传输方式。这种故障反馈的方式，完全集成在控制回路内部，一旦出现异常情况，则控制上位机的实验人员无法及时得到故障信息，以致于降低实验效率。为此，需要一种造波机运行状态的监测方法来实时评测运行中的造波状态。而采用视频监控的方法不仅独立于造波控制系统，而且具有安装方便、非接触、全场测量的特点，因此较适宜于造波现场的监测。
参考文献：
[1]杨洪齐,李木国,柳淑学,等.伺服电机驱动的水槽主动吸收式造波机原理与实现.大连理工大学学报,2013,53(3):423-428.
[2]朱萍,黄晶华,赵丽君.水槽造波机的参数确定及结构设计.现代电力,2011,28(4):44-48.
[3]柳淑学,吴斌,李木国,等.无反射不规则波造波机系统的研究.水动力学研究与进展,2003,18(5):532-539.
[4]李俊,陈刚,杨建民,等.海洋工程试验中多单元造波机波浪模拟方法.海洋工程,2011,29(3):37-42.
发明内容
针对海洋工程实验室中造波系统的运行状态监测问题，本发明将图像处理 技术与造波板运动追踪相结合，提出了一种造波机运行状态的视频监测方法。
本发明的技术方案：
一种造波机运行状态的视频监测装置，包括计算机、带有定焦镜头的摄像机、带云台的三角支架、多个圆形红色LED灯以及驱动控制电路板；摄像机固定在三角支架上，布置在实验水池的外侧，其光轴与造波板的运动方向互成一定的角度，并通过传输导线与计算机相连；在可视区内的每块造波板上布置一个圆形红色LED灯，并将每个LED连接到驱动控制电路板上，LED的驱动控制电路板通过RS232接口与计算机相连；每块造波板即为一个标志点，在造波机运行状态监测时，首先对摄像机采集的图像进行标志点检测，并计算中心位置；然后在动态的视频中追踪每个标志点的位置，并根据标志点的运动状态来评估每块造波板的运行情况。
一种造波机运行状态的视频监测方法，步骤如下：
步骤A：在造波板上安装好圆形红色LED灯后，对摄像机的拍摄位置进行布置，使得造波板的运动与摄像机的光轴形成一定的角度；再调整镜头的物距与光圈，使得现场成像清晰；
步骤B：首次运行时需要进行系统定标，PC机控制驱动控制电路板点亮所有的圆形红色LED灯，同时控制造波板回到初始位置；摄像机采集现场一帧图像，通过图像二值化的方法提取造波板初始化状态时所有发光标志点的坐标Pa，并按照由近及远的顺序对标志点进行编号；之后，PC机控制造波板运动到最大行程处，拍摄现场图像，并提取所有标志点的坐标Pb；与此同时，将此次识别的标志点的位置与标识点编号相对应；每个编号下记录的两个坐标位置形成一个线段PaPb i,i＝1,2,3...N，其中N为标识点的数量；由于每块造波板的运动将限制在线段上，所以称PaPb i为行程线段；另外，由初始位置的点集Pa形成直线la，而 由终止位置点集Pb形成直线lb。将la与lb之间的区域设置为分析区域WROI；接下来，使用透视变换P′＝M3×3P(P为la与lb上的标识点坐标的集合，P′为校正后点的坐标集合，M3×3为透视变换矩阵)对图像中标识点的坐标进行校正，使得由P′所组成的两条直线平行la′//lb′，即新的行程线段彼此相等Pa′Pb′1|＝|Pa′Pb′2|＝...＝|Pa′Pb′N|。与此同时记录透视变换矩阵M3×3。设定二维坐标平面，其x轴与la′重合，y轴与Pa′Pb′i重合。当完成这些操作后，PC机控制LED驱动板关闭所有的标识灯，进入分析等待状态。
步骤C：启动造波程序的同时，点亮所有的圆形红色LED灯；设置摄像机进入等间隔连续采集模式。
步骤D：对当前图像进行二值化分析，并在WROI区域内进行标识点的位置提取，同时利用透视变换矩阵M3×3对标识点的位置进行修改。
步骤E：将当前标识点的位置与前一时刻的位置进行对比，若没有发生位置改变则对该编号的标识点进行首次记录；沿y轴向将当前时刻每个标识点的位置与近邻的标识点位置进行对比，计算之间的位置差异，若近邻位置差异大于设定阈值T，则对该编号的标识点进行二次记录。
步骤F：若某标识点被连续记录两次，则该编号的造波板出现故障，而与之依次邻接的仅进行第一次记录的编号下的造波板同样认定出现故障。
步骤G：当有故障发生时，计算机显示报警，同时关闭造波程序，此时控制驱动控制电路板关闭除有故障发生造波板所有标识灯。若没有故障发生，则反复运行步骤D-E，直到造波实验完毕，关掉所有标识灯，监测程序停止运行。
综上所述，在监测前首先在各个造波板的相同位置安装LED标识点；然后布置摄像机并进行系统定标；之后开始进行程序的自动监测，测量时不断检测标识点并获取其位置；最后根据当前标识点位置与前一时刻位置以及空间近邻 位置之间的关系对造波板的运行状态进行判断。
本发明的有益效果：将造波板运行监测独立于造波控制系统之外，并通过非接触的图像测量方式实时监测造波板的运行情况。以LED来标识造波板，通过图像透视校正和二值化分析来获取每帧图像中标识点的位置，并根据不同时刻、不同空间位置标识点之间的对比来判断造波板的运行状态，有效地降低了造波控制系统对造波板运行监测的出错率，大幅度提高了模拟造波的实验效率。
附图说明
图1是本发明的视频监测装置结构示意图。
图中：1计算机；2摄像机；3LED驱动板；4三角支架；5LED灯；
6实验水池；7造波板。
具体实施方式
以下结合附图和技术方案，进一步说明本发明的具体实施方式。
一种造波机运行状态的视频监测方法，其结构示意如附图1所示：由一台计算机1；一台带有定焦镜头的摄像机2；一支带云台的三角支架4；多个LED圆形灯珠5以及驱动控制电路板3所组成。摄像机2固定在三角架4上，并布置在实验水池6的外侧，其光轴与造波板7的运动方向互成一定的角度，并通过传输导线与计算机1相连。在可视区内的每块造波板7上布置一个圆形红色LED灯5，并将每个LED连接到驱动控制电路板3上。LED的驱动控制板3通过RS232接口与计算机1相连。在造波机运行状态监测时，首先对摄像机2采集的图像进行标志点检测，并计算中心位置。然后在动态的视频中追踪每个标志点的位置，并根据标志点的运动状态来评估每块造波板7的运行情况。具体方法描述如下：
步骤A：在造波板7上安装好LED灯5后，对摄像机2的拍摄位置进行布 置，使得造波板7的运动与摄像机2的光轴形成一定的角度。与此同时，调整镜头的物距与光圈，使得现场成像清晰。
步骤B：首次运行时需要进行系统定标。计算机1控制LED驱动板3点亮所有的LED标识灯5，同时控制造波板7回到初始位置。摄像机2采集现场一帧图像，通过图像二值化的方法提取造波板7初始化状态时所有发光标志点5的坐标Pa，并按照由近及远的顺序对标志点5进行编号。之后，PC机1控制造波板7运动到最大行程处，拍摄现场图像，并提取所有标志点5的坐标Pb。与此同时，将此次识别的标志点的位置与标识点编号相对应。这样每个编号下记录的两个坐标位置便形成一个线段PaPbi,i＝1,2,3...N，其中N为标识点的数量。由于每块造波板7的运动将限制在这线段上，所以称PaPbi为行程线段。另外，由初始位置的点集Pa可形成直线la，而由终止位置点集Pb可形成直线lb。将la与lb之间的区域设置为分析区域WROI。接下来，使用透视变换P′＝M3×3P(P为la与lb上的标识点坐标的集合，P′为校正后点的坐标集合，M3×3为透视变换矩阵)对图像中标识点的坐标进行校正，使得由P′所组成的两条直线平行la′//lb′，即新的行程线段彼此相等|Pa′Pb′1|＝|Pa′Pb′2|＝...＝|Pa′Pb′N|。与此同时记录透视变换矩阵M3×3。设定二维坐标平面，其x轴与la′重合，y轴与Pa′Pb′i重合。当完成这些操作后，PC机1控制LED驱动板3关闭所有的标识灯，进入分析等待状态。
步骤C：启动造波程序的同时，点亮所有的标识灯5。设置摄像机2进入等间隔连续采集模式。
步骤D：对当前图像进行二值化分析，并在WROI区域内进行标识点5的位置提取。同时利用透视变换矩阵M3×3对标识点的位置进行修改。
步骤E：将当前标识点的位置与前一时刻的位置进行对比。此时，若没有发生位置改变则对该编号的标识点进行首次记录。沿y轴向将当前时刻每个标识点 的位置与近邻的标识点位置进行对比，计算之间的位置差异。此时，若近邻位置差异大于设定阈值T，则对该编号的标识点进行二次记录。
步骤F：若某标识点5被连续记录两次，则该编号的造波板7出现故障，而与之依次邻接的仅进行第一次记录的编号下的造波板7同样认定出现故障。
步骤G：当有故障发生时，计算机显示报警，同时关闭造波程序，此时控制LED驱动板3关闭除有故障发生造波板7所有标识灯5。若没有故障发生，则反复运行步骤D-E，直到造波实验完毕，关掉所有标识灯5，监测程序停止运行。
综上所述，在监测前首先在各个造波板7的相同位置安装LED标识点5；然后布置摄像机2并进行系统定标；之后开始进行程序的自动监测，测量时不断检测标识点5并获取其位置；最后根据当前标识点位置与前一时刻位置以及空间近邻位置之间的关系对造波板7的运行状态进行判断。

Claims (2)

  1. 一种造波机运行状态的视频监测装置，其特征在于，所述的视频监测装置包括计算机、带有定焦镜头的摄像机、带云台的三角支架、多个圆形红色LED灯以及驱动控制电路板；摄像机固定在三角支架上，布置在实验水池的外侧，其光轴与造波板的运动方向互成一定的角度，并通过传输导线与计算机相连；在可视区内的每块造波板上布置一个圆形红色LED灯，并将每个LED连接到驱动控制电路板上；LED的驱动控制电路板通过RS232接口与计算机相连；每块造波板即为一个标志点，在造波机运行状态监测时，首先对摄像机采集的图像进行标志点检测，并计算中心位置；然后在动态的视频中追踪每个标志点的位置，并根据标志点的运动状态来评估每块造波板的运行情况。
  2. 一种造波机运行状态的视频监测方法，其特征在于，步骤如下：
    步骤A：在造波板上安装好圆形红色LED灯后，对摄像机的拍摄位置进行布置，使得造波板的运动与摄像机的光轴形成一定的角度；再调整镜头的物距与光圈，使得现场成像清晰；
    步骤B：首次运行时需要进行系统定标，PC机控制驱动控制电路板点亮所有的圆形红色LED灯，同时控制造波板回到初始位置；摄像机采集现场一帧图像，通过图像二值化的方法提取造波板初始化状态时所有发光标志点的坐标Pa，并按照由近及远的顺序对标志点进行编号；之后，PC机控制造波板运动到最大行程处，拍摄现场图像，并提取所有标志点的坐标Pb；与此同时，将此次识别的标志点的位置与标识点编号相对应；每个编号下记录的两个坐标位置形成一个线段PaPb i,i＝1,2,3...N，其中N为标识点的数量；由于每块造波板的运动将限制在线段上，所以称PaPb i为行程线段；另外，由初始位置的点集Pa形成直线la，而由终止位置点集Pb形成直线lb；将la与lb之间的区域设置为分析区域WROI；接下来，使用透视变换P′＝M3×3P对图像中标识点的坐标进行校正，使得由P′所组成 的两条直线平行la′//lb′，即新的行程线段彼此相等|Pa′Pb′1|＝|Pa′Pb′2|＝...＝|Pa′Pb′N|，与此同时记录透视变换矩阵M3×3；P为la与lb上的标识点坐标的集合，P′为校正后点的坐标集合，M3×3为透视变换矩阵；设定二维坐标平面，其x轴与la′重合，y轴与Pa′Pb′i重合；当完成这些操作后，PC机控制LED驱动板关闭所有的标识灯，进入分析等待状态；
    步骤C：启动造波程序的同时，点亮所有的圆形红色LED灯；设置摄像机进入等间隔连续采集模式；
    步骤D：对当前图像进行二值化分析，并在WROI区域内进行标识点的位置提取，同时利用透视变换矩阵M3×3对标识点的位置进行修改；
    步骤E：将当前标识点的位置与前一时刻的位置进行对比，若没有发生位置改变则对该编号的标识点进行首次记录；沿y轴向将当前时刻每个标识点的位置与近邻的标识点位置进行对比，计算之间的位置差异，若近邻位置差异大于设定阈值T，则对该编号的标识点进行二次记录；
    步骤F：若某标识点被连续记录两次，则该编号的造波板出现故障，而与之依次邻接的仅进行第一次记录的编号下的造波板同样认定出现故障；
    步骤G：当有故障发生时，计算机显示报警，同时关闭造波程序，此时控制驱动控制电路板关闭除有故障发生造波板所有标识灯；若没有故障发生，则反复运行步骤D-E，直到造波实验完毕，关掉所有标识灯，监测程序停止运行。
PCT/CN2017/101121 2017-03-17 2017-09-08 一种造波机运行状态的视频监测装置及方法 Ceased WO2018166149A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/311,590 US10605694B2 (en) 2017-03-17 2017-09-08 Video monitoring apparatus and method for operating state of wave maker

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710159653.8 2017-03-17
CN201710159653.8A CN106851218B (zh) 2017-03-17 2017-03-17 一种造波机运行状态的视频监测装置及方法

Publications (1)

Publication Number Publication Date
WO2018166149A1 true WO2018166149A1 (zh) 2018-09-20

Family

ID=59144960

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/101121 Ceased WO2018166149A1 (zh) 2017-03-17 2017-09-08 一种造波机运行状态的视频监测装置及方法

Country Status (3)

Country Link
US (1) US10605694B2 (zh)
CN (1) CN106851218B (zh)
WO (1) WO2018166149A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113624444A (zh) * 2021-07-22 2021-11-09 江苏科技大学 一种可同步摄像的造波机控制系统及控制方法
CN113639959A (zh) * 2021-10-18 2021-11-12 中国水产科学研究院渔业工程研究所 一种出流口后置式水槽波流产生系统

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106851218B (zh) * 2017-03-17 2023-05-02 大连理工大学 一种造波机运行状态的视频监测装置及方法
CN109443694B (zh) * 2018-12-10 2020-10-30 中国科学院电工研究所 一种点阵式可调节人工造浪板装置及方法
EP3734385B1 (de) * 2019-05-02 2022-10-05 Siemens Aktiengesellschaft Verfahren zum rechnergestützten verarbeiten von zustandsmeldungen in einer automatisierungsanlage
CN111122114B (zh) * 2020-01-08 2022-02-11 河海大学 一种潜流带野外示踪实验示踪剂自动投放装置及其实施方法
CN112268663A (zh) * 2020-09-10 2021-01-26 杭州电子科技大学 一种机器视觉皂泡法气密性检验方法
CN115655652B (zh) * 2022-11-03 2026-02-10 珠江水利委员会珠江水利科学研究院 造波机系统数据控制方法
CN118035498B (zh) * 2024-03-05 2025-01-21 中国船舶科学研究中心 长峰不规则波试验中的试验数据快速处理方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110209280A1 (en) * 2009-03-05 2011-09-01 Justin Enjo Orientation of Wave Generating Devices for Generating Plunging Breakers in a Pool
CN103072894A (zh) * 2012-12-27 2013-05-01 三一重工股份有限公司 臂架动态参数检测方法及系统
CN204314069U (zh) * 2014-12-23 2015-05-06 华北电力大学（保定） 一种断路器动触头运动特性检测中的定标及追踪灯装置
CN106403901A (zh) * 2016-08-31 2017-02-15 国家海洋技术中心 一种浮标姿态测量装置及方法
CN106840110A (zh) * 2017-03-17 2017-06-13 大连理工大学 一种应用于大型多板波浪模拟系统的运动测量方法与装置
CN106851218A (zh) * 2017-03-17 2017-06-13 大连理工大学 一种造波机运行状态的视频监测装置及方法

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4229969A (en) * 1979-03-12 1980-10-28 Hark William B Apparatus for making waves in a body of liquid
US4406162A (en) * 1981-07-02 1983-09-27 Seasom Controls Limited Apparatus for creating waves in a body of liquid
JP3654189B2 (ja) * 2001-01-17 2005-06-02 株式会社デンソー 携帯端末およびプログラム
KR100447573B1 (ko) * 2001-08-07 2004-09-04 (주) 백산 오엠비 수중진동파 발생 욕조
US20050018882A1 (en) * 2003-06-30 2005-01-27 Iowa University Research Foundation Controlled surface wave image velocimetry
US8356900B2 (en) * 2006-01-20 2013-01-22 Clarity Medical Systems, Inc. Large diopter range real time sequential wavefront sensor
JP2008124727A (ja) * 2006-11-10 2008-05-29 Toshiba Corp 情報処理装置および情報管理装置
CN101661280B (zh) * 2008-08-29 2012-09-12 比亚迪股份有限公司 钻铣加工方法、数控钻铣机以及工控机
US9530060B2 (en) * 2012-01-17 2016-12-27 Avigilon Fortress Corporation System and method for building automation using video content analysis with depth sensing
CN104977908B (zh) * 2015-05-04 2017-10-24 清华大学 工业现场指示灯状态的视频监测方法
JP2017209326A (ja) * 2016-05-26 2017-11-30 セイコーエプソン株式会社 超音波測定装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110209280A1 (en) * 2009-03-05 2011-09-01 Justin Enjo Orientation of Wave Generating Devices for Generating Plunging Breakers in a Pool
CN103072894A (zh) * 2012-12-27 2013-05-01 三一重工股份有限公司 臂架动态参数检测方法及系统
CN204314069U (zh) * 2014-12-23 2015-05-06 华北电力大学（保定） 一种断路器动触头运动特性检测中的定标及追踪灯装置
CN106403901A (zh) * 2016-08-31 2017-02-15 国家海洋技术中心 一种浮标姿态测量装置及方法
CN106840110A (zh) * 2017-03-17 2017-06-13 大连理工大学 一种应用于大型多板波浪模拟系统的运动测量方法与装置
CN106851218A (zh) * 2017-03-17 2017-06-13 大连理工大学 一种造波机运行状态的视频监测装置及方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113624444A (zh) * 2021-07-22 2021-11-09 江苏科技大学 一种可同步摄像的造波机控制系统及控制方法
CN113624444B (zh) * 2021-07-22 2022-08-02 江苏科技大学 一种可同步摄像的造波机控制系统及控制方法
CN113639959A (zh) * 2021-10-18 2021-11-12 中国水产科学研究院渔业工程研究所 一种出流口后置式水槽波流产生系统
CN113639959B (zh) * 2021-10-18 2022-02-11 中国水产科学研究院渔业工程研究所 一种出流口后置式水槽波流产生系统
US11624678B1 (en) 2021-10-18 2023-04-11 Fishery Engineering Research Institute, Chinese Academy Of Fishery Sciences Tank wave-current generation system with rear-mounted outlet

Also Published As

Publication number Publication date
US20190204179A1 (en) 2019-07-04
CN106851218A (zh) 2017-06-13
US10605694B2 (en) 2020-03-31
CN106851218B (zh) 2023-05-02

Similar Documents

Publication Publication Date Title
WO2018166149A1 (zh) 一种造波机运行状态的视频监测装置及方法
CN113850137B (zh) 一种输电线路图像在线监测方法、系统及设备
JP6144282B2 (ja) 目標物上の不具合を追尾し、検出するための自動システム及び方法
CN106840110B (zh) 一种应用于大型多板波浪模拟系统的运动测量方法与装置
CN100485371C (zh) 钢板预处理过程中的上、下表面缺陷在线自动检测方法
CN111476921A (zh) 一种机房智能巡检系统
CN105479786B (zh) 一种胎胚成型部件贴合检测装置及方法
CN111208146B (zh) 一种隧道线缆检测系统及检测方法
CN204330609U (zh) 六轴机械手aoi检测系统
CN105675610A (zh) 一种物体表面质感特征在线检测系统及工作原理
CN104111663A (zh) 火箭惯组目标棱镜自动准直的三维闭环反馈控制方法
KR20140000379A (ko) 카메라와 로봇 기반의 풍력 발전용 블레이드 검사 장치 및 방법
CN108827973A (zh) 裂纹检测方法和系统
CN115375888A (zh) 一种路侧交安、绿化设施异常检测方法及系统
CN206709833U (zh) 一种应用于大型多板波浪模拟系统的运动测量装置
CN120254743A (zh) 一种电能表智能视觉检测方法及系统
WO2025141325A2 (en) System and method for performing external and internal inspections of wind turbine blades
CN118821571A (zh) 一种同步测量鱼的运动轨迹及其周围瞬态流场的方法及装置
CN207603961U (zh) 一种舞台灯光自动跟踪系统
CN117760327A (zh) 智能识别闸门开度系统及其控制方法
CN111882619B (zh) 一种模拟测试智能船舶上视觉设备的海面目标识别方法
CN116443264A (zh) 一种飞机外观缺陷筛查方法
CN112738463A (zh) 一种钻场跟踪监测方法及装置
CN221924992U (zh) 一种大坝三维错动变形监测装置
CN113834669B (zh) 一种车辆监控装置及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17900813

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17900813

Country of ref document: EP

Kind code of ref document: A1