JP5418963B2 - Waveform analyzer - Google Patents

Description

  The present invention relates to a waveform analysis apparatus, and more particularly to an improvement of a waveform analysis apparatus configured to display an analog signal waveform to be analyzed and an image in association with each other on a common screen.

  Conventionally, in the development and maintenance of mechanical drive mechanisms and various mechanical tests such as impact, rupture, and drop, the operation status of each part to be analyzed is detected as an electrical signal by an appropriate sensor and the behavior of each part is monitored. A waveform analysis apparatus as shown in Patent Document 1 configured to be visualized by a camera and displayed on a common screen by associating an analog signal waveform and video of each part to be analyzed is used.

JP 05-091461 A

  However, in general, the sample rate of analog signals used for impact tests, break tests, drop tests, etc. is faster than the frame rate (fps) of camera images, and images that match the fine changes in waveforms between frames can be obtained. not exist. For this reason, it has been forced to perform re-shooting at a higher frame rate or to estimate the image from the waveform shape of the analog signal.

  Conversely, when analyzing video, there are multiple analog signal measurement data per frame of the camera video, making it difficult to handle analog signal waveforms. Especially, the measurement time is long and the ratio between the frame rate and the measurement sample rate is high. In some cases, the analog signal data corresponding to the video is buried in the entire waveform display when it is large.

  In other words, video data is sacrificed when performing analog signal waveform analysis, and analog signal waveform data is sacrificed when performing video analysis. The advantage of performing simultaneous analysis by displaying on the screen was not fully demonstrated.

  The present invention solves these problems, and its purpose is to correlate an analog signal waveform to be analyzed and a video on a common screen for simultaneous analysis, and to analyze the waveform sample rate and An object of the present invention is to realize a waveform analysis apparatus capable of performing detailed analysis on each of an analog signal waveform to be analyzed and a video even when the video frame rate is different.

In order to achieve such a problem, the invention according to claim 1 of the present invention is:
In the waveform analyzer configured to perform simultaneous analysis by associating the analog signal waveform to be analyzed with the video and displaying them on a common screen,
Based on the video data, a ratio between a sample rate for quantizing the analog signal waveform and a frame rate of the video data, means for generating frame interpolated video data for interpolating between frames,
The frame interpolation video corresponding to the sample points of the analog signal waveform is displayed on the screen.

The invention according to claim 2 is the waveform analysis apparatus according to claim 1,
On the screen,
A waveform display area for displaying the analog signal waveform to be analyzed;
A waveform enlargement display area for selectively enlarging and displaying a part of the waveform display area;
A video display area for displaying the video to be analyzed;
Video operation panel area for controlling and operating the video display operation in this video display area,
Is provided.

The invention according to claim 3 is the waveform analysis apparatus according to claim 2,
In the waveform enlarged display area, the analog signal waveform to be analyzed displayed in the waveform display area is enlarged and displayed in frame units of the video to be analyzed,
The video to be analyzed or the frame-interpolated video corresponding to the sample points of the enlarged waveform displayed in the waveform display area is displayed in the video display area.

The invention according to claim 4 is the waveform analysis apparatus according to claim 1,
In the frame interpolation of the analysis target video, the means for generating the frame interpolation video data selects an optimal algorithm from a plurality of frame interpolation algorithms according to the analysis application.

  According to the present invention, in performing simultaneous analysis by associating an analog signal waveform to be analyzed and an image and displaying them on a common screen, even if the sample rate of the waveform and the frame rate of the image are different, Detailed analysis can be performed for each target analog signal waveform and video.

It is a block diagram which shows one Example of this invention. It is an example of the display screen of FIG. It is an example of the video screen of FIG. It is frame interpolation explanatory drawing of the image | video of FIG. It is an example of the display screen after the waveform analysis of FIG. It is an example of the display screen after the image | video analysis of FIG. It is an example of the simultaneous display screen of the image | video and waveform of FIG. It is a flowchart at the time of the waveform analysis of FIG. It is a flowchart at the time of the video analysis of FIG.

  Hereinafter, the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of the present invention. In FIG. 1, the waveform analysis apparatus 100 synchronizes the analog signal waveform to be analyzed such as voltage and strain with the analysis target image captured by a high-speed camera used in an impact test or a drop test. Display them on a common screen.

  An analog signal to be analyzed such as voltage and distortion is quantized and stored in the waveform data file 101, and an image of an object to be analyzed in a drop test is stored in a format such as “avi” in the video data file 102, for example. Is done.

  The waveform data reading unit 103 reads waveform data from the waveform data file 101, and the video data reading unit 104 reads video data from the video data file 102.

  The rate ratio memory 105 is a memory for storing the ratio of the sample rate and the frame rate when the waveform data and the video data are read. In this embodiment, the sample rate of the waveform data is 20 kS / s and the frame of the video data is stored. Since the rate is 1000 fps (1000 frames per second), “20” is stored as the ratio data.

  The drawing waveform generation unit 106 generates a waveform to be drawn based on the waveform data read from the waveform data file 101 and the rate ratio read from the rate ratio memory 105.

  The frame interpolation unit 107 generates video data subjected to frame interpolation based on the video data read from the video data file 102 and the rate ratio read from the rate ratio memory 105. For such frame interpolation, a general moving image interpolation algorithm using a luminance change, a motion vector, or the like can be used.

  The drawing data control unit 108 sends the waveform data generated by the drawing waveform generation unit 106 and the video data subjected to frame interpolation by the frame interpolation unit 107 to the waveform drawing unit 109 and the video drawing unit 110.

  The waveform data operation unit 111 adjusts the cursor, zoom position, and the like on the analog waveform.

  The video data operation unit 112 plays or stops the display video, or designates an arbitrary frame video.

  In such a waveform analysis apparatus 100, the waveform drawing unit 109 and the video drawing unit 110 can be realized by hardware such as a liquid crystal display, and the other units 103 to 108, 111, and 112 can be realized by software, for example.

  FIG. 2 is an example of the display screen of FIG. The display screen 200 includes a waveform display area 201 for displaying an analog signal waveform, a waveform enlargement display area 202 for selectively enlarging and displaying a part of the waveform display area 201, a video display area 203, and a video operation panel area 204. It is divided.

  In the waveform display area 201, for example, 20,000 points of waveform data sampled at 20 kS / s for one second are displayed, and in the waveform enlargement display area 202, the number of sample points corresponding to one frame of video (in this embodiment, the rate ratio). 20 points) are enlarged and displayed. The waveform display area 201 and the enlarged waveform display area 202 correspond to the waveform drawing unit 109 in FIG.

  In the video display area 203, for example, an image is displayed at the solid line position while the object falls from the dotted line position toward the platform. The video display area 203 corresponds to the video drawing unit 110 in FIG.

  The video operation panel area 204 is provided with various buttons for performing operations such as play, stop, reverse playback, head movement, end point movement, and arbitrary frame designation for the video displayed in the video display area 203. Yes. By these button operations, the video in the video display area 203, the waveforms in the waveform display area 201, and the waveform enlarged display area 202 change in conjunction with each other. The video operation panel area 204 corresponds to the video data operation unit 112 in FIG.

  The operation of FIG. 1 will be described for “waveform analysis” and “video analysis”, respectively. Here, “analysis of waveform” means to analyze the waveform by manipulating the waveform and confirm the image at that time, and “analysis of image” means to analyze the image by manipulating the image and to analyze the waveform at that time It means to confirm.

The “waveform analysis” will be described with reference to the flowchart of FIG.
(A) The waveform data reading unit 103 reads a desired waveform data file 101 by performing an operation instruction from a menu or the like (not shown) in order to display a waveform and an image.

  (B) The video data reading unit 104 reads the video data file 102. In the process of reading out these waveform data and video data, a measurement sample rate (for example, 20 kS / s) and a frame rate (for example, 1000 fps) stored as auxiliary information of the data are acquired, and the rate ratio (= 20) is obtained. The ratio rate memory 105 is updated and stored.

  (C) When, for example, 450 frames of video data are read out as shown in FIG. 2, the drawing waveform generation unit 106 rates the entire waveform corresponding to 1 second of video and 0.45000 seconds corresponding to 450 frames. A zoom waveform for 20 points converted from the ratio is generated.

  An image of 450 frames is read into the drawing data control unit 108 as it is through the frame interpolation unit 107. The drawing data control unit 108 collects the waveform data to be drawn and the video data, and sends them to the waveform drawing unit 109 and the video drawing unit 110 to perform waveform display and video display as shown in FIG.

  The image display area 203 displays an image of the 450th frame, the waveform display area 201 displays the entire waveform display for one second and the zoom cursor 205 indicating the 450 frame position, and the waveform enlargement display area 202 displays the 450th frame. A total of 20 points of ± 10 points from the corresponding time of 0.45000 are zoomed. Note that black dots in the enlarged waveform display area 202 mean measurement sample points that are synchronized with the frame rate, and white points mean measurement sample points that are not synchronized with the frame rate.

  (D) The zoom cursor 205 on the waveform display screen 201 can be moved in units of one frame, and the cursor 206 in the waveform enlarged display area 202 can be moved in units of one measurement sample, and these cursors 205 and 206 can be moved. The waveform can be analyzed by operating the waveform.

  By moving the cursor 206 in the direction of “a” or “b” in FIG. 2, the range of “a” in FIG. 3 (449 frames to 450 frames) or the range of “b” (450 frames to 451 frames) can be designated.

  (E) First, when the cursor 206 is moved 3 measurement samples before (150 μsec before = 3 * 1/20000), the frame interpolation unit 107 reads out the images of 449 frames and 450 frames in FIG.

  (F, G) Since the designated sample point corresponds to data between frames (white point), 20-division frame interpolation is executed from the images of 449 frames and 450 frames to generate an interpolated image A before 3 measurement samples. . Frame interpolation is not performed when the position of the cursor 206 is a black dot synchronized with the frame rate.

  (H) The drawing data control unit 108 sends the generated interpolation image A to the video drawing unit 110. Thereby, a display as shown in FIG. 5 is performed. In FIG. 5, the video displayed in the video display area 203 is a reference video generated by frame interpolation and is not an actual video. Therefore, an “*” mark B indicating an interpolated video is displayed on the upper right of the video display area 203. ing. The video time is displayed at the lower right of the video display area 203, indicating 0.44985 seconds from 0.450000 seconds to 150 μs ago. The same 0.44985 seconds are also displayed on the right side of the cursor 206.

  As described above, while viewing the waveform, the zoom cursor 205 and the cursor 206 are operated and moved to generate an image corresponding to the waveform to be analyzed by frame interpolation, so that an overview of the image can be grasped even at a measurement sample point without an image. It becomes possible.

The “video analysis” will be described with reference to the flowchart of FIG.
(A to C) Similar to FIG. 8, the waveform data reading unit 103 reads a desired waveform data file 101 to display the waveform and the video, and the video data reading unit 104 reads the video data file 102 and the rate ratio thereof. Are updated and stored in the ratio rate memory 105, and the drawing waveform generation unit 106 generates a zoom waveform converted from the rate ratio.

(D) By operating playback, reverse playback, frame number, etc. from the video operation panel 204 , the frame “600” at the moment when the object collides with the table is designated.

  (E) The video data reading unit 104 reads the video data of the designated frame “600”.

  (F) The video data of frame “600” is sent to the video drawing unit 110 through the drawing data control unit 108 without being interpolated by the frame interpolation unit 107. The video drawing unit 110 performs display like the video screen of FIG. A corresponding time of 0.60000 seconds is displayed at the lower right of the video display area 203.

  (G) The drawing waveform generation unit 106 extracts and generates waveform data corresponding to the designated frame “600” based on the waveform data and the rate ratio (= 20).

  (H) The waveform data extracted and generated by the drawing waveform generation unit 106 is sent to the waveform drawing unit 109 through the drawing data control unit 108, and the waveform display as shown in the waveform display area 201 and the waveform enlarged display area 202 of FIG. Done. At this time, the zoom cursor 205 is displayed at a position corresponding to the frame “600” with respect to the waveform display, and the cursor 206 is displayed at a measurement sample position (0.60000 seconds) synchronized with the frame rate. As a result, a detailed waveform corresponding to the frame “600” at the moment when the object collides can be confirmed.

  With this configuration, when the analog signal sample rate is higher than the frame rate of the camera video, the inter-frame video is interpolated from the previous and next frame images, so at the sample point of the analog signal waveform without video You can also get an overview of the video.

  When manipulating a frame image while viewing the image, specify the image to be analyzed, highlight the position corresponding to the frame in the entire waveform and the number of waveforms included in that frame, or zoom the waveform Since it is possible to superimpose images with images, waveform data is not buried in the display, and detailed analysis is possible.

  Furthermore, the relationship between the waveform and the video can be analyzed more deeply while easily going back and forth depending on the application and the measurement object by the operation from the waveform side or the video side.

  In addition, although the example of the independent waveform analysis apparatus was demonstrated in the said Example, it is applicable also to the waveform analysis application implement | achieved by the measurement system comprised by a personal computer and a measurement unit, and the software on a personal computer.

  In the above embodiment, the example in which the waveform data and the video data are read from the file has been described. However, the waveform data and the video data stored in the memory provided in the waveform analyzer may be accessed.

  Furthermore, in video frame interpolation, an optimum algorithm may be selected from a plurality of frame interpolation algorithms according to the analysis application.

  As described above, according to the present invention, in performing simultaneous analysis by associating an analog signal waveform to be analyzed with an image and displaying them on a common screen, the sample rate of the waveform and the frame rate of the image Even if they are different, it is possible to realize a waveform analysis apparatus that can perform detailed analysis on each of the analog signal waveform and the video.

DESCRIPTION OF SYMBOLS 100 Waveform analyzer 101 Waveform data file 102 Video data file 103 Waveform data reading part 104 Video data reading part 105 Rate ratio memory 106 Drawing waveform generation part 107 Frame interpolation part 108 Drawing data control part 109 Waveform drawing part 110 Video drawing part 111 Waveform Data operation unit 112 Video data operation unit 200 Display screen 201 Waveform display area 202 Waveform enlarged display area 203 Video display area 204 Video operation panel area 205, 206 Cursor
B frame interpolation video mark

Claims (4)

In the waveform analyzer configured to perform simultaneous analysis by associating the analog signal waveform to be analyzed with the video and displaying them on a common screen,
Based on the video data, a ratio between a sample rate for quantizing the analog signal waveform and a frame rate of the video data, means for generating frame interpolated video data for interpolating between frames,
The waveform analysis apparatus, wherein the frame interpolated video corresponding to the sample point of the analog signal waveform is displayed on the screen. On the screen,
A waveform display area for displaying the analog signal waveform to be analyzed;
A waveform enlargement display area for selectively enlarging and displaying a part of the waveform display area;
A video display area for displaying the video to be analyzed;
Video operation panel area for controlling and operating the video display operation in this video display area,
The waveform analyzing apparatus according to claim 1, wherein the waveform analyzing apparatus is provided. In the waveform enlarged display area, the analog signal waveform to be analyzed displayed in the waveform display area is enlarged and displayed in frame units of the video to be analyzed,
The waveform analysis apparatus according to claim 2, wherein the video to be analyzed or the frame-interpolated video corresponding to the sample point of the enlarged waveform displayed in the waveform display area is displayed in the video display area.   2. The waveform according to claim 1, wherein the means for generating the frame-interpolated video data selects an optimal algorithm from a plurality of algorithms for frame interpolation in accordance with the analysis application in frame interpolation of the video to be analyzed. Analysis device.

Images