CN118398178A - An auxiliary system for processing electrocardiogram interference waveform - Google Patents

Abstract

The present invention discloses an auxiliary system for processing electrocardiogram interference waveforms, including: an interface extraction module, an operation processing module, a graphic file generation module, an interference waveform feature processing module and an interference waveform determination module; the interface extraction module is used to obtain acquisition files and push them to the graphic file generation module; the operation processing module is used to obtain window events and simulate mouse and keyboard operations; the graphic file generation module is used to receive acquisition files and process them into electrocardiogram image files; the interference waveform feature processing module is used to determine the waveform identification to be processed; the interference waveform determination module is used to generate an interference waveform identification group and send it to the operation processing module; the operation processing module parses the interference waveform identification group into multiple simulation operation instructions and executes them one by one. According to the above technical scheme, the doctor's operation in the electrocardiogram system can be simulated, and multiple interference waveforms can be automatically processed in batches, thereby improving the doctor's work efficiency.

Description

An auxiliary system for processing electrocardiogram interference waveform

Technical Field

The present invention relates to the technical field of image processing, and in particular to an auxiliary system for processing electrocardiogram interference waveforms.

Background technique

Electrocardiogram (ECG or EKG) is an important medical test method for recording the electrical activity of the heart. A set of electrodes and wires are placed on a designated part of the patient to collect the tiny current changes generated by each heart beat to form a waveform. Some complex heart problems require long-term monitoring, such as 24 hours or 48 hours, through equipment such as Holter. When performing Holter monitoring, the patient is still carrying out a normal daily life. Some behaviors in daily life, such as driving and using electrical appliances, will cause electromagnetic interference to the ECG equipment, so there are a lot of interference waveforms in the collected ECG.

When developing an ECG system for reading films, ECG manufacturers generally perform preliminary processing of the interference on the waveform. However, as the sampling frequency is getting higher and higher, and the waveform characteristics of each patient are clinically different, the preliminary processing is far from meeting clinical needs. On this basis, the ECG system provided by the ECG manufacturer provides the function of doctors modifying while reading the image. Doctors can prepare before conducting diagnostic analysis, that is, in the ECG system, select the interference waveform, delete it or mark it as "interference", and the number of interference waves generated in an ECG based on 24 hours, even 48 hours, or 72 hours reaches thousands, which puts a great burden on doctors' preparation before diagnosis. If interference analysis is performed by combining the collected raw data with medical standards, it is necessary to adapt the standard protocol of ECG data. The protocols of ECG data include SCP-ECG, DAXML, DICOM, etc. The research and development process needs to be compatible with multiple protocols, which is difficult to develop; at the same time, the determination of the ECG waveforms of different patients needs to be analyzed in combination with the actual situation of the patients, and there are individual differences.

Summary of the invention

In order to solve the above problems, the present invention provides an auxiliary system for processing electrocardiogram interference waveforms, comprising:

An interface extraction module, an operation processing module, a graphic file generation module, an interference waveform feature processing module and an interference waveform determination module; wherein the interface extraction module and the operation processing module are deployed on the ECG system client provided by the ECG manufacturer; the graphic file generation module, the interference waveform feature processing module and the interference waveform determination module are deployed on the server side of the auxiliary system.

The interface extraction module is used to obtain display content from a specified display window in the electrocardiogram system interface, generate an acquisition file, and push the acquisition file to the graphic file generation module, wherein the acquisition file is a video file;

Operation processing module: used to obtain window events and simulate mouse and keyboard operations; the operation processing module includes an interface operation processing plug-in and an operation data processing unit. The interface operation processing plug-in is used to obtain window events, obtain operation instructions, and execute operation instructions to the ECG system interface; the operation data processing unit is used to generate simulated operation instructions and send the simulated operation instructions to the interface operation processing plug-in for execution;

Graphics file generation module: used to receive the acquisition file submitted by the interface extraction module and process the acquisition file into an electrocardiogram image file;

Interference waveform feature processing module: used to obtain the characteristics of the interference waveform area, locate the interference waveform area from the electrocardiogram image file, and determine the waveform mark to be processed;

Interference waveform determination module: used to generate an interference waveform identification group from the waveform identification to be processed, and send it to the operation data processing unit;

The information of the interference waveform identification group includes: the total duration T of the electrocardiogram sampling, and the waveform identification P. The total duration T is determined by the sampling end time and the sampling start time. The waveform identification P is determined by the sampling point time and the sampling start time. Each sampling point time determines an overall waveform. The waveform identification P is a unique identification for determining the overall waveform.

The operation data processing unit parses the interference waveform identification group into multiple simulation operation instructions, which are handed over to the interface operation processing plug-in for execution one by one; the simulation operation instructions include: the position of the image area corresponding to the waveform identification P, the mouse operation and keyboard operation to be performed on the position;

Before the interface operation processing plug-in executes the simulation operation instruction, the waveform marker is located according to the total duration T of the electrocardiogram sampling and the waveform marker P.

Among them, the interface extraction module includes a page extraction plug-in, a screen recording tool and a file transfer unit;

After the page extraction plug-in is running in the ECG system, it starts or stops screen recording in the ECG display window; after starting the screen recording, the screen recording tool is called to record the window, and after stopping, it is saved as a collection file;

Screen recording tools support the operating system's built-in screen recording tools or third-party screen recording tools;

The file transfer unit is used to push the collected files to the auxiliary system server.

Among them, after the page extraction plug-in starts screen recording, the interface operation processing plug-in of the scheduling operation processing module simulates the mouse to uniformly pull the scroll bar of the display window of the electrocardiogram at an appropriate speed.

Furthermore, the interface operation processing plug-in obtains the operation instruction including: the position of the mouse in the window selection, the mouse button mode, and the keyboard input instruction;

The interface operation processing plug-in also generates reference operation instructions, including the electrocardiogram area in the window selected by the doctor and the operation of marking the area as an interference waveform; the reference operation instructions are reference specifications for the data processing unit to generate simulation operation instructions.

Among them, the graphic file generation module converts the acquisition file into a horizontally long image file through the function provided by opencv; the content of the horizontally long image file is the waveform of the electrocardiogram, in which the horizontal axis is the signal acquisition time, and the vertical axis is multiple waveforms with consistent sampling time points; multiple waveforms with consistent sampling time points constitute an overall waveform; the duration corresponding to the sampling time point is the waveform identifier P of the waveform.

Furthermore, the interference waveform feature processing module provides an auxiliary system client; the doctor selects a waveform area as an interference waveform through the client; the interference waveform feature processing module identifies all areas that meet the image features from the long picture file based on the image features of the interference waveform, and extracts the duration corresponding to the sampling time point from the area as the waveform identifier of the interference waveform to be processed.

Furthermore, waveform marker positioning refers to: adjusting the window scroll bar according to the total time length T, waveform marker P and window parameters, so that the waveform corresponding to waveform marker P is in the visible area of the window, and then determining the position of the sampling time point corresponding to waveform marker P in the window.

When realizing waveform mark positioning, first perform horizontal scroll bar positioning, and after the horizontal scroll bar positioning is completed, perform sampling time point positioning;

The horizontal scroll bar positioning is used to place the waveform corresponding to the waveform marker within the displayable range of the current window;

The sampling time point positioning is used to determine the waveform corresponding to the waveform identifier P in the current window position.

The method for realizing horizontal scroll bar positioning includes:

Get the time period W, scroll bar length L, and slider length L2 of the ECG that can be displayed in a page window, and determine the horizontal scroll bar slider position as: L1 = K×(L-L2)/Kp; where K is the page number to which the waveform marker P belongs, expressed as K=math.ceil(P/W),

Kp is the number of pages that the electrocardiogram needs to be divided into corresponding to the total display time T, expressed as: Kp=math.ceil(T/W).

The realization of sampling time point positioning includes:

Get the width B of the window, determine the width F=B/W of the waveform marker P; get the time point Q corresponding to the waveform marker P in the current window, Q=((P%W)/W)×B; where P%W is the remainder of P divided by W;

The starting point and the ending point of the horizontal direction of the image area corresponding to the waveform marker P are calculated as: S(x1,y1) and E(x2,y2), where x1=Q-F/2, x2=Q+F/2; y1=y2=0.

According to the present invention, the complex electrocardiogram data analysis process can be skipped, and based on the functions already realized by the existing electrocardiogram system, the electrocardiogram image file can be extracted, the waveform features in the image file can be extracted, and the personalized interference waveform can be located without considering the waveform data analysis and different data standards in the medical field, and it can be compatible with a variety of displays and window sizes of the electrocardiogram system; at the same time, it can simulate the doctor's operation in the existing electrocardiogram system, and automatically batch process a large number of interference waveforms in the existing electrocardiogram system, thereby improving the doctor's work efficiency.

BRIEF DESCRIPTION OF THE DRAWINGS

1 is a schematic diagram of the structure of an auxiliary system for processing electrocardiogram interference waveforms according to an embodiment of the present invention;

2 is a timing diagram of an auxiliary system for processing electrocardiogram interference waveforms according to an embodiment of the present invention;

FIG3 is a schematic diagram of a waveform region in an auxiliary system provided according to an embodiment of the present invention;

4 is a schematic diagram of positioning a horizontal scroll bar in an auxiliary system provided according to an embodiment of the present invention;

FIG5 is a schematic diagram of time point positioning in an auxiliary system according to an embodiment of the present invention.

Detailed ways

Based on the electrocardiogram system provided by the existing manufacturer, the present invention extracts the electrocardiogram waveform generated by the system and displayed in the window, processes it into a picture file, extracts the image features judged by the doctor as interference waveforms in the picture file, and uses this as a standard to extract and mark all similar interference waveforms in the picture file; after batch confirming all interference waveforms, the present invention simulates the mouse and keyboard operations of the doctor or staff in the electrocardiogram system window provided by the manufacturer, marks and processes all interference waveforms of the electrocardiogram in the electrocardiogram system, and realizes auxiliary processing of batch interference waveforms in the electrocardiogram system.

The specific implementation of the present invention is described in detail below with reference to the accompanying drawings.

FIG1 provides a system structure diagram of an auxiliary system for processing an electrocardiogram interference waveform, as shown in the figure, including the following parts:

P100 ECG system client: The auxiliary system for processing ECG interference waveforms provided by the present invention is based on the existing ECG system. It is an auxiliary system that assists doctors in implementing ECG system client operations to reduce doctors' repeated operations and improve work efficiency. Therefore, the solution of the present invention needs to rely on the client of the P100 ECG system. It needs to extract the ECG data to be processed from the P101 ECG system interface that runs the ECG system, collect the doctor's operation instructions, and then generate simulation operation instructions, and operate the simulation operation instructions on the client of the ECG system. Some modules of the auxiliary system proposed by the present invention are deployed on the client of the P100 ECG system; before the auxiliary system is executed, it is necessary to run the existing ECG system, activate the P101 ECG system interface, and determine the display window of the ECG to be processed.

The P100 ECG system client includes a P110 interface extraction module and a P120 operation processing module, wherein the P120 operation processing module is used to simulate the doctor's component operations on the ECG system client, such as using the mouse to determine the display window in the ECG system interface to be processed, capturing the cursor position, window events, controlling the cursor position, and simulating mouse and keyboard operations; the P110 interface extraction module is used to capture video from the display window in the ECG system interface to be processed. The details are as follows:

P110 interface extraction module: used to obtain display content from the display window in the ECG system interface to be processed, generate acquisition files, and push the acquisition files to the graphic file generation module;

The interface extraction module includes a page extraction plug-in, a screen recording tool, and a file transfer unit;

1) After the page extraction plug-in runs in the ECG system, it records the screen in the ECG display window. The recording operation is triggered by manual keystrokes or requests sent by the server to start and stop. The manual start and stop method supports shortcut keys, such as Ctrl+1 to start and Ctrl+0 to stop. After starting, the screen recording tool is called to record the window, and after stopping, it is saved as a collection file;

After the screen recording is started, the interface operation processing plug-in of the operation processing module is scheduled to simulate the mouse to pull the scroll bar of the ECG display window at a suitable speed, so that all the waveforms of the ECG are displayed in the window at a suitable speed, so that all the waveforms of the ECG within the acquisition time period can be obtained during the screen recording process.

2) Screen recording tools can support the screen recording tools that come with the operating system or third-party screen recording tools, such as screen recording software OBS. The acquisition file generated by screen recording is a video file, and its file format, parameters, and file size can be set according to computer parameters and intranet transmission requirements.

3) The file transfer unit is used to establish a connection with the auxiliary system server and push the collected files to the graphic file generation module of the auxiliary system server; the connection method can be achieved through the network, equipment, etc.

P120 operation processing module: deployed on the client of the existing ECG system, used to obtain window events and simulate mouse and keyboard operations;

The operation processing module includes a P121 interface operation processing plug-in and a P122 operation data processing unit;

The P121 interface operation processing plug-in can select a window, obtain window events, obtain operation instructions from the ECG system interface, and execute operation instructions to the ECG system interface;

The interface operation processing plug-in selects the ECG display window to be processed, obtains and locates the properties of the window according to the shortcut key (such as Alt+0), so that subsequent operations are all performed in this window;

The interface operation processing plug-in obtains window events. It can be started by a shortcut key (such as Ctrl+2). After starting, it obtains window events executed by the user through the mouse. The window events that can be obtained include: the form Handle executes the form scrolling event, the scrolling event includes the scrolling event message of the WM_VSCROLL vertical scroll bar, the scrolling event message of the WM_HSCROLL horizontal scroll bar, etc.

The interface operation processing plug-in obtains operation instructions, and can start the corresponding function through shortcut keys (such as Ctrl+3), including: identifying the position of the mouse in the window selection, the mouse button mode (select, release, single click, double click or right click), keyboard input instructions, etc. After the interface operation processing plug-in is started, the electrocardiogram area in the doctor selection window is obtained, and the operation of marking the area as an interference waveform generates a reference operation instruction, which is used for the subsequent generation of reference specifications for simulation operation instructions; for example: the doctor selects the area in the window, the starting and ending positions of the area are A(xa,0), B(xb,0), and the shortcut key Alt+R is entered to mark the waveform in the area as an interference waveform; the expression form of the reference operation instruction can be agreed upon, for example, it can be expressed as: {area:(xa,xb);key:(alt,R);mouse:()}, that is: the horizontal coordinate of the area (xa to xb), the keyboard operation alt,R, and the mouse no operation; in the present invention, the position of the electrocardiogram is based on the horizontal area, so the vertical area is ignored in the calculation.

The interface operation processing plug-in executes operation instructions and can be started through shortcut keys (such as Ctrl+4). After startup, it obtains simulation operation instructions, executes simulation operation instructions, and simulates the doctor's operations on the ECG system interface according to the simulation operation instructions. The operations that can be simulated include: dragging the scroll bar at a constant speed in the display window with the mouse, selecting the waveform area with the mouse, inputting shortcut keys on the keyboard, etc.

The P122 operation data processing unit is used to generate simulation operation instructions for multiple waveform markers and send the instructions to the interface operation processing plug-in for execution.

The multiple waveform identifiers come from an interference waveform identifier group sent by an interference waveform determination module in the auxiliary system server.

The simulation operation instruction is an operation instruction generated by the operation data processing unit for different waveform identifiers according to the reference operation instruction, including the waveform identifier to be processed and the corresponding image area information, mouse button mode, keyboard input instruction and other contents, and its expression is the same as that of the reference operation instruction;

The information in the interference waveform identification group includes: the total duration T of the electrocardiogram sampling (sampling end time-sampling start time), the waveform identification P (sampling point time-sampling start time); in the sampling result of the electrocardiogram, each sampling point time can determine a waveform, so the information corresponding to the sampling point time can be used as a unique identifier of the waveform, expressed as the waveform identification P.

For example: the ECG sampling start time is 10:15 on January 1, 2024, the sampling end time is 10:00 on January 2, 2024, and the sampling point time is 12:26:14 on January 1, 2024;

The total duration T is the time difference (in seconds) between 10:15 on January 1, 2024 and 10:00 on January 2, 2024, which is 85500;

The waveform marker P is the time difference (in seconds) between 10:15 on January 1, 2024 and 12:26:14 on January 1, 2024, which is 7874 seconds.

The auxiliary system for processing electrocardiogram interference waveform provided by the present invention includes a server and a client. The server can be arranged on the same computer device as the P100 electrocardiogram system client, or on other computer devices.

The server of the auxiliary system is used to obtain the screen recording results (i.e., acquisition files) pushed by the interface extraction module, and convert the video files into image files through tools (such as opencv); the image files are provided to the client, and the doctor selects multiple interference waveforms from the image files through the client; the server analyzes the characteristics of the interference waveforms selected by the doctor, and after confirmation, generates an interference waveform identification group consisting of multiple waveforms that meet the characteristics, and sends the interference waveform identification group to the operation data processing unit to generate simulation operation instructions.

Specifically, the server side of the auxiliary system includes:

P130 Graphics file generation module: used to receive the acquisition file submitted from the interface extraction module, and process the acquisition file into an electrocardiogram image file;

Among them, the acquisition file is a video file, which can be converted into a horizontally long image file through the function provided by opencv. The content of the horizontally long image file is the waveform of the electrocardiogram. A valid electrocardiogram is composed of multiple waveforms, wherein the horizontal axis is the signal acquisition time, and the vertical axis is the waveform with the same sampling time points, as shown in Figure 3. In the present invention, the waveforms with the same sampling time points are processed as a whole waveform. As shown in Figure 3, the framed part is the whole waveform at a time point. Based on this, the information related to the whole waveform at a time point includes: the start time and end time of the electrocardiogram sampling, the sampling time point, and the image features of the waveform area, wherein the duration corresponding to the sampling time point is the unique identifier of the waveform, that is, the waveform identifier P.

During the processing, based on the image size and the processing power of the server, the horizontally long image file is compressed without affecting the overall clarity, to facilitate subsequent image recognition and transmission during image recognition.

P140 interference waveform feature processing module: used to obtain interference waveform area features and locate the interference waveform area from the electrocardiogram image file;

The interference waveform feature processing module provides an auxiliary system client and a horizontal long image file to the client. The doctor selects the waveform area as the interference waveform through the client and submits it to the interference waveform feature processing module. The interference waveform feature processing module extracts the interference waveform based on the interference waveform image features (such as vector features) and other information through a third-party image recognition tool, that is, it identifies all areas that meet the interference waveform features from the long image file, extracts sampling time points from these areas, and uses the corresponding time length as the waveform identifier of the interference waveform to be processed.

In the interference waveform feature processing module, doctors can make personalized interference waveform confirmation for each ECG. For example, the interference waveform specified in a long image file of a patient is only used for recognition in that image file, thereby realizing personalized processing of ECG recognition for special patients. Interference waveform features in different ECGs can also be accumulated as a public interference waveform library for public image feature analysis.

The interference waveform feature processing module can also display all areas that meet the interference waveform features extracted by a third-party image recognition tool on the client, and after confirmation by the doctor, determine the waveform identification to be processed.

P150 interference waveform determination module: used to generate interference waveform identification groups according to the specifications for all waveform identifications to be processed and send them to the P122 operation data processing unit.

The P122 operation data processing unit parses the interference waveform identification group into multiple simulation operation instructions, which are executed one by one by the interface operation processing plug-in.

When the interface operation processing plug-in executes the simulation operation instruction, it determines the waveform position and simulates the manual operation of the mouse and keyboard according to the simulation operation instruction. For example: first simulate the mouse to select the position of the interference waveform in the window, and simulate the keyboard to press the shortcut key to execute the operation annotated as the interference waveform.

Since the ECG sampling time is long, the ECG result cannot be fully displayed in one page of the window. Therefore, the waveform to be processed needs to be in the display area of the window. Therefore, the waveform identification positioning needs to be performed when the position of the interference waveform in the window is selected;

Since the graphics file generation module compresses the long image file, the image pixels will change. Different display settings and different window sizes will also cause the size of the window display area to be different. If a commonly used positioning method (such as pixel positioning) is used, each time the window or image changes, it is necessary to accurately capture the image attributes and window attributes and recalculate the pixels. In the electrocardiogram image, the proportion of the acquisition time point corresponding to the waveform mark to the total duration T will not change with the image clarity and the size of the window. In order to be compatible with the window size, display resolution, and image size of the electrocardiogram system client, and to reduce the amount of calculation when the window changes, the present invention performs waveform mark positioning through the proportional relationship between the total duration T and the waveform mark P.

Waveform marker positioning means: adjusting the window scroll bar according to the total time length T, waveform marker P and window parameters, so that the waveform corresponding to waveform marker P is in the visible area of the window, and then determining the position of the sampling time point corresponding to waveform marker P in the window.

When realizing waveform mark positioning, first perform horizontal scroll bar positioning, and after the horizontal scroll bar positioning is completed, perform sampling time point positioning.

1) The horizontal scroll bar is used to position the waveform corresponding to the waveform marker within the displayable range of the current window (as shown in Figure 4)

First, determine the horizontal scroll bar position: obtain the time period W of the ECG that can be displayed in a page window, the scroll bar length L, and the slider length L2, and then calculate the horizontal scroll bar slider position: L1 = K×(L-L2)/Kp;

Where: K is the page number to which the waveform symbol P belongs. If implemented in Python, it is expressed as K=math.ceil(P/W).

Kp is the number of pages that the electrocardiogram needs to be divided into to display the total duration T. If implemented in Python, it is expressed as: Kp=math.ceil(T/W).

2) Sampling time point positioning is used to determine the waveform corresponding to the waveform marker P in the current window position:

The method of time point positioning is: obtain the width B of the window through tools (such as Python professional libraries), set the leftmost point at the bottom of the window as the origin O'(0,0), then the rightmost point O is O(B,0) (as shown in Figure 5), and x=B in Figure 5;

Determine the waveform mark P corresponding to the graph width F=B/W;

Get the time point corresponding to the waveform marker P at the current window position Q, Q = ((P%W)/W) × B; where P%W is the remainder of P divided by W;

The waveform marker P is calculated to correspond to the horizontal starting point and ending point of the image area, such as S(x1,y1) and E(x2,y2) as shown in FIG5 , where x1=Q-F/2, x2=Q+F/2; y1=y2=0;

Thus, the waveform corresponding to the waveform mark can be obtained at the current window position.

In the simulation operation instruction, the position of the image area corresponding to the waveform mark P, the mouse operation and keyboard operation to be performed on the position are provided to realize the simulation operation of the operator processing an interference waveform.

For example: the total duration T is 85500, the waveform mark P is 7874 seconds, the time period that can be displayed on one page is W=30 seconds, the scroll bar length is L=1134px, the slider length is L2=38px, and the window width is B=1200px;

The waveform marker positioning calculation process includes:

The page number K to which the waveform symbol P belongs = math.ceil(P/W) = math.ceil(7874/30) = 263;

The number of pages that the total time T corresponds to for the electrocardiogram is Kp = math.ceil(T/W) = math.ceil(85500/30) = 2850;

Horizontal scroll bar slider position: L1 = K×(L-L2)/Kp=263×(1134-38)/2850=101px;

The waveform symbol P corresponds to the graph width F=B/W=1200/30=40;

The time point corresponding to the waveform marker P is at the current window position Q=((P%W)/W)×B=((7874%30)/30)×1200=560px;

The waveform marker P corresponds to the horizontal starting point and ending point of the image area, S(540,0) and E(580,0).

After obtaining the horizontal starting point and ending point of the image area corresponding to the waveform mark P, the simulation operation instruction is generated according to the convention of the reference operation instruction: {area:(540,580);key:(alt,R);mouse:()}.

It should be noted that, according to the auxiliary system provided by the present invention, when processing the electrocardiogram interference waveform from the perspective of the window, in order to avoid the increase in overall calculation complexity due to the change in the size of the electrocardiogram image, no deletion processing of the interference waveform is provided.

The auxiliary system for processing electrocardiogram interference waveforms provided by the present invention and the parts deployed in the electrocardiogram system terminal (interface extraction module, operation processing module) and the collaborative interaction process with the electrocardiogram system are shown in FIG2 :

After the ECG system is running, the auxiliary system server or the operator schedules the interface extraction module to trigger the screen recording. At the same time, the trigger operation processing module simulates the mouse to simulate pulling the scroll bar at an appropriate speed, so that all ECG waveforms within the acquisition time period can be obtained during the screen recording process; after the screen recording is completed, the interface extraction module pushes the video file to the auxiliary system server, converts it into an image file, and determines the waveform identification of the interference waveform on the server; the operation processing module identifies the manual operation in the ECG system, generates a reference operation instruction, generates a simulation operation instruction according to the waveform identification of the interference waveform, and runs the simulation operation instruction in the ECG system to simulate manual operation and realize the identification and labeling of interference waveforms in batches.

The present invention firstly skips the complicated electrocardiogram data analysis process, starts from the functions realized by the electrocardiogram system, extracts the electrocardiogram picture file, extracts the waveform features in the picture file, and the waveform features at this time are image features, and only analyzes the personalized interference waveform from the perspective of the image, so there is no need to consider the waveform data analysis in the medical field, there is no need to consider different data standards, and it is compatible with displays with different resolutions and windows of different sizes running the electrocardiogram system; thirdly, on the basis of determining the interference waveform features, the present invention simulates the doctor's operation in the electrocardiogram system, assists the doctor in realizing automatic batch processing of interference waveforms, reduces the doctor's repeated operations, and improves the doctor's work efficiency.

The above disclosures are only several specific embodiments of the present invention; however, the present invention is not limited thereto, and any changes that can be conceived by those skilled in the art should fall within the protection scope of the present invention.

Claims (8)

1. An auxiliary system for processing an interference waveform of an electrocardiographic, comprising: the system comprises an interface extraction module, an operation processing module, a graphic file generation module, an interference waveform characteristic processing module and an interference waveform determining module, wherein the interface extraction module and the operation processing module are deployed at an electrocardiogram system client; the graphic file generation module, the interference waveform characteristic processing module and the interference waveform determining module are deployed at a server side of the auxiliary system;

The interface extraction module is used for acquiring display content from a display window in an electrocardiogram system interface, generating an acquisition file and pushing the acquisition file to the graphic file generation module, wherein the acquisition file is a video file;

The operation processing module is used for: the device is used for acquiring window events and simulating mouse and keyboard operations; the operation processing module comprises an interface operation processing plug-in and an operation data processing unit, wherein the interface operation processing plug-in is used for acquiring window events, acquiring operation instructions and executing operation instructions on an interface of the electrocardiogram system, and the operation data processing unit is used for generating a simulation operation instruction and sending the simulation operation instruction to the interface operation processing plug-in for execution;

the graphic file generation module: the system comprises an interface extraction module, an electrocardiographic image processing module and a storage module, wherein the interface extraction module is used for receiving an acquisition file submitted by the interface extraction module and processing the acquisition file into an electrocardiographic image file;

the interference waveform characteristic processing module is used for: the method comprises the steps of acquiring characteristics of an interference waveform area, positioning the interference waveform area from an electrocardiographic image file, and determining a waveform identifier to be processed;

An interference waveform determining module: the method comprises the steps of generating an interference waveform identification group by the waveform identification to be processed and sending the interference waveform identification group to an operation data processing unit;

Wherein the information of the interference waveform identification group includes: the method comprises the steps of determining the total time length T of electrocardiograph sampling and a waveform identifier P, wherein the total time length T is determined by sampling end time and sampling start time, the waveform identifier P is determined by sampling point time and sampling start time, each sampling point time determines an integral waveform, and the waveform identifier P is a unique identifier for determining the integral waveform;

the operation data processing unit analyzes the interference waveform identification group into a plurality of simulation operation instructions, and the simulation operation instructions are transmitted to an interface operation processing plug-in unit for execution one by one; the simulation operation instruction comprises: the waveform mark P corresponds to the position of the image area, the mouse operation to be executed on the position and the keyboard operation;

Before the interface operation processing plug-in executes the simulation operation instruction, waveform identification positioning is carried out according to the total duration T of the electrocardiogram sampling and the waveform identification P; the waveform identification positioning finger: according to the total duration T, the waveform identification P and the window parameters, adjusting the window scroll bar to enable the waveform corresponding to the waveform identification P to be in the window visible region, and determining the position of the sampling time point corresponding to the waveform identification P in the window; when the waveform identification positioning is realized, firstly, horizontal scroll bar positioning is carried out, and after the horizontal scroll bar positioning is finished, sampling time point positioning is carried out; the horizontal scroll bar is positioned to enable the waveform corresponding to the waveform identifier P to be in a displayable range of the current window; the sampling time point positioning is used for determining that the waveform corresponding to the waveform identifier P is at the current window position.

2. The auxiliary system according to claim 1, wherein the interface extraction module comprises a page extraction plug-in, a screen recording tool, and a file transfer unit;

after the page extraction plug-in runs in the electrocardiogram system, a screen recording is started or stopped in a display window of the electrocardiogram; after the screen recording is started, a screen recording tool is called to record the screen of the window, and the window is saved as an acquisition file after the screen recording is stopped;

the screen recording tool supports a screen recording tool or a third party screen recording tool carried by an operating system;

The file transmission unit is used for pushing the acquired file to the auxiliary system server side.

3. The auxiliary system according to claim 2, wherein after the page extraction plug-in starts the screen recording, the interface operation processing plug-in of the scheduling operation processing module simulates a mouse to pull a display window scroll bar of an electrocardiogram at a proper speed at a uniform speed.

4. The assistance system of claim 2, wherein the interface operation processing plug-in obtains content of an operation instruction comprising: the mouse inputs instructions at the selected position of the window, the mode of mouse key and keyboard;

The interface operation processing plug-in also generates a reference operation instruction, including an electrocardiogram area in a window selected by a doctor and an operation of marking the area as an interference waveform; the reference operation instruction is a reference specification for the data processing unit to generate the simulated operation instruction.

5. The auxiliary system according to claim 1, wherein the graphic file generation module converts the acquisition file into a horizontally long picture file through a function provided by opencv; the content of the transverse long picture file is a waveform chart of an electrocardiogram, wherein the transverse axis is signal acquisition time, and the longitudinal direction is waveforms with consistent sampling time points; the waveforms with the same sampling time points form an integral waveform; the duration corresponding to the sampling time point is the waveform identifier P of the waveform.

6. The assistance system of claim 5, wherein the interference waveform characteristics processing module provides an assistance system client; the doctor selects the waveform area as an interference waveform through the client; and the interference waveform characteristic processing module identifies all areas conforming to the image characteristics from a long picture file according to the image characteristics of the interference waveform, and extracts the duration corresponding to the sampling time point from the areas as the waveform identification of the interference waveform to be processed.

7. The assistance system of claim 1, wherein the horizontal scroll bar positioning comprises:

acquiring a time period W, a rolling bar length L and a sliding block length L2 of an electrocardiogram which can be displayed by a page window, and determining the sliding block position of the horizontal rolling bar as follows: l1=k× (L-L2)/Kp;

Wherein K is the page number to which the waveform identification P belongs, expressed as K=math.ceil (P/W),

Kp is the number of pages to be divided of the electrocardiogram corresponding to the total time length T, and is expressed as: kp=math.

8. The assistance system of claim 1, wherein the sampling time point positioning comprises:

Acquiring the width B of a window, and determining the width F=B/W of a graph corresponding to the waveform mark P;

acquiring the position Q, Q= ((P% W)/W) x B of the waveform identifier P corresponding to the time point at the current window; wherein P% W is P divided by W to obtain remainder;

the starting point and the ending point of the waveform mark P corresponding to the transverse direction of the image area are calculated as follows: s (x 1, y 1), E (x 2, y 2), wherein x1=q-F/2, x2=q+f/2; y1=y2=0.