CN115988325A - Image processing method, system and device for eliminating laser layering - Google Patents
Image processing method, system and device for eliminating laser layering Download PDFInfo
- Publication number
- CN115988325A CN115988325A CN202211616763.XA CN202211616763A CN115988325A CN 115988325 A CN115988325 A CN 115988325A CN 202211616763 A CN202211616763 A CN 202211616763A CN 115988325 A CN115988325 A CN 115988325A
- Authority
- CN
- China
- Prior art keywords
- laser
- equipment
- image
- frame
- image acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 10
- 238000004891 communication Methods 0.000 claims abstract description 50
- 238000000034 method Methods 0.000 claims abstract description 49
- 229910052689 Holmium Inorganic materials 0.000 claims abstract description 38
- KJZYNXUDTRRSPN-UHFFFAOYSA-N holmium atom Chemical compound [Ho] KJZYNXUDTRRSPN-UHFFFAOYSA-N 0.000 claims abstract description 38
- 230000005284 excitation Effects 0.000 claims abstract description 30
- 238000002430 laser surgery Methods 0.000 claims description 41
- 230000032798 delamination Effects 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 11
- 238000013517 stratification Methods 0.000 claims description 7
- 238000004364 calculation method Methods 0.000 claims description 4
- 238000001514 detection method Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 13
- 230000000007 visual effect Effects 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 18
- 238000004590 computer program Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 206010052143 Ocular discomfort Diseases 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Landscapes
- Laser Surgery Devices (AREA)
Abstract
The application provides an image processing method, system and device for eliminating laser layering. In the present application, in this embodiment, an image capturing device in a laser operation, such as an endoscope camera system, establishes communication with a laser device, such as a holmium laser device, to control the time of the laser device in the laser operation, such as the laser emitted by the holmium laser device, to be within a reading time, the laser device is prevented from exciting the laser in the image exposure process, finally, the image exposure and the laser excitation can be avoided (or misplaced), it is ensured that the generated current frame image does not generate a laser layering phenomenon caused by the laser excitation, and further, the laser layering phenomenon in the acquired current frame image is eliminated, the visual obstruction of a doctor is eliminated, and a good operation impression is provided.
Description
Technical Field
The present application relates to image processing technologies, and in particular, to an image processing method, system, and apparatus for eliminating laser delamination.
Background
Currently, during laser surgery, if the release time (pulse width) of the laser is very short, e.g., typically hundreds of microseconds (us), within the exposure time of one frame of image, then only a portion of the exposed lines will be "responded to" and the remaining exposed lines will still be normally exposed. For example, during holmium laser surgery, the very short release time (pulse width) of the holmium laser, typically hundreds of microseconds (us), for one frame of image exposure results in only a portion of the exposed lines being "responsive" and the remaining exposed lines still being normally exposed.
This causes delamination (a portion including the laser beam splitting region and another portion including the normal image region) in the finally formed image of one frame. The laser splitting area has high brightness and even overexposure, and dynamic 'bright light bars' can be presented at times when image frames are subsequently displayed, so that the operation visual field of a doctor in the laser operation process can be influenced, the judgment of the doctor is interfered, and the expected operation effect cannot be achieved.
Disclosure of Invention
The application provides an image processing method, a system and a device for eliminating laser layering, which are used for eliminating the laser layering in an image frame.
The embodiment of the application provides an image processing method for eliminating laser stratification, which is used for image acquisition equipment in laser surgery; the image acquisition equipment establishes communication connection with laser equipment in laser surgery, and the method comprises the following steps:
under the condition that an exposure completion event is detected, determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment;
on the premise that the fact that the laser equipment needs to be controlled to emit the laser signals at present is determined, the communication connection established between the image acquisition equipment and the laser equipment is used for sending laser enabling signals, and therefore the laser equipment emits the laser signals after detecting the laser enabling signals.
The embodiment of the application also provides an image processing method for eliminating laser layering, which is applied to laser equipment in laser surgery, wherein communication connection is established between the laser equipment and image acquisition equipment in the laser surgery, and the method comprises the following steps:
receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that when an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
and emitting a laser signal based on the laser enable signal.
An embodiment of the present application provides an image processing system for eliminating laser delamination, and the system includes:
image acquisition equipment and laser equipment in laser surgery; the image acquisition equipment and the laser equipment are in communication connection;
the image acquisition device executes the first method;
the laser device performs the second method as described above.
The embodiment of the application provides an image processing device for eliminating laser stratification, which is used for image acquisition equipment in laser surgery; the image acquisition equipment has established communication connection with the laser equipment in the laser operation, and the device includes:
the determining unit is used for determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment under the condition that an exposure completion event is detected;
and the control unit is used for sending a laser enabling signal through the communication connection established between the image acquisition equipment and the laser equipment on the premise of determining that the laser equipment is required to be controlled to emit the laser signal at present, so that the laser equipment emits the laser signal after detecting the laser enabling signal.
The embodiment of the application provides an image processing device for eliminating laser layering, and the device is applied to laser equipment in laser surgery, and communication connection is established between the image acquisition equipment in laser surgery and the laser equipment, and the device comprises:
the receiving unit is used for receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that under the condition that an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
a transmitting unit for transmitting a laser signal based on the laser enable signal.
An electronic device is provided. The electronic device includes: a processor and a machine-readable storage medium;
the machine-readable storage medium stores machine-executable instructions executable by the processor;
the processor is configured to execute machine executable instructions to implement the steps of the method disclosed above.
According to the technical scheme, in the embodiment, the image acquisition equipment in the laser operation, such as an endoscope camera system and the like, and the laser equipment, such as holmium laser equipment and the like, are communicated to control the laser equipment to excite the laser in a linkage manner, so that the time of the laser emitted by the laser equipment in the laser operation, such as holmium laser equipment, is within the Readout time, the laser equipment is prevented from exciting the laser in the image exposure process, the image exposure and the laser excitation can be avoided (or misplaced), the generated current frame image is ensured not to generate the laser layering phenomenon caused by the laser excitation, the laser layering phenomenon in the acquired current frame image is eliminated, the visual obstacle of a doctor is eliminated, and a good operation impression is provided.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.
FIG. 1a is a schematic diagram of an image frame with a layer according to an embodiment of the present application;
FIG. 1b is a schematic diagram of a normal image frame provided in an embodiment of the present application;
FIG. 2 is a flow chart of a method provided by an embodiment of the present application;
FIG. 3 is a graph of plot time provided by an embodiment of the present application;
FIG. 4 is a flowchart of step 201 provided by an embodiment of the present application;
FIG. 5 is another flow chart provided by an embodiment of the present application;
fig. 6 is a system configuration diagram provided in the embodiment of the present application;
FIG. 7 is a block diagram of an apparatus according to an embodiment of the present disclosure;
FIG. 8 is a block diagram of another apparatus provided in an embodiment of the present application;
fig. 9 is a structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with aspects such as the present application.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
As described above, in laser surgery, if the release time (pulse width) of the laser within the exposure time of one frame image is often very short (only hundreds of us), only a part of the exposure lines will generate "response", and the rest of the exposure lines are still normally exposed, and a layer (referred to as laser layer) is generated in the finally formed frame image. The laser layering results in a frame image divided into two regions: laser splitting area and normal image area. The area size and the position of the laser splitting layer area are not fixed, but the brightness of the laser splitting layer area is higher and even overexposed. Taking holmium laser surgery as an example, delamination (denoted as holmium laser delamination) occurs in one frame of image acquired in holmium laser surgery. And the holmium laser delamination can cause one frame of image to be divided into two areas: holmium laser splitting area and normal image area. Fig. 1a shows an image in which a holmium laser splitting region is present by way of example, and fig. 1b shows an image in normal exposure by way of example.
For the above-mentioned images with laser stratification, such as holmium laser stratification, they may sometimes present dynamic "bright light bars" when displayed, which may cause visual discomfort to the physician performing the laser surgery, such as holmium laser surgery, etc., and may affect the operation visual field, interfere with the physician's judgment, and may fail to achieve the desired surgical effect. To solve such a technical problem, the present embodiment provides an image processing method for eliminating laser delamination such as holmium laser delamination, which can eliminate laser delamination existing in an image frame, as described below by way of example:
referring to fig. 2, fig. 2 is a flowchart of a method provided by an embodiment of the present application. The method is applied to image acquisition equipment in laser surgery. As one example, the image capture device may be an endoscopic imaging system in an endoscope, such as a set of lenses in an endoscope.
In the embodiment, the image acquisition device and the laser device applied to the laser surgery need to establish communication connection. When the imaging system is applied to holmium laser surgery, the endoscope imaging system is in communication connection with holmium laser equipment. The present embodiment does not specifically limit the communication connection manner, and includes but is not limited to a network port, a serial port, a can bus, bluetooth, and the like.
Based on the above description, as shown in fig. 2, the process may include the following steps:
In this embodiment, after detecting an external trigger (also referred to as a laser emission trigger), the laser device in the laser surgery transmits a laser excitation signal to the image capturing device through the communication connection, so that the image capturing device executes the process shown in fig. 2.
Specifically, the image capture device starts exposure signal detection after receiving the laser excitation signal. In this embodiment, an image capturing process of an image capturing device, such as a camera, includes the following two parts: the first part is the auto Exposure time (Exposure) and the second part is the Readout time. The readout time refers to the time when a sensor (sensor) in the image capturing device outputs an image after the image exposure is completed, and is generally about 20 to 30 ms. That is, the time for acquiring one frame of image (also called the image time) = exposure time + readout time. Fig. 3 shows an example of the plot time.
Based on the above description, in this embodiment, as described in step 201, in the case that the image capturing device detects an exposure completion event, it is determined whether the laser device needs to be controlled to emit a laser signal currently according to the current image output frame rate N of the image capturing device and the laser emission frequency M of the laser device. Here, the laser emission frequency M may be a frequency of laser excitation within one second(s), and if the laser emission frequency M is 15HZ, it means that the laser is excited 15 times within 1 s. In this embodiment, the laser emission frequency M of the laser device may be carried in the laser excitation signal by the laser device and sent to the image capturing device, or may be configured in advance in the image capturing device, and this embodiment is not particularly limited.
In the above description, the exposure complete event is, for example, the receipt of an exposure complete signal, a signal of Readout start, a Readout enable signal, or the like. Alternatively, in this embodiment, an exposure complete signal is generated at the end of each frame of automatic exposure, and the exposure complete signal is equal to a Readout start signal, also called a Readout enable signal.
As can be seen from step 201, in this embodiment, a laser device in laser surgery, such as a holmium laser device, does not directly perform laser emission even when the laser emission trigger is detected, but links an image capturing device, and determines whether the laser device needs to be controlled to emit a laser signal currently according to a current image output frame rate N and a laser emission frequency M of the laser device by the image capturing device. As to how to determine whether the laser device needs to be controlled to emit the laser signal currently according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device, which will be described in the following by way of example, and will not be described herein again.
Step 202, on the premise that it is determined that the laser device needs to be controlled to emit the laser signal currently, the laser enable signal is sent through the communication connection established between the image acquisition device and the laser device, so that the laser device emits the laser signal after detecting the laser enable signal.
In this embodiment, a laser device in laser surgery, such as a holmium laser device, emits laser light after detecting the laser enable signal.
It should be noted that, this step 202 is executed on the premise that an exposure completion event is detected, based on this premise, the time for laser equipment in laser surgery, such as holmium laser equipment, to emit laser is within the above Readout time, and the laser is certainly not excited in the exposure process, so that the image exposure and the excitation of the laser are misaligned, and the generated current frame image does not generate a laser delamination phenomenon caused by the laser excitation.
Thus, the flow shown in fig. 2 is completed.
As can be seen from the flow shown in fig. 2, in this embodiment, communication is established between an image acquisition device in the laser surgery, such as an endoscope camera system, and a laser device, such as a holmium laser device, to cooperatively control the timing of laser excitation of the laser device, so as to control the time of laser emitted by the laser device in the laser surgery, such as the holmium laser device, to be within the Readout time, so as to avoid laser excitation by the laser device in the image exposure process, and finally, to avoid (or make misalignment between) image exposure and laser excitation, so as to ensure that the generated current frame image does not generate a laser delamination phenomenon caused by laser excitation, and further eliminate the laser delamination phenomenon in the acquired current frame image, eliminate visual obstruction of a doctor, and provide a good surgical impression.
How to determine whether the laser device needs to be controlled to emit the laser signal currently or not according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device in the above step 201 is described as follows:
referring to fig. 4, fig. 4 is a flowchart of step 201 implementation provided in an embodiment of the present application. As shown in fig. 4, the process may include the following steps:
In this embodiment, the image frame-laser association relationship is used to indicate that the image capturing device needs to control the laser device to emit the laser signal n times every time m image frames are captured.
As an embodiment, there are many implementation ways to determine the image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device, for example: calculating the maximum common factors of M and N, and dividing the numerator and the denominator in M/N by the maximum common factors respectively to obtain M/N, wherein M is greater than N, and N is greater than or equal to 1; and determining the image frame-laser association relation according to the m/n. If N is 30 and m is 20, N is 3 and m is 2, which means that the laser is fired 2 times every 3 frames, i.e. the image capturing device needs to generate the above laser enable signal for 2 frames of images in every 3 frames of images captured.
As an embodiment, there are many implementations for determining whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship, such as: acquiring a first laser excitation signal sent by the laser equipment through the communication connection on the premise that the current image output frame rate of the image acquisition equipment is N and the laser emission frequency of the laser equipment is M; taking the image frame collected after receiving the first laser excitation signal as a first frame; and determining whether the laser equipment needs to be controlled to emit laser signals at present or not from the first frame according to the image frame-laser association relation.
Optionally, the determining, from the first frame, whether the laser device needs to be controlled to emit the laser signal at present according to the image frame-laser association relationship has a plurality of implementation manners, for example, detecting a frame number K of a target image frame corresponding to the exposure completion event; the frame number K is counted from the first frame; determining the current control period according to K; if K is larger than or equal to n, rounding K/n to obtain a calculation result p, and determining that the current control period is the (p + 1) th control period, wherein p is larger than or equal to 1; if K is smaller than n, determining that the current control period is the 1 st control period; and determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation and the sequence of the current image frame in the current control period.
Here, it is determined whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship and the sequence of the current image frame in the current control period, such as: if the laser is determined to be emitted or not according to the sequence in each control period, if the sequence number of the current image frame in the current control period is less than or equal to m, the laser device is determined to be required to be controlled to emit the laser signal, otherwise, the laser device is determined not to be required to be controlled to emit the laser signal currently. For example, the image frame-laser association relationship indicates that laser is excited every 3 frames for 2 times, and if the current image frame is the second frame image in the current control period, it may be determined that the laser device needs to be controlled to emit a laser signal currently based on the image frame-laser association relationship (indicating that laser is excited every 3 frames for 2 times); and if the current image frame is the 3 rd image in the current control period, because the previous two frames already determine that the laser device needs to be controlled to emit the laser signal, then based on the image frame-laser association relationship (indicating that the laser is excited for 2 times every 3 frames), it can be determined that the laser device does not need to be controlled to emit the laser signal currently. It should be noted that the present invention is by way of example only and is not limited thereto.
The flow shown in fig. 4 is completed.
Through the process shown in fig. 4, it is realized how to determine whether the laser device needs to be controlled to emit the laser signal currently according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device.
It should be noted that, in the present embodiment, as described above, the laser apparatus in laser surgery detects the laser stop trigger after detecting the laser emission trigger. Once the laser stop trigger is detected, an excitation termination signal is sent to the image acquisition device through the connection. And the image acquisition equipment finishes the control of the laser emitted by the laser equipment on the premise of detecting the laser termination signal sent by the laser equipment through the communication connection.
The above is the method provided by the embodiments of the present application described in terms of an image capturing device such as an endoscopic imaging system standing in laser surgery, and the following is the method provided by the embodiments of the present application described in terms of a laser device such as a holmium laser device standing in laser surgery:
referring to fig. 5, fig. 5 is a flow chart of another method provided by the embodiments of the present application. The method is applied to laser equipment in laser surgery, such as holmium laser equipment, and the laser equipment is in communication connection with image acquisition equipment used for acquiring images in the laser surgery, such as an endoscope imaging system.
As shown in fig. 5, the process may include the following steps:
In this embodiment, the sending of the laser enable signal by the image capturing device is determined based on the flow shown in fig. 2, for example, when it is determined that the laser device needs to be controlled to send the laser signal currently according to the current image output frame rate N of the image capturing device and the holmium laser emission frequency M of the laser device when the exposure completion event is detected, the laser enable signal is sent to the laser device through the communication connection, which is specifically shown in the flow shown in fig. 2.
When the laser equipment receives the laser enable signal, a laser signal is emitted once based on the laser enable signal.
As can be known from the above-described laser enable signal, in this embodiment, the image capturing device in the laser surgery, such as an endoscope camera system, and the like, establishes communication with the laser device, such as a holmium laser device, and the like, to control the timing of laser excitation of the laser device in the laser surgery in a linkage manner, so as to control the time of the laser emitted by the laser device in the laser surgery, such as the holmium laser device, to be within the Readout time, so as to avoid laser excitation by the laser device in the image exposure process, and finally, to avoid (or make a misalignment between) image exposure and laser excitation, so as to ensure that the generated current frame image does not generate a laser delamination phenomenon caused by laser excitation, thereby eliminating the laser delamination phenomenon in the acquired current frame image, eliminating a visual obstruction of a doctor, and providing a good surgical impression.
The flow shown in fig. 5 is completed.
The method provided by the embodiment of the present application is described above, and the system and the apparatus provided by the embodiment of the present application are described below:
referring to fig. 6, fig. 6 is a system structure diagram provided in the embodiment of the present application. The system comprises: image acquisition equipment and laser equipment in laser surgery; the image acquisition equipment and the laser equipment are in communication connection;
the image acquisition device performs the steps in the flow as shown in fig. 2.
The laser device performs the steps in the flow chart shown in fig. 5.
Thus, the description of the structure of the system shown in fig. 6 is completed.
Referring to fig. 7, fig. 7 is a structural diagram of an apparatus provided in the embodiment of the present application. The device is used for image acquisition equipment in laser surgery; the image acquisition equipment has established communication connection with the laser equipment in the laser operation, and the device includes:
the determining unit is used for determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment under the condition that an exposure completion event is detected;
and the control unit is used for sending a laser enabling signal through the communication connection established between the image acquisition equipment and the laser equipment on the premise of determining that the laser equipment is required to be controlled to emit the laser signal at present, so that the laser equipment emits the laser signal after detecting the laser enabling signal.
Optionally, the determining, according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device, whether the laser device needs to be controlled to emit a laser signal currently includes: determining an image frame-laser association relation according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment; the image frame-laser association relation is used for indicating that the laser equipment needs to be controlled to emit laser signals for n times when the image acquisition equipment acquires m image frames; determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation;
optionally, the determining an image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device includes: calculating the maximum common factors of M and N, and dividing the numerator and the denominator in M/N by the maximum common factors respectively to obtain M/N, wherein M is greater than N, and N is greater than or equal to 1; determining the image frame-laser association relation according to the m/n;
optionally, the determining whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship includes: on the premise that the current image output frame rate of the image acquisition equipment is N and the laser emission frequency of the laser equipment is M, obtaining a first holmium laser excitation signal sent by the laser equipment through the communication connection; taking the image frame collected after receiving the first holmium laser excitation signal as a first frame; determining whether the laser equipment needs to be controlled to emit laser signals at present or not according to the image frame-laser association relation from the first frame;
optionally, the determining, starting from the first frame, whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship includes: detecting a frame number K of a current image frame corresponding to the exposure completion event; the frame number K is counted from the first frame; determining the current control period according to the K; if K is larger than or equal to n, rounding K/n to obtain a calculation result p, and determining that the current control period is the (p + 1) th control period, wherein p is larger than or equal to 1; if K is smaller than n, determining that the current control period is the 1 st control period; determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation and the sequence of the current image frame in the current control period;
optionally, the determining unit performs detection of an exposure completion event on the premise of detecting a laser excitation signal sent by the laser device through the communication connection; or,
and the control unit finishes the control of the laser emitted by the laser equipment on the premise of detecting the laser termination signal sent by the laser equipment through the communication connection.
Thus, the description of the structure of the apparatus shown in fig. 7 is completed.
Referring to fig. 8, fig. 8 is a structural diagram of another apparatus according to an embodiment of the present disclosure. The device is applied to the laser equipment in the laser operation, has established communication connection between the image acquisition equipment in laser operation and the laser equipment, and the device includes:
the receiving unit is used for receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that under the condition that an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
a transmitting unit for transmitting a laser signal based on the laser enable signal.
Thus, the description of the structure of the apparatus shown in fig. 8 is completed.
The embodiment of the application also provides a hardware structure of the device shown in fig. 7 or 8. Referring to fig. 9, fig. 9 is a structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 9, the hardware structure may include: a processor and a machine-readable storage medium having stored thereon machine-executable instructions executable by the processor; the processor is configured to execute machine-executable instructions to implement the methods disclosed in the above examples of the present application.
Based on the same application concept as the method, embodiments of the present application further provide a machine-readable storage medium, where several computer instructions are stored, and when the computer instructions are executed by a processor, the method disclosed in the above example of the present application can be implemented.
The machine-readable storage medium may be, for example, any electronic, magnetic, optical, or other physical storage device that can contain or store information such as executable instructions, data, and the like. For example, the machine-readable storage medium may be: a RAM (random Access Memory), a volatile Memory, a non-volatile Memory, a flash Memory, a storage drive (e.g., a hard drive), a solid state drive, any type of storage disk (e.g., an optical disk, a dvd, etc.), or similar storage medium, or a combination thereof.
The systems, devices, modules or units illustrated in the above embodiments may be specifically implemented by a computer processor or an entity, or by an article of manufacture with certain functionality. A typical implementation device is a computer, which may be in the form of a personal computer, laptop, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email messaging device, game console, tablet computer, wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Furthermore, these computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (12)
1. An image processing method for eliminating laser stratification is characterized in that the method is used for an image acquisition device in laser surgery; the image acquisition equipment and the laser equipment in the laser operation establish communication connection, and the method comprises the following steps:
under the condition that an exposure completion event is detected, determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment;
on the premise that the fact that the laser equipment needs to be controlled to emit laser signals at present is determined, the communication connection established between the image acquisition equipment and the laser equipment is used for sending laser enabling signals, and therefore the laser equipment emits the laser signals after detecting the laser enabling signals.
2. The method according to claim 1, wherein the determining whether the laser device needs to be controlled to emit the laser signal currently according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device comprises:
determining an image frame-laser association relation according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment; the image frame-laser association relation is used for indicating that the laser equipment needs to be controlled to emit laser signals for n times when the image acquisition equipment acquires m image frames;
and determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation.
3. The method according to claim 2, wherein the determining an image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device comprises:
calculating the maximum common factors of M and N, and dividing the numerator and the denominator in M/N by the maximum common factors respectively to obtain M/N, wherein M is greater than N, and N is greater than or equal to 1;
and determining the image frame-laser association relation according to the m/n.
4. The method of claim 2, wherein the determining whether the laser device is currently required to be controlled to emit laser signals according to the image frame-laser association comprises:
on the premise that the current image output frame rate of the image acquisition equipment is N and the laser emission frequency of the laser equipment is M, obtaining a first holmium laser excitation signal sent by the laser equipment through the communication connection;
taking the image frame collected after receiving the first holmium laser excitation signal as a first frame;
and determining whether the laser equipment needs to be controlled to emit laser signals at present or not according to the image frame-laser association relation from the first frame.
5. The method of claim 4, wherein the determining whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship from the first frame comprises:
detecting a frame number K of a current image frame corresponding to the exposure completion event; the frame number K is counted from the first frame;
determining the current control period according to the K; if K is larger than or equal to n, rounding K/n to obtain a calculation result p, and determining that the current control period is the (p + 1) th control period, wherein p is larger than or equal to 1; if K is smaller than n, determining that the current control period is the 1 st control period;
and determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation and the sequence of the current image frame in the current control period.
6. The method of claim 1, further comprising:
on the premise that a laser excitation signal sent by the laser equipment through the communication connection is detected, the method is executed; or,
and on the premise of detecting a laser termination signal sent by the laser equipment through the communication connection, ending the control of the laser emission of the laser equipment.
7. An image processing method for eliminating laser stratification is applied to laser equipment in laser surgery, communication connection is established between the laser equipment and image acquisition equipment in the laser surgery, and the method comprises the following steps:
receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that under the condition that an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
and emitting a laser signal based on the laser enable signal.
8. An image processing system for eliminating laser delamination, the system comprising:
image acquisition equipment and laser equipment in laser surgery; the image acquisition equipment and the laser equipment are in communication connection;
the image acquisition device performs the method of any one of claims 1 to 6;
the laser apparatus performs the method of claim 7.
9. An image processing device for eliminating laser delamination is characterized in that the device is used for an image acquisition device in laser surgery; the image acquisition equipment has established communication connection with the laser equipment in the laser operation, and the device includes:
the determining unit is used for determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment under the condition that an exposure completion event is detected;
and the control unit is used for sending a laser enabling signal through the communication connection established between the image acquisition equipment and the laser equipment on the premise of determining that the laser equipment is required to be controlled to emit the laser signal at present, so that the laser equipment emits the laser signal after detecting the laser enabling signal.
10. The apparatus according to claim 9, wherein the determining whether the laser device needs to be controlled to emit the laser signal currently according to the current image output frame rate N of the image capturing device and the laser emission frequency M of the laser device comprises: determining an image frame-laser association relation according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment; the image frame-laser association relation is used for indicating that the laser equipment needs to be controlled to emit laser signals for n times when the image acquisition equipment acquires m image frames; determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation;
determining an image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device includes: calculating the maximum common factors of M and N, and dividing the numerator and the denominator in M/N by the maximum common factors respectively to obtain M/N, wherein M is greater than N, and N is greater than or equal to 1; determining the image frame-laser association relation according to the m/n;
the determining whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relation includes: acquiring a first holmium laser excitation signal sent by the laser device through the communication connection on the premise that the current image output frame rate of the image acquisition device is N and the laser emission frequency of the laser device is M; taking an image frame acquired after the first holmium laser excitation signal is received as a first frame; determining whether the laser equipment needs to be controlled to emit laser signals at present or not according to the image frame-laser association relation from the first frame;
the determining whether the laser device needs to be controlled to emit the laser signal at present according to the image frame-laser association relationship from the first frame comprises: detecting a frame number K of a current image frame corresponding to the exposure completion event; the frame number K is counted from the first frame; determining the current control period according to the K; if K is larger than or equal to n, rounding K/n to obtain a calculation result p, and determining that the current control period is the (p + 1) th control period, wherein p is larger than or equal to 1; if K is smaller than n, determining that the current control period is the 1 st control period; determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation and the sequence of the current image frame in the current control period;
the determining unit executes detection of an exposure completion event on the premise of detecting a laser excitation signal sent by the laser device through the communication connection; or,
and the control unit finishes the control of the laser emitted by the laser equipment on the premise of detecting the laser termination signal sent by the laser equipment through the communication connection.
11. An image processing device for eliminating laser stratification, which is applied to a laser device in laser surgery, wherein a communication connection is established between the laser device and an image acquisition device in laser surgery, and the device comprises:
the receiving unit is used for receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that under the condition that an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
a transmitting unit for transmitting a laser signal based on the laser enable signal.
12. An electronic device, comprising: a processor and a machine-readable storage medium;
the machine-readable storage medium stores machine-executable instructions executable by the processor;
the processor is configured to execute machine executable instructions to implement the method steps of any of claims 1-7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211616763.XA CN115988325A (en) | 2022-12-15 | 2022-12-15 | Image processing method, system and device for eliminating laser layering |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211616763.XA CN115988325A (en) | 2022-12-15 | 2022-12-15 | Image processing method, system and device for eliminating laser layering |
Publications (1)
Publication Number | Publication Date |
---|---|
CN115988325A true CN115988325A (en) | 2023-04-18 |
Family
ID=85958813
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211616763.XA Pending CN115988325A (en) | 2022-12-15 | 2022-12-15 | Image processing method, system and device for eliminating laser layering |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115988325A (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090290607A1 (en) * | 2008-05-23 | 2009-11-26 | Beijing Institute Of Opto-Electronic Technology | Signal processing device for controlling laser output and device for observing laser action process |
WO2019040036A1 (en) * | 2017-08-24 | 2019-02-28 | Bae Systems Information And Electronic Systems Integration Inc. | Laser spot contrast enhancement |
WO2020238569A1 (en) * | 2019-05-30 | 2020-12-03 | Oppo广东移动通信有限公司 | Control method and control device for terminal, terminal, and computer readable storage medium |
CN112642064A (en) * | 2020-12-22 | 2021-04-13 | 沈阳雷卓激光医疗器械有限公司 | Laser gap emission method and device |
US20210145295A1 (en) * | 2017-05-16 | 2021-05-20 | Sony Corporation | Image processing apparatus and method and image processing system |
CN114441418A (en) * | 2022-01-28 | 2022-05-06 | 天津凌视科技有限公司 | Imaging system, imaging method and readable storage medium for high-speed flowing particles |
CN115379130A (en) * | 2022-08-25 | 2022-11-22 | 上海联影医疗科技股份有限公司 | Automatic exposure control system, method, device and storage medium |
-
2022
- 2022-12-15 CN CN202211616763.XA patent/CN115988325A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090290607A1 (en) * | 2008-05-23 | 2009-11-26 | Beijing Institute Of Opto-Electronic Technology | Signal processing device for controlling laser output and device for observing laser action process |
US20210145295A1 (en) * | 2017-05-16 | 2021-05-20 | Sony Corporation | Image processing apparatus and method and image processing system |
WO2019040036A1 (en) * | 2017-08-24 | 2019-02-28 | Bae Systems Information And Electronic Systems Integration Inc. | Laser spot contrast enhancement |
WO2020238569A1 (en) * | 2019-05-30 | 2020-12-03 | Oppo广东移动通信有限公司 | Control method and control device for terminal, terminal, and computer readable storage medium |
CN112642064A (en) * | 2020-12-22 | 2021-04-13 | 沈阳雷卓激光医疗器械有限公司 | Laser gap emission method and device |
CN114441418A (en) * | 2022-01-28 | 2022-05-06 | 天津凌视科技有限公司 | Imaging system, imaging method and readable storage medium for high-speed flowing particles |
CN115379130A (en) * | 2022-08-25 | 2022-11-22 | 上海联影医疗科技股份有限公司 | Automatic exposure control system, method, device and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9451150B2 (en) | Image capturing apparatus comprising focus detection, and method for controlling the same | |
JP4731698B2 (en) | Image processing apparatus, photographing apparatus, image processing system, image processing method, and storage medium | |
US20080074529A1 (en) | Imaging apparatus, control method of imaging apparatus, and computer program | |
CN108062763B (en) | Target tracking method and device and storage medium | |
EP2757771A2 (en) | Image pickup apparatus, remote control apparatus, and methods of controlling image pickup apparatus and remote control apparatus | |
EP3053510A1 (en) | Data reception device, capsule endoscope system, data reception method, and program | |
US9757086B2 (en) | Radiation imaging system, control method therefor, and storage medium having stored thereon a program for executing the control method | |
US20130002830A1 (en) | Stereoscopic imaging device and method for automatically adjusting the focal point of a stereoscopic imaging device | |
US11134205B2 (en) | Control apparatus, radiographic imaging system, control method, and recording medium | |
CN110520050A (en) | Radiation imaging system, radiation imaging apparatus, radioactive ray imaging method and program | |
JP2016134723A (en) | Imaging apparatus, imaging method and imaging operation control program | |
JP2004233664A (en) | Microscopic image acquisition device and method therefor | |
JP2010039284A (en) | Image pick-up apparatus and control method therefor | |
CN106054350A (en) | Optical apparatus, display controlling method, and display controlling program | |
CN105549299B (en) | Control method, control device and electronic device | |
JP5977907B1 (en) | Capsule endoscope and capsule endoscope system | |
US11092698B2 (en) | Radiation imaging system, imaging apparatus, control apparatus, and methods of controlling the same | |
JP2009055125A (en) | Imaging apparatus and its control method | |
CN108652653B (en) | Method and device for shooting medical image, medical image system and storage medium | |
CN115988325A (en) | Image processing method, system and device for eliminating laser layering | |
CN111357278A (en) | Image processing method, image processing apparatus, image capturing apparatus, and storage medium | |
JP2016097195A (en) | Radiographic system and control method thereof | |
JP2019184710A (en) | Imaging device, light emission control method of the same and program thereof | |
JP5029573B2 (en) | Imaging apparatus and imaging method | |
US8634018B2 (en) | Image pickup apparatus and control method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |