CN115988325A - Image processing method, system and device for eliminating laser layering - Google Patents

Image processing method, system and device for eliminating laser layering Download PDF

Info

Publication number
CN115988325A
CN115988325A CN202211616763.XA CN202211616763A CN115988325A CN 115988325 A CN115988325 A CN 115988325A CN 202211616763 A CN202211616763 A CN 202211616763A CN 115988325 A CN115988325 A CN 115988325A
Authority
CN
China
Prior art keywords
laser
equipment
image
frame
image acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211616763.XA
Other languages
Chinese (zh)
Inventor
刘恩毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Haikang Huiying Technology Co ltd
Original Assignee
Hangzhou Haikang Huiying Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Haikang Huiying Technology Co ltd filed Critical Hangzhou Haikang Huiying Technology Co ltd
Priority to CN202211616763.XA priority Critical patent/CN115988325A/en
Publication of CN115988325A publication Critical patent/CN115988325A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Laser Surgery Devices (AREA)

Abstract

The application provides an image processing method, system and device for eliminating laser layering. In the present application, in this embodiment, an image capturing device in a laser operation, such as an endoscope camera system, establishes communication with a laser device, such as a holmium laser device, to control the time of the laser device in the laser operation, such as the laser emitted by the holmium laser device, to be within a reading time, the laser device is prevented from exciting the laser in the image exposure process, finally, the image exposure and the laser excitation can be avoided (or misplaced), it is ensured that the generated current frame image does not generate a laser layering phenomenon caused by the laser excitation, and further, the laser layering phenomenon in the acquired current frame image is eliminated, the visual obstruction of a doctor is eliminated, and a good operation impression is provided.

Description

Image processing method, system and device for eliminating laser layering
Technical Field
The present application relates to image processing technologies, and in particular, to an image processing method, system, and apparatus for eliminating laser delamination.
Background
Currently, during laser surgery, if the release time (pulse width) of the laser is very short, e.g., typically hundreds of microseconds (us), within the exposure time of one frame of image, then only a portion of the exposed lines will be "responded to" and the remaining exposed lines will still be normally exposed. For example, during holmium laser surgery, the very short release time (pulse width) of the holmium laser, typically hundreds of microseconds (us), for one frame of image exposure results in only a portion of the exposed lines being "responsive" and the remaining exposed lines still being normally exposed.
This causes delamination (a portion including the laser beam splitting region and another portion including the normal image region) in the finally formed image of one frame. The laser splitting area has high brightness and even overexposure, and dynamic 'bright light bars' can be presented at times when image frames are subsequently displayed, so that the operation visual field of a doctor in the laser operation process can be influenced, the judgment of the doctor is interfered, and the expected operation effect cannot be achieved.
Disclosure of Invention
The application provides an image processing method, a system and a device for eliminating laser layering, which are used for eliminating the laser layering in an image frame.
The embodiment of the application provides an image processing method for eliminating laser stratification, which is used for image acquisition equipment in laser surgery; the image acquisition equipment establishes communication connection with laser equipment in laser surgery, and the method comprises the following steps:
under the condition that an exposure completion event is detected, determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment;
on the premise that the fact that the laser equipment needs to be controlled to emit the laser signals at present is determined, the communication connection established between the image acquisition equipment and the laser equipment is used for sending laser enabling signals, and therefore the laser equipment emits the laser signals after detecting the laser enabling signals.
The embodiment of the application also provides an image processing method for eliminating laser layering, which is applied to laser equipment in laser surgery, wherein communication connection is established between the laser equipment and image acquisition equipment in the laser surgery, and the method comprises the following steps:
receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that when an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
and emitting a laser signal based on the laser enable signal.
An embodiment of the present application provides an image processing system for eliminating laser delamination, and the system includes:
image acquisition equipment and laser equipment in laser surgery; the image acquisition equipment and the laser equipment are in communication connection;
the image acquisition device executes the first method;
the laser device performs the second method as described above.
The embodiment of the application provides an image processing device for eliminating laser stratification, which is used for image acquisition equipment in laser surgery; the image acquisition equipment has established communication connection with the laser equipment in the laser operation, and the device includes:
the determining unit is used for determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment under the condition that an exposure completion event is detected;
and the control unit is used for sending a laser enabling signal through the communication connection established between the image acquisition equipment and the laser equipment on the premise of determining that the laser equipment is required to be controlled to emit the laser signal at present, so that the laser equipment emits the laser signal after detecting the laser enabling signal.
The embodiment of the application provides an image processing device for eliminating laser layering, and the device is applied to laser equipment in laser surgery, and communication connection is established between the image acquisition equipment in laser surgery and the laser equipment, and the device comprises:
the receiving unit is used for receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that under the condition that an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
a transmitting unit for transmitting a laser signal based on the laser enable signal.
An electronic device is provided. The electronic device includes: a processor and a machine-readable storage medium;
the machine-readable storage medium stores machine-executable instructions executable by the processor;
the processor is configured to execute machine executable instructions to implement the steps of the method disclosed above.
According to the technical scheme, in the embodiment, the image acquisition equipment in the laser operation, such as an endoscope camera system and the like, and the laser equipment, such as holmium laser equipment and the like, are communicated to control the laser equipment to excite the laser in a linkage manner, so that the time of the laser emitted by the laser equipment in the laser operation, such as holmium laser equipment, is within the Readout time, the laser equipment is prevented from exciting the laser in the image exposure process, the image exposure and the laser excitation can be avoided (or misplaced), the generated current frame image is ensured not to generate the laser layering phenomenon caused by the laser excitation, the laser layering phenomenon in the acquired current frame image is eliminated, the visual obstacle of a doctor is eliminated, and a good operation impression is provided.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.
FIG. 1a is a schematic diagram of an image frame with a layer according to an embodiment of the present application;
FIG. 1b is a schematic diagram of a normal image frame provided in an embodiment of the present application;
FIG. 2 is a flow chart of a method provided by an embodiment of the present application;
FIG. 3 is a graph of plot time provided by an embodiment of the present application;
FIG. 4 is a flowchart of step 201 provided by an embodiment of the present application;
FIG. 5 is another flow chart provided by an embodiment of the present application;
fig. 6 is a system configuration diagram provided in the embodiment of the present application;
FIG. 7 is a block diagram of an apparatus according to an embodiment of the present disclosure;
FIG. 8 is a block diagram of another apparatus provided in an embodiment of the present application;
fig. 9 is a structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with aspects such as the present application.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
As described above, in laser surgery, if the release time (pulse width) of the laser within the exposure time of one frame image is often very short (only hundreds of us), only a part of the exposure lines will generate "response", and the rest of the exposure lines are still normally exposed, and a layer (referred to as laser layer) is generated in the finally formed frame image. The laser layering results in a frame image divided into two regions: laser splitting area and normal image area. The area size and the position of the laser splitting layer area are not fixed, but the brightness of the laser splitting layer area is higher and even overexposed. Taking holmium laser surgery as an example, delamination (denoted as holmium laser delamination) occurs in one frame of image acquired in holmium laser surgery. And the holmium laser delamination can cause one frame of image to be divided into two areas: holmium laser splitting area and normal image area. Fig. 1a shows an image in which a holmium laser splitting region is present by way of example, and fig. 1b shows an image in normal exposure by way of example.
For the above-mentioned images with laser stratification, such as holmium laser stratification, they may sometimes present dynamic "bright light bars" when displayed, which may cause visual discomfort to the physician performing the laser surgery, such as holmium laser surgery, etc., and may affect the operation visual field, interfere with the physician's judgment, and may fail to achieve the desired surgical effect. To solve such a technical problem, the present embodiment provides an image processing method for eliminating laser delamination such as holmium laser delamination, which can eliminate laser delamination existing in an image frame, as described below by way of example:
referring to fig. 2, fig. 2 is a flowchart of a method provided by an embodiment of the present application. The method is applied to image acquisition equipment in laser surgery. As one example, the image capture device may be an endoscopic imaging system in an endoscope, such as a set of lenses in an endoscope.
In the embodiment, the image acquisition device and the laser device applied to the laser surgery need to establish communication connection. When the imaging system is applied to holmium laser surgery, the endoscope imaging system is in communication connection with holmium laser equipment. The present embodiment does not specifically limit the communication connection manner, and includes but is not limited to a network port, a serial port, a can bus, bluetooth, and the like.
Based on the above description, as shown in fig. 2, the process may include the following steps:
step 201, in the case of detecting an exposure completion event, determining whether the laser device needs to be controlled to emit a laser signal currently according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device.
In this embodiment, after detecting an external trigger (also referred to as a laser emission trigger), the laser device in the laser surgery transmits a laser excitation signal to the image capturing device through the communication connection, so that the image capturing device executes the process shown in fig. 2.
Specifically, the image capture device starts exposure signal detection after receiving the laser excitation signal. In this embodiment, an image capturing process of an image capturing device, such as a camera, includes the following two parts: the first part is the auto Exposure time (Exposure) and the second part is the Readout time. The readout time refers to the time when a sensor (sensor) in the image capturing device outputs an image after the image exposure is completed, and is generally about 20 to 30 ms. That is, the time for acquiring one frame of image (also called the image time) = exposure time + readout time. Fig. 3 shows an example of the plot time.
Based on the above description, in this embodiment, as described in step 201, in the case that the image capturing device detects an exposure completion event, it is determined whether the laser device needs to be controlled to emit a laser signal currently according to the current image output frame rate N of the image capturing device and the laser emission frequency M of the laser device. Here, the laser emission frequency M may be a frequency of laser excitation within one second(s), and if the laser emission frequency M is 15HZ, it means that the laser is excited 15 times within 1 s. In this embodiment, the laser emission frequency M of the laser device may be carried in the laser excitation signal by the laser device and sent to the image capturing device, or may be configured in advance in the image capturing device, and this embodiment is not particularly limited.
In the above description, the exposure complete event is, for example, the receipt of an exposure complete signal, a signal of Readout start, a Readout enable signal, or the like. Alternatively, in this embodiment, an exposure complete signal is generated at the end of each frame of automatic exposure, and the exposure complete signal is equal to a Readout start signal, also called a Readout enable signal.
As can be seen from step 201, in this embodiment, a laser device in laser surgery, such as a holmium laser device, does not directly perform laser emission even when the laser emission trigger is detected, but links an image capturing device, and determines whether the laser device needs to be controlled to emit a laser signal currently according to a current image output frame rate N and a laser emission frequency M of the laser device by the image capturing device. As to how to determine whether the laser device needs to be controlled to emit the laser signal currently according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device, which will be described in the following by way of example, and will not be described herein again.
Step 202, on the premise that it is determined that the laser device needs to be controlled to emit the laser signal currently, the laser enable signal is sent through the communication connection established between the image acquisition device and the laser device, so that the laser device emits the laser signal after detecting the laser enable signal.
In this embodiment, a laser device in laser surgery, such as a holmium laser device, emits laser light after detecting the laser enable signal.
It should be noted that, this step 202 is executed on the premise that an exposure completion event is detected, based on this premise, the time for laser equipment in laser surgery, such as holmium laser equipment, to emit laser is within the above Readout time, and the laser is certainly not excited in the exposure process, so that the image exposure and the excitation of the laser are misaligned, and the generated current frame image does not generate a laser delamination phenomenon caused by the laser excitation.
Thus, the flow shown in fig. 2 is completed.
As can be seen from the flow shown in fig. 2, in this embodiment, communication is established between an image acquisition device in the laser surgery, such as an endoscope camera system, and a laser device, such as a holmium laser device, to cooperatively control the timing of laser excitation of the laser device, so as to control the time of laser emitted by the laser device in the laser surgery, such as the holmium laser device, to be within the Readout time, so as to avoid laser excitation by the laser device in the image exposure process, and finally, to avoid (or make misalignment between) image exposure and laser excitation, so as to ensure that the generated current frame image does not generate a laser delamination phenomenon caused by laser excitation, and further eliminate the laser delamination phenomenon in the acquired current frame image, eliminate visual obstruction of a doctor, and provide a good surgical impression.
How to determine whether the laser device needs to be controlled to emit the laser signal currently or not according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device in the above step 201 is described as follows:
referring to fig. 4, fig. 4 is a flowchart of step 201 implementation provided in an embodiment of the present application. As shown in fig. 4, the process may include the following steps:
step 401, determining an image frame-laser association relationship according to a current image output frame rate N of the image acquisition device and a laser emission frequency M of the laser device.
In this embodiment, the image frame-laser association relationship is used to indicate that the image capturing device needs to control the laser device to emit the laser signal n times every time m image frames are captured.
As an embodiment, there are many implementation ways to determine the image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device, for example: calculating the maximum common factors of M and N, and dividing the numerator and the denominator in M/N by the maximum common factors respectively to obtain M/N, wherein M is greater than N, and N is greater than or equal to 1; and determining the image frame-laser association relation according to the m/n. If N is 30 and m is 20, N is 3 and m is 2, which means that the laser is fired 2 times every 3 frames, i.e. the image capturing device needs to generate the above laser enable signal for 2 frames of images in every 3 frames of images captured.
Step 402, determining whether the laser device needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation.
As an embodiment, there are many implementations for determining whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship, such as: acquiring a first laser excitation signal sent by the laser equipment through the communication connection on the premise that the current image output frame rate of the image acquisition equipment is N and the laser emission frequency of the laser equipment is M; taking the image frame collected after receiving the first laser excitation signal as a first frame; and determining whether the laser equipment needs to be controlled to emit laser signals at present or not from the first frame according to the image frame-laser association relation.
Optionally, the determining, from the first frame, whether the laser device needs to be controlled to emit the laser signal at present according to the image frame-laser association relationship has a plurality of implementation manners, for example, detecting a frame number K of a target image frame corresponding to the exposure completion event; the frame number K is counted from the first frame; determining the current control period according to K; if K is larger than or equal to n, rounding K/n to obtain a calculation result p, and determining that the current control period is the (p + 1) th control period, wherein p is larger than or equal to 1; if K is smaller than n, determining that the current control period is the 1 st control period; and determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation and the sequence of the current image frame in the current control period.
Here, it is determined whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship and the sequence of the current image frame in the current control period, such as: if the laser is determined to be emitted or not according to the sequence in each control period, if the sequence number of the current image frame in the current control period is less than or equal to m, the laser device is determined to be required to be controlled to emit the laser signal, otherwise, the laser device is determined not to be required to be controlled to emit the laser signal currently. For example, the image frame-laser association relationship indicates that laser is excited every 3 frames for 2 times, and if the current image frame is the second frame image in the current control period, it may be determined that the laser device needs to be controlled to emit a laser signal currently based on the image frame-laser association relationship (indicating that laser is excited every 3 frames for 2 times); and if the current image frame is the 3 rd image in the current control period, because the previous two frames already determine that the laser device needs to be controlled to emit the laser signal, then based on the image frame-laser association relationship (indicating that the laser is excited for 2 times every 3 frames), it can be determined that the laser device does not need to be controlled to emit the laser signal currently. It should be noted that the present invention is by way of example only and is not limited thereto.
The flow shown in fig. 4 is completed.
Through the process shown in fig. 4, it is realized how to determine whether the laser device needs to be controlled to emit the laser signal currently according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device.
It should be noted that, in the present embodiment, as described above, the laser apparatus in laser surgery detects the laser stop trigger after detecting the laser emission trigger. Once the laser stop trigger is detected, an excitation termination signal is sent to the image acquisition device through the connection. And the image acquisition equipment finishes the control of the laser emitted by the laser equipment on the premise of detecting the laser termination signal sent by the laser equipment through the communication connection.
The above is the method provided by the embodiments of the present application described in terms of an image capturing device such as an endoscopic imaging system standing in laser surgery, and the following is the method provided by the embodiments of the present application described in terms of a laser device such as a holmium laser device standing in laser surgery:
referring to fig. 5, fig. 5 is a flow chart of another method provided by the embodiments of the present application. The method is applied to laser equipment in laser surgery, such as holmium laser equipment, and the laser equipment is in communication connection with image acquisition equipment used for acquiring images in the laser surgery, such as an endoscope imaging system.
As shown in fig. 5, the process may include the following steps:
step 501, receiving a laser enable signal sent by an image acquisition device through a communication connection established between the image acquisition device and a laser device.
In this embodiment, the sending of the laser enable signal by the image capturing device is determined based on the flow shown in fig. 2, for example, when it is determined that the laser device needs to be controlled to send the laser signal currently according to the current image output frame rate N of the image capturing device and the holmium laser emission frequency M of the laser device when the exposure completion event is detected, the laser enable signal is sent to the laser device through the communication connection, which is specifically shown in the flow shown in fig. 2.
Step 502, emitting a laser signal based on a laser enable signal.
When the laser equipment receives the laser enable signal, a laser signal is emitted once based on the laser enable signal.
As can be known from the above-described laser enable signal, in this embodiment, the image capturing device in the laser surgery, such as an endoscope camera system, and the like, establishes communication with the laser device, such as a holmium laser device, and the like, to control the timing of laser excitation of the laser device in the laser surgery in a linkage manner, so as to control the time of the laser emitted by the laser device in the laser surgery, such as the holmium laser device, to be within the Readout time, so as to avoid laser excitation by the laser device in the image exposure process, and finally, to avoid (or make a misalignment between) image exposure and laser excitation, so as to ensure that the generated current frame image does not generate a laser delamination phenomenon caused by laser excitation, thereby eliminating the laser delamination phenomenon in the acquired current frame image, eliminating a visual obstruction of a doctor, and providing a good surgical impression.
The flow shown in fig. 5 is completed.
The method provided by the embodiment of the present application is described above, and the system and the apparatus provided by the embodiment of the present application are described below:
referring to fig. 6, fig. 6 is a system structure diagram provided in the embodiment of the present application. The system comprises: image acquisition equipment and laser equipment in laser surgery; the image acquisition equipment and the laser equipment are in communication connection;
the image acquisition device performs the steps in the flow as shown in fig. 2.
The laser device performs the steps in the flow chart shown in fig. 5.
Thus, the description of the structure of the system shown in fig. 6 is completed.
Referring to fig. 7, fig. 7 is a structural diagram of an apparatus provided in the embodiment of the present application. The device is used for image acquisition equipment in laser surgery; the image acquisition equipment has established communication connection with the laser equipment in the laser operation, and the device includes:
the determining unit is used for determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment under the condition that an exposure completion event is detected;
and the control unit is used for sending a laser enabling signal through the communication connection established between the image acquisition equipment and the laser equipment on the premise of determining that the laser equipment is required to be controlled to emit the laser signal at present, so that the laser equipment emits the laser signal after detecting the laser enabling signal.
Optionally, the determining, according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device, whether the laser device needs to be controlled to emit a laser signal currently includes: determining an image frame-laser association relation according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment; the image frame-laser association relation is used for indicating that the laser equipment needs to be controlled to emit laser signals for n times when the image acquisition equipment acquires m image frames; determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation;
optionally, the determining an image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device includes: calculating the maximum common factors of M and N, and dividing the numerator and the denominator in M/N by the maximum common factors respectively to obtain M/N, wherein M is greater than N, and N is greater than or equal to 1; determining the image frame-laser association relation according to the m/n;
optionally, the determining whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship includes: on the premise that the current image output frame rate of the image acquisition equipment is N and the laser emission frequency of the laser equipment is M, obtaining a first holmium laser excitation signal sent by the laser equipment through the communication connection; taking the image frame collected after receiving the first holmium laser excitation signal as a first frame; determining whether the laser equipment needs to be controlled to emit laser signals at present or not according to the image frame-laser association relation from the first frame;
optionally, the determining, starting from the first frame, whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship includes: detecting a frame number K of a current image frame corresponding to the exposure completion event; the frame number K is counted from the first frame; determining the current control period according to the K; if K is larger than or equal to n, rounding K/n to obtain a calculation result p, and determining that the current control period is the (p + 1) th control period, wherein p is larger than or equal to 1; if K is smaller than n, determining that the current control period is the 1 st control period; determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation and the sequence of the current image frame in the current control period;
optionally, the determining unit performs detection of an exposure completion event on the premise of detecting a laser excitation signal sent by the laser device through the communication connection; or,
and the control unit finishes the control of the laser emitted by the laser equipment on the premise of detecting the laser termination signal sent by the laser equipment through the communication connection.
Thus, the description of the structure of the apparatus shown in fig. 7 is completed.
Referring to fig. 8, fig. 8 is a structural diagram of another apparatus according to an embodiment of the present disclosure. The device is applied to the laser equipment in the laser operation, has established communication connection between the image acquisition equipment in laser operation and the laser equipment, and the device includes:
the receiving unit is used for receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that under the condition that an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
a transmitting unit for transmitting a laser signal based on the laser enable signal.
Thus, the description of the structure of the apparatus shown in fig. 8 is completed.
The embodiment of the application also provides a hardware structure of the device shown in fig. 7 or 8. Referring to fig. 9, fig. 9 is a structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 9, the hardware structure may include: a processor and a machine-readable storage medium having stored thereon machine-executable instructions executable by the processor; the processor is configured to execute machine-executable instructions to implement the methods disclosed in the above examples of the present application.
Based on the same application concept as the method, embodiments of the present application further provide a machine-readable storage medium, where several computer instructions are stored, and when the computer instructions are executed by a processor, the method disclosed in the above example of the present application can be implemented.
The machine-readable storage medium may be, for example, any electronic, magnetic, optical, or other physical storage device that can contain or store information such as executable instructions, data, and the like. For example, the machine-readable storage medium may be: a RAM (random Access Memory), a volatile Memory, a non-volatile Memory, a flash Memory, a storage drive (e.g., a hard drive), a solid state drive, any type of storage disk (e.g., an optical disk, a dvd, etc.), or similar storage medium, or a combination thereof.
The systems, devices, modules or units illustrated in the above embodiments may be specifically implemented by a computer processor or an entity, or by an article of manufacture with certain functionality. A typical implementation device is a computer, which may be in the form of a personal computer, laptop, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email messaging device, game console, tablet computer, wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Furthermore, these computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (12)

1. An image processing method for eliminating laser stratification is characterized in that the method is used for an image acquisition device in laser surgery; the image acquisition equipment and the laser equipment in the laser operation establish communication connection, and the method comprises the following steps:
under the condition that an exposure completion event is detected, determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment;
on the premise that the fact that the laser equipment needs to be controlled to emit laser signals at present is determined, the communication connection established between the image acquisition equipment and the laser equipment is used for sending laser enabling signals, and therefore the laser equipment emits the laser signals after detecting the laser enabling signals.
2. The method according to claim 1, wherein the determining whether the laser device needs to be controlled to emit the laser signal currently according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device comprises:
determining an image frame-laser association relation according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment; the image frame-laser association relation is used for indicating that the laser equipment needs to be controlled to emit laser signals for n times when the image acquisition equipment acquires m image frames;
and determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation.
3. The method according to claim 2, wherein the determining an image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device comprises:
calculating the maximum common factors of M and N, and dividing the numerator and the denominator in M/N by the maximum common factors respectively to obtain M/N, wherein M is greater than N, and N is greater than or equal to 1;
and determining the image frame-laser association relation according to the m/n.
4. The method of claim 2, wherein the determining whether the laser device is currently required to be controlled to emit laser signals according to the image frame-laser association comprises:
on the premise that the current image output frame rate of the image acquisition equipment is N and the laser emission frequency of the laser equipment is M, obtaining a first holmium laser excitation signal sent by the laser equipment through the communication connection;
taking the image frame collected after receiving the first holmium laser excitation signal as a first frame;
and determining whether the laser equipment needs to be controlled to emit laser signals at present or not according to the image frame-laser association relation from the first frame.
5. The method of claim 4, wherein the determining whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relationship from the first frame comprises:
detecting a frame number K of a current image frame corresponding to the exposure completion event; the frame number K is counted from the first frame;
determining the current control period according to the K; if K is larger than or equal to n, rounding K/n to obtain a calculation result p, and determining that the current control period is the (p + 1) th control period, wherein p is larger than or equal to 1; if K is smaller than n, determining that the current control period is the 1 st control period;
and determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation and the sequence of the current image frame in the current control period.
6. The method of claim 1, further comprising:
on the premise that a laser excitation signal sent by the laser equipment through the communication connection is detected, the method is executed; or,
and on the premise of detecting a laser termination signal sent by the laser equipment through the communication connection, ending the control of the laser emission of the laser equipment.
7. An image processing method for eliminating laser stratification is applied to laser equipment in laser surgery, communication connection is established between the laser equipment and image acquisition equipment in the laser surgery, and the method comprises the following steps:
receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that under the condition that an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
and emitting a laser signal based on the laser enable signal.
8. An image processing system for eliminating laser delamination, the system comprising:
image acquisition equipment and laser equipment in laser surgery; the image acquisition equipment and the laser equipment are in communication connection;
the image acquisition device performs the method of any one of claims 1 to 6;
the laser apparatus performs the method of claim 7.
9. An image processing device for eliminating laser delamination is characterized in that the device is used for an image acquisition device in laser surgery; the image acquisition equipment has established communication connection with the laser equipment in the laser operation, and the device includes:
the determining unit is used for determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment under the condition that an exposure completion event is detected;
and the control unit is used for sending a laser enabling signal through the communication connection established between the image acquisition equipment and the laser equipment on the premise of determining that the laser equipment is required to be controlled to emit the laser signal at present, so that the laser equipment emits the laser signal after detecting the laser enabling signal.
10. The apparatus according to claim 9, wherein the determining whether the laser device needs to be controlled to emit the laser signal currently according to the current image output frame rate N of the image capturing device and the laser emission frequency M of the laser device comprises: determining an image frame-laser association relation according to the current image output frame rate N of the image acquisition equipment and the laser emission frequency M of the laser equipment; the image frame-laser association relation is used for indicating that the laser equipment needs to be controlled to emit laser signals for n times when the image acquisition equipment acquires m image frames; determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation;
determining an image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device includes: calculating the maximum common factors of M and N, and dividing the numerator and the denominator in M/N by the maximum common factors respectively to obtain M/N, wherein M is greater than N, and N is greater than or equal to 1; determining the image frame-laser association relation according to the m/n;
the determining whether the laser device needs to be controlled to emit the laser signal currently according to the image frame-laser association relation includes: acquiring a first holmium laser excitation signal sent by the laser device through the communication connection on the premise that the current image output frame rate of the image acquisition device is N and the laser emission frequency of the laser device is M; taking an image frame acquired after the first holmium laser excitation signal is received as a first frame; determining whether the laser equipment needs to be controlled to emit laser signals at present or not according to the image frame-laser association relation from the first frame;
the determining whether the laser device needs to be controlled to emit the laser signal at present according to the image frame-laser association relationship from the first frame comprises: detecting a frame number K of a current image frame corresponding to the exposure completion event; the frame number K is counted from the first frame; determining the current control period according to the K; if K is larger than or equal to n, rounding K/n to obtain a calculation result p, and determining that the current control period is the (p + 1) th control period, wherein p is larger than or equal to 1; if K is smaller than n, determining that the current control period is the 1 st control period; determining whether the laser equipment needs to be controlled to emit laser signals currently or not according to the image frame-laser association relation and the sequence of the current image frame in the current control period;
the determining unit executes detection of an exposure completion event on the premise of detecting a laser excitation signal sent by the laser device through the communication connection; or,
and the control unit finishes the control of the laser emitted by the laser equipment on the premise of detecting the laser termination signal sent by the laser equipment through the communication connection.
11. An image processing device for eliminating laser stratification, which is applied to a laser device in laser surgery, wherein a communication connection is established between the laser device and an image acquisition device in laser surgery, and the device comprises:
the receiving unit is used for receiving a laser enabling signal sent by the image acquisition equipment through the communication connection established between the image acquisition equipment and the laser equipment; the method comprises the steps that under the condition that an exposure completion event is detected by the image acquisition equipment, whether the laser equipment needs to be controlled to emit laser signals currently or not is determined according to the current image output frame rate N of the image acquisition equipment and the holmium laser emission frequency M of the laser equipment, and when the laser equipment needs to be controlled to emit the laser signals currently, laser enabling signals are sent to the laser equipment through the communication connection;
a transmitting unit for transmitting a laser signal based on the laser enable signal.
12. An electronic device, comprising: a processor and a machine-readable storage medium;
the machine-readable storage medium stores machine-executable instructions executable by the processor;
the processor is configured to execute machine executable instructions to implement the method steps of any of claims 1-7.
CN202211616763.XA 2022-12-15 2022-12-15 Image processing method, system and device for eliminating laser layering Pending CN115988325A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211616763.XA CN115988325A (en) 2022-12-15 2022-12-15 Image processing method, system and device for eliminating laser layering

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211616763.XA CN115988325A (en) 2022-12-15 2022-12-15 Image processing method, system and device for eliminating laser layering

Publications (1)

Publication Number Publication Date
CN115988325A true CN115988325A (en) 2023-04-18

Family

ID=85958813

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211616763.XA Pending CN115988325A (en) 2022-12-15 2022-12-15 Image processing method, system and device for eliminating laser layering

Country Status (1)

Country Link
CN (1) CN115988325A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090290607A1 (en) * 2008-05-23 2009-11-26 Beijing Institute Of Opto-Electronic Technology Signal processing device for controlling laser output and device for observing laser action process
WO2019040036A1 (en) * 2017-08-24 2019-02-28 Bae Systems Information And Electronic Systems Integration Inc. Laser spot contrast enhancement
WO2020238569A1 (en) * 2019-05-30 2020-12-03 Oppo广东移动通信有限公司 Control method and control device for terminal, terminal, and computer readable storage medium
CN112642064A (en) * 2020-12-22 2021-04-13 沈阳雷卓激光医疗器械有限公司 Laser gap emission method and device
US20210145295A1 (en) * 2017-05-16 2021-05-20 Sony Corporation Image processing apparatus and method and image processing system
CN114441418A (en) * 2022-01-28 2022-05-06 天津凌视科技有限公司 Imaging system, imaging method and readable storage medium for high-speed flowing particles
CN115379130A (en) * 2022-08-25 2022-11-22 上海联影医疗科技股份有限公司 Automatic exposure control system, method, device and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090290607A1 (en) * 2008-05-23 2009-11-26 Beijing Institute Of Opto-Electronic Technology Signal processing device for controlling laser output and device for observing laser action process
US20210145295A1 (en) * 2017-05-16 2021-05-20 Sony Corporation Image processing apparatus and method and image processing system
WO2019040036A1 (en) * 2017-08-24 2019-02-28 Bae Systems Information And Electronic Systems Integration Inc. Laser spot contrast enhancement
WO2020238569A1 (en) * 2019-05-30 2020-12-03 Oppo广东移动通信有限公司 Control method and control device for terminal, terminal, and computer readable storage medium
CN112642064A (en) * 2020-12-22 2021-04-13 沈阳雷卓激光医疗器械有限公司 Laser gap emission method and device
CN114441418A (en) * 2022-01-28 2022-05-06 天津凌视科技有限公司 Imaging system, imaging method and readable storage medium for high-speed flowing particles
CN115379130A (en) * 2022-08-25 2022-11-22 上海联影医疗科技股份有限公司 Automatic exposure control system, method, device and storage medium

Similar Documents

Publication Publication Date Title
US9451150B2 (en) Image capturing apparatus comprising focus detection, and method for controlling the same
JP4731698B2 (en) Image processing apparatus, photographing apparatus, image processing system, image processing method, and storage medium
US20080074529A1 (en) Imaging apparatus, control method of imaging apparatus, and computer program
CN108062763B (en) Target tracking method and device and storage medium
EP2757771A2 (en) Image pickup apparatus, remote control apparatus, and methods of controlling image pickup apparatus and remote control apparatus
EP3053510A1 (en) Data reception device, capsule endoscope system, data reception method, and program
US9757086B2 (en) Radiation imaging system, control method therefor, and storage medium having stored thereon a program for executing the control method
US20130002830A1 (en) Stereoscopic imaging device and method for automatically adjusting the focal point of a stereoscopic imaging device
US11134205B2 (en) Control apparatus, radiographic imaging system, control method, and recording medium
CN110520050A (en) Radiation imaging system, radiation imaging apparatus, radioactive ray imaging method and program
JP2016134723A (en) Imaging apparatus, imaging method and imaging operation control program
JP2004233664A (en) Microscopic image acquisition device and method therefor
JP2010039284A (en) Image pick-up apparatus and control method therefor
CN106054350A (en) Optical apparatus, display controlling method, and display controlling program
CN105549299B (en) Control method, control device and electronic device
JP5977907B1 (en) Capsule endoscope and capsule endoscope system
US11092698B2 (en) Radiation imaging system, imaging apparatus, control apparatus, and methods of controlling the same
JP2009055125A (en) Imaging apparatus and its control method
CN108652653B (en) Method and device for shooting medical image, medical image system and storage medium
CN115988325A (en) Image processing method, system and device for eliminating laser layering
CN111357278A (en) Image processing method, image processing apparatus, image capturing apparatus, and storage medium
JP2016097195A (en) Radiographic system and control method thereof
JP2019184710A (en) Imaging device, light emission control method of the same and program thereof
JP5029573B2 (en) Imaging apparatus and imaging method
US8634018B2 (en) Image pickup apparatus and control method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination