Disclosure of Invention
Aiming at the defects, the embodiment of the invention discloses an OCT image display adjustment method, which can provide corresponding display mark information for a user to refer to and use, and improve the whole image viewing efficiency.
The first aspect of the embodiment of the invention discloses a method for displaying and adjusting an OCT image, which comprises the following steps:
sending a control signal to a driving motor to drive the OCT probe to rotate, and receiving a detection signal at the driving motor in the rotating process;
acquiring an OCT image captured by an OCT imaging device;
determining the working state of the laser according to the detection signal, and controlling the laser to emit a display mark to the surface of the detection cavity when the laser is in the working state;
acquiring an endoscopic image within a detection lumen captured by an endoscopic device, the endoscopic image including display marker information.
As an alternative implementation, in the first aspect of the embodiment of the present invention, after the acquiring an endoscopic image inside a detection lumen captured by an endoscopic apparatus, the endoscopic image including display marker information, the method further includes:
and performing rotation operation on the endoscope image or the OCT image according to the display mark information.
As an alternative implementation, in the first aspect of the embodiment of the present invention, the performing a rotation operation on the endoscope image or the OCT image according to the display mark information includes:
determining corresponding angle information according to the display mark information;
and performing rotation operation on the endoscope image or the OCT image according to the angle information so as to enable the image display orientations of the endoscope image and the OCT image to be consistent.
As an alternative implementation, in the first aspect of the embodiment of the present invention, the receiving a detection signal at the driving motor during the rotation includes:
receiving a starting level signal and a terminating level signal detected by a photoelectric sensor at a driving motor in the rotating process;
the determining the working state of the laser according to the detection signal comprises:
controlling the laser to work according to the initial level signal;
and controlling the laser to stop working according to the termination level signal so as to form a ring-shaped display mark in the detection cavity.
As an alternative implementation, in the first aspect of the embodiment of the present invention, the receiving a detection signal at the driving motor during the rotation includes:
receiving a starting level signal and a terminating level signal detected by a photoelectric sensor at a driving motor in the rotating process;
the determining the working state of the laser according to the detection signal comprises:
controlling a laser to increase or decrease irradiation brightness at a starting point and an end point according to the starting level signal and the end level signal, wherein the display marks comprise annular display marks and point display marks; or the like, or, alternatively,
and controlling the laser to perform irradiation operation at a starting point and an end point according to the starting level signal and the end level signal, wherein the display mark is a point display mark.
The second aspect of the embodiments of the present invention discloses a system for displaying and adjusting an OCT image, including:
the endoscope device comprises an endoscope body, an endoscope light source, an endoscope lens and an image display module, wherein the endoscope lens is electrically connected with the image display module, and the image display module is used for displaying images transmitted back by the endoscope lens;
the OCT imaging device comprises an OCT optical host, a driving motor and an OCT probe, wherein the OCT probe, the driving motor and the OCT optical host are electrically connected, the driving motor is used for driving the OCT probe to rotate, and a photoelectric sensor is further arranged at the driving motor to detect the zero position of the driving motor;
the laser device is connected with the laser device driving circuit, the laser device driving circuit is electrically connected with the photoelectric sensor, and the laser device emits laser to the OCT probe.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the OCT imaging apparatus further includes an optical fiber combiner, and the light exit end of the laser is connected to the OCT probe sequentially through the optical fiber and the optical fiber combiner;
and/or the optical fiber combiner comprises an optical fiber coupler or a wavelength division multiplexer;
and/or the endoscope body comprises a light source channel, a lens channel and a working channel, the endoscope light source is arranged in the light source channel, the endoscope lens is arranged in the lens channel, and the OCT probe extends into the detection cavity channel through the working channel.
A third aspect of an embodiment of the present invention discloses an electronic device, including: a memory storing executable program code; a processor coupled with the memory; the processor calls the executable program code stored in the memory for executing the method for adjusting the display of the OCT image disclosed in the first aspect of the embodiment of the present invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, where the computer program causes a computer to execute the method for OCT image display adjustment disclosed in the first aspect of the embodiments of the present invention.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
according to the OCT image display adjustment method in the embodiment of the invention, the laser is associated with the driving motor, so that when the driving motor works, the laser is simultaneously turned on to form corresponding display mark information in the detection cavity; the display mark information assists the user to quickly identify and position the image.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first", "second", "third", "fourth", and the like in the description and the claims of the present invention are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
At present, when the two images are observed in a combined manner, a certain random angle deviation exists, namely, a certain random angle difference exists between an endoscope display image and an OCT display image, so that great inconvenience is brought to observation of a user, and the user can expend more energy on image correspondence. Based on the above, the embodiment of the invention discloses an OCT image display adjustment method, an OCT image display adjustment device, an electronic device and a storage medium, wherein a laser and a driving motor are associated, so that when the driving motor works, the laser is simultaneously turned on to form corresponding display mark information in a detection cavity; the display mark information assists the user to quickly identify and position the image.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart of an OCT image display adjustment method according to an embodiment of the present invention. The execution main body of the method described in the embodiment of the present invention is an execution main body composed of software or/and hardware, and the execution main body can receive related information in a wired or/and wireless manner and can send a certain instruction. Of course, it may also have certain processing and storage functions. The execution body may control a plurality of devices, such as a remote physical server or a cloud server and related software, or may be a local host or a server and related software for performing related operations on a device installed somewhere. In some scenarios, multiple storage devices may also be controlled, which may be co-located with the device or located in a different location. As shown in fig. 1, the method for OCT image display adjustment includes the following steps:
s101: sending a control signal to a driving motor to drive the OCT probe to rotate, and receiving a detection signal at the driving motor in the rotating process;
s102: acquiring an OCT image captured by an OCT imaging device;
s103: determining the working state of the laser according to the detection signal, and controlling the laser to emit a display mark to the surface of the detection cavity when the laser is in the working state;
s104: acquiring an endoscopic image within a detection lumen captured by an endoscopic device, the endoscopic image including display marker information.
When image acquisition is carried out, only endoscope images and OCT images are obtained, and both images do not have corresponding display marks for carrying out correspondence; the user can only carry out image correspondence through the detected shape and other features, and further observe the specific situation of the lesion appearing in the image. In the embodiment of the invention, the starting signal and the stopping signal of the driving motor are associated with the laser, so that the laser starts to work when the driving motor drives the OCT probe to work; the display marker is provided to make the user aware of different detection orientations.
When the specific laser coupling setting is carried out, laser emitted by the laser is coupled to the OCT probe, and then the laser is emitted to the detection cavity through the OCT probe; since the laser is coupled to the OCT probe, the position irradiated by the laser is the position where the OCT image is displayed when the OCT probe is detected; the display mark irradiated by the laser assists the user to realize rapid image correspondence.
FIG. 4 is a schematic diagram showing an original OCT image disclosed in the embodiment of the present invention, as shown in FIG. 4, the starting point and the ending point of the image display are fixed every time the OCT image is scanned, but the angle is random because the OCT probe penetrates into the working channel of the endoscope, that is, the starting point and the ending point of the driving motor are random; the final imaging result is that the endoscope image and the OCT image have certain display angle deviation. And the user cannot directly know where in the endoscopic image the OCT image is the sectional image. Fig. 3 is a schematic view of an endoscope image with display mark information according to an embodiment of the present invention, as shown in fig. 3, a ring mark in the figure is a concrete embodiment of a display mark, and when the ring mark is specifically arranged, the ring mark may also be in a semicircular ring or a dot or other form, and the main purpose of the ring mark is to mark a position; and the user is made to know the current detection position by displaying the circular scanning track.
Although the scheme can assist the user to know the specific display position, when observation is carried out, certain angle deviation exists, namely, when bubbles in a lumen are detected, the directions appearing in an OCT image and an endoscope image are different; therefore, when the user searches for the corresponding information again, certain inconvenience exists. As an alternative implementation, in the first aspect of the embodiment of the present invention, after the acquiring an endoscopic image inside a detection lumen captured by an endoscopic apparatus, the endoscopic image including display marker information, the method further includes:
s105: and performing rotation operation on the endoscope image or the OCT image according to the display mark information.
Because the display mark information is detected, the start and stop points of the OCT probe driven by the driving motor can be determined, and the graph rotation operation is carried out according to the corresponding display mark information; the rotated image is shown in fig. 5, and the user can better correspond the image as shown in fig. 3 and 5. When the rotation operation is performed, there are two different ways, one is to provide a rotation interface for a user to enable the user to perform the rotation operation by himself, and the other is to perform the rotation operation directly on the OCT image or the endoscope image by recognizing an angle. More preferably, in the embodiment of the present invention, the OCT image is rotated, and since the angle between the endoscope image and the actual observation angle is more consistent, and the OCT image has a certain deviation from the actual display position due to the scanning display problem, the OCT image is rotated in the embodiment of the present invention, so that the user can better observe the OCT image.
As an alternative implementation manner, in a first aspect of the embodiments of the present invention, fig. 2 is a schematic flowchart of an image rotation operation disclosed in the embodiments of the present invention, and as shown in fig. 2, the performing a rotation operation on an endoscope image or an OCT image according to the display mark information includes:
s1051: determining corresponding angle information according to the display mark information;
s1052: and performing rotation operation on the endoscope image or the OCT image according to the angle information so as to enable the image display orientations of the endoscope image and the OCT image to be consistent.
The confirmation of the angle information can be realized in various ways: one is to provide an angle detection tool, such as a protractor, on the rotation operation page, to detect the angle by rotating the detection line of the protractor; then, when the corresponding angle information is determined, the equipment can automatically rotate the image; still another way is an image recognition way, when the orientation of the displayed mark point is detected, by constructing a rectangular coordinate system, then determining the position of the point in the rectangular coordinate system, and then calculating to obtain the corresponding angle information. When the angle is known, the apparatus can directly perform a rotation operation on the image to obtain an OCT image in accordance with the endoscope image display angle.
In embodiments of the present invention, the display marking information may take a number of different forms: the first is an annular display mark, since laser is coupled to the OCT probe, the laser is consistent with light emitted by the OCT probe, so that a laser irradiation region is also a detection region of the OCT probe, and a user can directly know a current detection position by displaying an annular scanning track; the second is to display the mark points, so that the detection position can be displayed on one hand, and the rotation start and stop points of the driving motor can be displayed on the other hand; thirdly, a mode of combining a ring shape and a mark point is adopted; as shown in fig. 3, two combined modes are actually adopted, the specific position of detection can be more clearly known to the user by displaying the circular scanning track, and the angular deviation of the image can be more clearly known to the user by displaying the position of the point.
As an alternative implementation, in the first aspect of the embodiment of the present invention, the receiving a detection signal at the driving motor during the rotation includes:
receiving a starting level signal and a terminating level signal detected by a photoelectric sensor at a driving motor in the rotating process;
the determining the working state of the laser according to the detection signal comprises:
controlling the laser to work according to the initial level signal;
and controlling the laser to stop working according to the termination level signal so as to form a ring-shaped display mark in the detection cavity.
The specific control logic for forming the annular display mark controls whether to turn on the red laser according to the starting and stopping signal of the photoelectric sensor.
As an alternative implementation, in the first aspect of the embodiment of the present invention, the receiving a detection signal at the driving motor during the rotation includes:
receiving a starting level signal and a terminating level signal detected by a photoelectric sensor at a driving motor in the rotating process;
the determining the working state of the laser according to the detection signal comprises:
controlling a laser to improve the irradiation brightness at a starting point and an end point according to the starting level signal and the end level signal, wherein the display marks comprise annular display marks and point display marks; or the like, or, alternatively,
and controlling the laser to perform irradiation operation at a starting point and an end point according to the starting level signal and the end level signal, wherein the display mark is a point display mark.
The photoelectric sensor mentioned in the embodiment of the present invention: it determines the zero position when the motor rotates one circle; the zero position determines the angle of an image, and the red laser driving circuit can control the red laser to emit light according to the level signal of the photoelectric sensor so as to realize the display of the initial position of red light;
fig. 3 is a schematic view of an endoscope image with display mark information according to an embodiment of the present invention, as shown in fig. 3, a ring mark in the figure is a concrete embodiment of a display mark, and when the ring mark is specifically arranged, the ring mark may also be in a semicircular ring or a dot or other form, and the main purpose of the ring mark is to mark a position; the user is made to know the current detection position by displaying the circular scanning track; and displaying the initial position of the OCT image, so that the client can correspond to the image of the endoscope according to the initial position of the OCT image.
According to the OCT image display adjustment method in the embodiment of the invention, the laser is associated with the driving motor, so that when the driving motor works, the laser is simultaneously turned on to form corresponding display mark information in the detection cavity; the display mark information assists the user to quickly identify and position the image.
Example two
Fig. 6 is a schematic structural diagram of an OCT image display adjustment system disclosed in an embodiment of the present invention, fig. 7 is a schematic structural diagram of a driving motor disclosed in an embodiment of the present invention, and as shown in fig. 6 and 7, an embodiment of the present invention provides an OCT image display adjustment system, including:
the endoscope device comprises an endoscope body 1, an endoscope light source, an endoscope lens and an image display module, wherein the endoscope lens is electrically connected with the image display module, and the image display module is used for displaying images transmitted back by the endoscope lens;
the OCT imaging device comprises an OCT optical host 2, a driving motor 3 and an OCT probe 4, wherein the OCT probe 4, the driving motor 3 and the OCT optical host 2 are electrically connected, the driving motor 3 is used for driving the OCT probe 4 to rotate, and a photoelectric sensor 31 is further arranged at the driving motor 3 for detecting the zero position of the driving motor 3;
the laser device 5 is connected with the laser device driving circuit 51, the laser device driving circuit 51 is electrically connected with the photoelectric sensor 31, and the laser device 5 emits laser 52 to the OCT probe 4.
The photosensor 31 mentioned in the embodiment of the present invention: it determines the zero position when the motor rotates one circle; the zero position determines the angle of the image, and the red laser driving circuit 51 can control the light emission of the red laser 5 according to the level signal of the photoelectric sensor 31 to realize the display of the initial position of the red light. Since the photoelectric sensor 31 is arranged in association with the laser driving circuit 51, when the driving motor 3 is detected to work and the laser is controlled to work, the laser 52 emitted by the laser 5 is coupled to the OCT probe 4 through the optical fiber 8, so that the laser can be emitted through the OCT probe 4; the driving motor 3 controls and realizes the rotation of the OCT probe 4, so that the effect of scanning one frame of picture by rotating one circle can be realized.
More preferably, the OCT imaging apparatus further includes an optical fiber combiner 6, and the light output end of the laser is connected to the OCT probe 4 sequentially through the optical fiber 8 and the optical fiber combiner 6;
the light emitted from the laser is coupled with the optical fiber combiner 6 through the optical fiber 8, so that the laser can be better transmitted to the OCT probe 4. The optical fiber combiner 6 in the embodiment of the present invention includes an optical fiber coupler and a wavelength division multiplexer.
FIG. 8 is a schematic cross-sectional view of an endoscope body as disclosed in embodiments of the present invention; as shown in fig. 8, the endoscope body 1 disclosed in the embodiment of the present invention includes a light source channel 11, a lens channel 12, and a working channel 13, the endoscope light source is disposed in the light source channel 11, the endoscope lens is disposed in the lens channel 12, and the OCT probe 4 extends into the detection cavity 7 through the working channel 13.
Each time when OCT image scanning is carried out, the starting point and the ending point of image display are fixed, but because the OCT probe 4 penetrates into the endoscope working channel 13, the angle is random, namely the starting point and the ending point of the driving motor 3 are random; the final imaging result is that the endoscope image and the OCT image have certain display angle deviation. And the user cannot directly know where in the endoscopic image the OCT image is the sectional image.
FIG. 9 is a schematic illustration of detection in a detection channel according to an embodiment of the disclosure; as shown in fig. 9, when a specific laser coupling setting is performed, laser emitted by the laser is coupled to the OCT probe 4, and then the OCT probe 4 emits the laser to the detection channel 7; since the laser is coupled to the OCT probe 4, the position irradiated by the laser is the position where the OCT image is displayed when the OCT probe 4 performs the detection; the display mark irradiated by the laser assists the user to realize rapid image correspondence. The driving motor 3 controls and realizes the rotation of the OCT probe 4, and the laser is coupled to the OCT probe 4, so the laser is synchronously emitted to the surface of the corresponding detection cavity 7 for display.
In the OCT image display adjustment method in the embodiment of the invention, the laser is associated with the driving motor 3, so that when the driving motor 3 works, the laser is simultaneously turned on to form corresponding display mark information in the detection cavity 7; the display mark information assists the user to quickly identify and position the image.
EXAMPLE III
Referring to fig. 10, fig. 10 is a schematic structural diagram of an apparatus for displaying and adjusting an OCT image according to an embodiment of the present invention. As shown in fig. 10, the apparatus for OCT image display adjustment may include:
the sending module 21: the OCT probe is used for sending a control signal to the driving motor to drive the OCT probe to rotate and receiving a detection signal at the driving motor in the rotating process;
the first acquisition module 22: the OCT imaging device is used for acquiring an OCT image shot by the OCT imaging device;
the state determination module 23: the laser device is used for determining the working state of the laser device according to the detection signal, and when the laser device is in the working state, the laser device is controlled to emit a display mark to the surface of the detection cavity;
the second acquisition module 24: the endoscope device is used for acquiring endoscope images in a detection cavity channel shot by the endoscope device, and the endoscope images comprise display mark information.
As an alternative implementation, in the first aspect of the embodiment of the present invention, after the acquiring an endoscopic image inside a detection lumen captured by an endoscopic apparatus, the endoscopic image including display marker information, the method further includes:
a rotating module: and the display mark information is used for performing rotation operation on the endoscope image or the OCT image according to the display mark information.
As an alternative implementation, in the first aspect of the embodiment of the present invention, the performing a rotation operation on the endoscope image or the OCT image according to the display mark information includes:
an angle determination module: the angle information module is used for determining corresponding angle information according to the display mark information;
rotating the operation module: and the controller is used for performing rotation operation on the endoscope image or the OCT image according to the angle information so as to enable the image display orientations of the endoscope image and the OCT image to be consistent.
As an alternative implementation, in the first aspect of the embodiment of the present invention, the receiving a detection signal at the driving motor during the rotation includes:
receiving a starting level signal and a terminating level signal detected by a photoelectric sensor at a driving motor in the rotating process;
the determining the working state of the laser according to the detection signal comprises:
controlling the laser to work according to the initial level signal;
and controlling the laser to stop working according to the termination level signal so as to form a ring-shaped display mark in the detection cavity.
As an alternative implementation, in the first aspect of the embodiment of the present invention, the receiving a detection signal at the driving motor during the rotation includes:
receiving a starting level signal and a terminating level signal detected by a photoelectric sensor at a driving motor in the rotating process;
the determining the working state of the laser according to the detection signal comprises:
controlling a laser to improve the irradiation brightness at a starting point and an end point according to the starting level signal and the end level signal, wherein the display marks comprise annular display marks and point display marks; or the like, or, alternatively,
and controlling the laser to perform irradiation operation at a starting point and an end point according to the starting level signal and the end level signal, wherein the display mark is a point display mark.
According to the OCT image display adjustment method in the embodiment of the invention, the laser is associated with the driving motor, so that when the driving motor works, the laser is simultaneously turned on to form corresponding display mark information in the detection cavity; the display mark information assists the user to quickly identify and position the image.
Example four
Referring to fig. 11, fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. The electronic device may be a computer, a server, or the like, and may also be an intelligent device such as a mobile phone, a tablet computer, a monitoring terminal, or the like, and an image acquisition device having a processing function. As shown in fig. 11, the electronic device may include:
a memory 510 storing executable program code;
a processor 520 coupled to the memory 510;
the processor 520 calls the executable program code stored in the memory 510 to perform part or all of the steps in the method for adjusting the OCT image display according to the first embodiment.
The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute part or all of the steps in the OCT image display adjustment method in the first embodiment.
The embodiment of the invention also discloses a computer program product, wherein when the computer program product runs on a computer, the computer is enabled to execute part or all of the steps in the method for adjusting the display of the OCT image in the first embodiment.
The embodiment of the invention also discloses an application publishing platform, wherein the application publishing platform is used for publishing a computer program product, and when the computer program product runs on a computer, the computer is enabled to execute part or all of the steps in the method for adjusting the display of the OCT image in the first embodiment.
In various embodiments of the present invention, it should be understood that the sequence numbers of the processes do not mean the execution sequence necessarily in order, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the method according to the embodiments of the present invention.
In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a from which B can be determined. It should also be understood, however, that determining B from a does not mean determining B from a alone, but may also be determined from a and/or other information.
Those of ordinary skill in the art will appreciate that some or all of the steps of the methods of the embodiments may be implemented by hardware instructions associated with a program, which may be stored in a computer-readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), a One-time Programmable Read-Only Memory (OTPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc Read-Only Memory (CD-ROM), or other Memory, a CD-ROM, or other disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The method, the apparatus, the electronic device and the storage medium for OCT image display adjustment disclosed in the embodiments of the present invention are described in detail above, and a specific example is applied in the present disclosure to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.