JP7253273B2 - Reproductive medical support system - Google Patents

Description

The present invention relates to a reproductive medical support system.

Currently, one out of six couples of reproductive age in developed countries is said to be infertile. In addition, 48% of infertile couples are attributed to male factors. Reproductive medicine for the treatment of male infertility includes microinsemination and intratesticular sperm retrieval, but the current situation is that sperm search and sorting in both treatments rely on human power.
In addition, there is a computer assisted semen analyzer (CASA) as a support tool already used in the field of reproductive medicine. Although this support tool can measure various parameters related to sperm, it does not directly support sperm searching and sorting work, and its work load reduction effect is limited. In addition, even from the viewpoint of widespread use of sperm motility analyzers, it is still difficult to say that they are sufficient.
By the way, examples of support tools related to assisted reproductive medicine that have already been disclosed in documents include those described in Patent Documents 1 and 2 below.

Patent Document 1 describes image analysis processing using a classifier trained by machine learning (artificial intelligence processing) for the purpose of classifying biological particles (including oocytes and sperm) in liquid samples. is disclosed.

In Patent Document 2, image analysis processing using a classifier trained by machine learning for the purpose of ranking or categorizing embryos (including fusion of unfertilized secondary oocytes and sperm) is disclosed.

JP 2016-505836 A JP 2016-509845 A

All of the prior arts exemplified above are still under development, have not been actually introduced into the field of reproductive medicine, and have not produced sufficient results in terms of supporting reproductive medicine. .

The present invention has been made in view of the above problems, and provides a reproductive medical support system that supports persons involved in reproductive medicine (in particular, embryologists who collect sperm).

According to the present invention, there is provided a reproductive medical support system for supporting inspection work on an inspection object containing sperm, wherein the display means displays a work screen including a first image showing an enlarged display of the inspection object. and an analysis means for acquiring image data in which an area wider than the area displayed on the work screen is captured as the first image, and performing image analysis processing on the image data, wherein the image The analysis processing includes discrimination processing for discriminating the sperm photographed in the video data and analysis processing for analyzing the sperm discriminated by the discrimination processing, and the display means discriminates by the discrimination processing. and a first additional display based on the analysis processing related to the sperm displayed in the display area of the first image; and a second additional display based on the analysis processing related to the sperm outside the display area of the first image within the display area of the work screen.

According to the above invention, in addition to the display (first additional display) indicating the analysis result of the sperm displayed in the image (first image) in which the inspection target is enlarged, the area displayed in the image Since a display (second additional display) showing the analysis results of the spermatozoa displayed in a wider area is also displayed, inspection work can be performed based on more useful information.

ADVANTAGE OF THE INVENTION According to this invention, the reproductive medical support system which supports the persons concerned (in particular, the embryocultivator who collects a spermatozoon) engaged in reproductive medical care is provided.

It is a specific example of an image obtained by enlarging and photographing a sample set during microinsemination. It is a specific example of an image obtained by enlarging and photographing a sample set with a high-definition camera relating to the sperm motility analyzer. 1 is a configuration diagram of a reproductive medical support system; FIG. FIG. 4 is a diagram showing a specific example of a work screen displayed on the display unit; FIG. 4 is a diagram showing a specific example of a work screen displayed on the display unit; FIG. 4 is a diagram showing a specific example of a work screen displayed on the display unit; It is a figure which shows the specific example of the work screen displayed on a monitor. It is a figure which shows the specific example of the work screen displayed on a monitor. It is a figure which shows the specific example of the work screen displayed on a monitor.

An embodiment (reproductive medical support system 100) of the present invention will be described below with reference to the drawings. In addition, in all the drawings, the same reference numerals are given to the same constituent elements, and the description thereof will be omitted as appropriate.

<Regarding Examination Work Supported by Reproductive Medicine Support System 100>
The inspection work to be supported by the reproductive medical support system 100 according to the present invention is not particularly limited as long as it relates to an inspection object containing sperm (hereinafter referred to as a specimen set). As a specific example, in the following description, (i) work related to microinsemination (motile sperm collection method) and (ii) work related to intratesticular sperm collection technology are supported by the reproductive medical support system 100 .

In microinsemination, a specimen set obtained by washing the ejaculated semen is observed under a microscope, one healthy motile sperm is selected from the specimen set and collected (motile sperm collection method), and the collected motile sperm It is reproductive medicine that artificially promotes fertilization by injecting directly into previously collected egg cells (cytoplasmic sperm injection method). Microinsemination is generally a therapeutic method performed in cases where insemination cannot be achieved even if in vitro fertilization is performed.
FIG. 1 is a specific example of an enlarged photographed image of a specimen set during microinsemination. The image was taken at a magnification of 400 times, and the magnification rate is the same as the general magnification rate at the time of microscopic insemination. Note that the magnifying power of the specimen set at the time of microinsemination may be lower than 400 times or higher than 400 times, and is not necessarily constant.

Intratesticular sperm retrieval involves surgically incising the scrotum, observing the seminiferous tubules in the testicles under a microscope, collecting relatively healthy seminiferous tubules, and then recovering sperm from the collected seminiferous tubules. reproductive medicine. Intratesticular sperm retrieval is generally a therapeutic method performed when sperm cannot be retrieved by the above motile sperm retrieval method.
When sperm is recovered from the seminiferous tubule in the intratesticular sperm retrieval technique, other cells (red blood cells and white blood cells) contained in the blood and tissue cells constituting the seminiferous tubule are included. Therefore, in testicular sperm retrieval, the number of spermatozoa contained in the specimen set is limited because the specimen set contains a large number of floating substances different from sperm, or the patient to be treated is azoospermia in most cases. It is different from the motile sperm collection method in that there are few motile sperm.

<About the sperm movement analyzer>
As described above, there is a computer assisted semen analyzer (CASA) as a device that assists examination work related to reproductive medicine.
The sperm motility analyzer captures images of the specimen set with a high-definition camera, automatically analyzes the health of the sperm contained in the specimen set (sperm number, motility, etc.) by image analysis processing, and displays and outputs the analysis results. Alternatively, by printing out, it is possible to reduce the burden of inspection and measurement on the embryologist.

FIG. 2 is a specific example of an image obtained by enlarging and photographing a sample set with a high-definition camera relating to the sperm motility analyzer. In addition, the said image was image|photographed with the phase-contrast microscope. In addition, the image is obtained by photographing a sample set different from the sample set related to the image of FIG. 1, and the number of contained spermatozoa is different.

Although the images were taken in different environments, a simple comparison cannot be made, but from the size of each individual sperm, the image in Fig. 2 was taken at a lower magnification than the image in Fig. 1. Recognize. Since the method for collecting motile sperm is intended to collect one sperm, it is preferable that the area within the field of view is relatively narrow. On the other hand, since the purpose of the sperm motility analysis apparatus is to perform analysis processing with high accuracy, it is preferable that the area to be analyzed (the area captured by the high-definition camera) be relatively wide. Since the objectives are different from each other in this way, the magnification rate in the sperm motility analyzer tends to be generally set lower than the magnification rate in the method for collecting motile spermatozoa.

<Regarding Configuration of Reproductive Medicine Support System 100>
In conventional examinations as described above, the operator's (embryologist's) field of view during the sperm collection operation does not necessarily match the display showing the analysis results of the sperm motility analyzer.
The reproductive medical support system 100 in this embodiment displays the analysis results of the sperm movement analysis device by applying augmented reality (AR) within the display area that fits in the field of view of the operator during the sperm collection work. It is intended to As a result, the burden on the operator can be reduced as compared with the conventional method.
The configuration of the reproductive medical support system 100 will be specifically described below.

FIG. 3 is a configuration diagram of the reproductive medical support system 100. As shown in FIG.
A reproductive medical support system 100 includes a microscope 10 , an analysis device 20 and a monitor 30 .

The microscope 10 employs an inverted microscope as shown in FIG. However, in the practice of the present invention, microscope 10 does not necessarily have to be an inverted microscope and may be any other type of microscope. Note that the dashed lines superimposed on the microscope 10 in FIG. 3 schematically show the optical path of the microscope 10 and are not externally confirmed.
An optical path of the microscope 10 is configured to be branched into a plurality of parts by mirrors and lenses (not shown), and an imaging unit 11 and a display unit 12 are incorporated in the optical path of the microscope 10. there is
The photographing unit 11 is configured to magnify and photograph a specimen set (inspection object containing sperm).
The display unit 12 displays the video data generated by the imaging unit 11 within the field of view of the eyepiece of the microscope 10, or displays the video data from an augmented reality image reflecting the analysis result of the analysis device 20, which will be described later. This is a configuration for displaying a work screen in the field of view of the eyepiece of the microscope 10, and realizes the display means according to the present invention.
Since the microscope 10 has the configuration as described above, the operator looking into the microscope 10 through the eyepiece can confirm the analysis result of the analysis device 20 while observing the sample set under the microscope. Details of the work screen displayed on the display unit 12 will be described later.
Although the microscope 10 in the present embodiment is assumed to be a phase-contrast microscope, implementation of the present invention is not limited to this, and other types of microscopes (bright-field microscopes, etc.) may be used. .
Further, the positions at which the photographing unit 11 and the display unit 12 are provided can be changed as appropriate within the scope of realizing the above functions.

The analysis device 20 acquires video data generated by the imaging unit 11 and performs image analysis processing on the acquired video data, and implements analysis means according to the present invention.
Image analysis processing by the analysis device 20 is performed as needed (in real time) in parallel with acquisition of video data, and an operator looking through the microscope 10 can confirm a work screen reflecting the latest analysis results.

Image analysis processing by the analysis device 20 includes, for example, the following.
(i) A process of discriminating the sperm captured in the video data (hereinafter referred to as a discriminating process).
(ii) A process of deriving a migration trajectory of spermatozoa (hereinafter referred to as migration analysis process).
(iii) Processing for counting the sperm discriminated by the discrimination processing (hereinafter referred to as counting analysis processing).
(iv) A process of classifying the sperm discriminated by the discrimination process according to the soundness classified into a plurality of ranks (hereinafter referred to as a soundness analysis process).
(v) A process of extracting the outline of the sperm discriminated by the discrimination process (hereinafter referred to as contour analysis process).
In carrying out the present invention, at least part of each of the processes listed here may be omitted, and other processes not listed here may be added, as long as the object of the present invention is not violated. .
At least part of each process (process included in the image analysis process) mentioned here is preferably realized based on a trained model generated by machine learning (deep learning, etc.). In particular, it is expected that highly accurate analysis results will be obtained by implementing the discrimination processing and soundness analysis processing based on the learned model.

The analysis device 20 is provided with a keyboard 21 and a mouse 22 as operation input means for receiving operations by an operator or the like. Note that the keyboard 21 and the mouse 22 are merely specific examples of operation input means for the analysis apparatus 20, and may be replaced with other configurations. For example, as an operation input means for the analysis device 20, a touch panel may be provided in which a display device having the same function as the monitor 30 described later and a position input device are integrated.

Similar to the display unit 12 described above, the monitor 30 is configured to display a work screen composed of an augmented reality image reflecting the analysis result of the analysis device 20 for the video data generated by the imaging unit 11. The present invention realizes the display means according to the above. Details of the work screen displayed on the monitor 30 will be described later.
The monitor 30 is provided for a person other than the operator looking into the microscope 10 (work assistant, etc.) to view the situation under the microscope. Alternatively, part of the displayed content may be changed.

<About the work screen displayed on the display unit 12>
4 to 6 are diagrams showing specific examples of work screens displayed on the display unit 12. FIG. 4 to 6 are schematic diagrams, and the sizes and ratios of the dimensions of each display shown are not necessarily strict.
The work screen displayed on the display unit 12 includes a main screen G1 and a sub-screen G2, as shown in FIGS. 4-6.

The main screen G1 includes an image (hereinafter referred to as a first image) displaying an enlarged sample set (inspection object). The first video is an enlarged part of the shooting area of the video data generated by the shooting unit 11 . In other words, the image data generated by the image capturing unit 11 captures an area wider than the area displayed on the work screen as the first image.
For example, three sperms are displayed within the display area of the main screen G1 illustrated in FIG. These spermatozoa have been discriminated by the discriminating process described above, and are labeled with labels G11 to G13 based on the soundness analysis process.
Specifically, the display G11 displays an index "A" indicating that the sperm is classified into rank A, which is the most sound. A display G12 displays an index "B" indicating that the sperm is classified into the rank B, which is the second most excellent after the rank A. A display G13 displays an index "C" indicating that the sperm is classified into the rank C, which is the second most excellent after the rank B.
As described above, the displays G11 to G13 are displays based on the analysis processing related to the sperm determined by the determination processing and displayed in the display area of the first image. A corresponding display, specifically showing the health of the sperm as classified by the health analysis process. FIG. 4 illustrates a display mode in which an index indicating the soundness of these spermatozoa is attached to each spermatozoon displayed in the display area of the first video image as a first additional display, but the embodiment of the present invention is shown in FIG. is not limited to this, and for example, by distinguishing sperm by different colors, it is also possible to make the ranking related to soundness visible.
In the present embodiment, the index indicating superiority or inferiority of sperm soundness is expressed as "rank", but it is permissible to replace it with an expression similar to "rank" (for example, level, grade, class). In addition, although alphabetical letters (A to D) are used to indicate the ranking (grade) of the indicator, replace it with a meaningful display (numbers, graphs, etc.) that allows workers to recognize the same content. allow.

The sub-screen G2 is a screen that displays the appearance of the entire shooting area of the video data shot by the shooting unit 11 . The image displayed on the sub-screen G2 may be the content of the video data itself, or may be an image to which auxiliary lines such as grid lines are added so that the position coordinates in the shooting area of the video data can be easily visually recognized. may be
For example, in the display area of the sub-screen G2 shown in FIG. 4, there is a display G21 indicating the position of the first image in the entire imaging area of the image data generated by the imaging unit 11, and a plurality of images relating to sperm soundness. Indications G22 to G25 indicating the positions of spermatozoa classified into rank A among the ranks are displayed.
Specifically, the display G22 indicates the position of the sperm classified as rank A among the spermatozoa displayed in the display area of the first image (sperm labeled with the display G11). In addition, displays G23 to G25 indicate the positions of spermatozoa classified as rank A among the spermatozoa displayed outside the display area of the first image.
As described above, the displays G22 to G25 are displays based on the analysis processing (soundness analysis processing) related to all the sperm discriminated by the discrimination processing. Since the display is based on the analysis processing (soundness analysis processing) related to the sperm that has been determined and is outside the display area of the first image, it can be said that these displays correspond to the second additional display according to the present invention. In this way, by showing the positions of the sperm classified as rank A on the sub-screen G2 (second image area) provided separately from the main screen G1 (display area for the first image), the operator can It becomes possible to easily search for sperm with excellent soundness located outside the display area of G1.
In the present embodiment, a display mode is illustrated in which only the positions of sperm classified into rank A among the plurality of ranks related to sperm soundness are displayed on the sub-screen G2. may be displayed on the sub-screen G2.

FIG. 5 illustrates the moment when the sperm indicated by G11 in FIG. 4 is collected by the operator (sucked up with a glass tube).
At this time, of course, the display G11 disappears from the main screen G1, and the display G22 disappears from the sub-screen G2.

FIG. 6 illustrates a state in which the result (movement trajectory) of the migration analysis process for sperm displayed on the work screen in FIG. 4 is displayed. It should be noted that the dashed line in FIG. 6 is a display corresponding to the movement locus.
4 has moved outside the display area of the main screen G1 in the state shown in FIG. 6, and only the movement trajectory of the sperm remains within the display area of the main screen G1. Only. Even in such a case, the operator can confirm the movement direction of the sperm based on the movement trajectory of the sperm, and can also confirm the current position on the sub-screen G2.
Here, the movement trajectory of the sperm displayed on the main screen G1 (sperm with display G12 and sperm with display G13) is derived by the movement analysis process described above. It can be said that this corresponds to the first additional display according to the present invention because it is the moving trajectory of the spermatozoa displayed within the display area of one image. In addition, the movement trajectory of the sperm (sperm with display G22) displayed across the main screen G1 and the sub-screen G2 is derived by the movement analysis process described above. Since it is a moving trajectory related to the sperm moving from within the image display area to outside the display area, it can be said to correspond to the second additional display according to the present invention. Furthermore, the movement trajectories of the other sperm displayed on the sub-screen G2 (the sperm with display G23 and the sperm with display G24) are derived by the movement analysis process described above. , is the movement trajectory of the spermatozoa displayed outside the display area of the first image, it can be said that it corresponds to the second additional display according to the present invention.

<About the work screen displayed on the monitor 30>
FIG. 7 is a diagram showing a specific example of the work screen displayed on the monitor 30. As shown in FIG. Note that FIG. 7 is a schematic diagram, and the sizes and ratios of the dimensions of each display shown are not necessarily strict.
The work screen displayed on the monitor 30 includes a main screen G3, a sub-screen G4, a side display G5, a marking icon G61, and a marking cancellation icon G62, as shown in FIG.

A first image is displayed in the display area of the main screen G3, similarly to the main screen G1. For example, in the display area of the main screen G3 shown in FIG. 7, the same image as the first image displayed on the main screen G1 shown in FIG. 4 is displayed. is attached with an index (corresponding to the first additional display) based on soundness analysis processing.

In the display area of the sub-screen G4, in addition to what is displayed on the sub-screen G2, a marking icon G61, which will be described later, can be added. For example, in the display area of the sub-screen G4 shown in FIG. 7, in addition to what is displayed in the display area of the sub-screen G2 shown in FIG. A display G41 indicating the position of the sperm that has been detected is displayed.

In the display area of the side display G5, the number of spermatozoa counted by the counting analysis process described above is displayed, which corresponds to the second additional display according to the present invention. Of course, each numerical value displayed on the side display G5 fluctuates according to the counting analysis processing, and is not a fixed value.
Specifically, the total number of sperm discriminated by the discrimination process (the total number of sperm contained in the video data captured by the imaging unit 11) and the number of sperm classified by the soundness analysis process The number of spermatozoa counted by rank of health (ie, by rank A, rank B, rank C and rank D) is displayed. Here, the rank D is an index indicating the lowest soundness in classification by soundness analysis processing.
As a result, the operator can collect the sperm while making a decision based on the number of sperm captured in the video data.
Note that what is given here is a specific example of the second additional display based on the counting analysis processing, and part of the display content may be deleted or changed in the implementation of the present invention. For example, by multiplying the number of spermatozoa photographed in the video data by a predetermined coefficient, the total number of spermatozoa contained in the entire specimen set is derived and displayed as a second additional display on the side display G5. You may

The marking icon G61 is used after arbitrarily selecting one of the sperm discriminated by the discriminating process based on the operator's selection operation received by the operation input means (keyboard 21 and mouse 22) attached to the analysis device 20. This is an icon display for marking the sperm. That is, the marking icon G61 is an icon display for realizing the marking means according to the present invention.
The marking cancellation icon G62 is used to cancel the marking on the sperm after arbitrarily selecting one of the already marked sperm based on the operator's selection operation received by the operation input means attached to the analysis device 20. This is an icon display for

As illustrated in FIG. 7, the display G41 indicating the positions of the marked spermatozoa can be displayed so as to be distinguishable from other displays (displays indicating the positions of the sperm classified as rank A) on the sub-screen G2. preferable.
This is to make it possible to distinguish between the sperm automatically discriminated by the analysis device 20 and the sperm selected intentionally by the operator.

Further, as shown in FIG. 7, a display G41 indicating the position of the marked sperm and a display indicating the position of the sperm classified as rank A are displayed on a sub-screen G4 provided separately from the main screen G3. be. In other words, the monitor 30 can be said to display, in the second image area, a display showing the positions of marked spermatozoa and a second additional display showing the positions of spermatozoa classified into a specific rank.
As a result, regardless of the result of the analysis processing automatically performed by the analysis device 20, the operator can confirm the position of the sperm selected by the operator's intention even outside the display area of the main screen G3 (first image). can do.
Note that FIG. 7 illustrates an example in which the positions of the marked spermatozoa are displayed only on the sub-screen G4, but when the marked spermatozoa are displayed on the main screen G3, the spermatozoa and the other spermatozoa may be displayed so as to be distinguishable.

<Work screen for intratesticular sperm retrieval>
As for the work screen in the intratesticular sperm recovery procedure, the same display as the work screen in the above-described motile sperm recovery method (the work screens illustrated in FIGS. 4 to 7) may be made.
However, as described above, in intratesticular sperm retrieval, motile sperm retrieval is often difficult because the specimen set contains a large number of floating substances different from sperm, or the number of sperm contained in the specimen set is small in many cases. Unlike the law, there may be cases where the same display content as the work screen in the motile sperm collection method is not necessarily appropriate.

8 and 9 are diagrams showing specific examples of work screens displayed on the monitor 30. FIG. 8 and 9 are schematic diagrams, and the sizes and ratios of the dimensions of each display shown are not necessarily strict. Further, each numerical value displayed on the side display G5 in FIGS. 8 and 9 is the same as the side display G5 in FIG. Not a fixed value.

A main screen G7 related to the work screen shown in FIG. 8 and a main screen G8 related to the work screen shown in FIG. is.
The first image displayed on the main screen G7 contains, in addition to sperm, red blood cells, white blood cells, tissue fragments constituting the testis, and the like, and the outline of the sperm is different from that of the first image shown in FIG. (shape) is difficult to distinguish.
In order to facilitate visual recognition of this, the first image displayed on the main screen G8 is the outline of the spermatozoon extracted by the above-described outline analysis process, highlighted. Specifically, the outline of the sperm is clarified by image processing that increases the contrast ratio between the outline of the sperm extracted by the outline analysis process and the background display. In addition to this image processing, for the display other than the outline of the sperm extracted by the outline analysis process, image processing is performed to reduce the contrast ratio with the background display, making the outline of floating matter other than sperm unclear. By doing so, the sperm can be seen more clearly.
It should be noted that the highlighted display of the outline of the sperm on the main screen G8 is a display based on the outline analysis process, and thus can be said to correspond to the first additional display according to the present invention.

As described above, the reproductive medical support system 100 according to the present embodiment displays a work screen to which augmented reality that reflects the results of various analysis processes realized by the analysis device 20 is displayed on the display unit 12 or the monitor 30. Since it is displayed, it is possible to reduce the burden associated with the work of collecting the sperm.

<Regarding Modifications of the Present Invention>
Although the present invention has been described with reference to the embodiments described with reference to the respective drawings, the present invention is not limited to the above-described embodiments, and various modifications can be made as long as the object of the present invention can be achieved. Modifications, improvements, etc. are also included.

Although the reproductive medical support system 100 in the above embodiment is configured to include the microscope 10, the analysis device 20, and the monitor 30, implementation of the present invention is not limited to this.
For example, the configuration may be such that the microscope 10 is omitted. In this modification, the image data to be analyzed by the analysis device 20 may be acquired from another configuration, and the configuration may not be included in the reproductive medical support system 100 . Further, in this modified example, the monitor 30 corresponds to display means according to the present invention, and the analysis device 20 corresponds to analysis means according to the present invention.
Alternatively, the configuration may be such that the monitor 30 is omitted. In this modified example, the display unit 12 of the microscope 10 corresponds to the display means according to the invention, and the analysis device 20 corresponds to the analysis means according to the invention.

Although the microscope 10 used in the above embodiment has been described as having the photographing unit 11 and the display unit 12, it may be replaced with a microscope that does not have at least one of them. For example, the microscope may have the display unit 12 but not the photographing unit 11, and the photographing unit 11 may be provided as a camera device separate from the microscope.

The layout of the work screens described in the above embodiment (the work screens shown in FIGS. 4 to 9) can be changed as appropriate, and these layouts can be arbitrarily adjusted by the operator (the layout customization function can be used). have) is more preferable.

In the above embodiment, the display contents of the display unit 12 (contents related to the work screens in FIGS. 4 to 6) and the display contents of the monitor 30 (contents related to the work screens in FIGS. 7 to 9) are partially different. Although an example has been described, the implementation of the present invention allows the display content of one to be diverted to the display content of the other.

In the soundness analysis process in the above embodiment, the process of classifying the ranks related to the soundness of the sperm into four stages (A to D) has been described, but the ranks may be two or more stages, and the implementation of the present invention The number of steps in is not particularly limited.

This embodiment includes the following technical ideas.
(1) A reproductive medical support system for supporting an inspection work on an inspection object containing sperm, the display means displaying a work screen including a first image showing an enlarged display of the inspection object; an analysis means for acquiring image data in which an area wider than the area displayed on the work screen is captured as a first image, and performing image analysis processing on the image data; includes a discrimination process for discriminating the sperm photographed in the video data, and an analysis process for analyzing the sperm discriminated by the discrimination process, and the display means is discriminated by the discrimination process and the a first additional display based on the analysis processing related to the sperm displayed in the display area of the first image; A reproductive medical support system that displays a second additional display based on the analysis processing related to the sperm that is outside the display area of the first image within the display area of the work screen.
(2) The analysis process includes a process of deriving a sperm movement trajectory, and the display means displays the sperm movement trajectory derived by the analysis process in the display area of the first image. (1 ).
(3) The analysis process includes a process of counting the sperm determined by the determination process, and the display means displays the number of sperm counted by the analysis process as the second additional display ( 1) or the reproductive medical support system according to (2).
(4) The analysis process includes a process of classifying the sperm discriminated by the discrimination process according to the soundness classified into a plurality of ranks. The reproductive medical support system according to any one of (1) to (3), displaying the first additional display indicating sex.
(5) The display means attaches an index indicating the soundness of the sperm classified by the analysis process to each sperm displayed in the display area of the first image, and adds the index to the first addition. The reproductive medical support system according to (4) displayed as a display.
(6) The display means is subordinate to (3) for displaying the number of spermatozoa counted according to ranks related to sperm soundness classified by the analysis process as the second additional display (4) or The reproductive medical support system according to (5).
(7) The display means displays the position of a sperm classified into a specific rank among a plurality of ranks related to the soundness of the sperm, out of the sperm determined by the determination process and outside the display area of the first image. The reproductive medical support system according to any one of (4) to (6), wherein the second additional display shown is displayed in a second image area provided separately from the display area of the first image.
(8) Marking means for arbitrarily marking the sperm discriminated by the discriminating process by a selection operation by the operator, and the display means displays the position of the sperm marked by the marking means in the display area of the work screen. The reproductive medical support system according to any one of (1) to (7) displayed within.
(9) The display means displays the display indicating the position of the sperm marked by the marking means and the second additional display indicating the position of the sperm classified into the specific rank in the second image area. The reproductive medical support system according to (8) subordinate to displaying (7).
(10) The analysis process includes a process of extracting the outline of the sperm discriminated by the discrimination process, and the display means highlights the contour of the sperm extracted by the analysis process, and displays the outline of the sperm extracted by the first The reproductive medical support system according to any one of (1) to (9) displayed as an additional display.
(11) Reproductive medicine according to any one of (1) to (10), wherein at least part of the processing included in the image analysis processing is realized based on a trained model generated by machine learning. support system.

This application claims priority based on Japanese Patent Application No. 2018-177672 filed on September 21, 2018, and incorporates all of its disclosure herein.

100 reproductive medical support system 10 microscope 11 imaging unit 12 display unit 20 analysis device 21 keyboard 22 mouse 30 monitor

Claims (11)

A reproductive medical support system for supporting inspection work on an inspection object containing sperm,
display means for displaying a work screen including a first image showing an enlarged display of the object to be inspected;
an analysis means for acquiring image data in which an area wider than the area displayed on the work screen is captured as the first image, and performing image analysis processing on the image data;
with
In the image analysis process,
a discrimination process for discriminating the sperm photographed in the video data;
an analysis process for analyzing the sperm discriminated by the discrimination process;
includes
The display means displays a first additional display based on the analysis processing related to the sperm determined by the determination processing and displayed in the display area of the first image, and displays all of the sperm determined by the determination processing. and a second additional display based on the analysis process related to the sperm determined by the analysis process or the determination process and outside the display area of the first image within the display area of the work screen. system. The analysis process includes a process of deriving a sperm movement trajectory,
The display means displays, as the first additional display, the movement trajectory of the sperm displayed in the display area of the first image among the sperm movement trajectories derived by the analysis processing, and 2. The system for supporting reproductive medicine according to claim 1, wherein a movement trajectory of a sperm that has moved from within the image display area to outside the display area is displayed as the second additional display. The analysis process includes a process of counting the sperm discriminated by the discrimination process,
3. The reproductive medical support system according to claim 1, wherein said display means displays the number of spermatozoa counted by said analysis processing as said second additional display. The analysis process includes a process of classifying the sperm discriminated by the discrimination process according to the soundness classified into a plurality of ranks,
4. The reproductive medical support system according to any one of claims 1 to 3, wherein said display means displays said first additional display indicating the soundness of sperm classified by said analysis processing. The display means attaches an index indicating the soundness of the sperm classified by the analysis process to each sperm displayed in the display area of the first image, and displays the index as the first additional display. The reproductive medical support system according to claim 4. 6. A method according to claim 4, wherein said display means displays, as said second additional display, the number of spermatozoa counted by rank relating to sperm soundness classified by said analysis processing. reproductive medical support system. The display means displays the position of a sperm classified into a specific rank among a plurality of ranks related to the soundness of the sperm among the sperm identified by the identification process and outside the display area of the first image. 7. The reproductive medical support system according to any one of claims 4 to 6, wherein the second additional display is displayed in a second image area provided separately from the display area of the first image. A marking means for arbitrarily marking the sperm discriminated by the discrimination process by a selection operation by an operator,
8. The reproductive medical support system according to any one of claims 1 to 7, wherein said display means displays the position of the sperm marked by said marking means within a display area of said work screen. wherein the display means displays, in the second image area, a display showing the position of the sperm marked by the marking means and the second additional display showing the position of the sperm classified into the specific rank. Reproductive medical support system according to claim 8 when dependent on claim 7. The analysis process includes a process of extracting the outline of the sperm discriminated by the discrimination process,
10. The reproductive medical support system according to any one of claims 1 to 9, wherein said display means displays, as said first additional display, a highlighted display of the outline of the sperm extracted by said analysis processing. The reproductive medical support system according to any one of claims 1 to 10, wherein at least part of the processing included in the image analysis processing is implemented based on a learned model generated by machine learning.

Images