JP2019042199A - Camera system - Google Patents

Abstract

To provide a camera system which, when capturing images of a medical operation such a surgical operation, prevents the visual fields of cameras from being interfered by a looking-in motion of the surgeon or by a hand or a surgical instrument and displays the condition of the medical treatment and the subject's affected part on a screen with a high probability, and also to provide associated simplified display device for captured images and a recording unit.SOLUTION: A camera mechanism 12 with shadowless lamps includes a plurality of light sources 24, 32 and is configured such that a central camera 22 and surrounding cameras 30 capture images of an illuminated object simultaneously from a plurality of points of view. A monitor mechanism 40 has means which uses an operation device 44 to select an image from among a plurality of images captured by the central camera 22 and the surrounding cameras 24, and displays the selected image on a display device 42.SELECTED DRAWING: Figure 1

Description

  BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to a medical support camera system and a display method for surgery and the like in which an image of an affected area to be treated in surgery and the like is photographed with a camera and displayed on a monitor display.

Lighting is used when performing medical procedures such as surgery, and this lighting does not cause shadows of the body of the operator, in particular, the head, arms, hands, etc., and surgical instruments, in the affected area. Shadow lights are usually used.
As this operation light, a circular support base attached to the tip of an arm suspended from a ceiling and movable and tilted, a central light disposed at the center of the support base, and a periphery of the central light In many cases, a structure having a plurality of ambient lights attached to the support base is used.
By the way, during treatment, the person who assists in the preparation of the next surgical instrument or the person who grasps the progress of the surgery in another room can not directly observe the affected area, so the photographed video It is usual to know the condition of the treatment area by
At this time, a camera is used, but this camera is often attached to the shadowless light because it is convenient to move and tilt along with the movement and tilting of the shadowless light. Japanese Patent Application No. 11-267663 (Patent Document 1) and Japanese Patent Application No. 2016-518657 (Patent Document 2) have been proposed as an example in which a shadowless lamp is equipped with a camera, and the position close to the central light source of the shadowless lamp Or, a camera is provided in the inside of the handle portion that operates the shadowless light.
In the case of operation using a camera-equipped surgical light of this structure, even if illumination is applied to the target area to be treated, the body of the operator, in particular, the head, arms, hands, etc., surgical instruments etc. A situation occurs in which the affected area is not reflected. Below, this subject is explained in full detail.

Japanese Patent Application No. 11-267663 Japanese Patent Application No. 2016-518657 JP, 2012-120812, A

  In the imaging of the treatment target affected area in the operation, a visual field disorder occurs in which the treatment target affected area to be photographed is hidden due to the peeping motion of the operator who is the treating person, the movement of the hand or finger, the surgical instrument or the like. In order to complete imaging by avoiding visual field impairment, the position and direction of the camera should be adjusted according to the positional relationship between the treatment target area that is constantly changing during the operation and the operator, surgical instruments, etc. that may become an obstacle to imaging. It is necessary to adjust the angle of view. However, in practice, it is difficult to immediately operate the camera according to the change in the position of the affected area to be treated and the obstacle, and the factors that cause the difficulty are listed below.

  First, it is difficult to arrange personnel for the operation of the camera as described above at the site of the operating room. It is difficult for the surgeon who is a surgeon who participates in the surgery as a surgeon or assistant and an instrumented nurse who hands the surgical instrument to the surgeon, because he is concentrating on the progress of the surgery, so it is difficult to grasp the situation of the photographed images during the surgery. It is. In the operating room, there is an external nurse who places an additional surgical instrument on the instrumenting nurse, and may also operate the camera between tasks. Nevertheless, it is difficult to immediately operate the camera each time the position of the treatment target affected area and the obstacle changes.

  Next, there are situations where it is difficult to change the position of the camera. At the surgical site, the affected area is treated and the patient lying on the surgical bed is covered with a sterile cloth, and the operator and the nurse who wears the instrument wear a sterile gown on the surgical gown. An instrument stand for placing a sterile surgical instrument is disposed around the periphery. The camera is not permitted to touch these sterile people or objects when taking pictures of the diseased area to be treated, and the camera may be placed just above the affected area or even further away from the sterile people or objects. Position. In addition, the shadowless lamp is usually placed just above the treatment target area. If the camera is located just above the affected area, the circling nurse who can manipulate the position of the camera does not wear a sterile gown, making it difficult to access the camera without touching sterile people or objects. is there.

  In addition, as in Patent Document 1 and Patent Document 2, although only one camera is provided for the shadowless lamp, illumination is applied to the treatment target affected area, but the head of the operator between the camera and the treatment target affected area There may be a situation where visual field disorder occurs due to the presence of an obstacle such as a hand. At this time, it is necessary to manipulate the position of the camera in order to photograph an affected area to be treated avoiding an obstacle, but in both Patent Document 1 and Patent Document 2, the camera and the surgical lamp are in the same housing. Because it is equipped with it, when operating the position and direction of the camera according to the operation of the operator, the position and direction of the shadowless light will change in conjunction with this, and it is difficult to lose the illumination on the affected area to be treated Produces

  What is common in all cases is that in the operating room, the completion of safe surgery is given priority over the shooting of a good image, and stable illumination of the affected area to be treated rather than the operation of the camera Takes precedence. For these reasons, it is difficult for any of the cameras of Patent Document 1 and Patent Document 2 to perform imaging of the target area to be treated while avoiding visual field impairment due to an obstacle.

  In addition, when the visual field of the camera is impaired due to an obstacle during shooting, the operator concentrates on the progress of the operation and it is impossible to view the display at the same time, so the visual field of the camera is generated. It is difficult to notice, and the operation will progress in a situation where the imaging has not been performed.

  On the other hand, in the video of surgery required in the medical field, the most necessary information is the content of the medical operation to the affected area, and it is necessary for the viewer of the photographed video to grasp the video accurately at any time. It is necessary to perform imaging of the treatment target area while avoiding visual field impairments of imaging such as the head, body, arms and hands of the person.

  The present invention has been made in view of the above-described needs and circumstances, and it is an object of the present invention to photograph an affected area to be treated without the operator being conscious of photographing and concentrating on surgery. An object of the present invention is to provide a camera system which can be completed and which has a high probability of the affected part being treated in any of the photographed images.

  The present invention assumes that the range of illumination by a light source falls within the range photographed by the camera, and a plurality of camera units are arranged to constitute a shadowless lamp, for a camera unit configured of a camera and a plurality of light sources. A plurality of cameras are disposed in a distributed manner within a group of a plurality of light sources of a shadowless lamp, and even if any light source is applied to the treatment target area, the cameras simultaneously located in the vicinity of the light sources Realize a situation where shooting is completed. In this situation, the operator is not aware of the condition of photographing, maintains stable illumination to the treatment target area, and shoots the treatment target area with any camera without changing the position of the camera. It is possible to complete. In addition, even when the shadowless lamp is moved to improve the stable illumination to the treatment target affected area, the imaging of the treatment target affected area is achieved by any camera. A more specific description of the configuration will be described below.

  The present invention is a camera system provided with a camera mechanism with a shadowless light for photographing an affected area during medical treatment such as surgery to achieve the above object, and a monitor mechanism for displaying an image photographed by the camera mechanism, The overall configuration of the shadowless camera mechanism is similar to that of a shadowless lamp generally used in surgery, includes a plurality of light sources, and can be moved and tilted in the same manner as a general shadowless lamp. And a control handle to which a sterile cover can be attached approximately at the center of the entire base, a central camera unit at the center of the entire base, and at least one peripheral camera unit around the central camera unit. Do. The overall form and configuration are similar to a general surgical light, and the operator can illuminate the affected area in the sense of operating a general surgical light.

  At this time, the surrounding camera unit includes the surrounding camera in the vicinity of the plurality of light sources provided in each of the plurality of light sources since the direction of illumination of the light source matches the direction of photographing of the surrounding camera. When any illumination reaches the treatment target affected area, there is a high possibility that the affected area is photographed from a surrounding camera located in the vicinity of the light source reaching the affected area. Conversely, when the illumination does not reach the treatment target affected area, the possibility that the affected area is not shown in the image being taken is high, but in the situation where the illumination does not reach the affected area Because it is difficult to perform, it is common for the operator to hold the operating handle to move and tilt the entire base of the shadowless camera mechanism so that illumination can reach the affected area. It is similar to the operation in the shadow light, and this operation makes it possible to return to the situation where the affected part is photographed by the camera in the vicinity of any light source. During this operation, the operator does not have to be aware of the imaging situation. In addition, although a light source is essential to the surrounding camera unit, it is optional whether a light source is installed in the central camera unit.

  Images from multiple cameras are input to the monitor mechanism, and the image displayed on the display device by the central camera is desirable in the initial setting, but depending on the situation of the operation, the image from the surrounding cameras has more information By operating the operation device provided in the monitor mechanism, it is possible to switch the image of the display device or simultaneously display a plurality of images.

The present invention, with such a configuration, provides a function to support the effective use of moving images related to medical treatment such as surgery,
The operator can complete imaging of the treatment target area only by performing the operation in the same sense as operating a conventional shadowless lamp without being conscious of imaging.
There is no need to allocate personnel for shooting.
・ When the visual field disorder of the camera due to an obstacle occurs, the illumination of the light source does not reach the treatment target area at the same time, so the operator can notice the occurrence of visual field disorder, and the camera mechanism with shadowless light Movement and tilting can also improve visual field impairment.
-It is possible to display the image of the affected area more reliably on the display, and staff such as external nurses involved in surgery, anesthesiologists, doctors and students who are visitors of surgery, administrators of operating room, etc. More accurate progress of the operation, without having to look into the site where the operation is actually performed from behind the operator, efficient operation of the operating room, occurrence of wound infection due to reduction of contamination It is expected that the number will decrease.
・ Others, in the medical field, regarding the application of images taken of medical procedures including surgery, investigation of causes of medical accidents, improvement of satisfaction with more specific explanations to patients, surgeons and young medical staff Can be expected to have effects such as improvement of

  In the field of dental care, JP-A-2012-120812 (Patent Document 3) proposes means for combining an operating light with a video camera system that outputs multi-viewpoint images by a plurality of video cameras. Simply using this method for medical surgery that deals with the whole body can not achieve good imaging.

  First, in order to photograph the affected area to be treated in dentistry from multiple viewpoints, it is possible to photograph the structure of at least the depth to the molar with a plurality of cameras through the cleft of the mouth at the entrance of the oral cavity and between the upper and lower incisors. So, you need to place a video camera. Cleft lip is as wide as about 6 cm in adult men, the distance between the upper and lower incisors is up to about 5 cm, and the depth to the third molar is also about 6 cm. In order for the dentist to operate the shadowless lamp in the dental examination position, the shadowless lamp is at a distance of 60 to 70 cm from the patient at most, so from this distance the third In order to photograph molars from a plurality of viewpoints, the distance between cameras needs to be arranged within about 15 cm. Of course, when children and women have small mouths, the camera should be located closer. In this case, the camera is separated by a distance smaller than the width of the head of the operator who can cause visual field disorder during the operation, and it is difficult to image the treatment target in the medical operation. In medical surgery, the treatment target is wider than dental treatment, and the number of staff involved in treatment is also large. Therefore, in order to give good illumination to the treatment target area, the shadowless lamp is at least about 50 cm in size It is necessary to provide a light source in the area of Unless the positional relationship between the camera and the light source is noted, when the shadowless lamp is equipped with a plurality of cameras, as described above, although the illumination target is applied to the treatment target area, a situation occurs in which the camera is not photographed . In order to be aware of this situation, it is necessary for a third party to monitor the display, and in order to recover from the situation where shooting is not achieved, it is also necessary to manipulate the position and direction of the camera together with the shadowless light. This may interfere with the progress of the treatment and may cause harm to the patient.

1 is a system embodiment according to the present invention. It is a figure which shows the structure which selects the imaging | video displayed on a display apparatus with an operating device out of the imaging | video of several cameras. It is a figure which shows the structure which records the imaging | video of several cameras simultaneously by a video recording unit. It is a figure which shows the example of embodiment which records simultaneously the several imaging | video image | photographed simultaneously by common imaging | photography date, and reproduces | regenerates simultaneously. It is a figure which shows the example embodiment which tilts the tilting unit of a surrounding camera unit by rotation of an operating handle. FIG. 8 is a diagram showing an example of the guide light irradiated to the object to be photographed when the device according to the present invention is provided with a guide light irradiation device for notifying the direction of the image of the camera. It is an example embodiment which equipped the present invention device with a microphone. It is a figure which shows the example of embodiment which records simultaneously with several imaging | video and audio | voice acquired on the common imaging | photography date, and reproduces | regenerates simultaneously. It is an example of embodiment which equipped the present invention device with a semi-spherical camera. The operation handle is equipped with a light source, angle of view, automatic adjustment of focus, recording unit, operation device of recording device, focal length operation device activates automatic adjustment of focus by input from example of operation device of monitor mechanism or tilting of unit base 1 is an example embodiment of the inventive device. It is a figure which shows the structure which cuts out several recorded video and audio | voice in the range of a common imaging | photography date, and outputs it as several divided data. 6 is a flowchart illustrating an example of an algorithm for switching an image when the display device recognizes an image failure. It is a figure which shows the structure which selects the image displayed on a display apparatus by CPU with which a distance measurement apparatus and a monitor mechanism are equipped. It is a figure which shows the structure which automatically recognizes the content of moving image data and audio | speech data, produces character string data, adds the tag information of a character string to imaging | photography time information, and produces list data.

Embodiments embodying the present invention will be described in detail below with reference to the drawings. The drawing is drawn schematically for the convenience of explanation.

  FIG. 1 shows an embodiment of the present invention in which the camera system 10 comprises one central camera unit 16 and six peripheral camera units 26. The light source of the shadowless light is not essential for the light source 24 of the central camera unit, and the light source 32 of the surrounding camera unit may be arranged to surround the surrounding camera 30 as in the embodiment of FIG. It may be arranged as follows. The central camera 22 may be juxtaposed to the operating handle 20 as in the embodiment of FIG. 1 or may be installed in the operating handle. The image of each camera is displayed on the display device 42 of the monitor mechanism 40. The number of shadowless camera mechanisms 12 and monitor mechanisms 40 is at least one to one, but may be many to one, one to many, or many to many. The monitor mechanism 40 is not limited to the case where it is fixed to the wall in the operating room or is movable on a cart, and when it is installed in the operating room or the staff room of the medical office via the hospital network, For example, it may be installed in another facility, and the situation of surgery may be viewed as live surgery via the Internet. The image to be displayed on the display device 42 can be selected using the operating device 44. When the operation device 44 is a button installed on the monitor mechanism 40, a mouse or a keyboard, or the display device 42 is a touch panel, it is a remote controller wirelessly connected to the monitor mechanism 40 , It may be a combination of these. By putting the remote control in a sterile plastic bag, staff wearing sterile gowns can select images. The display device 42 can magnify and display a part of the displayed image, and when the affected area to be treated is small, the affected area can be selected and enlarged and displayed. . This allows the user to select an area to be enlarged by displaying a pointer on the display device 42 and operating it with a mouse or the like, or by the display device 42 being a touch panel.

  FIG. 2 shows a configuration in which the operation device 44 selects an image to be displayed on the display device 42 from the images of the central camera 22 and the six surrounding cameras 30. In the field of surgery, it is not the surgeon but the operating room nurses and visitors who have not participated in the surgery to view the images on the display. The present invention provides a means for selecting, displaying, and enlarging a plurality of photographed images by the monitor mechanism. Display on / off can be specified for each of the images, and if not specified, only the image of the central camera 22 is displayed on the display unit 42. The screen area of the display device is automatically divided according to the number of cameras specified as ON, and the images are displayed side by side. However, the ratio of the division size and the arrangement order of each image are the operation device 44 Can be adjusted. Also, with respect to the video displayed in each divided area, the video can be enlarged.

  FIG. 3 shows a configuration in which the recording unit 62 simultaneously inputs the images of the central camera 22 and the six surrounding cameras 30. A switch (not shown) for operating start and stop of recording is provided, and operation of one switch is used to start and stop recording of all cameras. The switch may be provided in the recording unit, provided in the operation handle 20 illustrated in FIG. 1, provided in the remote controller, or a combination of these.

  FIG. 4 shows a plurality of images taken simultaneously by the central camera 22 and the two surrounding cameras 30 with the common photographing date and time 66 added and recorded in the recording device 64, and any combination through the output means 68 In the present embodiment, a plurality of moving images are simultaneously reproduced by aligning the shooting date and time signal Sg1 from the recorded shooting date and time signal adding device 66, and an image is displayed on the display device 42 of the monitor mechanism 40. When playing back multiple videos at the same time, in order to play back the same scene by combining the captured real time, if there is a gap in the recording time recorded in each video, perform fine adjustment of the playback time There was a case where it was necessary. In the present invention, a means for simultaneously recording a plurality of video images simultaneously and in parallel, and a means for simultaneously reproducing and outputting the plurality of recorded video images in time for shooting, in order to eliminate this labor and time provide. In the present invention, it is possible to switch the screen to another camera's video without time lag or simultaneously display the same by reproducing the plurality of moving images by aligning the shooting date and time with the common shooting date and time signal Sg1. It is. Although two peripheral cameras 30 are schematically illustrated, in reality, the central camera 22 is surrounded by three or more peripheral cameras 30 for effective photographing to avoid the possibility of visual field obstruction. Is desirable. The recording unit 62 may be configured separately from the monitoring mechanism 40 as illustrated in FIG. 4, or may be incorporated inside the monitoring mechanism 40. Further, if the output unit 68 is provided in the recording unit 62 as illustrated in FIG. 4, in the situation where the recording unit 62 is incorporated in the monitor mechanism 40, It may be possible to play a role. When the output destination of the moving image is the display device 42 as illustrated in FIG. 4, the plurality of moving images simultaneously output are simultaneously reproduced while the same as in the case illustrated in FIG. In addition, it is possible to select a moving image to be displayed on the display device 42 and adjust the screen configuration. Also, there may be a case where the output destination is not a display but a storage medium such as a DVD. In this case, an arbitrary moving image is selected from a plurality of moving images and output as an independent moving image file, or There may be a case where a moving image of a combination of is arranged and displayed in an arbitrary arrangement as one moving image file.

  FIG. 5 shows an embodiment in which the link unit 82 mechanically links the operating handle 20 and the tilting unit 84 of each surrounding camera unit 26 and operates the tilting unit 84 by the rotation of the operating handle 20. The link device 82 may change the direction of the rotational force using a bevel gear or a helical gear (not shown) and may mechanically transmit the force to the tilting unit 84. In FIG. 5, the surrounding camera unit 26 is circular, and it is illustrated to tilt to the center of the camera mechanism 12 with the shadowless light by rotating around an axis that matches the diameter of this circle. The shape of the unit 26 is not limited to a circle, and the tilting center or fulcrum may be offset from the center of the surrounding camera unit 26 as long as the tilting method is to the center of the shadowless camera mechanism 12. As another example, the link device 82 may be an electric type that transmits an electronic signal and operates a motor provided to the tilting unit 84 to achieve tilting.

FIG. 6 shows an embodiment of guide light for irradiating the object 90 when the camera mechanism with a shadow light is provided with a guide light irradiation device for notifying the direction of the image of the camera. By irradiating the subject 90 with the guide light 92 along the vertical direction of the image and the guide light 94 along the horizontal direction of the image, the operator can view the guide light without seeing the image on the display while the operator is not It is possible to adjust the tilt for displaying the shooting target 90 on the image by operating the camera mechanism with shadow light. The guide light should be a combination of linear light and display a pointer that indicates a specific direction of the image in one direction, and in this example the arrowhead 92 indicates the upper side in the vertical direction, this form is arbitrary . If the inclinations of the images of a plurality of cameras are parallel to the horizontal direction, one guide light irradiation device is sufficient, but otherwise, the camera units may be provided one by one.
It is desirable that the irradiation of the guide light is automatically output when the shadowless camera mechanism is moved and tilted, and automatically turned off after a predetermined time has elapsed. An acceleration sensor is used to detect the movement and tilting of the shadowless camera mechanism. Of course, the occurrence of these motions is detected by means such as an internal sensor that measures the movement and tilting of the camera mechanism with a shadowless light and the angle of joints necessary for tilting the surrounding camera unit as well as the acceleration sensor. There is also a possibility.
In addition, the guide light needs to ensure safety to the human body, in particular to the eye.

  FIG. 7 shows an embodiment of the present invention in which the camera mechanism 12 with shadowless light includes the microphone 102, and the recording device 104 and the microphone 102 for outputting sound to the audio output device 106. In surgery, staff conversations are also important information. In particular, when teaching a staff member of an intern who wears a sterile gown and participates in an operation, it is difficult to take notes during the operation, so it is difficult to accurately memorize the contents of the instruction. Also, although the content of the instruction is worth sharing to the operating room nurses and visitors, the volume of the operator's voice may not be sufficient and may not be heard by the surrounding people. Although the central camera 22 and the monitor mechanism 40 of FIG. 1 are omitted for convenience of explanation, these configurations are the same as those of FIG. Although FIG. 7 exemplifies the case where the microphones 102 are juxtaposed to the operation handle 20, for effective sound collection, the microphone 102 is installed near the tip of the operation handle 20 near the operator. Is desirable. In addition, the microphone 102 has a noise canceling function because the operating room may be echoing with sounds emitted by medical equipment such as an electrocardiogram and blood oxygen saturation, and an electric scalpel in the operating room. It is desirable to be a unidirectional microphone along the direction of illumination and shooting.

  FIG. 8 shows an embodiment of the present invention in which a microphone 102, an audio output device 106 and a recording device 104 are added to FIG. The voice output device 106 may be provided independently of the monitor mechanism 40 as shown, or may be a device worn by a staff like an earphone. It is desirable that the recording device 104 be incorporated in the recording unit 62 as shown in the drawing, and perform recording by adding the same shooting date and time 66 as the moving image to be recorded simultaneously. In the output of a moving image, it is possible to output the moving image and the sound simultaneously by aligning the shooting date and time 66 via the output means 68. By arranging a common shooting date and time 66 and reproducing a plurality of moving pictures and sounds, it is possible to switch screens to another camera's video without time lag or to simultaneously display them.

FIG. 9 shows an embodiment of the present invention in which the central camera 22 of the camera mechanism 12 with shadowless light is a semi-spherical camera or a stereo camera or an infrared camera 122 and any camera 122 is provided at the tip of the operation handle 20. is there.
In the operating room, it is desirable that not only the image of the affected area to be treated but also a wide range of situations such as the arrangement and operation of staff and surgical instruments be grasped. The present invention provides a means for acquiring a wide range of images with a semi-spherical camera. When using a semi-spherical camera, a central camera may be provided on the central camera unit 16 separately from the semi-spherical camera, but also in this case, in order to obtain an image without video impairment over 360 °, The semi-spherical camera is preferably installed at the tip of the operation handle 20. Although the monitor mechanism 40 in FIG. 1 is omitted in FIG. 9 and illustrated, the image of the semi-spherical camera 122 is also input to the monitor mechanism 40 in the same manner as other cameras. Adjustment of the expansion range is possible.
Moreover, in order to grasp the condition of the treatment target affected area, the information obtained in the two-dimensional display image is inferior to the information obtained in the three-dimensional display image. The present invention provides a means for displaying an image in three dimensions by the stereo camera 122. When a stereo camera is used, it can be selected by the operating device 44 of the monitor mechanism 40 whether the image of the display device 42 is displayed in two dimensions or three dimensions. The stereo camera may be a combination of any two of the central camera 22 and the peripheral cameras 30, or any one or more cameras may be stereo cameras.
Further, in the operating room, there is a scene in which an affected area to be treated is often evaluated using an infrared camera. At this time, it is time-consuming to put an infrared camera in a sterile bag near the affected area and carry it for imaging. The present invention provides a means for displaying the image of the infrared camera by omitting this trouble. In the case of using an infrared camera, it is sufficient if it is possible to switch to an infrared camera or one of the central camera 22 or the surrounding cameras 30 is an infrared camera.

In FIG. 10, switches 134, 136, 142, 146, and 148 are provided on the side of the operation handle 20, and the operator operates during the operation to transmit the light source, the angle of view, and the focus of each camera via electronic signals. The switching of the operation of the automatic adjustment function, the recording and the start and stop of the recording can be performed, and the automatic adjustment function of the focus of each camera can also be operated by detecting the tilt of the unit substrate 144 of the present invention. The structure in an Example is shown. In the past, the camera setting, recording, and recording operations can not be performed by staff wearing sterile gowns, so there is a shortage of personnel in the operating room and there are no staff who do not wear sterile gowns. It was difficult. The present invention provides a camera system provided with a light source, an angle of view of a camera, an auto focus setting, a recording, and a recording operation in a handle portion to which a sterile cover is attached in a general shadowless light. The operating handle 20 is equipped with a sterile cover so that the operator wearing a sterile gown can also operate it when performing surgery. At this time, it is desirable that the cover is made of a transparent and soft material such as vinyl and thin plastic so that the operation of the switches 134, 136, 142, 146 and 148 is not hindered. Also, the positions of the switches 134, 136, 142, 146, and 148 may be erroneously detected when the operating handle 20 is touched to move and tilt the whole of the shadowless camera mechanism or to tilt the surrounding camera unit. It is necessary to arrange the switches 134, 136, 142, 146, 148 so as not to operate.
Although it is desirable that the automatic adjustment function of the camera operates automatically when the positional relationship between the camera and the affected area to be treated changes, the camera mechanism with a shadowless light 12 in which the positional relationship between the camera and the affected area may change. Motion and tilting of the surrounding camera unit 26 or detection of tilting of the surrounding camera unit 26 can be detected for any of these movements using an acceleration sensor provided in any of the surrounding camera units 26. Therefore, it is desirable to use an acceleration sensor. Of course, the motion is not limited to an acceleration sensor, but may be generated by means such as movement or tilting of the shadowless camera mechanism 12 or an internal sensor that measures the angle of a joint necessary for tilting the surrounding camera unit 26. There is also a possibility of detection.

  FIG. 11 does not output data over the entire recording time when outputting a plurality of recorded moving images 152 and 154 and audio 156 to an external recorder, but the range of imaging time T1 to T2 is not output. 7 shows an embodiment of the present invention in which each data is cut out as data within the time range at the same position, and voices are synthesized with each moving image and output. In the present invention, as shown in FIG. 4 and FIG. 8, the same shooting date and time data is shared by any moving image data or audio data. It is possible to divide a plurality of moving image data in

FIG. 12 is a flow chart showing an example of an algorithm for switching an image when the display device recognizes an image failure. If the staff who are not wearing a sterile gown who operates the monitoring mechanism is not in the operating room, it is difficult to switch the image displayed on the display, and if a surgical assistant or an instrumented nurse wants to switch the image. It causes inconvenience. The present invention provides a camera system provided with means for detecting that the displayed image does not display the treatment target affected area due to image failure and automatically switching to another image. As described in FIG. 2, when the designation of the image is not performed, the image of the central camera is displayed on the display device (step S1). The display device can detect from the configuration of the pixels of the video that the video to be displayed is not likely to display the affected area, and can automatically switch to the video of another camera. In surgery, the pixels of the image of the external diseased area are large in the range composed of skin color and red, etc., and the pixels of the image displayed when the affected area is not photographed are clean cloth or the like covering the periphery of the affected area. It may be blue or green, which is the general color of surgical clothes and hats, or green, which is the color of gloves for the surgeon. The display device recognizes that a video failure has occurred when blue and green pixels occupy a certain range of the video (step S2). If YES in step S2, a monitoring time timer is set (step S3). Until the timer set time elapses, recognition of whether or not the video failure continues is continued (step S4). If the image failure has disappeared, the result of the step S5 is YES, and the display of the image of the central camera is continued. If the video failure continues, the determination in step S5 is NO, and monitoring of the video failure is continued until the timer set time elapses. If the timer set time has elapsed while the image failure continues,
The determination in step S4 is YES, and the image is automatically switched to another camera image and displayed (step S6). Hereinafter, with respect to the displayed image, it is possible to similarly detect an image failure and automatically switch to an image of another camera. The recognition of the image failure is simultaneously performed for each image when a plurality of images are displayed simultaneously. In addition, even with respect to a video not being displayed, it is possible to designate a video to be switched to as a video without video failure by similarly monitoring the video failure in the background.

  FIG. 13 shows a configuration example of the present invention in which a distance measuring device 172 is provided near the central camera 22 and each surrounding camera 30, and the CPU 174 provided in the monitor mechanism 40 automatically selects an image to be displayed on the display device 42. When using a laser range finder, it is necessary for the distance measuring device 172 to adopt laser class 1 (near infrared radiation) as a light source, and to ensure safety to the human body, particularly to the eye. When the measured value of each distance measuring device 172 is transmitted to the CPU 174 and the CPU 174 changes the measured value in the situation where the affected part is treated for a certain time from the measured value in the situation, the distance It is possible to control the image of the cameras 22 and 30 located in the vicinity of the measuring device 174 not to be displayed on the display device 42.

  In FIG. 14, the contents of the moving image data 182 and the audio data 188 are automatically recognized by the moving image recognition unit 184 and the speech recognition unit 190 respectively, character string data is created, and tag information of the character string is added to photographing time information 7 shows the configuration of the present invention for creating data 186, 192. FIG. The recorded moving images are long-time, the overall color tone and composition are often monotonous, and it is often difficult to identify the recording time of the surgical scene that you want to reproduce. Although there is a method in which the viewer of the moving image manually adds tag information to the moving image as a means for this, it takes a great deal of time and effort. In the present invention, a scene to be reproduced can be retrieved by automatically recognizing recorded video and audio mechanically and adding tag information of a character string to time information of data, thereby enabling retrieval of time information of recording. Provide a means that can be identified. Specific examples of the video recognition means 184 and the speech recognition means 190 include Cloud Video Intelligence and Cloud Speech APIs (application programming interfaces) provided by Google, respectively. However, in practice, since the video data 182 and the voice data 188 include patient information, it is necessary to obtain patient's permission in advance when using this API, which requires communication with Google's server. is there. In order to practice the present invention without going through an out-of-hospital network, it is required to operate the video recognition means 184 and the speech recognition means 190 in the hospital.

DESCRIPTION OF THE PREFERRED EMBODIMENTS 10 Present Invention Device Example 12 Camera Mechanism with Operating Light 14 Whole Base 16 Central Camera Unit 18 Central Unit Base 20 Operation Handle 22 Central Camera 24 Light Source 26 Ambient Camera Unit 28 Ambient Unit Base 30 Ambient Camera 32 Light Source 40 Monitor Mechanism 42 Display Device 44 operation device 62 recording unit 64 recording device 66 shooting date and time signal adding device 68 commonly added to each image output means 82 link device 84 tilting unit 90 shooting object 92 guide light 94 indicating the vertical direction of the image 94 horizontal direction of the image Guide light 102 Microphone 104 Recording device 106 Audio output device 122 Half sphere camera or stereo camera or infrared camera 132 Central camera unit or ambient camera unit 134 Light source operation switch 136 Field angle operation switch 138 Central camera or peripheral camera 140 Focal length operating device 142 Operation switch for automatic focus adjustment function 144 Detection of tilting of unit base 146 Operation switch for recording 148 Operation switch for recording 152 Movie 1
154 videos 2
156 audio 158 output data 1
160 Output data 2
172 distance measurement device 174 CPU
182 movie data 1
184 movie recognition means 186 list data of time and tag information derived from movie data 1 voice data 190 voice recognition means 192 list data of time and tag information derived from voice data starting point time of extraction T2 end time of extraction end time Sg1 Shooting date and time data to be added commonly to images

Claims (26)

  A camera mechanism with a shadowless lamp that can be used for treatment operations such as surgery and can capture the image of the treatment target affected area and / or the surgeon's hands with fixed images and moving images, and a monitor mechanism that displays an image captured by this camera mechanism In the camera system, the camera mechanism is provided on an overall substrate capable of moving and tilting, a central camera unit disposed approximately at the center of the overall substrate, and the overall substrate, and disposed around the central camera unit The central camera unit is erected on the central unit base body, the central portion of the central unit base body, and the entire camera mechanism is moved and tilted by the operation of the operator. Operating handle that is designed to be able to move, and built in or adjacent to this operating handle A central camera, the peripheral camera units each comprising a peripheral unit substrate, a peripheral camera disposed on the peripheral unit substrate, and a plurality of light sources disposed adjacent to the peripheral camera on the peripheral unit substrate The central camera and the peripheral camera can simultaneously capture, with fixed images and moving pictures, a treatment target area and / or a surgeon's hand at the same time from different viewpoints, and the monitor mechanism usually takes the central area. At least one display device for displaying an image of a camera, and an operation device capable of selecting an image displayed on the display device also from images taken by a surrounding camera by an operation of a viewer Camera system characterized by   The camera system according to claim 1, wherein the central camera unit comprises a plurality of light sources disposed in the vicinity of the central camera, and the plurality of light sources constitute a shadowless lamp.   The said operation apparatus has a function which can be displayed on the said display apparatus combining two or more images among the images which the said central camera unit and the said periphery camera unit image | photographed Camera system.   The camera system according to any one of claims 1 to 3, further comprising a recording unit which simultaneously and simultaneously records respective images photographed by the central camera unit and the surrounding camera unit.   The camera system according to claim 4, wherein the recording unit can simultaneously reproduce two or more videos simultaneously shot by the central camera unit and the surrounding camera unit by synchronized shooting time.   The surrounding camera unit further includes a tilting unit for tilting the surrounding unit base, the operating handle and the tilting unit are in communication via a linking device, and the operating handle is rotated along an axis of rotation. The direction of the surrounding camera can be adjusted by operating the tilting unit via the link device and tilting the base of the surrounding camera unit with respect to the central camera unit. Or 2 camera system.   The shadowless camera mechanism includes a guide light irradiation device for irradiating a subject with guide light, which is a light beam indicating the vertical and horizontal directions of the image of either the central camera or the peripheral camera, without looking at the display The camera system according to any one of claims 1 to 6, wherein the inclination of the photographed image with respect to the treatment target affected area can be known.   The camera system according to any one of claims 1 to 7, further comprising a microphone for acquiring voice information including a conversation during surgery, a recording device for recording the acquired voice information, and a voice output device for outputting the obtained voice.   The camera system according to any one of claims 4 to 8, wherein the recording unit can simultaneously reproduce the video and audio taken and recorded by the central camera unit, the surrounding camera unit and the microphone at the same time. .   The camera system according to any one of claims 1 to 9, wherein the operation handle is provided with a semi-spherical camera at the tip of the handle and capable of recording the surrounding environment over 360 °.   The camera system according to any one of claims 1 to 9, wherein the central camera is a semi-spherical camera and capable of recording surrounding environment 360 degrees. The operation handle is provided with an operation device of the light source of the central unit and the peripheral unit base on the side surface of the handle, and can send an instruction signal on lighting on / off of the light source and adjustment of illuminance. Camera system.   The camera according to any one of claims 1 to 12, wherein each of the central camera and the peripheral camera has a view angle control device, and the control handle has a switch on the side of the handle for sending an instruction signal to the view angle control device Camera system.   The central camera and the peripheral camera each have a focal length control device, and the focal length control device can automatically adjust focus according to an object to be photographed by an automatic focus adjustment function. Camera system.   15. The control handle according to claim 1, wherein operation and stop of the automatic focusing function of the focal distance control device of the central camera and the peripheral camera can be operated through a switch on a side of the handle. Any camera system.   The focal length operating device is configured to adjust the angle of view of the central camera and the peripheral camera via the operating handle and to move or tilt the entire camera mechanism when the automatic focus adjustment function is stopped. The camera system according to any one of claims 1 to 15, wherein it is possible to automatically stop the automatic focus adjustment function after activating the automatic focus adjustment function and adjusting focus when detecting that an operation has occurred.   The camera system according to any one of claims 1 to 16, wherein the operation handle has an operation device of the recording unit attached to a side surface of the handle and can start and stop recording.   The camera system according to any one of claims 7 to 17, wherein the operation handle has an operation device of the recording device attached to a side of the handle, and can start and stop recording.   The camera system according to any one of claims 1 to 18, wherein the operating device of the monitor mechanism is capable of operating the automatic focus adjustment function of the central camera and the focal distance operating device of the surrounding camera.   The camera system according to any one of claims 1 to 19, wherein at least one of the central camera and the peripheral cameras is a stereo camera, and the display device can three-dimensionally display an image captured by the stereo camera.   The camera system according to any one of claims 1 to 20, wherein at least one of the central camera and the peripheral cameras is an infrared camera, and the display device can display an image captured by the infrared camera.   The monitor mechanism cuts out and enlarges an image captured by any one of the central camera, the surrounding camera, and the semi-spherical camera in any imaging range by the operation device which selects the image displayed on the display device. 22. A camera system according to any of claims 10 to 21, which can be displayed on the display.   The camera system according to any one of claims 4 to 22, wherein the recording unit can cut out a plurality of recorded video and audio in an arbitrary time range while keeping time synchronization and output as data.   The display device recognizes that the image being displayed is not displaying the object to be treated such as the treatment target area and / or the treatment target by recognizing the pixels of the image and does not improve the situation for a predetermined time or more The camera system according to any one of claims 1 to 23, wherein it is possible to automatically switch to another video display.   The central unit base body and the surrounding unit base body include a distance measuring device which optically measures the distance to the object in the vicinity of the central camera and the surrounding camera, and transmits the distance information to the CPU provided in the monitoring mechanism. When the CPU detects that the distance suddenly changes greatly and the distance does not return for a certain period of time, it determines that the object to be photographed is not photographed and automatically displays the image of the display device. The camera system according to any one of claims 1 to 24, which can be switched to display of an image of another camera. The recording unit and the recording device automatically and automatically recognize image information and audio information of the recorded video, and add tag information to data time information, thereby recording time information based on the tag information. The camera system according to any one of claims 4 to 25, which is searchable and allows reproduction from a relevant time point.