JP2009141710A - Moving image imaging apparatus, moving image display method, moving image display program, and computer-readable recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily grasp a visual field after changing a frame rate. <P>SOLUTION: A moving image imaging apparatus includes: a read area determination means 32 for determining the size and/or position of a read area with a range for reading image data from an imaging area of an imaging section 10 with a period equal to an imaging period as a read area, based on an imaging period set by an imaging period setting means 31; and an area display means 34 for overlapping and displaying area display RH that corresponds to an imaging period faster than an imaging period at which image data being displayed at a display section 52 is imaged, and indicates the size and/or position of the read area determined by the read area determination means 32 at the display section 52, thus easily grasping the read area after a change by displaying the read area to be changed in advance, when changing the imaging period, and hence confirming a situation in which no objects appear in advance. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a moving image capturing apparatus capable of capturing an image at a high frame rate, such as a high-speed image capturing camera, a moving image display method, a moving image display program, and a computer-readable recording medium.

  In order to capture changes in a subject, high-speed imaging cameras that can continuously capture images at a high frame rate are used. Such an apparatus causes the display means to display frame image data imaged by the imaging means at a predetermined imaging cycle (imaging frame rate) at a frame rate different from that at the time of imaging. For example, an ordinary video camera has a frame rate of 1/30 seconds per image, that is, a frame rate of 30 fps (frame per second), whereas a high-speed camera has a high frame rate of 60 to 32000 fps. Can be set. By recording a moving image using such a high-speed camera and displaying a series of frame image data captured at a high frame rate on a display screen at a frame rate lower than that at the time of imaging, the movement of the subject is detected every minute. It is possible to observe with a slow speed by a series of captured images (for example, see Patent Documents 1 and 2). Here, as described above, the standard speed is 30 fps for the NTSC system, and 25 fps for the PAL system and the SECAM system.

  In a high-speed imaging device, by adjusting an imaging cycle or a frame rate, imaging suitable for various changes in a subject is performed, and a slow image is obtained. Here, if the frame rate is too fast, the time for reading out an image from an image sensor such as a CCD or C-MOS constituting the image pickup means will not be in time. Therefore, in the conventional high-speed imaging device, when the frame rate is increased, the image reading time from the image sensor, that is, the imaging region is limited, so that the image reading time is set to be less than the frame rate.

The higher the frame rate, the shorter the time available for image readout, and the smaller the size of the displayed image readout area. For example, if the image data captured at the standard speed is in the state shown in FIG. 27, the image readout area becomes narrower as shown in FIGS. 28 and 29 as the frame rate is increased. However, since the display screen cannot be used efficiently in this state, the full screen display in which the image reading area is expanded to the entire display screen is performed. For example, when the image reading area shown in FIG. 28 is displayed on the full screen, the image reading area is enlarged and displayed as shown in FIG.
Japanese Patent No. 3046100 JP 2003-319262 A

  Such an enlarged display of the image makes it easy to see details, but there is a problem that it is difficult to grasp in which part of the original image the enlarged image readout area is located. In particular, if the user specifies and displays the enlargement / reduction ratio, it is considered easy to grasp to some extent, but if the magnification is automatically changed on the high-speed imaging device side, the user is expected to be confused. The

  In the conventional high-speed imaging device, such change of the image reading area, that is, enlargement / reduction of an arbitrary area is automatically performed at the timing when the frame rate is changed. For this reason, the user's field of view is suddenly changed during display on the display screen, and the user cannot determine the position of the image after the change before the change or the subject is not reflected in the field of view after the change. There was a problem. In particular, at the setting stage before imaging, it is more convenient to display with a field of view as wide as possible from the viewpoint of field of view search, positioning, and illumination setting. However, the wider the field of view is, the larger the field of view is lost when the frame rate is increased. This makes it easier to lose sight of the display position, which hinders such setting work. Further, even after the field of view is known, it may be necessary to readjust the alignment and illumination settings in order to confirm the display state of the subject, and this is also troublesome.

  The present invention has been made in view of such conventional problems. A main object of the present invention is to provide a moving image imaging apparatus, a moving image display method, a moving image display program, and a computer-readable recording medium that can grasp the field of view after changing the frame rate.

Means for Solving the Problems and Effects of the Invention

  In order to achieve the above object, according to the first moving image pickup device of the present invention, a moving image pickup device for picking up a moving image of a subject to be picked up, which is arranged in a two-dimensional manner. An imaging unit capable of reading captured image data and an imaging cycle when imaging the subject with the imaging unit are different from each other in at least a part of the imaging region in which the imaging device is provided. Based on the imaging cycle setting means that can be set by changing to the imaging cycle, and the imaging cycle set by the imaging cycle setting means, image data is read out from the imaging area of the imaging means at a cycle equivalent to the imaging cycle. Using the possible range as a reading area, a reading area determining means for determining the size and / or position of the reading area, and a series of image data imaged by the imaging means, the image data is imaged. The display means capable of displaying as a moving image with a display cycle slower than the imaging cycle, and the image data taken from the imaging cycle in which the image data is taken from the state in which the image data taken by the imaging means is displayed on the display means. It is detected that the imaging cycle has been changed by the cycle setting means, and is changed in accordance with the size and / or position of the readout area corresponding to the changed imaging cycle determined by the readout area determining means. Display update means for updating the image display of the display means so that a series of image data captured in the imaging period is read from the read area after the change and displayed on the display means in a predetermined display period; An area indicating the size and / or position of the readout area determined by the readout area determination means, corresponding to an imaging cycle faster than an imaging cycle in which image data being displayed on the display means is captured It shows the can and a viewable area display means superimposed in the display unit. As a result, when the imaging cycle is changed, the readout area to be changed is displayed in advance on the image, so that it becomes easy to grasp the readout area after the change and the occurrence of a situation in which the subject is not shown in advance. Can be confirmed. Here, the range in which image data can be read out in a cycle equivalent to the imaging cycle is a range in which image data can be read out in a time equal to or shorter than one cycle of the imaging cycle, and image data in this range is referred to as an imaging cycle. By repeating at substantially the same cycle, a moving image can be taken.

  Further, according to the second moving image imaging apparatus, the area display means can display a plurality of readout areas corresponding to a plurality of imaging cycles in a superimposed manner on the display means as a plurality of area displays. As a result, the readout area corresponding to various imaging cycles can be notified to the user in advance, and the user can individually grasp the field of view after changing the imaging cycle, further improving convenience.

  Furthermore, according to the third moving image pickup device, the moving image pickup device picks up a subject to be picked up, and includes an image pickup device arranged in a two-dimensional shape, and at least one in an image pickup region in which the image pickup device is arranged. An imaging unit that can read out captured image data with respect to the area of the image capturing unit, an imaging cycle setting unit that can be set by changing an imaging cycle when the subject is captured by the imaging unit to a different imaging cycle, Based on the imaging cycle set by the imaging cycle setting means, a range in which image data can be read from the imaging area of the imaging means at a period equivalent to the imaging period is set as a readout area, and the size of the readout area and Read area determination means for determining the position and display means capable of displaying the image data picked up by the image pickup means at a display cycle slower than the image pickup cycle of picking up the image data The size of the first readout area determined by the readout area determining means based on the first imaging period in the first image data captured in the first imaging period displayed on the display means A first readout area storage means for storing the height and / or position, and the second imaging period when the imaging period setting means sets the second imaging period different from the first imaging period. Based on the second read area determining means for recognizing the size and / or position of the second read area determined by the read area determining means, and the second read area storing means stored in the first read area storing means. A read area determining means for obtaining a relative size and / or position between one read area and the second read area recognized by the second read area recognizing means; and displaying the image data. For the display means, An area display unit capable of displaying an area display indicating the second readout area on the first image data based on the relative size and / or position obtained by the output area determination unit. Can be provided. As a result, when the imaging cycle is changed, the readout area to be changed is displayed in advance on the image, so that it becomes easy to grasp the readout area after the change and the occurrence of a situation in which the subject is not shown in advance. Can be confirmed.

  Furthermore, according to the fourth moving image capturing apparatus, it is possible to further include an area position specifying means for specifying the position of the readout area displayed by the area display means. As a result, the user can designate a readout region at a desired position from the wide area image, and can confirm the display state after changing the imaging cycle at the desired position.

  Furthermore, according to the fifth moving image imaging device, the image processing apparatus further includes correspondence relationship storage means for storing a correspondence table in which information relating to the readout region corresponding to the imaging cycle is recorded for each settable imaging cycle, The reading area determining means can determine the reading area according to the correspondence table stored in the correspondence relation storing means. Thus, by previously recording the correspondence relationship between the imaging cycle and the readout area, the readout area can be immediately acquired from the correspondence table and can be processed at high speed and with a light load.

  Furthermore, according to the sixth moving image imaging apparatus, the readout area determining means can calculate and obtain the readout area based on the imaging period set by the imaging period setting means. As a result, the correspondence between the readout area and the imaging period can be calculated every time, and an advantage that a table is unnecessary can be obtained. Further, by changing the arithmetic expression, it is possible to change the readout area to a different shape such as vertically long, horizontally long or square even in the same imaging cycle.

  Further, according to the seventh moving image capturing apparatus, an area for adjusting the size and / or position of the area display displayed on the image data by the area display means on the image data. Display adjustment means can be provided. Thereby, the user can change the display area, that is, the reading area while viewing the image data.

  Furthermore, according to the eighth moving image imaging device, the area display unit detects that the imaging cycle has been changed by the imaging cycle setting unit, and indicates a readout region corresponding to the changed imaging cycle. After the area display is displayed on the display means so as to overlap the image data before the imaging cycle change, the image display of the display means can be updated. Thus, when changing the imaging cycle of the displayed image data, the readout area is not changed suddenly, but the image display is updated after the area display after the change is once shown in the displayed image data. Therefore, before the read area is changed, the changed state can be notified to the user in advance.

  Furthermore, according to the ninth moving image capturing apparatus, the image display on the display means can be updated after a predetermined time has elapsed from the timing at which the imaging cycle is changed. As a result, after instructing the change of the imaging cycle, the display of the area after the change is shown first, and the imaging cycle is automatically changed after a lapse of a certain time, so the user does not need an extra operation. In addition, since the imaging cycle is changed after the field of view of the change destination is notified in advance, it is possible to appropriately cope with the field of view change without being confused.

  Further, according to the tenth moving image capturing apparatus, the image display on the display unit can be updated by operating the change instruction unit for instructing execution of the change of the imaging cycle. Thereby, after instructing the change of the imaging cycle, the change of the imaging cycle is executed by the user operating the change instructing means after first displaying the area display after the change. For this reason, after the user finishes confirming the field of view of the change destination at his / her own pace, the user can instruct the timing to execute the change operation of the imaging cycle, and there is an advantage that oversight of the change position and lack of confirmation can be solved.

  Furthermore, according to the eleventh moving image imaging apparatus, the area display means can be configured to display an imaging cycle indicated by the area display in addition to the area display. Thereby, the imaging cycle indicated by the area display can be clearly shown to the user. In particular, displaying a plurality of area displays is effective because each area display can be identified.

  Furthermore, according to the twelfth moving image capturing apparatus, the region display means can display the region display in a frame shape. Thereby, it can visually grasp that the area surrounded by the frame shape is an area displayed after changing the imaging cycle, and even a user who is not familiar with the operation can understand it sensuously.

  Furthermore, according to the thirteenth moving image capturing apparatus, the area display means can display the area display at a position on the display means. This provides an advantage that the user can visually grasp the position of the read area after the change.

  Furthermore, according to the fourteenth moving image display method, an image obtained by capturing image data of a subject to be imaged with respect to at least a part of an imaging area in which imaging elements are two-dimensionally arranged at a constant imaging cycle. A moving image display method for displaying data on a display unit with a display cycle slower than the imaging cycle after the data is captured by an imaging unit capable of reading data, and based on the imaging cycle, the imaging region of the imaging unit in advance In the step of determining the size and / or position of the reading area as a reading area, and the display means capable of displaying the image data captured by the imaging means, An area display indicating the size and / or position of the determined readout area corresponding to an imaging period different from the imaging period in which the image data was captured is displayed over the image data. And the size and / or position of the readout area corresponding to the changed imaging cycle by detecting that the imaging cycle is changed from the imaging cycle in which the image data displayed on the display means is captured. Accordingly, the image display of the display unit is updated so that a series of image data captured in the changed imaging cycle is read from the read-out area after the change and displayed on the display unit in a predetermined display cycle. Steps. As a result, when the imaging cycle is changed, the readout area to be changed is displayed in advance on the image, so that it becomes easy to grasp the readout area after the change and the occurrence of a situation in which the subject is not shown in advance. Can be confirmed.

  Furthermore, according to the fifteenth moving image display program, an image obtained by capturing image data of a subject to be imaged with respect to at least a part of an imaging area in which imaging elements are two-dimensionally arranged at a constant imaging cycle. A moving image display program for displaying data on a display unit at a display cycle slower than the imaging cycle after the data is captured by an imaging unit capable of reading data, and based on the imaging cycle, the imaging region of the imaging unit in advance A function for determining the size and / or position of the read area, and a display means capable of displaying the image data picked up by the image pickup means. An area display indicating the size and / or position of the determined readout area corresponding to an imaging cycle different from the imaging cycle in which the image data was captured is superimposed on the image data. It is possible to realize the Shimesuru function to the computer. As a result, when the imaging cycle is changed, the readout area to be changed is displayed in advance on the image, so that it becomes easy to grasp the readout area after the change and the occurrence of a situation in which the subject is not shown in advance. Can be confirmed.

  Furthermore, a sixteenth computer-readable recording medium stores the above program. Recording media include CD-ROM, CD-R, CD-RW, flexible disk, magnetic tape, MO, DVD-ROM, DVD-RAM, DVD-R, DVD + R, DVD-RW, DVD + RW, Blu-ray, HD A medium that can store a program such as a magnetic disk such as a DVD (AOD), an optical disk, a magneto-optical disk, a semiconductor memory, or the like is included. The program includes a program distributed in a download manner through a network line such as the Internet, in addition to a program stored and distributed in the recording medium. Further, the recording medium includes a device capable of recording the program, for example, a general purpose or dedicated device in which the program is implemented in a state where the program can be executed in the form of software, firmware, or the like. Furthermore, each process and function included in the program may be executed by computer-executable program software, or each part of the process or hardware may be executed by hardware such as a predetermined gate array (FPGA, ASIC), or program software. And a partial hardware module that realizes a part of hardware elements may be mixed.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the following embodiments exemplify a moving image capturing apparatus, a moving image display method, a moving image display program, and a computer-readable recording medium for embodying the technical idea of the present invention. The present invention does not specify a moving image capturing apparatus, a moving image display method, a moving image display program, and a computer-readable recording medium as follows. Further, the present specification by no means specifies the members shown in the claims to the members of the embodiments. In particular, the dimensions, materials, shapes, relative arrangements, and the like of the constituent members described in the embodiments are not intended to limit the scope of the present invention only to the description unless otherwise specified. It is just an example. Note that the size, positional relationship, and the like of the members shown in each drawing may be exaggerated for clarity of explanation. Furthermore, in the following description, the same name and symbol indicate the same or the same members, and detailed description thereof will be omitted as appropriate. Furthermore, each element constituting the present invention may be configured such that a plurality of elements are constituted by the same member and the plurality of elements are shared by one member, and conversely, the function of one member is constituted by a plurality of members. It can also be realized by sharing. In addition, the contents described in some examples and embodiments may be used in other examples and embodiments.

  The connection between the moving image capturing apparatus used in the embodiment of the present invention and the computer, printer, external storage device and other peripheral devices for operation, control, display, and other processing connected thereto is, for example, IEEE 1394. , RS-232x, RS-422, serial connection such as USB, parallel connection, or communication via electrical, magnetic, or optical connection via a network such as 10BASE-T, 100BASE-TX, 1000BASE-T I do. The connection is not limited to a physical connection using a wire, but may be a wireless connection using a wireless LAN such as IEEE802.1x, radio waves such as Bluetooth, infrared rays, optical communication, or the like. Furthermore, a memory card, a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like can be used as a recording medium for exchanging data or storing settings. In this specification, the term “moving image capturing device” is used to include not only a moving image capturing device body but also a moving image capturing system in which peripheral devices such as a computer and an external storage device are combined.

  Further, in this specification, the moving image capturing apparatus is limited to the system itself that performs high-speed observation image capturing, and the apparatus and method that perform input / output, display, calculation, communication, and other processes related to imaging in hardware. Not what you want. An apparatus and method for realizing processing by software are also included in the scope of the present invention. For example, a general-purpose circuit or computer that incorporates software, programs, plug-ins, objects, libraries, applets, compilers, modules, macros that operate on specific programs, etc., and enables imaging itself or related processing The system also corresponds to the moving image capturing apparatus of the present invention. In this specification, the computer includes a general-purpose or dedicated computer, a workstation, a terminal, a portable electronic device, PDC, CDMA, W-CDMA, FOMA (registered trademark), GSM, IMT2000, fourth generation, and the like. Mobile phones, PHS, PDAs, pagers, smartphones and other electronic devices. Further, in the present specification, the program is not limited to a program that is used alone, an aspect that functions as a part of a specific computer program, software, service, etc., an aspect that is called and functions when necessary, an environment such as an OS, etc. It can also be used as a mode provided as a service, a mode that operates resident in the environment, a mode that operates in the background, and other support programs.

  In this specification, high-speed observation is also referred to as high-speed imaging or the like, and captures instantaneous images that are difficult to see with the human eye as a plurality of continuous frame images. (Unit for defining the number of images acquired continuously in one second) Imaging is performed at 100 fps to 1 million fps. At this time, the subject can be appropriately enlarged and displayed as necessary.

Note that high-speed imaging basically captures still images continuously, but if they are displayed continuously, they can be handled like moving images, and may be referred to as video recording for convenience. . That is, in this specification, a moving image refers to a set of a series of still images captured continuously at a predetermined frame rate. Further, one screen data in which a moving image is displayed on the display unit is also referred to as image data.
(Block Diagram)

  FIG. 1 is an external perspective view of a moving image capturing apparatus 100 according to an embodiment of the present invention, and FIG. 2 is a block diagram. The moving image imaging apparatus 100 shown in these drawings includes a head unit 15 that includes the imaging unit 10, a main body unit 50 that drives and controls the head unit 15 to perform image processing, and a cable unit 24 that connects them. The The head unit 15 includes an imaging module 16 including the imaging unit 10, an illumination module 66 including the illumination unit 60, and the lens module 20. On the other hand, the main body 50 generates an illumination light source 64 for supplying illumination light to the illumination means 60 and an imaging control unit for generating an imaging control signal for controlling the imaging unit 10 and transmitting the imaging control signal to the imaging unit 10. 13 and an image processing unit 81 for performing image processing on an image captured by the imaging unit 10. Furthermore, the main body 50 includes a display unit 52 that displays an image captured by the imaging unit 10 and an operation unit 55 for a user to perform various settings and operations. If the moving image capturing apparatus 100 can be exchanged for the lens module 20 and the illumination module 66 according to the observation application, one moving image capturing apparatus can be used for a plurality of different applications.

  Furthermore, the main body 50 has an imaging cycle setting means 31 for changing the imaging cycle of the imaging unit 10 as necessary, and a reading area from which image data can be read from the imaging region of the imaging unit 10 based on the imaging cycle. And a reading area determining means 32 for determining the size and / or position of the image, and an image corresponding to the size and / or position of the reading area corresponding to the changed imaging period by detecting that the imaging period has been changed. Display update means 33 for reading data from the read area and displaying it on the display means at a predetermined display cycle, and area display RH indicating the size and / or position of the read area on the display unit 52 Means 34, area display adjusting means 35 for adjusting the reference position of the area display RH, area position specifying means 36 for specifying the reference position and the size of the readout area, and the user can further display the moving image. Change instructing means for instructing the execution 37, the shutter speed setting means 38 for setting a shutter speed, and a trigger setting means 39 for setting a trigger.

The moving image imaging apparatus 100 can display a series of image data captured by the imaging unit 10 on the display unit 52 as a moving image with a display cycle slower than the imaging cycle at the time of imaging. That is, the captured moving image can be reproduced at a slow speed.
(Head 15)

The head unit 15 includes the imaging unit 10 in the imaging module 16. The imaging unit 10 includes an imaging element 12 that electrically reads reflected light incident through an optical system from a subject S (sample, work, etc.) to be observed illuminated by the illumination unit 60. In this example, the imaging element 12 uses a CMOS, but other elements such as a CCD can also be used. Here, the outer shape of the head unit 15 is a cylindrical imaging module 16 as shown in FIG. 1, and the imaging element 12 is built inside. Also, a plurality of types of imaging modules 16 for monochrome imaging, color imaging, and the like are prepared, and by appropriately selecting these, a moving image imaging apparatus that can handle various applications can be obtained.
(Imaging unit 10)

The imaging unit 10 has the image sensor 12 arranged in a two-dimensional manner, and the captured image data can be read out from at least a part of the imaging region in which the image sensor 12 is arranged. That is, image data acquired by all of the imaging elements is not always read from the entire imaging area, but is limited to a partial area (a reading area or a visual field range described later) according to the imaging cycle and the like to acquire image data. Thus, high-speed reading is possible. In addition, an imaging cycle (so-called imaging frame rate; in the present specification, it may be simply referred to as “frame rate”) can be changed to a different cycle when the subject is imaged by the imaging unit 10. Yes. The frame rate can be set, for example, in the range of 30 to 32000 fps.
(Lens module 20)

The lens module 20 contains an optical lens that is optically coupled to the image sensor 12. The lens module 20 includes a plurality of optical lenses having a size and a curvature according to required magnification and brightness. In addition to a lens module that incorporates a lens for high-speed observation, for example, a lens module that incorporates a lens for magnified observation may be prepared and exchangeable.
(Lighting means 60)

The illumination means 60 illuminates the subject S imaged on the image sensor 12 via the lens module 20. The light source of the illuminating unit 60 is built in the main body unit 50, and the illumination light is transmitted to the illuminating unit 60 of the head unit 15 via the cable unit 24. The illuminating means 60 can be incorporated in the head unit 15 or can be separated from the head unit 15.
(Main body 50)

The main body unit 50 includes an illumination light source 64, an imaging control unit 13, an image processing unit 81, a memory unit 53, and an interface unit 54. In the example of FIG. 2, each member is incorporated in the main body unit 50, but the main body unit 50 is not limited to this configuration, and the illumination light source 64, the imaging control unit 13, the image processing unit 81, and the like are each divided into units. It can also be possible. Thereby, the freedom degree of a structure increases. For example, it is possible to connect externally without incorporating a light source for illumination. In this case, the light source can be easily switched, but the installation of the light source and wiring work are required, which is troublesome.
(Light source for illumination 64)

  Lighting of the illumination light source 64 is controlled by the imaging control unit 13. Specifically, when using a metal halide lamp or a halogen lamp, a mask plate (not shown) that shields all or part of the illumination light on the optical path with the connection terminal to which the illumination light supply cable 61 is connected. )). The mask plate is shaped so that two large and small substantially fan shapes are connected back to back, and is mounted so as to be rotatable about a rotation axis. An opening window is provided in the large fan-shaped portion, and a substantially circular all-round illumination opening window and a substantially fan-shaped side illumination opening window are respectively opened. In addition, a gear groove is formed on the circumferential side surface portion of the small sector shape. This mask plate is connected to be rotatable about a rotation shaft, and is rotated by a motor. The motor has a worm gear fixed to the rotating shaft, and the gear portion of the worm gear is arranged so as to mesh with a gear groove provided in a small fan-shaped arc portion of the mask plate. When the mask plate is rotated by rotating the motor, one of the all-round illumination opening window and the side illumination opening window coincides with the illumination light supply cable 61. As a result, the illumination light supply cable 61 is connected to the illumination light source 64 so that illumination light can be emitted from the illumination means 60.

In addition to metal halide lamps, mercury lamps, xenon lamps, halogen lamps and LEDs can be used. LEDs have fewer infrared components than halogen lamps, metal halide lamps, and the like, and even when irradiated with the same amount of light, the advantage of less heat generation to the subject can be obtained. In addition, it is relatively inexpensive and has a long service life, excellent responsiveness to input, and can be controlled to light without using a mask plate that blocks illumination light. Can be turned off.
(Imaging control unit 13)

The imaging control unit 13 sets imaging conditions such as a frame rate and a shutter speed during high-speed observation via the operation unit 55, and controls each unit according to the set imaging conditions. Specifically, an imaging control signal for driving and controlling the imaging element 12 of the imaging unit 10 is generated and transmitted to the imaging unit 10. Further, ON / OFF and light shielding of the illumination light source 64 are controlled. For example, when performing strobe imaging, a synchronization signal synchronized with the imaging is output, the lighting light source 64 is turned on / off by the synchronization signal, and the imaging element 12 performs imaging. As described above, the imaging control unit 13 transmits to the illumination light source 64 the imaging timing signal synchronized with the start and end times of one imaging and the exposure timing signal synchronized with the exposure start time of each frame being imaged. Is done.
(Image processing unit 81)

The image processing unit 81 performs image processing on the image captured by the imaging unit 10. For example, a measurement process is performed on the subject image displayed on the display unit 52, such as designating a region and calculating an area or calculating a height difference, a distance, and an angle.
(Display unit 52)

The display unit 52 is a display that displays captured images and settings. As the display unit 52, a CRT, a liquid crystal panel, or the like is used. In the example of FIG. 1, the display unit 52 is incorporated in the main body unit 50, but it is also possible to connect an external display by providing a video output terminal.
(Memory unit 53)

The memory unit 53 holds captured image data, setting contents, and the like. Preferably, a high-speed semiconductor memory such as a RAM is used as a temporary storage area, and a hard disk is used as a data storage area.
(Interface section 54)

In addition, an interface unit 54 for exchanging data with an external device via I / O or communication is provided. A terminal hole for connecting the cable portion 24 and various connectors is opened in the main body portion 50 as a port for transferring control signals, image data, and the like to an external device. Also, by providing a USB port, data communication can be easily performed by writing data to a USB memory or by serial connection with another computer or the like.
(Operation unit 55)

The operation unit 55 is an input / output device for a user to perform input and other operations based on a screen displayed on the display unit 52. The operation unit 55 is connected to the main body unit 50 by wire or wirelessly, or is fixed to the main body unit 50. Examples of the general operation unit 55 include various pointing devices such as a mouse, keyboard, slide pad, track point, tablet, joystick, console, jog dial, digitizer, light pen, numeric keypad, touch pad, and accu point. In addition to the operation of the moving image capturing apparatus, these operation units 55 can be used for the operation of the moving image capturing apparatus itself and its peripheral devices. Furthermore, using a touch screen or touch panel on the display itself that displays the interface screen, the user can directly input or operate the screen by hand, or use voice input or other existing input means, Or these can also be used together. The display unit 52 and the operation unit 55 can be incorporated integrally with the main body unit 50 or can be external members connected to the main body unit by wire or wirelessly. Furthermore, if a display part is comprised with a touch panel, a display part and an operation part can also be comprised integrally. The operation unit 55 can also be configured with a wireless connection console.
(Reading area determining means 32)

  The imaging frame rate is set by the imaging cycle setting means 31. When the imaging frame rate is increased, the reading speed from the imaging device is not in time. Therefore, by limiting the area that can be read from the imaging area within a given time as a reading area according to the imaging frame rate, it is possible to support high-speed reading. For this purpose, the reading area determining means 32 calculates the size of the reading area in accordance with the imaging frame rate. Based on the imaging frame rate, the reading area determination unit 32 determines the size and / or position of the reading area using a range in which image data can be read from the imaging area of the imaging unit 10 as a reading area. Note that the imaging frame rate serving as a reference for the calculation at this time can be set to the imaging frame rate set by the imaging cycle setting unit 31 or can be a slightly faster cycle or a slower cycle.

  The read area determining means 32 calculates the size and / or position of the read area for each frame rate. That is, the readout area is calculated and obtained based on the imaging frame rate set by the imaging cycle setting means 31. As a result, the correspondence between the readout area and the imaging frame rate can be calculated every time, and an advantage that a table is unnecessary can be obtained. Further, by changing the arithmetic expression, it is possible to change the readout area to a different shape such as vertically long, horizontally long, or square even at the same imaging frame rate.

In addition to calculating the size and / or position of the reading area for each frame rate, the reading area determining means 32 can also refer to the table using a table in which the correspondence between the frame rate and the reading area is recorded in advance. . Such a table may be incorporated in the read area determination unit 32 or may be a separate storage unit such as a memory. In the example of FIG. 2, a correspondence table in which information related to the readout area corresponding to the imaging frame rate is recorded for each settable imaging frame rate is recorded in the correspondence storage unit 56 of the memory unit 53. Thereby, the read area determining unit 32 determines the read area according to the correspondence table stored in the correspondence storage unit 56. With such a configuration, it is possible to reduce the load on the reading area determination unit 32 and realize high-speed processing.
(Display update means 33)

  The change of the frame rate by the imaging cycle setting means 31 and the update of the display unit 52 after the change can be performed in real time. As a result, the user can adjust the frame rate with the imaging cycle setting means 31 while confirming the result displayed on the display unit 52, so that a desired moving image can be obtained. That is, it is possible to adjust to an optimum frame rate according to the observation application and purpose, such as an imaging frame rate at which necessary events can be grasped and an imaging frame rate with less blur. Such display update is performed by the display update means 33.

The display update unit 33 changes the imaging frame rate by the imaging cycle setting unit 31 from the imaging frame rate at which the image data is captured from the state in which the image data captured by the imaging unit 10 is displayed on the display unit 52. A series of images captured at the changed imaging frame rate in accordance with the size and / or position of the readout area corresponding to the changed imaging frame rate determined by the readout area determining means 32. The image display of the display unit 52 is updated so that the image data is read from the read area after the change and displayed on the display unit 52 at a predetermined display cycle (display frame rate).
(Area display means 34)

  On the other hand, if the imaging frame rate is increased, reading of image data from the imaging device will not be in time. Therefore, by limiting the reading area to a part of the image data reading area rather than the entire imaging area provided with the image sensor, it is possible to obtain a moving image that does not cause frame dropping even at a high frame rate. However, in this case, since the image size that can be captured becomes small, a situation in which the visual field desired by the user cannot be obtained may occur. In particular, when the frame rate is updated in real time, it may be impossible to grasp which area is currently displayed. In some cases, it is necessary to readjust the field of view by changing the imaging frame rate. In order to adjust the field of view and adjust the camera focus and the angle of the illumination module 66, it is necessary to actually adjust the head unit 15 with the user's own hand. In particular, when the display unit 52 and the head unit 15 are separated from each other, the user stands up from the state of operating while viewing the screen of the display unit 52 and moves to the location of the head unit 15. Need to do work. Considering the labor of readjustment in this way, it is preferable to make adjustments with an eye on the change in field of view after changing the imaging frame rate at the initial setting stage.

  Therefore, by notifying the user in advance that the field of view of the display unit 52 is limited according to the frame rate at the stage of adjusting the head unit 15, such a situation of losing the subject or the subsequent re-use. The need for adjustment work can be eliminated. For this reason, the area display unit 34 displays the area display RH indicating the size and / or position of the reading area for each frame rate determined in advance by the reading area determining unit 32 in an overlapping manner on the display unit 52. As a result, when the imaging frame rate is changed, the change-out reading area is displayed in advance on the image, so that the reading area after the change can be easily grasped and the subject is not reflected or an appropriate position is set. It is possible to confirm in advance the occurrence of a situation such as failure to capture.

  FIG. 3 shows a screen example in which the area display RH is displayed on the display unit 52 in an overlapping manner. As described above, the area display RH is displayed in a frame shape so as to overlap the image data of the subject. In addition to displaying only one frame rate, the region display RH may display a region display RH corresponding to a plurality of frame rates in an overlapping manner as shown in FIG. As a result, it is possible to notify the user in advance of the readout areas corresponding to various imaging frame rates, and the user can individually grasp the field of view after changing the imaging frame rate, further improving convenience. At this time, by adding the value of the frame rate corresponding to each region display RH, the user can easily recognize the change in the field of view when adjusting the frame rate by the imaging cycle setting means 31 in a frame shape. Furthermore, a region display corresponding to a higher imaging frame rate can also be displayed on the image after changing the imaging frame rate. It goes without saying that the area display means 34 can also turn on / off such an area display function.

The size of the read area can be grasped as a change in relative size. For this reason, the moving image data obtained at a certain imaging frame rate is displayed on the display unit 52, and the size and / or position of the reading region of this frame rate is stored in the first reading region storage means of the memory unit 53. Keep it. In this state, the size and / or position of the readout area determined by the readout area determination unit 32 for each imaging frame rate is not particularly stored for the changed imaging frame rate candidates. Is temporarily held by the second reading area recognition means, the relative size and / or position of the current reading area and the changed reading area are obtained by the reading area determination means 32, and this relative The area display indicating the read area after the change can be superimposed and displayed on the current moving image data from the specific size and / or positional relationship.
(Area display adjustment means 35)

In the example of FIG. 3, each reading area is set to be located at the center of the screen of the display unit 52. However, the reference position is not limited to the center, and can be set to any position such as the upper left or lower right of the screen. This adjustment is performed by the area display adjustment means 35. The area display adjustment means 35 adjusts the position of the area display RH on the image data. For example, the reference position is designated by the coordinate position, or the reference position is designated directly from the screen of the display unit 52 by a pointing device such as a mouse.
(Area position designation means 36)

  Alternatively, the user may specify the reference position and the size of the reading area. This designation is performed by the area position designation means 36. The area position specifying means 36 adjusts the position of the area display RH on the image data. The region position designation means 36 can change the reference position by designation from the screen using a coordinate position or a pointing device such as a mouse. As a result, the user can designate a reading area at a desired position from the wide area image, and can confirm the display state after changing the imaging frame rate at the desired position.

  Furthermore, not only the reference position of the area display RH but also means for designating the size of the area display RH may be provided. For example, the user designates a reference position by clicking on the screen of the image display field 304 of the display unit 52 with a pointing device such as a mouse, or drags a corner to designate a rectangular area, thereby newly reading out An area can be specified. Thereby, the user can change the reading area while viewing the image data. As a matter of course, a restriction is imposed on the readout area based on the changed imaging frame rate.

  The area display RH can display a reading area narrower than the area currently being displayed. For this reason, it is preferable that the screen for performing the area display RH is based on image data obtained by imaging a subject with a wide field of view. That is, area display RH is performed on the image data captured in the entire imaging area acquired by all of the imaging elements. Thereby, it is possible to easily display the region display RH corresponding to a plurality of different frame rates. However, the present invention is not limited to this. For example, even after the display updating unit changes the readout area to be narrower than the imaging area, it is also possible to display a further narrow readout area, that is, an area display RH corresponding to a faster frame rate.

  Further, the area display means 34 can limit the number of area displays displayed on one screen. In particular, when a large number of area displays are simultaneously displayed on one screen, it may be difficult to determine an area display corresponding to a desired frame rate. Therefore, by limiting the number of area displays, such a problem can be solved and the display can be easily viewed. Such area display details can also be set by the area display adjusting means 35. Also, in order to distinguish each area display, in addition to changing the color of the lines that make up the frame shape, highlighting such as line thickness, line type (solid line, broken line, wavy line, etc.), blinking / highlighting / greyout, etc. A method of changing the color or hatching pattern that fills the area surrounded by the frame shape, or a combination of these can also be used as appropriate. Further, the display is not limited to a frame shape, and for example, an x or an icon can be displayed at four corners, or a region display can be expressed by a locus of a cursor moving in a frame shape. Alternatively, the area display may be displayed with position information such as a coordinate position. Furthermore, as shown in the lower part of FIG. 3, vertical and horizontal sizes corresponding to the imaging frame rate may be displayed on the screen of the display unit 52.

Furthermore, it is also possible to provide a separate screen from the image display column 304 for displaying an image, and display the region corresponding to the image display column 304 in this separate screen. For example, as shown in FIG. 4, a reduced display column 304 ′ smaller than this is provided on the right side of the image display column 304, and an area display RH ′ is performed on the reduced display column 304 ′. With this configuration, it is possible to confirm the change in the visual field after the change in the frame rate before the change without hindering the display of the subject displayed in the image display field 304. In addition, even after the frame rate is changed, it is possible to confirm which part of the field of view before the change is currently observed, so that it is possible to obtain an advantage that it is easy to understand before and after the change of the position of the field of view. In particular, by fixing the display of the reduced display field 304 ′ to a reduced display of the entire imaging area, no matter which part of the imaging area is observed as an absolute index, regardless of how the frame rate is changed. It is easy for beginners to understand the changes in the field of view.
(Time difference display)

  In the above example, the user changes the frame rate by the imaging cycle setting means 31 in a state where a plurality of frame-like area displays are displayed in advance. In this configuration, in order to grasp the change in the field of view after the frame rate is changed, the user first determines the frame rate after the change, and then selects an area corresponding to the frame rate after the change from the plurality of area displays. After finding out the display, it is necessary to check the field of view. In particular, as described above, when multiple area displays are displayed simultaneously as shown in FIG. 3, it may not be easy to find out which area display corresponding to a desired frame rate corresponds to. Therefore, it is possible to adopt a configuration in which, instead of displaying a plurality of candidate area displays in advance, an area display corresponding to the frame rate is displayed after the user determines the changed frame rate.

  As an example, when the area display unit 34 detects that the frame rate has been changed by the imaging period setting unit 31, before changing the frame rate, the area display RH indicating the readout area corresponding to the changed frame rate is displayed. , Once displayed on the display unit 52. After that, the display content of the display unit 52 is updated to a moving image whose frame rate has been changed at a predetermined timing. As a result, only the area display RH after the change is displayed once, and the image display is updated. Therefore, the user can surely grasp the positional relationship of the read areas after the change without hesitation from the plurality of area displays RH. In addition, since the update to the moving image after the frame rate is updated is performed at a predetermined timing, the reading area is not suddenly updated, and the change of the field of view can be sufficiently handled with a margin. Especially for novice users, there is a risk of being confused if the field of view is suddenly changed when only the frame rate is to be changed, but once the change of the field of view has been announced as the frame rate is changed, the change is made. If performed, such a sense of incongruity is reduced, and it is expected that the operation can be understood smoothly.

Here, the predetermined timing for updating the display of the moving image is a timing at which the user operates the change instructing means 37 for instructing execution of the display update, or a predetermined time from the timing at which the user changes the imaging frame rate (for example, After a few seconds). According to the operation of the change instruction unit 37 (for example, pressing of the update button), the update can be executed at the user's own pace, so that it is particularly easy for a novice user. Further, in the configuration in which the update is automatically performed after a certain period of time, the display can be automatically updated without requiring a specific operation such as pressing the change instruction button, so that the burden on the user operation can be reduced. These can be adopted as appropriate according to the user's request, or can be switched and executed.
(Adjustment of imaging frame rate and field of view)

A procedure for adjusting the imaging frame rate and the field-of-view range according to the above using the region display unit 34 will be described with reference to the flowchart of FIG. First, in step S′1, an imaging frame rate to be changed is designated. The change of the frame rate is performed from the “display field-of-view range corresponding to the frame rate” column 382, which is one form of the imaging cycle setting means shown in FIG. At this stage, the imaging frame rate changing process itself is not yet executed. Next, in step S′2, the area after changing the imaging frame rate is displayed. In the example of FIG. 17, when the frame rate in the “display visual field range according to frame rate” field 382 is changed, the region display RH indicating the visual field range corresponding to the designated frame rate is displayed in the image display field 304 of the display unit. Is superimposed. Next, in step S′3, it is determined whether or not the subject is included in the area. Here, the user confirms whether or not the desired region of the subject is properly included in the region display RH in the image display field 304. If it is included appropriately, the user jumps to step S'5 and is inappropriate. If not, in step S′4, the camera position, magnification, etc. are adjusted so that the subject is included in the area, and the process proceeds to step S′5. In step S′5, the imaging frame rate is changed. Here, the display content is updated so that the field-of-view range after changing the imaging frame rate is displayed in the image display field 304 of the display unit. In this way, the user can appropriately specify the changed visual field range by using the area display means 34 while adjusting to a desired imaging frame rate.
(Tentative imaging)

  The moving image capturing apparatus 100 displays a live image on the display unit 52 under the set conditions before capturing and storing a moving image. In addition, moving image data that has been temporarily shot under the set conditions can be displayed on the display unit 52. FIG. 5 shows a block diagram of the moving image imaging apparatus 100 having such a provisional imaging function. The moving image imaging apparatus 100 shown in this figure includes an imaging unit 10, an imaging control unit 13, and a display unit 52, as in FIG. 2, and is operated from an external input device GN. In addition, the imaging control unit 13 confirms the moving image data captured by the imaging unit 10 and the live processing unit 82 for displaying the moving image data captured by the imaging unit 10 in real time on the display unit 52 at the temporarily set frame rate. A recording / playback unit 83 is provided for acquiring a moving image under the adjusted imaging conditions and storing the data.

An operation unit 55 such as a mouse can be used as the external input device GN. The user can set and change the frame rate with the imaging period setting means 31 by operating the operation unit 55. The imaging unit 10 captures a moving image of the subject according to the set frame rate. On the other hand, the processing selection unit 84 is operated by the external input device GN, and the recording / playback unit 83 and the live processing unit 82 are switched as moving image data destinations. In accordance with this switching destination, the moving image data read from the image sensor 12 of the imaging unit 10 is sent to the recording / playback unit 83 or live processing unit 82 on the side switched by the data switching unit 89. Note that although the operation unit 55 is connected in the example of FIG. 5, a device that generates an external trigger can be used as the external input device GN, and more various uses are possible.
(Live processing unit 82)

The live processing unit 82 includes a continuous image extraction unit 85 and an image output unit 86. The continuous image extraction unit 85 extracts the image data obtained by the imaging unit 10 while thinning out at a constant cycle so that the image data can be displayed at the display frame rate. The extracted image data is output as a live image from the image output unit 86 to the display unit 52 at the display frame rate and displayed. Thereby, real-time image data captured at a high frame rate can be displayed as a live image at a low frame rate, and live observation can be performed.
(Recording / playback unit 83)

  The recording / playback unit 83 actually acquires and stores moving image data in accordance with the imaging conditions of this setting determined with reference to the real-time display in the live processing unit 82. The recording / playback unit 83 includes a trigger processing unit 87, an image writing unit 88, an image storage unit 58, and an image reading unit 86 '. The trigger processing unit 87 instructs the image writing unit 88 to start imaging according to a timing designated by the external input unit or a predetermined trigger. The image writing unit 88 takes in moving image data in accordance with the trigger from the trigger processing unit 87 and stores it in the image storage unit 58 of the memory unit 53. The stored moving image data is read by the image reading unit 86 ′ and displayed on the display unit 52.

  The final imaging condition finally determined is also performed by operating the imaging cycle setting unit 31, the shutter speed setting unit 38, the trigger setting unit 39, and the like with the operation unit 55 and the like. For example, according to the imaging frame rate set by the imaging cycle setting means 31, image data is continuously captured by the imaging unit 10, and a predetermined number of image data captured is recorded in the image storage unit 58 by the image writing unit 88.

The image reading unit 86 ′ reproduces a predetermined number of recorded image data on the display unit 52 at a display frame rate in the order of image capturing. Slow reproduction is realized by setting the display frame rate to a cycle slower than the imaging frame rate.
(Moving images)

Next, a setting procedure when capturing a moving image will be described. As shown in FIG. 1, as the head unit 15 of the moving image imaging apparatus 100, an imaging module 16 that incorporates an imaging element 12 for color imaging or monochrome imaging is selected, and the lens module 20 is attached to the tip of the imaging module 16. To do. At this time, the optical axis of the image pickup device 12 built in the image pickup module 16 and the optical axis of the lens module 20 are optically joined so as to coincide with each other. Further, an illumination unit 66 is attached to the imaging module 16 or the lens module 20 as the illumination means 60. In this way, by making the illumination unit 66 a separate member from the lens module 20 and enabling it to be mounted on the head unit 15, it is possible to easily prepare illumination equipment for high-speed observation that has been troublesome to install separately in the past. Furthermore, the adjustment work is also simplified by the illumination unit tilt angle adjusting means. In the example of FIG. 1, the illumination unit 66 can be attached to and detached from the lens module 20. However, if a type in which the illumination unit is integrally fixed to the lens module in advance is used, only the lens module can be attached to the head portion to facilitate handling.
(Setting program for moving image capturing device)

  Here, an example of the user interface screen 300 of the setting program of the moving image capturing apparatus for setting and operating the moving image capturing apparatus 100 is shown in FIGS. 6 shows a recording mode screen 300A for performing high-speed imaging, that is, recording a moving image, and FIG. 7 shows a preview mode screen 300B for reproducing recorded high-speed imaging data (moving image data). In this program, moving image data captured at a high speed on the recording mode screen 300A is displayed on the preview mode screen 300B. Switching between the recording mode screen 300A and the preview mode screen 300B can be performed by selecting the “recording mode” and “preview mode” switching buttons, which are the screen switching means 302 provided at the upper right of the screen.

  6 and 7 are normal recording mode setting screens in which all the setting items can be directly operated. The basic configuration of each screen is common, and an image display field 304 for displaying an image at the center, and a tool bar 320 on which tool buttons for switching to a screen for performing various settings are arranged at the top. Also, below the toolbar 320, the screen switching means 302 for switching the screen is on the right side of the image display column 304, below that is the item setting column 310 of specific setting items in each menu, and further below the image display column 304 is below. An operation setting column 306 including progress bars 306A and 306B, trigger setting, start and stop buttons, and the like is provided.

  Needless to say, in the screen examples of these programs, the arrangement, shape, display method, size, color scheme, pattern, etc. of each input field and button can be changed as appropriate. By changing the design, it is possible to make the display easier to view, easier to evaluate and judge, and easier to operate. For example, in the example of FIG. 6, the image display field 304 and the item setting field 310 are displayed on the same screen, but it goes without saying that any of these may be displayed in separate windows.

  In addition, on the user interface screens of these programs, ON / OFF operations for numerically provided buttons and input fields, designation of numerical values and command inputs, etc. are specified by a moving image pickup apparatus incorporating a setting program for the moving image pickup apparatus. Alternatively, the operation is performed by the operation unit 55 connected to the computer in which the setting program for the moving image capturing apparatus is installed. In this specification, “pressing” includes not only physically touching buttons and operating them, but also clicking or selecting with the operation unit 55 and pressing them in a pseudo manner.

A computer connected to the moving image capturing apparatus can also be used as the operation unit itself. By causing the computer to execute a setting support program for the moving image capturing apparatus, the operation unit can function as a setting support apparatus for the moving image capturing apparatus. Of course, it goes without saying that such a setting support device or setting support program for the moving image capturing apparatus can be incorporated in the main body of the moving image capturing apparatus itself. Furthermore, an external input device can be used as the operation unit, and data can be communicated with the external input device or an external trigger can be input to perform an operation.
(Recording mode screen 300A)

First, the recording mode screen 300A shown in FIG. 6 will be described. In the recording mode screen 300A, the item setting field 310 includes a brightness setting field 311 for setting brightness, an imaging frame rate setting field 315 for setting a frame rate, and operation buttons 316 for performing various operations. . In the brightness setting column 311, a shutter speed setting column 312 for setting the shutter speed of the imaging unit 10 and a gain setting column 314 for setting a gain are provided. Below that, an imaging frame rate setting field 315 for setting a frame rate at the time of imaging, a slow observation button 316B for performing slow observation, and a recording button 318 for starting recording are provided. In the shutter speed setting field 312 and the gain setting field 314, if a drop button provided on the right side is pressed, a preset numerical value is presented as an option in a drop-down menu or a pull-down menu. Further, it is possible to directly input a numerical value.
(Shutter speed setting field 312)

The shutter speed setting field 312 sets the shutter speed of the camera, that is, the exposure time, as one form of the shutter speed setting means 38. Here, the shutter speed cannot be faster than the reciprocal of the imaging frame rate for capturing a moving image. For example, when the imaging frame rate is 1000 fps, the shutter speed can be set only from 1/100000 to 1/1000 seconds. In this example, the shutter speed can be set in the range of 1/100000 to 1/30 seconds.
(Gain setting field 314)

In the gain setting field 314, the gain of the camera is set. Here, adjustment is possible in three stages of x1 (0 dB), x2 (+6.0 dB), and x3 (9.5 dB).
(Temporary imaging start button 317)

Under the gain setting field 314, a temporary imaging start button 317 and a temporary stop button 317 ′ for executing temporary imaging are provided. When the provisional imaging start button 317 is pressed, provisional imaging is executed under the imaging conditions that are currently set, and immediately displayed in the image display field 304. However, the temporarily captured data is only temporarily expanded in the memory unit 53 and is not saved.
(Imaging frame rate setting field 315)

  In the imaging frame rate setting column 315, the frame rate at the time of imaging by the camera is set as a numerical value. In addition, a numerical value can be increased or decreased by pressing a spin button provided on the right side of the imaging frame rate setting field 315.

In a state where the imaging frame rate is low, still image data using the entire imaging area can be acquired each time. However, when the imaging frame rate is increased, the readout speed from the imaging device is not in time, so that the readout area is limited. In this example, when the imaging frame rate is 30, 60, 125, or 250 fps, the readout area can be imaged at 640 × 480 pixels, which is the maximum screen size. The screen size is limited at higher imaging frame rates, for example, 640 × 240 pixels at 500 fps, 256 × 256 pixels at 1000 fps, 256 × 128 pixels at 2000 fps, 128 × 120 pixels at 4000 fps, and 128 at 8000 fps. It is limited to 64 × 50 pixels at × 60 pixels, 16000 fps, and 64 × 32 pixels at 24000 fps, respectively.
(Slow observation button 316B)

  When the slow observation button 316B is further pressed, slow observation is executed. In this slow observation, a fixed number of continuous images (for example, 10 to 30 images) are extracted from still images obtained at a designated imaging frame rate, and the extracted still images are reproduced at a reproduction frame rate designated on the display unit 52. The display to repeat the playback operation is performed. Thereby, it is possible to confirm a continuous change state within a certain time, that is, smoothness of the image. Here, the image of the moving image data obtained under the provisional imaging conditions such as the provisional frame rate and shutter speed is displayed on the display unit 52 for the user to actually confirm. The user can confirm, by trial and error, what kind of imaging conditions should be set to capture a desired moving image while variously adjusting the provisional imaging conditions. For this reason, the moving image data obtained by the temporary setting is not saved.

  The temporary imaging condition is performed by adjusting the imaging cycle setting unit 31, the shutter speed setting unit 38, the trigger setting unit 39, and the like with an external input device GN such as the operation unit 55. For example, in accordance with the provisional imaging frame rate temporarily set by the imaging cycle setting unit 31, the imaging unit 10 continuously captures image data, and extracts and holds a predetermined number of captured image data. Then, the display unit 52 displays the display frame rate slower than the provisional imaging frame rate. Similarly, the shutter speed is also temporarily set by the shutter speed setting means 38, and the image data captured at this temporary shutter speed is reproduced on the display unit 52. While actually confirming the moving image obtained according to such temporary setting on the display unit 52, the moving image is adjusted to a desired setting value. Further, if the display update speed on the display unit 52 is slowed, so-called image blur can be confirmed.

  The user can adjust the imaging condition while confirming the moving image temporarily captured as described above, and after the final imaging condition is determined, the user presses the recording button 318 to start the main imaging. That is, at the timing when the recording button 318 is pressed, the switching process from the recording / playback unit 83 to the live processing unit 82 by the processing selection unit 84 in the block diagram of FIG. 5 is executed, and moving image data is recorded in the image storage unit 58. . Note that the video button 318 changes the character display of the button to “recording preparation” before imaging and “recording” during imaging, so that the current state can be easily identified.

Further, buttons for performing a stroboscope for irradiating a subject with strong illumination light periodically and performing imaging in synchronization therewith may be provided.
(Trigger setting means)

The operation setting field 306 includes a progress bar 306A on the left side, a memory number selection field 307 for calling the temporarily stored moving image data by a memory number, and details of a trigger for specifying the start and end timing of the moving image data. A trigger setting button 308 for setting is provided. The trigger setting button 308 is one form of trigger setting means 39 for setting a trigger, and when this button is pressed, a dialog of a trigger setting screen 308 ′ shown in FIG. 8 is displayed. From this screen, a “recording time” tab 308a is selected, and a trigger type, an imaging frame rate, the number of still images to be captured, and the like are set. The trigger type can be selected from the trigger type selection field 308b, and here, a start trigger, a center trigger, an end trigger, or a custom trigger is selected from a pull-down menu. The start trigger instructs to start imaging, and the end trigger instructs to end imaging. In the center trigger, when a trigger is input during continuous imaging of images with a pre-trigger, imaging is continued so that the trigger timing is at the center, and the processing is automatically terminated. Further, in the manual trigger, the start and end timing of imaging is manually specified. The trigger setting field 308c is displayed according to the trigger type selected in the trigger type selection field, and the recording time can be set before triggering or after triggering. In the example of FIG. 8, the start trigger is selected as the trigger type, and the operation after trigger input is set in the trigger setting field 308c. Here, the imaging frame rate and the number of images to be captured are input as numerical values as the recording time. Further, the recording time for imaging is calculated and displayed according to the setting content in the trigger setting field 308c. Further, the recordable time that can be recorded is also displayed below the progress bar 306A in FIG. Further, the remaining time may be displayed during recording.
(Record button 318)

  When the recording button 318 described above is pressed from the screen in FIG. 6, a trigger for starting imaging is input at this timing, and imaging is started. During imaging, the progress status is displayed on the progress bar 306A. The progress bar 306A indicates in a bar graph the extent to which the imaging task has been completed with the left end as the trigger position. In addition, a shootable time is displayed below the progress bar 306A. In the example of FIG. 6, it is shown that shooting can be performed for 6.5 seconds after the trigger is started. The captured moving image data is given a memory number and temporarily stored in the image storage unit 58 of the memory unit 53. Also, a plurality of moving image data can be temporarily stored, and each moving image data is distinguished by a memory number.

The tool bar 320 includes a recording setting button 320B for mainly setting imaging conditions for recording, a lens button 320D for setting the lens module 20 used for imaging, and various measurements such as area and distance measurement on the captured image. A measurement button 320C for performing an image, a print button 320E for printing an image, a comment input button 320F for a user to add an arbitrary comment to the image, a display button 320G for performing image display settings, and an image sensor 12, a camera / image button 320H for setting an image to be captured, a help button 320A for calling up help, an album button 320I for organizing and browsing captured images, and starting a setting program for the moving image capturing apparatus An initial menu button for calling an initial menu (FIG. 10 to be described later) displayed 20 J, and a power button 320K for ON / OFF the power of the moving picture imaging apparatus, are displayed.
(Screen switching means 302)

  In the screen switching means 302 of the recording mode screen 300A shown in FIG. 6, the recording mode button is pressed and selected. Here, the recording mode button is highlighted and the preview mode button is grayed out, indicating that the currently selected mode is the recording mode. As described above, the screen switching unit 302 also functions as a mode display field indicating the mode being selected.

Further, an operation state display field 302B for displaying the current operation state is provided on the right side of the screen switching unit 302 and in the upper right of the image display area. In the example of FIG. 6, “observing” is displayed, and in the example of FIG. 7, “reproducing” is displayed, and “× 10 rewinding” or the like can be displayed according to the operation.
(Preview mode screen 300B)

  After performing various settings on the recording mode screen 300A as described above, high-speed imaging is performed, and the obtained moving image data is displayed on the preview mode screen 300B. By pressing the preview mode button of the screen switching means 302 from the screen of FIG. 6, the screen is switched to the preview mode screen 300B shown in FIG. Next, the preview mode screen 300B will be described with reference to FIG. Also on this screen, the basic arrangement is almost the same as in FIG. 6, and an image display field 304, an item setting field 310, a toolbar 320, a screen switching unit 302, and an operation setting field 306 are provided. The contents of the toolbar 320 are the same as those in FIG.

  In the preview mode screen 300B, data to be saved can be specified by specifying a portion to be saved from the captured moving image data. In the item setting column 310 provided on the right side of this screen, a frame rate display column 336 for displaying the frame rate of moving image data displayed in the image display column 304, a reproduction range and a storage range of moving image data are designated. A reproduction / storage range setting field 338, a still image shooting button 316D for capturing a still image, and a data storage button 339 for executing data storage are provided. Further, in the operation setting field 306 at the lower stage, a progress bar 306B indicating the progress of reproduction of moving image data, a memory number selection field 307 ′ for selecting a memory number of moving image data to be displayed in the image display field 304, a moving image A playback reference display field 301 for designating a data playback speed, a trigger operation button 309 for operating a trigger, a playback / pause button 331 for playing back a recorded moving image, a repeat playback button 334, a fast forward button 333, a volume A playback operation button 330 such as a return button 332 is provided. The trigger operation button 309 can set the type of trigger (for example, start trigger, end trigger, etc.). When moving image data is selected in the memory number selection field 307 ′ and the playback / pause button 331 is pressed, playback of the captured moving image data is started. Also at this time, the progress of playback is displayed by the progress bar 306B. In the lower part of the progress bar 306B, the number of frames (number of frames) of the captured moving image data currently displayed in the image display field 304 is displayed together with the total number of frames, and the elapsed time is also shown. It is. When the replay button 334 is pressed, the captured moving image is loop-reproduced.

  In the frame rate display column 336, a recording frame rate (imaging cycle) when moving image data currently being displayed is captured and a playback frame rate (display cycle) currently being displayed are displayed. The playback frame rate can be changed from the playback reference display field 301 using a pull-down menu. Here, moving image data captured at 1000 fps is played back slowly at 5 fps. As described above, the frame rate at the time of reproduction can be changed from that at the time of imaging.

  In the reproduction / storage range setting field 338, a part to be stored is designated by a start point and an end point from the moving image data. In this case, when moving image data is regarded as a sequence of still images, the timing is specified according to the number of images from the top, for example, the first point is the first and the end point is the 6,520th. Note that the method is not limited to the method of designating in the order of still images, and other indicators such as an elapsed time or a ratio when the total imaging time is set to 100 can be used. Designation of the start point and / or end point can be visually performed by designating from the progress bar 306B with a slider. Further, a desired range can be trimmed from the progress bar 306B.

  When the position is designated, the corresponding numerical value is automatically input to the reproduction / storage range setting field 338. When the set button is pressed in this state, the currently displayed position is set. If the start / end point reset button is pressed, the setting can be reset. When the data save button 339 is pressed in a state where the start point and the end point are specified in this way, moving image data in the specified range is saved. The still image shooting button 316D can save the moving image or still image being displayed in the image display field 304 as a still image.

In this example, the moving image data recorded on the recording mode screen 300A is temporarily stored, and the user can check on the preview mode screen 300B and specify a storage range to determine whether to save the data. When not saving, the moving image data can be newly acquired by returning to the recording mode screen 300A again. When the data save button 339 is pressed, a dialog for saving moving image data is displayed, and the user can name and save a predetermined folder.
(Setting support function of moving image pickup device)

  The above setting can be performed by a user who is used to operating the moving image capturing apparatus. On the other hand, since the moving image imaging device has a wide variety of setting items, if you are a beginner who is not familiar with the operation, or you do not understand the relationship between items that affect other settings such as the relationship between frame rate and shutter speed, May be confused about the setting. In particular, when the shutter speed is determined, the upper limit of the frame rate that can be set under this condition is determined, so that there is a problem that the performance of the moving image imaging apparatus capable of high-speed imaging cannot be fully utilized. In addition, since the value to be set does not match the range of the item that has already been set, there is a rework that the previous setting must be reset.

Therefore, a setting support apparatus having a guidance function for supporting the setting work is configured so that the setting work can be efficiently advanced without requiring knowledge about the operation of the moving image capturing apparatus. As an example, if each setting item is input in a wizard format, the user can make necessary settings simply by answering the questions, and can guide the user to set necessary items accurately without waste. The setting procedure by such a guidance function is shown in the flowchart of FIG. The general procedure for setting is the initial setting, recording setting, and preview saving. As a specific procedure for setting, first, a series of steps of the recording procedure is confirmed in step S1, then, as an initial setting, a lens is selected in step S2, and an initial setting is performed in step S3. Further, as the recording setting, the visual field range is adjusted in step S4, the illumination is adjusted in step S5, the frame rate is adjusted in step S6, the image blur is confirmed in step S7, and the trigger setting and recording are performed in step S8. Finally, as a preview save, a preview and data are saved in step S9. In accordance with this procedure, the setting screen is sequentially presented to the user to prompt the setting, and the setting content, setting, adjustment advice, etc. are explained as needed to assist the setting work. Each setting screen and description of the setting contents are stored in the setting screen storage unit 57 shown in FIG. 2, and the guiding unit calls the necessary setting screen from the setting screen storage unit 57 and displays it on the display unit 52 to display the user's screen. Prompt for setting. In the following example, necessary operations are explained by displaying character information, figures, and photographs on the setting screen. As described above, in addition to the configuration in which the text information and the image information are combined to explain the operation to the user, a moving image, voice guidance, or the like can be used together, or conversely, only the text information can be used.
(Setting support program for moving image pickup device)

Next, specific work procedures in each step will be sequentially described. First, when the setting support program of the moving image capturing apparatus is activated, an initial menu screen 340 shown in FIG. 10 is displayed. When the user presses the simple recording button 341 from this screen, the setting support function is executed, the mode is shifted to the simple recording mode, and the screen is changed to the screen of FIG. When the normal recording button 342 is pressed from the screen of FIG. 10, the normal recording mode is entered and the recording mode screen 300A shown in FIG. 6 is entered. Therefore, the user can set the imaging condition according to the guidance function or select the normal recording mode in which all parameters can be directly operated according to his / her proficiency level and observation purpose. In addition to the above, in the screen of FIG. 10, a still image normal shooting button 343 for shooting a still image and an album button 344 for editing the captured moving image data can be selected, and further, security setting, communication setting, option setting, etc. Can also be done.
(Step S1 Confirmation of a series of operations)

When the simple recording button 341 is pressed from the screen of FIG. 10, the procedure shifts to the procedure confirmation screen 350 of FIG. 11 as step S1. Here, an outline of the operation procedure to be performed is displayed as confirmation of the recording procedure. That is, the user is notified of a series of work flow from (1) initial setting, (2) recording setting, and (3) preview saving. After the user confirms, the “Next” button 351 is pressed to start the setting operation. (1) The screen shifts to the screen shown in FIG. 12 as an initial setting.
(Initial setting)
(Step S2 Lens selection)

  The screen in FIG. 12 shows the lens selection screen 360 in step S2. Here, the user first selects a lens to be used. That is, in FIG. 1, the lens is selected as the lens module 20 to be mounted on the imaging module 16 of the head unit 15 according to the observation purpose. Examples of the lens module 20 mounted on the moving image capturing apparatus include macro lens units, microscope lens units, and other lens candidates. On the lens selection screen 360, a macro zoom lens button 361, a microscope lens button 362, and other lens buttons 363 are provided as lens buttons corresponding to the respective lenses. Further, below the lens buttons 361, 362, and 363, each lens is provided. A description of the feature is displayed. The user can press the “Next” button 364 by pressing one of the lens buttons 361, 362, 363 from these options. On the other hand, unless one of the lens buttons 361, 362, 363 is selected, the “next” button 364 is configured so that it is not possible to avoid omission of settings or forgetting to set. Further, the subsequent setting items are changed according to the type of the selected lens button 361, 362, 363.

Each setting screen is provided with a “return” button 365 in addition to a “next” button 364, and the user can return to the previous operation screen and set again at any time. Alternatively, it may be configured to shift directly to the screen by pressing a tab-type screen button 366 provided in the upper stage. The screen button 366 highlights the currently selected screen so that the user can determine the setting items on the currently displayed screen and also knows where the current setting screen is in the overall setting work. it can.
(Step S3 initial setting)

When the “next” button 364 is pressed from the screen of FIG. 12, the process proceeds to step S3 and the initial setting screen 370 of FIG. 13 is displayed. Here, 1. 1. fixing the camera; Encourage users to make initial settings. First of all, it is necessary to fix the camera as a pre-observation step. Therefore, as a specific procedure, stop the movement of the observation object, firmly fix the camera with a tripod, etc., working distance (WD) between the camera and subject, Replacing the close-up lens according to the field size and adjusting the distance from the lens tip to the subject will be described in text. In addition, regarding the default settings that should be selected if they are not well understood, the types of close-up lenses and WD settings are specifically presented. Further, as an initial setting, the user is prompted to initialize the lens and illumination. This is because the lens and the illumination are not always used as they were in the previous use, and thus are initialized once.
(Hint screen)

Here, a separate hint screen is prepared for items that are difficult to understand, such as the relationship between the WD, the field size, and the close-up lens to be attached. The user can refer to such a hint screen as necessary. In the example of FIG. 13, a plurality of hint buttons are provided, and a hint screen is displayed when each hint button is pressed, so that a hint corresponding to each item can be referred to. The hint screen can be composed of another screen similar to the help screen. Here, “how to use free angle stand” hint button 371, “how to use tripod” hint button 372, “WD and field size” hint button 373, “to record easy-to-read data” hint button 374, “camera A “term” hint button 375 is provided. For example, when a “tripod usage” hint button 372 is pressed, a “tripod usage” hint screen 372a shown in FIG. 14 is displayed, and the usage points of the tripod are displayed in bullets. Similarly, when the “To record easy-to-view data” hint button 374 is pressed, the “To record easy-to-view data” hint screen 374a in FIG. 15 is displayed. When the “Camera term” hint button 375 is pressed, FIG. When the “camera term” hint screen 375a is pressed and the “WD and field size” hint button 373 is pressed, a “WD and field size” hint screen 373a shown in FIG. 22 is displayed. In this way, the user can make a setting with reduced points even by a beginner who is not familiar with the setting by referring to the hint screen for an item for which details are desired. To close the hint screen, a “close” button provided on each hint screen is pressed.
(Recording settings)
(Step S4 Adjusting the field of view)

  When the initial setting is completed in this way, the “next” button 376 is pressed from the initial setting screen 370 in FIG. 13 to shift to the recording setting in step S4. First, the magnification and position are adjusted on the visual field range adjustment screen 380 shown in FIG. Specifically, an area to be imaged is set by adjusting the focus, magnification, imaging position, and the like of the camera that is the imaging unit 10. In the image display field 304 of FIG. 17, a live image of the subject reflecting the setting contents is displayed. The user operates the camera while referring to the live image, and adjusts the camera direction, WD, lens magnification, focus, and aperture. For each setting item, a “tripod usage” hint button 372 ′, a “WD and field size” hint button 373 ′, and a “lens adjustment” hint button 381 are prepared as hint buttons. For example, when the “lens adjustment” hint button 381 is pressed, the “lens adjustment” hint screen 381a of FIG. 18 is displayed, and (1) magnification adjustment, (2) aperture adjustment, and (3) focus adjustment items. Is displayed. In addition, the lens module 20 is illustrated, and a number is also displayed on the dial of the lens to be adjusted in correspondence with the above number, and the user can select which item is adjusted with which dial without hesitation, The work for performing the correct setting can be reliably guided. Furthermore, the relationship between the aperture, the light amount, the depth of field, the fact that the aperture should be opened as much as possible to increase the light amount, the shutter speed can be shortened, and the image blurring becomes difficult are explained.

  In this way, the user adjusts the camera focus, magnification, and position while viewing the live image displayed in the image display field 304 and referring to the hint screen as necessary. Since it is easier to perform alignment with a wide field of view, the image is displayed in the maximum field of view (in this example, the maximum range that can be displayed in the image display field 304 is 640 × 480 pixels). For this reason, the imaging frame rate is set low. In the example of FIG. 17, the live image displayed in the image display field 304 displays a moving image captured at 30 fps.

  In addition, as a content explanation, “Please stop the movement of the object to be observed if possible” is displayed to prompt the user to stop the movement of the subject. This is because it is possible to eliminate out-of-focus and insufficient depth, which are causes of imaging failure. Further, the camera orientation, WD, lens magnification, focus, and aperture are adjusted so that the subject falls within the screen range. At the stage of lens adjustment or camera orientation adjustment, it is convenient that the shutter speed can be changed greatly. Therefore, in this example, the imaging frame rate of the default camera is set to 30 fps, and the shutter speed is 1 / 100,000 to 1/30. It can be adjusted up to seconds.

  Further, on this screen, an area display RH can be displayed for clearly indicating that the field-of-view range changes when the imaging frame rate is changed. The imaging frame rate to be changed is set in the “display field-of-view range according to frame rate” field 382. In the example of FIG. 17, an area display RH corresponding to the readout area when the frame rate is set to 1000 fps in the “display field-of-view range according to frame rate” column 382 is superimposed on the live image captured at 30 fps. Displayed in red frame. The user adjusts the magnification and the like so that the subject is included in the area display RH corresponding to the imaging frame rate to be photographed. In this way, the apparent imaging frame rate can be set while taking a wide adjustment range of the shutter speed.

Further, when the “display with actual magnification” button 383 is pressed, the area display RH is enlarged and displayed so as to be displayed in the entire image display field 304 (see FIG. 20 or FIG. 28 and FIG. 30 described later). . The “display with actual enlargement ratio” button 383 is a toggle button, and switches between normal display and enlarged display (ROI (region of interest) display) each time the button is pressed.
(Brightness setting field 311)

In addition, a brightness setting field 311 ′ is provided at the lower right of the screen in FIG. Here, automatic adjustment or manual adjustment of brightness can be switched. Specifically, when auto is selected in the brightness setting field 311 ′, automatic adjustment is performed. Alternatively, when the manual is selected, the brightness can be manually adjusted by operating the slide bar 311a provided on the upper part. The adjustment of the screen brightness is actually determined by the shutter speed and gain of the camera. On this screen, such items are not displayed, and the shutter speed and / or gain are automatically adjusted so that the brightness changes continuously. In the example of FIG. 17, the brightness can be continuously adjusted from 0 to 255 with the slide bar 311a, and the shutter speed is automatically adjusted so that the average value of the luminance distribution of the image becomes the value set with the slide bar. , Adjust sequentially with hardware or software.
(Step S5 Lighting adjustment)

After the setting on the visual field range adjustment screen 380 in FIG. 17 is completed in this way, when the “Next” button 384 is pressed, the process proceeds to the illumination adjustment screen 390 shown in FIG. Do. Since it is necessary to adjust the illumination range in a slightly wider range than the visual field range set in the previous stage, the work can be carried out efficiently by adjusting the illumination after the visual field range is determined by adjusting the camera lens etc. be able to. Specifically, the illumination angle and illumination zoom are adjusted so that the illumination angle and illumination zoom are adjusted so that the illumination is performed slightly outside the field of view. In the illumination zoom, after the lock is released, left and right angle adjustment and vertical angle adjustment are performed. In order to show these adjustment operations in an easy-to-understand manner, in the example of FIG. 19, a perspective view of the illumination means 60 is shown, and knobs to be adjusted and an operation direction are indicated by arrows. Such an illustration is very effective for the user's understanding because the part to be operated for adjustment can be visually expressed. Note that if the lighting is adjusted to the limit of the visual field range, uneven lighting is conspicuous where the center of the screen is bright and the screen edge is dark. Further, if the illumination is made wider than the visual field range, the amount of illumination light in the visual field range decreases, and the imaging frame rate set in the subsequent stage cannot be increased. Therefore, it is preferable to set the illumination area so that it extends slightly beyond the size of the readout area obtained at the desired imaging frame rate. Even if the brightness of the screen changes suddenly due to lighting, if the brightness is automatically adjusted, that is, set to the auto shutter speed, the user does not need to adjust the shutter speed.
(Step S6 frame rate adjustment)

  When the “Next” button 391 is pressed after the setting is completed on the illumination adjustment screen 390 in FIG. 19, the process proceeds to the frame rate adjustment screen 400 in FIG. 20 to set the imaging frame rate in step S6. Here, the user inputs a desired frame rate value in the frame rate setting field 315 ′ with the subject moved. In the example of FIG. 20, the imaging frame rate is set. However, it cannot be determined whether the frame rate is appropriate for a live image. Therefore, slow observation that automatically repeats recording and playback is executed, and when the smoothness of the video is insufficient while adjusting the smoothness of the video, an adjustment is made to increase the imaging frame rate. In the example of FIG. 20, a “slow observation” check box 316b for performing slow observation is provided. When this column is checked, slow observation is performed, and when the check is removed, normal live observation is performed. As described above, the “slow observation” check box functions as a switching unit that switches between the slow observation and the live observation.

  Changing the imaging frame rate also changes the image size. In the present embodiment, the image size becomes smaller than 640 × 480 dots when the imaging frame rate is 250 fps or more. Further, since the shutter speed is close to the value automatically adjusted in the previous stage, the brightness does not change abruptly. The shutter speed is limited by the imaging frame rate. For example, when the imaging frame rate is 1000 fps, the maximum value of the shutter speed is limited to 1/1000 second. In many cases, there is no problem because the imaging frame rate is smaller than the reciprocal of the shutter speed. However, when changing the imaging frame rate, it is necessary to confirm that the shutter speed is within the above limit. As described above, the shutter speed is automatically set according to the brightness on the illumination adjustment screen 390 in the previous stage. If the shutter speed value set when the “Next” button 391 is pressed on the illumination adjustment screen 390 in FIG. 19 is larger than the reciprocal of the imaging frame rate set here, the shutter speed is imaged. Change to the inverse of the frame rate. For example, when the shutter speed is set to 1/500 seconds and the imaging frame rate is set to 1000 fps, the shutter speed is changed to 1/1000 seconds. This change is performed by the shutter speed setting means 38. At the same time, the gain may be adjusted to increase so as to suppress the change in brightness.

If you want to reset the field of view because the field of view range has changed as a result of changing the imaging frame rate, press the “I want to reset the field of view” hint button 401 provided in the trouble Q & A column. . Accordingly, a hint screen 401a “I want to adjust the field of view” shown in FIG. 21 is displayed, and a procedure for resetting the field of view is displayed. When the “lens adjustment” hint button 381 ′ is pressed from the screen of FIG. 21, the “lens adjustment” hint screen 381a of FIG. 18 described above is displayed. When the “WD and visual field size” hint button 373 ”is further pressed, the“ WD and visual field size setting screen ”hint screen 373a of FIG. 22 is displayed. Here, the magnification, focus adjustment, etc. have been redone, but if the subject cannot be adjusted because the subject is moving, pressing the “Redo from initial setting” button 402 will return to step S3 and shift to the screen of FIG. In this way, operations such as focus and magnification adjustment can be redone on the initial setting screen 370. In this way, even if re-setting is necessary, the link is set so that the necessary setting screen can be called immediately, so that the user can smoothly transition even when redoing the setting, realizing easy-to-use setting support. The
(Step S7: Check for image blur)

  When the “Next” button 403 is pressed after the setting of the frame rate adjustment screen 400 in FIG. 20 is completed, the process moves to the image blur confirmation screen 410 in FIG. 23 to confirm that there is no image blur in step S7. To do. Image blur or subject blur occurs because the subject moves within the time when light (image of the subject) is accumulated in the image sensor. Confirmation of image blur can be easily determined by temporarily stopping the moving subject. For this reason, a pause button 411 is provided below the gain setting field 314 '(described later).

  However, since it is troublesome to manually operate pause and playback restart, a function for slowing the update speed of the displayed moving image is provided so that image blur can be easily confirmed. In the example of FIG. 23, the display frame rate is changed from 15 fps to 2 fps by turning on the check box in the “slow update speed” column 412, and it becomes easy to visually recognize a still image. Meanwhile, occurrence of image blur can be confirmed.

  If image blurring occurs, the shutter speed is too slow. That is, the final adjustment of the shutter speed is performed at this stage after setting the imaging frame rate. The shutter speed can be adjusted in the shutter speed setting field 312 ′ which is the shutter speed setting means 38. Here, in addition to selecting from a predetermined option in a pull-down menu format, a configuration in which the user manually adjusts continuously by a slider may be adopted. As described above, since the shutter speed is limited by the imaging frame rate, the shutter speed value is limited so as not to exceed the reciprocal of the imaging frame rate.

  In addition, the camera gain can be adjusted along with the shutter speed. The gain adjustment is performed by selecting from the pull-down menu from the gain setting field 314 '. When the gain is increased, the screen becomes brighter, so the brightness can be adjusted with the gain when the imaging shutter speed is slow.

As for the image brightness adjustment, when the “I want to brighten an image” hint button 413 provided in the trouble Q & A column is pressed, a “I want to brighten an image” hint screen 413a shown in FIG. The procedure to do is displayed. Here, it is confirmed whether the output of the illumination means 60 is maximized, the gain of the camera is increased, and the aperture of the lens module 20 is opened (the operation is performed to reduce the numerical value. In this case, the depth of field becomes shallow). (So, the defocus in the depth direction will increase). Also in the screen of FIG. 24, the “lens adjustment” hint screen 381a of FIG. 18 described above is displayed when the “lens adjustment” hint button 381 ”is pressed. If the amount of light is still insufficient even if the gain is increased and the aperture is opened to record so as not to cause image blurring, the amount of illumination light is increased using external illumination. If the user wants to redo the work such as the focus adjustment, the user can move to the screen of FIG. 13 as in FIG. 21 by pressing the “Redo from initial setting” button 402 ′.
(Step S8 trigger setting / recording)

  When the “Next” button 414 is pressed after the setting of the image blur confirmation screen 410 in FIG. 23 is completed, the process proceeds to the trigger setting / recording screen 420 in FIG. 25 as step S8, and trigger setting and recording are performed. The trigger setting / recording screen 420 also constitutes one form of the trigger setting means 39. Specifically, as a trigger type, a radio button is used to select a start trigger that starts recording when the recording button 318 'is pressed or an end trigger that ends recording when the recording button 318' is pressed. In the case of an end trigger, the display of the recording button 318 ′ changes to “recording preparation”, and when pressed, the recording is performed and the display of the recording button 318 ′ changes to “recording”. When the button 318 ′ is pressed, the display changes to “stop”. Thus, the recording button 318 'can also fulfill the function of displaying the operating state.

A progress bar 306A ′ is provided in the lower part of the image display column 304, and the position of the triangular mark 421 indicating the trigger position changes according to the trigger setting. Further, a recordable time is displayed at the lower part of the progress bar 306A ′, and a recording number setting field 422 is provided on the right side. The number of recorded images can be set to 2 or more, and the maximum number varies depending on the imaging frame rate. The recording time display also changes according to the set number of recordings. Further, during the recording, a progress bar 306A ′ indicates the progress status. When recording ends, slow playback is automatically executed. When the recording setting is completed as described above, the “next” button 423 is pressed to move to the preview storage screen 430.
(Step S9 Save preview)

  As step S9, on the preview saving screen 430 of FIG. 26, recorded data, that is, moving image data is displayed and saved. The captured frame rate and playback frame rate of the slow playback image that is automatically played back after the recording is finished are displayed in the frame rate display field 336 '. The user designates a start point and an end point when data is stored in the data storage area of the memory unit 53 while viewing the slow playback image. The storage range is designated from the reproduction / storage range setting field 338 '. Here, the start point and the end point are set depending on the number of the shot when converted as a still image. The start point and end point are determined by pressing the set buttons 431 and 432, and the start point and end point positions set in the progress bar 306B 'are displayed. If the start / end point reset button 433 is pressed, these designations are reset.

  On the other hand, the progress bar 306 </ b> B ′ has a trigger position indicated by a triangular mark 421 ′ and a current playback position indicated by a slider 434. In addition, a reproduction reference designation field 435 is provided on the right side of the progress bar 306B ', from which a reproduction speed for slow reproduction can be designated. If the trigger jump button 436 provided on the right side of the button is pressed, jump to the trigger position can be made, the display of the image display field 304 is switched to the reproduction from the trigger position, and the position of the slider 434 of the progress bar 306B ′. Also jumps to the trigger position. Further, by pressing the right repeat playback button 334 ', the slow playback is repeated within the set range.

  When the storage range is determined in this manner, the “data storage” button 437 is pressed, and the moving image data is stored in the hard disk drive of the memory unit 53. When data storage is further executed, the end button 438 can be pressed. When the end button 438 is pressed, the screen returns to the initial menu screen 340 of FIG. Alternatively, the power-off button 439 arranged at the upper right of the screen is pressed to end.

  On the other hand, if it is desired to redo the adjustment of the imaging frame rate because the recorded data was not smooth, the user can return to step S6 shown in FIG. 20 by pressing the “re-adjustment of frame rate” button 440. If the user wants to re-acquire the data after saving, or if he / she wants to re-record since the recording timing is bad, the user can return to the previous step S8 (FIG. 25) by pressing the “Re-record” button 441. .

  In this way, conditions necessary for capturing a moving image can be sequentially set, and the user can observe the moving image after making necessary settings appropriately.

  The moving image imaging apparatus, moving image display method, moving image display program, and computer-readable recording medium of the present invention can be used to investigate the cause of FA line anomalies and observe how the material breaks during a tensile test of the material. It can be suitably used as a high-speed camera, a high-speed video camera, or the like that continuously images high-speed phenomena such as material destruction, high-speed combustion imaging of an internal combustion engine, sports motion behavior, collision, and discharge in a short time.

1 is an external perspective view showing a moving image capturing apparatus according to an embodiment of the present invention. It is a block diagram of the moving image imaging device of FIG. It is an image figure which shows the example which overlapped and displayed the area | region display on the display part. It is an image figure which shows the example which displays an area | region display in a reduced display column. It is a block diagram which shows a moving image imaging device provided with a temporary imaging function. It is an image figure of the user interface screen which shows the recording mode screen which performs high speed imaging with the setting program of a moving image imaging device. It is an image figure of the user interface screen which shows the preview mode screen which reproduces | regenerates high speed imaging data with the setting program of a moving image imaging device. It is an image figure which shows an example of a trigger setting screen. It is a flowchart which shows the procedure which supports the setting of a moving image imaging device according to a guidance function. It is an image figure which shows the initial menu screen of the setting assistance program of a moving image imaging device. It is an image figure which shows the outline explanatory screen of the operation procedure in simple recording mode. It is an image figure which shows a lens selection screen. It is an image figure which shows an initial setting screen. It is an image figure which shows the hint screen of "how to use a tripod". It is an image figure which shows the hint screen of "in order to record easy-to-read data". It is an image figure which shows the hint screen of "camera term". It is an image figure which shows a visual field range adjustment screen. It is an image figure which shows the hint screen of "lens adjustment." It is an image figure which shows an illumination adjustment screen. It is an image figure which shows a frame rate adjustment screen. It is an image figure which shows the hint screen of "I want to adjust a visual field again." It is an image figure which shows the hint screen of "WD and visual field size". It is an image figure which shows an image blur confirmation screen. It is an image figure which shows the hint screen of "I want to brighten an image." It is an image figure which shows a trigger setting / recording screen. It is an image figure which shows a preview preservation | save screen. It is an image figure which shows the moving image data imaged with the low frame rate. It is an image figure which shows the moving image data imaged at a frame rate faster than FIG. It is an image figure which shows the moving image data imaged at a faster frame rate than FIG. It is the image figure which expanded and displayed the moving image data shown in FIG. It is a flowchart which shows the procedure which adjusts an imaging frame rate and the visual field range according to this.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Moving image imaging device 10 ... Imaging part; 12 ... Imaging element; 13 ... Imaging control part; 15 ... Head part 16 ... Imaging module 20 ... Lens module; 24 ... Cable part 31 ... Imaging period setting means; Determination means; 33 ... Display update means 34 ... Area display means; 35 ... Area display adjustment means; 36 ... Area position designation means 37 ... Change instruction means; 38 ... Shutter speed setting means; 39 ... Trigger setting means 50 ... Body part; DESCRIPTION OF SYMBOLS 51 ... Control part; 52 ... Display part; 53 ... Memory part 54 ... Interface part; 55 ... Operation part 56 ... Correspondence relation storage means; 57 ... Setting screen storage means; 58 ... Image storage part 60 ... Illumination means; Light source for use; 66 ... Illumination module 81 ... Image processing unit; 82 ... Live processing unit; 83 ... Recording / playback unit; 84 ... Process selection unit 85 ... Continuous image extraction unit; 86 '... image reading unit 87 ... trigger processing unit; 88 ... image writing unit; 89 ... data switching unit 300 ... user interface screen 300A of the setting program of the moving image pickup device ... recording mode screen; 300B ... preview mode screen 301 ... Playback reference display field 302 ... Screen switching means; 302B ... Operation status display field 304 ... Image display field; 304 '... Reduced display field 306 ... Operation setting field; 306A, 306B, 306A', 306B '... Progress bar 307, 307 '... memory number selection field 308 ... trigger setting button; 308' ... trigger setting screen 308a ... "recording time"tab; 308b ... trigger type selection field; 308c ... trigger setting field 309 ... trigger operation button 310 ... item setting field; 311 311 ′: Brightness setting field; 311a: Slide bar;
312, 312 '... Shutter speed setting field; 314, 314' ... Gain setting field 315, 315 '... Imaging frame rate setting field 316 ... Operation buttons 316B ... Slow observation button; 316b ... "Slow observation" check box 316D ... Still Image capturing button 317 ... Temporary imaging start button; 317 '... Pause button 318, 318' ... Recording button 320 ... Toolbar 320A ... Help button; 320B ... Recording setting button; 320C ... Measurement button 320D ... Lens button; 320F ... comment input button 320G ... display button; 320H ... camera / image button; 320I ... album button 320J ... initial menu button; 320K ... power button 330 ... playback operation button; 331 ... play / pause button 332 ... rewind button ; 3 3 ... Fast forward button 334, 334 '... Repeat playback button; 336, 336' ... Frame rate display column 338, 338 '... Playback / storage range setting column; 339 ... Data storage button 340 ... Initial menu screen; 341 ... Simple recording button 342 ... Normal recording button 343 ... Still image normal shooting button; 344 ... Album button; 350 ... Procedure confirmation screen 351 ... "Next" button 360 ... Lens selection screen; 361 ... Macro zoom lens button 362 ... Microscope lens button; 363 ... Other lens buttons 364 ... "Next"button; 365 ... "Back"button; 366 ... Screen button 370 ... Initial setting screen; 371 ... "How to use the free angle stand" hint buttons 372, 372 '... "Tripod "How to use" hint button 372a ... "How to use a tripod" hint screen 73, 373 ', 373 "..." WD and field size "hint button 373a ..." WD and field size "hint button 374 ..." To record easy-to-read data "hint button 374a ..." To record easy-to-view data ""Hint screen 375 ..." Camera term "hint button; 375a ..." Camera term "hint screen 376 ..." Next "button 380 ... View range adjustment screen 381, 381 ', 381" ... "Lens adjustment" hint Button 381a ... "Lens adjustment" hint screen 382 ... "Display field of view according to frame rate" field 383 ... "Display at actual magnification"button; 384 ... "Next" button 390 ... Lighting adjustment screen; 391 ... "Next" button 400 ... Frame rate adjustment screen; 401 ... "I want to adjust the field of view" hint button 401a ... "Hint screens 402, 402 '..." Redo from initial settings "button 403 ..." Next "button 410 ... Image blur confirmation screen; 411 ... Pause button; 412 ..." Delay update speed "column 413 ... "I want to brighten an image" hint button 413a ... "I want to brighten an image" hint screen; 414 ... "Next" button 420 ... Trigger setting / recording screen; 421, 421 '... Triangular mark 422 ... Recording number setting field; 423 ... "Next" button 430 ... Preview save screen; 431 ... Set button; 432 ... Set button 433 ... Start point / end point reset button; 434 ... Slider; 435 ... Playback criteria designation field 436 ... Trigger jump button; Save button; 438 ... End button 439 ... Power OFF button 440 ... Frame Button 441 ... "Redo recording" button S ... Subject WD ... Working distance RH, RH '... Area display GN ... External input device

Claims (16)

A moving image imaging device for capturing a moving image of a subject to be imaged,
An image pickup means including an image pickup device arranged in a two-dimensional manner, and capable of reading out image data taken for at least a part of the image pickup region in which the image pickup device is arranged;
An imaging cycle setting unit that can be set by changing an imaging cycle when imaging a subject by the imaging unit to a different imaging cycle;
Based on the imaging cycle set by the imaging cycle setting means, a range in which image data can be read from the imaging area of the imaging means at a period equivalent to the imaging period is set as a readout area, and the size of the readout area and Reading area determining means for determining the position;
Display means capable of displaying a series of image data captured by the imaging means as a moving image at a display cycle slower than an imaging cycle in which the image data is captured;
From the state in which the image data picked up by the image pickup means is displayed on the display means, it is detected that the image pickup period is changed by the image pickup period setting means from the image pickup period of picking up the image data, and the reading In accordance with the size and / or position of the readout area corresponding to the changed imaging cycle determined by the area determining means, a series of image data captured in the changed imaging period is read from the changed readout area. Display update means for updating the image display of the display means to read and display on the display means at a predetermined display cycle;
An area display indicating the size and / or position of the readout area determined by the readout area determination means, corresponding to an imaging cycle faster than the imaging cycle in which the image data being displayed is imaged. An area display means that can be displayed in an overlapping manner,
A moving image imaging apparatus comprising: The moving image capturing apparatus according to claim 1,
The moving image imaging apparatus characterized in that the area display means can display a plurality of readout areas corresponding to a plurality of imaging cycles in a superimposed manner on the display means as a plurality of area displays. A moving image imaging device for imaging a subject to be imaged,
An image pickup means including an image pickup device arranged in a two-dimensional manner, and capable of reading out image data taken for at least a part of the image pickup region in which the image pickup device is arranged;
An imaging cycle setting unit that can be set by changing an imaging cycle when imaging a subject by the imaging unit to a different imaging cycle;
Based on the imaging cycle set by the imaging cycle setting means, a range in which image data can be read from the imaging area of the imaging means at a period equivalent to the imaging period is set as a readout area, and the size of the readout area and Reading area determining means for determining the position;
Display means capable of displaying the image data picked up by the image pickup means at a display cycle slower than the image pickup cycle of picking up the image data;
The size of the first readout area determined by the readout area determination means based on the first imaging period in the first image data captured in the first imaging period displayed on the display means. And / or first read area storage means for storing the position;
When the imaging period setting means sets the second imaging period that is different from the first imaging period, the second readout area determined by the readout area determination means based on the second imaging period Second read area recognition means for recognizing size and / or position;
In order to obtain a relative size and / or position between the first read area stored in the first read area storage means and the second read area recognized by the second read area recognition means. Reading area determining means,
An area display indicating the second readout area is displayed on the display means for displaying the image data based on the relative size and / or position obtained by the readout area determination means. Area display means that can be superimposed on the image data of
A moving image imaging apparatus comprising: In the moving image imaging device according to any one of claims 1 to 3, further,
A moving image capturing apparatus comprising: an area position designating unit for designating a position of a readout area displayed by the area display unit. In the moving image imaging device according to any one of claims 1 to 4, further,
Correspondence storage means for storing a correspondence table in which information relating to the readout region corresponding to the imaging cycle is recorded for each settable imaging cycle is provided,
The moving image capturing apparatus according to claim 1, wherein the reading area determining means determines a reading area according to a correspondence table stored in the correspondence relation storing means. In the moving image imaging device according to any one of claims 1 to 4,
The moving image imaging apparatus according to claim 1, wherein the readout area determining means calculates and obtains the readout area based on the imaging period set by the imaging period setting means. The moving image capturing apparatus according to any one of claims 1 to 6, further comprising:
A moving image imaging apparatus comprising: a region display adjusting unit for adjusting a size and / or position of a region display displayed on the image data by the region display unit. In the moving image imaging device according to claim 1 or 2,
The area display means detects that the imaging period has been changed by the imaging period setting means, and displays an area display indicating a readout area corresponding to the changed imaging period on the display means before the imaging period change. A moving image pickup apparatus configured to update an image display of the display unit after being displayed superimposed on image data. The moving image capturing apparatus according to claim 8,
The moving image imaging apparatus according to claim 1, wherein the display unit updates the image display after a predetermined time elapses from a timing when the imaging cycle is changed. The moving image capturing apparatus according to claim 8,
The moving image imaging apparatus according to claim 1, wherein the image display update in the display unit is performed by operating a change instruction unit for instructing execution of an imaging cycle change. In the moving image imaging device according to any one of claims 1 to 10,
The moving image imaging apparatus, wherein the area display means is configured to display an imaging cycle indicated by the area display in addition to the area display. In the moving image imaging device according to any one of claims 1 to 11,
The moving image imaging apparatus characterized in that the area display means can display the area display in a frame shape. In the moving image imaging device according to any one of claims 1 to 11,
The moving image imaging apparatus characterized in that the area display means can display the area display at a position on the display means. After the image data of the subject to be imaged is imaged by an imaging means capable of reading out image data captured at least in a part of the imaging area in which the imaging elements are two-dimensionally arranged at a constant imaging cycle, A moving image display method for displaying this on the display means at a display cycle slower than the imaging cycle,
Determining a size and / or position of the readout area based on an imaging cycle, with a range in which image data can be read out from the imaging area of the imaging means in advance as a readout area;
In the display means capable of displaying the image data picked up by the image pickup means, the size and / or position of the determined readout area corresponding to an image pickup period different from the image pickup period in which the image data being displayed is picked up are indicated. Displaying the area display overlaid on the image data;
Detecting that the image data displayed on the display means has been changed to an imaging cycle different from the imaging cycle, and depending on the size and / or position of the readout area corresponding to the changed imaging cycle Reading out a series of image data captured in the changed imaging cycle from the read-out area after the change and updating the image display of the display means so as to be displayed on the display means in a predetermined display cycle;
A moving image display method comprising: After the image data of the subject to be imaged is imaged by an imaging means capable of reading out image data captured at least in a part of the imaging area in which the imaging elements are two-dimensionally arranged at a constant imaging cycle, A moving image display program for displaying this on the display means at a display cycle slower than the imaging cycle,
A function for determining a size and / or a position of the reading area, based on an imaging period, with a range in which image data can be read from the imaging area of the imaging unit in advance as a reading area;
In the display means capable of displaying the image data picked up by the image pickup means, the size and / or position of the determined readout area corresponding to an image pickup period different from the image pickup period in which the image data being displayed is picked up are indicated. A function to display the area display over the image data;
A moving image display program characterized by causing a computer to realize the above.   A computer-readable recording medium storing the program according to claim 15.