JPH11127369A - Image pickup display system, its control program and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image pickup display system capable of selecting remaining images simultaneously with the selection of one image out of plural images at the time of reproducing, simultaneously displaying a synthetic image and enabling a user to easily use it. SOLUTION: The image pickup display system is provided with a recorder 115 for recording a group of n×m images obtained by the system so as to have information indicating that these images are constitutional images constituting a synthetic image, a CPU 112 for automatically selecting remaining images simultaneously with the selection of an optional image out of n×m images of the group recorded by the recorder 115 and a display controller 116 for automatically synthesizing and reproducing a synthetic image from the n×m images selected by the CPU 112.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging display system having a panoramic imaging display function and a stereoscopic imaging display function, a control program for controlling the imaging display system, and a recording medium storing the control program.

[0002]

2. Description of the Related Art Conventionally, there has been known a method of simultaneously processing a plurality of images picked up by an image pickup display system and displaying them. For example, an image captured by a compound-eye imaging device or an image captured twice by a monocular imaging device is used.
2. Description of the Related Art An imaging display method using a system image signal is known.
Taking a single-lens imaging device as an example, when an image is captured by matching the viewpoints of two imaging optical systems, and the obtained image is synthesized at the boundary of the shooting range, the angle of view is larger than that of an image captured by a single eye A high-definition panoramic image with little distortion can be viewed.

Further, when two imaging optical systems are arranged on the left and right at an interval given by the base line length and an image is captured from two viewpoints, a parallax is generated. You can see images with a three-dimensional effect. There are a method of displaying a stereoscopic image, a method of displaying the image on a stereoscopic display, a method of displaying a left and right image by using liquid crystal shutter glasses, and the like.

In either case of panoramic imaging display or stereoscopic imaging display, it is necessary to simultaneously process two types of image signals captured by a compound-eye imaging device. When these two images are recorded on a recording medium attached to the apparatus, an already synthesized image can be created and recorded. However, when only the constituent images constituting the synthesized image are viewed, the capacity of the recording medium is reduced, and the like. In consideration of the above, there are cases where it is desirable to record only the constituent images constituting the composite image. At this time, when reproducing from the recording medium again, it is necessary to simultaneously select and reproduce a plurality of, ie, one set of two constituent images constituting the composite image.

As described above, a plurality of images taken by an n-eye imaging and display system having a plurality of imaging optical systems or a plurality of images taken by a monocular imaging and display system as described in the example of a compound eye imaging apparatus are obtained. In order to simultaneously read a plurality of images from the recording medium, perform processing such as synthesis, and display the images simultaneously, the user needs to store a plurality of images of interest in one image.
You need to select them one by one.

[0006]

However, in the conventional example described above, a set of n images taken at the same time are independent of each other. Therefore, when a user reproduces a composite image, One set of n images constituting these must be selected and reproduced one by one.
There was a problem that it became burdensome for the user.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems of the prior art, and a first object of the present invention is to provide one of a plurality of images during reproduction.
When one image is selected, the remaining images can be selected at the same time, and a composite image can be displayed at a time, thereby providing an imaging display system that is easy for the user to use.

A second object of the present invention is to provide a control program capable of smoothly and reliably controlling the above-described imaging and display system of the present invention.

A third object of the present invention is to provide a recording medium on which a control program capable of controlling the above-mentioned imaging and display system of the present invention smoothly and reliably is recorded. .

[0010]

According to a first aspect of the present invention, there is provided an image pickup and display system having at least two or more image pickup optical systems and a set of n images.
In an n-eye imaging and display system that captures and outputs m times more than m times, 1
Recording means for recording the set n × m images so as to have information indicating that they are constituent images constituting the composite image; and arbitrary one of the set n × m images recorded by the recording means. Selecting means for automatically selecting the remaining image when one image is selected, and n selected by the selecting means
And a reproducing means for automatically synthesizing and reproducing a composite image from the × m images.

According to a second aspect of the present invention, there is provided an imaging and display system according to the first aspect, wherein the recording means includes the one set of nx
It is characterized in that m images have a file name to which a common character string and an identification character for identifying each are added.

According to a third aspect of the present invention, there is provided an imaging and display system according to the first aspect, wherein the recording means comprises the one set of n ×
It is characterized in that a common character string and an identification character for identifying each are added to the attribute information in each file of the m images.

According to a fourth aspect of the present invention, in order to achieve the first object, in the imaging display system according to the first aspect, the recording means comprises the one set nx
It is characterized in that the file names of the remaining constituent images are added to the attribute information inside each file of the m images.

According to a fifth aspect of the present invention, there is provided an imaging and display system according to the first aspect, wherein the recording means includes the one set of nx
It is characterized in that an imaging time that approximately matches the internal attribute information of each file of m images is added.

According to a sixth aspect of the present invention, there is provided an imaging and display system according to the first aspect, wherein the selecting means comprises a set n recorded by the recording means. Any one of × m images
When one image is selected, a search is made in the recording medium based on information indicating that the image is a constituent image of the composite image, and the remaining images are automatically selected.

According to a seventh aspect of the present invention, there is provided an imaging display system according to the first aspect of the present invention, wherein the composite image includes two images captured by the imaging display system. Is a panoramic image.

According to another aspect of the present invention, there is provided an image pickup and display system according to the first aspect, wherein the composite image includes two images picked up by the image pickup and display system. Is a stereoscopically captured image.

According to a ninth aspect of the present invention, in order to achieve the first object, in the imaging and display system according to the first aspect, the selecting means includes a set of images captured by the imaging and display system. When any one of the two panoramic images is selected, the image in the recording medium is searched and the image with the closest file creation date and time within any given time is automatically selected as another image. Is selected.

According to a tenth aspect of the present invention, in order to achieve the first object, in the imaging display system according to the first aspect, the selection means includes a set of images captured by the imaging display system. When any one of the two stereoscopically picked-up images is selected, a search is made in the recording medium, and the image with the closest file creation date and time within any given time is automatically set as another image. It is characteristically selected.

According to another aspect of the present invention, there is provided a control program for an image pickup display system,
A control program for an imaging display system having at least two or more imaging optical systems and controlling an n-eye imaging and display system that captures and outputs a set of n images only once or more m times, A recording module for recording a set of n × m images obtained by the imaging display system so as to have information indicating that the images are constituent images constituting a composite image, and a set of n recorded by the recording module × m
A selection module for automatically selecting any one of the images and simultaneously selecting the remaining images; and automatically synthesizing a synthesized image from the nxm images selected by the selection module. And a reproduction module for reproducing the data.

According to a twelfth aspect of the present invention, there is provided a control program for an imaging display system, wherein
12. The control program for an imaging display system according to claim 11, wherein the recording module has a file name in which a character string common to each set of n × m images and an identification character for identifying each are added. Features.

In order to achieve the second object, a control program for an imaging and display system according to claim 13 is
12. The control program of the imaging display system according to claim 11, wherein the recording module stores a character string common to attribute information inside each file of the set of n × m images and an identification character for identifying each character. It is characterized by being added.

In order to achieve the second object, a control program for an image pickup and display system according to claim 14 is
12. The control program according to claim 11, wherein the recording module adds a file name of a remaining constituent image to attribute information inside each file of the set of n × m images. And

According to another aspect of the present invention, there is provided a control program for an image pickup display system,
12. The control program for an imaging display system according to claim 11, wherein the recording module adds an imaging time that approximately matches attribute information in each file of the set of n × m images. .

In order to achieve the second object, a control program for an image pickup display system according to claim 16 is provided.
12. The control program according to claim 11, wherein the selecting module selects the arbitrary one of the set of n × m images recorded by the recording module to form the composite image. It is characterized in that a search is made in a recording medium based on information indicating that the image is a constituent image, and the remaining images are automatically selected.

In order to achieve the second object, a control program for an imaging and display system according to claim 17 is
12. The control program according to claim 11, wherein the composite image is two panoramic images captured by the imaging display system.

[0027] In order to achieve the second object, a control program for an imaging and display system according to claim 18 is provided.
12. The control program according to claim 11, wherein the composite image is two stereoscopic images captured by the imaging display system.

In order to achieve the second object, a control program for an imaging and display system according to claim 19 is
The control program for an imaging display system according to claim 11, wherein the selection module, when selecting any one image from a set of two panoramic images captured by the imaging display system, stores the image in the recording medium. It is characterized in that an image which is searched and has the closest file creation date and time within any given time is automatically selected as another image.

In order to achieve the second object, a control program for an imaging and display system according to claim 20 is
12. The control program for an imaging display system according to claim 11, wherein the selection module selects an arbitrary one image from a set of two stereoscopic images captured by the imaging display system, and stores the selected image in a recording medium. And automatically selecting an image within a given period of time and having the closest file creation date and time as another image.

In order to achieve the third object, a recording medium according to the twenty-first aspect has at least two or more imaging optical systems, and a set of n images can be read only once or more m times. A recording medium for recording a control program for an n-eye imaging and display system that captures and outputs images, and is a constituent image that forms a composite image from a set of nxm images obtained by the imaging and display system. And a selection module for automatically selecting the remaining image when selecting any one of a set of nxm images recorded by the recording module. A control program having an algorithm including a module and a reproduction module for automatically synthesizing and reproducing a synthesized image from the nxm images selected by the selection module. And it features.

In order to achieve the third object, the recording medium according to claim 22 is the recording medium according to claim 21, wherein the recording module is configured so that the set of nxm images is common to the set. It is characterized by having a file name to which a character string and an identification character for identifying each are added.

In order to achieve the third object, the recording medium according to the twenty-third aspect is the recording medium according to the twenty-first aspect, wherein the recording module comprises: It is characterized in that a common character string and an identification character for identifying each are added to the attribute information inside the file.

In order to achieve the third object, the recording medium according to claim 24 is the recording medium according to claim 21, wherein the recording module is configured to control each of the set of n × m images. It is characterized in that the file names of the remaining constituent images are added to the attribute information inside the file.

In order to achieve the third object, a recording medium according to a twenty-fifth aspect is the recording medium according to the twenty-first aspect, wherein the recording module is configured to control each of the n × m sets of images. It is characterized in that an imaging time that approximately matches the attribute information inside the file is added.

In order to achieve the third object, the recording medium according to the twenty-sixth aspect is the recording medium according to the twenty-first aspect, wherein the selection module is a set of nxm recorded by the recording module. Any one of the images
When one image is selected, a search is made in the recording medium based on information indicating that the image is a constituent image of the composite image, and the remaining images are automatically selected.

In order to achieve the third object, the recording medium according to the twenty-seventh aspect is the recording medium according to the twenty-first aspect, wherein the composite image is composed of two panoramic images captured by the imaging display system. It is a captured image.

In order to achieve the third object, the recording medium according to the twenty-eighth aspect is the recording medium according to the twenty-first aspect, wherein the combined image is formed by two stereoscopic images captured by the imaging and display system. It is a visually captured image.

In order to achieve the third object, the recording medium according to claim 29 is the recording medium according to claim 21, wherein the selection module is a set of two sheets imaged by the imaging display system. If any one of the panoramic images is selected, the recording medium is searched and the image with the closest file creation date and time within any given time is automatically selected as another image It is characterized by doing.

In order to achieve the third object, the recording medium according to claim 30 of the present invention is the recording medium according to claim 21, wherein the selection module is imaged by the imaging display system. When one arbitrary image is selected from a set of two stereoscopically captured images, the image in the recording medium is searched and the image with the closest file creation date and time within an arbitrary fixed time is set to another image. Is automatically selected.

[0040] In order to achieve the first object, the imaging display system according to claim 31 of the present invention is arranged as follows.
0, an imaging display system having one imaging optical system and n obtained by performing imaging a plurality of times.
Recording means for recording a set of n images obtained by the imaging and display system so as to have information indicating that the images are constituent images constituting a composite image in an imaging and display system for outputting a set of images; Selecting means for selecting any one of a set of n images recorded by the recording means and automatically selecting the remaining images at the same time; and selecting the n images selected by the selecting means And a reproducing unit for automatically synthesizing the image to a synthesized image and reproducing the image.

Further, in order to achieve the first object, the image pickup and display system according to claim 32 of the present invention provides the image pickup display system according to claim 3 of the present invention.
1. In the imaging display system according to 1, the recording unit includes:
The n images are provided with a file name in which a common character string and an identification character for identifying each are added.

According to a third aspect of the present invention, there is provided an image pickup and display system according to the third aspect of the present invention.
1. In the imaging display system according to 1, the recording unit includes:
It is characterized in that a common character string and an identification character identifying each are added to the attribute information inside each file of the n images.

Further, in order to achieve the first object, the image pickup and display system according to claim 34 of the present invention is arranged as follows.
1. In the imaging display system according to 1, the recording unit includes:
The file names of the remaining constituent images are added to the attribute information inside each file of the n images.

According to a third aspect of the present invention, there is provided an image pickup and display system according to the third aspect of the present invention.
1. In the imaging display system according to 1, the recording unit includes:
An image pickup time substantially matching the attribute information in the file of each of the n images is added.

Further, in order to achieve the first object, the imaging display system according to claim 36 of the present invention is arranged as follows.
1. In the imaging display system according to 1, the selecting means includes:
When an arbitrary one of the n images recorded by the recording means is selected, a search is performed in a recording medium based on information indicating that the image is a constituent image constituting the composite image, and the remaining images are searched for. It is automatically selected.

Further, in order to achieve the first object, the imaging display system according to claim 37 of the present invention provides
1. In the imaging and display system according to 1, the composite image is:
It is characterized by being two panoramic images picked up by the image pickup display system.

Further, in order to achieve the first object, the imaging display system according to claim 38 of the present invention is arranged as follows.
1. In the imaging and display system according to 1, the composite image is:
It is characterized by being two stereoscopically captured images captured by the imaging display system.

Further, in order to achieve the first object, the image pickup and display system according to claim 39 of the present invention is arranged as follows.
1. In the imaging display system according to 1, the selecting means includes:
When an arbitrary one image is selected from a set of two panoramic images picked up by the image pickup display system,
It is characterized in that a search is made in the recording medium and an image within a given period of time and having the closest file creation date and time is automatically selected as another image.

In order to achieve the first object, the imaging and display system according to claim 40 of the present invention is arranged as follows.
1. In the imaging display system according to 1, the selecting means includes:
When an arbitrary one image is selected from a set of two stereoscopically captured images captured by the imaging display system, a search is performed in the recording medium to determine the date and time of the most created file within an arbitrary fixed time. It is characterized in that a close image is automatically selected as another image.

In order to achieve the second object, a control program according to claim 41 of the present invention comprises an n-photographing apparatus having one image-capturing optical system and obtained by performing image-capturing a plurality of times. A control program for an imaging display system that controls an imaging display system that outputs a set of images, the information indicating that a set of n images obtained by the imaging display system is a constituent image forming a composite image. A recording module for recording so as to have, a selection module for automatically selecting any one of a set of n images recorded by the recording module, and at the same time automatically selecting the remaining images; A reproduction module for automatically synthesizing and reproducing a synthesized image from the n images selected by the module.

In order to achieve the second object, a control program according to claim 42 of the present invention provides a control program according to claim 41.
In the above described control program, the recording module has a file name in which a character string common to each of the n images and an identification character for identifying each are added.

In order to achieve the second object, a control program according to claim 43 of the present invention provides a control program according to claim 41.
In the above described control program, the recording module adds a common character string and an identification character for identifying each to the attribute information inside each file of the n images.

In order to achieve the second object, a control program according to claim 44 of the present invention provides a control program according to claim 41.
In the above described control program, the recording module adds the file names of the remaining constituent images to attribute information inside each file of the n images.

In order to achieve the second object, a control program according to claim 45 of the present invention provides a control program according to claim 41.
In the above described control program, the recording module adds an imaging time that approximately matches the attribute information in the file of each of the n images.

In order to achieve the second object, the control program according to claim 46 of the present invention provides a control program according to claim 41.
In the control program described above, the selection module is configured to select an arbitrary one of the n images recorded by the recording module based on information indicating that the selected image is a constituent image constituting the composite image. It is characterized in that a search is made in a recording medium and the remaining images are automatically selected.

In order to achieve the second object, a control program according to claim 47 of the present invention provides a control program according to claim 41.
In the above described control program, the composite image is two panoramic images captured by the image capturing and displaying system.

In order to achieve the second object, a control program according to claim 48 of the present invention provides a control program according to claim 41.
In the above-described control program, the composite image is two stereoscopically captured images captured by the imaging and display system.

In order to achieve the second object, the control program according to claim 49 of the present invention provides a control program according to claim 41.
In the control program described above, when the selection module selects any one image from a set of two panoramic images captured by the imaging display system, the selection module searches the recording medium and performs an arbitrary fixed time. , The image with the closest file creation date and time is automatically selected as another image.

In order to achieve the second object, a control program according to claim 50 of the present invention provides a control program according to claim 41.
In the control program described above, when the selection module selects any one image from a set of two stereoscopically captured images captured by the imaging display system, the selection module searches the recording medium to determine an arbitrary fixed image. It is characterized in that an image within the time and closest to the file creation date and time is automatically selected as another image.

In order to achieve the third object, the recording medium according to the fifty-first aspect of the present invention has a single image pickup optical system and is obtained by performing image pickup a plurality of times.
A recording medium for recording a control program for controlling an imaging and display system that outputs a set of images, wherein the set of n images obtained by the imaging and display system constitutes a composite image. And a selection module for automatically selecting the remaining image when selecting any one of a set of nxm images recorded by the recording module. Module and nx selected by the selected module
A control program having an algorithm including a reproduction module for automatically synthesizing m images into a synthesized image and reproducing the synthesized image is recorded.

In order to achieve the third object, the recording medium according to claim 52 of the present invention is the recording medium according to claim 51, wherein the recording module comprises a character common to the n images. It is characterized by having a file name to which a column and an identification character for identifying each are added.

In order to achieve the third object, a recording medium according to claim 53 of the present invention is the recording medium according to claim 51, wherein the recording module comprises a file for each of the n images. A common character string and an identification character for identifying each character string are added to the attribute information inside the character string.

In order to achieve the third object, the recording medium according to claim 54 of the present invention is the recording medium according to claim 51, wherein the recording module comprises a file for each of the n images. Is characterized by adding the file names of the remaining constituent images to the attribute information inside.

In order to achieve the third object, the recording medium according to claim 55 of the present invention is the recording medium according to claim 51, wherein the recording module comprises a file for each of the n images. Is characterized by adding an imaging time that approximately matches the attribute information inside the.

In order to achieve the third object, the recording medium according to claim 56 of the present invention is the recording medium according to claim 51, wherein the selection module comprises n sheets recorded by the recording module. Any one of the images
When one image is selected, a search is made in the recording medium based on information indicating that the image is a constituent image of the composite image, and the remaining images are automatically selected.

In order to achieve the third object, a recording medium according to a fifty-seventh aspect of the present invention is the recording medium according to the fifty-first aspect, wherein the composite image is captured by the imaging and display system. It is characterized by being a panoramic image.

In order to achieve the third object, the recording medium according to claim 58 of the present invention is the recording medium according to claim 51, wherein the composite image is captured by the imaging display system. It is characterized by being a stereoscopically captured image.

In order to achieve the third object, a recording medium according to claim 59 of the present invention is the recording medium according to claim 51, wherein the selection module is configured to store the image picked up by the image pickup display system. When any one of the two panoramic images is selected, the recording medium is searched and the image with the closest file creation date and time within any given time is automatically set as another image. It is characteristically selected.

In order to achieve the third object, a recording medium according to claim 60 of the present invention is the recording medium according to claim 51, wherein the selection module is configured to store the image picked up by the image pickup display system. When an arbitrary one image is selected from the set of two stereoscopically captured images, the image in the recording medium is searched, and the image with the closest file creation date and time within any given time is set as another image. It is automatically selected.

[0070]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) First, the first embodiment of the present invention will be described.
The embodiment will be described with reference to FIGS. In the present embodiment, when one of the two constituent images to be combined with the panoramic image captured and recorded by the imaging display system having the compound-eye imaging device is selected, the identification character of the file added at the time of recording is selected. A method of selecting the other image based on the file creation date and time in the directory entry and automatically synthesizing the image to reproduce a panorama synthesized image will be described. However, the content of this embodiment is
The intended purpose can be achieved by a similar method for an imaging display system having an imaging device with multiple eyes or more, and the description will be substituted for the case of multiple eyes. The same applies to a case where not only the n-eye imaging display system but also a plurality of images obtained by performing imaging multiple times using an imaging display system having a monocular imaging device are used.

FIG. 1 is a block diagram showing the configuration of an image pickup display system according to the present embodiment. The image pickup display system shown in FIG. 1 mainly includes a compound-eye image pickup apparatus 101, a personal computer (PC) 102, and a display 103. Elements.

The compound-eye imaging apparatus 101 includes two left and right imaging optical systems 104a and 104b, a synchronizing signal generator 105, A (analog) / D (digital) converters 106a and 106b,
It has a memory 107. Imaging optical system 104a, 10
Reference numeral 4b denotes lenses 108a and 108b and an image sensor CC
D109a and D109b. The synchronization signal generator 105 includes two imaging optical systems 104a and 104b.
It is connected to the. The memory 107 is an A / D converter 106
a, 106b. The compound eye imaging apparatus 101 is connected to a personal computer 102 via an interface cable 110.

The personal computer 102 has a parallel interface 111 and a CPU (central processing unit).
112, memory 113, image processing unit 114, recording device 1
15, a display controller 116, and a VRAM (Video Random Access Memory) 117. These components are connected to a CPU bus 118. The parallel interface 111 is connected to the memory 107 of the compound-eye imaging device 101, and the display controller 116 is connected to the display 103. The input of image signals from the compound-eye imaging device 101 is performed by the parallel interface 111, and the output of image signals to the display 103 is performed through the display controller 116.

The user interface 119 is connected to the CPU bus 118 of the personal computer 102.

Next, the operation of the image pickup and display system according to the present embodiment having the above configuration will be described. First, the left and right images formed by the lenses 108a and 108b in the two imaging optical systems 104a and 104b in the compound eye imaging apparatus 101 are acquired by the respective CCDs 109a and 109b.
An image is acquired by synchronizing and imaging the left and right imaging optical systems 104a and 104b based on a synchronization signal generated from the synchronization signal generator 105. The electrical signals of the image thus obtained are converted into digital signals by A / D converters 106a and 106b, respectively, and stored in the memory 107. These two types of image signals are transmitted to the interface cable 110.
Is input to the parallel interface 111 in the personal computer 102 via the.

The image input to the parallel interface 111 is first transferred to the memory 113 in the personal computer 102 via the CPU bus 118. Here, image processing in the personal computer 102 is performed in the area of the memory 113. Therefore, after performing image processing such as left-right difference correction on the image data by the image processing unit 114, the display controller 116
The left and right image data are transferred to the VRAM 117 under the control of, and are displayed on the display 103. The user interface 119 is for performing processing of the present apparatus.

First, the panoramic composite image is captured with the viewpoints of the two imaging optical systems 104a and 104b coincide with each other. The two image pickup optical systems 104a and 104b are arranged so as to form an overlapping area in the direction adjacent to the image to be picked up. The correspondence between the overlapping areas is obtained by template matching or the like, and the overlapping areas are joined so that they coincide. Thereby, it is possible to view a high-definition panoramic image having a large angle of view and little distortion as compared with an image captured with a single eye.

The above is the operation of the imaging display system according to the present embodiment. This operation is the same as in the case where a pair of captured left and right images are once recorded in the recording device 115 under the control of the CPU 112, reproduced from the recording device 115, and displayed on the display 103. However, according to the present invention, the two captured images are recorded as separate images instead of being recorded as synthesized. If the combined image is recorded, the combined 1
It is only necessary to select one panoramic composite image, but the recording capacity becomes very large because one panoramic composite image is recorded in addition to two images that are not to be composited. Also,
When actually viewing an image, there are cases where not only the composite image but also the individual component images that make up the composite image are viewed, so it is possible to record only the synthesized panoramic image and delete the individual component images. It is inconvenient. Therefore, at the time of reproduction, the images are combined again and displayed on the display 103, and the two constituent images that are not combined are recorded in the recording device 115 as they are.

However, when two left and right constituent images constituting one panoramic image are reproduced in this way,
The user must select the left and right images, respectively, and the operability for reproducing the composite image is low. Therefore, when one of the left and right images constituting the combined image is selected, the other image is similarly selected at the same time, and the image combined at one time is displayed on the display 103.

Hereinafter, the method will be described with reference to FIGS. This method is performed by using software (control program) loaded from a medium (not shown) on a program memory on the recording device 115. This software operates under the control of the CPU 112.

FIG. 2 shows the recording (recording) of a compound eye image on recording device 115 in the imaging and display system according to the present embodiment.
FIG. 3 is a flowchart showing a control procedure of an operation, and FIG. 3 is a flowchart showing a control procedure of an operation from reproduction to display of a set of images from the recording device 115 in the imaging and display system according to the present embodiment.

In FIG. 2, first, in step S201, the two image pickup optical systems 104a and 104a of the compound-eye image pickup apparatus 101 are set.
4b captures two left and right images. Now, it is assumed that the two imaging optical systems 104a and 104b are arranged for capturing a panoramic image. Therefore, the next step S2
In 02, these images are recorded in the recording device 115 with a file name in which a common character string is added with identification characters for identifying the left and right images, respectively, and then this processing operation is terminated. As the identification characters, for example, in the present embodiment, the identification character “_R” is added to the right image and the identification character “_L” is added to the left image to the common character string “IMAGE1” in the first group. When saving in the format, the left and right image names are respectively “IMAGE1_R.bmp” and “IMAGE1_R.bmp”.
1_L. bmp ". In this case,
Further, the two imaging optical systems 104 of the compound eye imaging apparatus 101
When imaging is performed at a and 104b, the common character strings of the file names are named “IMAGE2”, “IMAGE3”, and so on. Here, the file format at the time of recording is not limited to the bitmap, and the same applies to the case where recording is performed in various file formats. Further, the creation date and time of the captured image is added as attribute information of the captured image. This is added to the directory entry of the OS (operating system) of the recording device 115.

FIG. 4 shows the structure of a directory entry in the recording device 115. In the figure, reference numeral 401 denotes a directory entry, which describes a file name 402, an extension 403, attribute information 404, a leading cluster 405, and the like of a file recorded in the recording device 115. Here, the first cluster 405 is the FAT of each file.
The first cluster in (file allocation table) is shown in hexa units. Two imaging optical systems 104a and 104b of the compound eye imaging apparatus 101
The image file “I” captured by the
MAGE1_R. bmp "," IMAGE1_L. bm
The information of p ″ is recorded as shown in FIG.

Next, the case where these images are reproduced will be described with reference to FIG. The imaging display system according to the present embodiment includes a viewer for displaying a captured image in the software of the present invention.

In FIG. 3, when reproducing an image,
First, in step S301, the file manager of the viewer starts up, and the VRAM 117 as a recording medium is used.
The file name selection screen appears. Here, the user selects an image to be reproduced using a user interface 119 such as a mouse.

Next, in step S302, each of the constituent images “IMAGE1_R.
bmp "," IMAGE1_L. bmp ”, one of the images“ IMAGE1_L. bmp ".
However, the image to be selected is the left image “IMAGE1_
L. bmp ”, and is not limited to“ IM
AGE1_R. bmp ". Similar processing is conventionally performed. Only a selected image is stored in a VRAM serving as a recording medium.
Although the data is read from the display 117 and displayed on the display 103, the viewer in the present embodiment has been selected in advance in a mode premised on reproducing a panoramic captured display image. Therefore, the processing after step S303 is performed.

First, in step S303, it is determined whether or not it is possible to convert an identification character indicating that the image selected by the user is any of the constituent images constituting the panoramic composite image. “IMAGE1_
L. Since “bL” has an identification character “_L”, it is determined that the file name can be converted from “_L” to “_R.” Further, “IMAGE1” excluding this identification character Can be recognized as a common character string constituting the file name, and then “IMAGE1_L. bmp ”to“ I
MAGE1_R. bmp ”to create a file name of a new image to be selected. It is determined whether the selected image is“ _R ”or“ _L ”by this processing, It can be converted to a paired image file name.

Next, the data of the file name “IMAGE1_R.bmp” converted in step S305 is stored in the VRAM
Search within 117. Next, in step S306, it is determined whether or not data exists. If data exists, “IMAGE1_R.bmp”, “I
MAGE1_L. bmp ”simultaneously on the display 103
To determine whether the image is desired by the user. Then, when it is determined via the user interface 119 that the image is desired by the user, in step S308, a set of two constituent images “IMAGE1_R.bmp” and “IMAGE1_L.
bmp ”, and after one composite image is displayed on the display 103 in the next step S309, this processing operation ends. In the panoramic composition, two constituent images“ IMAGE1_R. bmp "," IMAGE1_L.
A corresponding point of a portion overlapping the imaging region boundary of “bmp” is determined by template matching or the like, and is combined by combining the portions.

On the other hand, if the user determines that the two images displayed in step S307 are not the desired images, it is determined that an appropriate set of two left and right images has not been selected in step S312. Step S
At 302, only one image selected first by the user is displayed on the display 103 in the 2D mode, and then the processing operation is terminated.

By the way, the file names of the two left and right images that are generally combined with a panorama are not necessarily “_R” and “_L”.
Does not have the identification character. Therefore, there is a possibility that the selected file name cannot be appropriately determined in step S303. However, since the data of the pair of left and right images of the panoramic composite image obtained by imaging is created at very short intervals, the recording device 11
It is considered that the creation date and time of the image data described in the attribute information of the directory entry in 5 is very close. Therefore, if the left and right image file names do not have left and right identification signals, the creation date and time of the directory entry is checked for all the files in the recording device 115 in step S310, and the file is selected in step S302. Select the one with the closest creation date and time to the image. Similarly, if the file name created by the conversion of the identification character in step S306 does not exist in the recording device 115 as a result of the data search, the process also proceeds to step S310, and the file creation date and time are set. Perform a search based on

However, since the difference between the creation date and time is considered to be very small, the time from when the shutter is pressed once by the present imaging system until the next time the shutter is pressed can be taken as a fixed time t. In S311, it is determined whether or not the difference between the creation date and time of the image selected in step S302 and the creation date and time of the image searched in step S310 is within the predetermined time t. If the difference between the creation dates and times is within the predetermined time t, the two images are selected as constituent images constituting a composite image, and the panoramic composite image is displayed on the display 103 (steps S307 to S30).
9).

If the difference between the creation dates and times is not within the predetermined time t in step S311, the flow advances to step S312 to skip only the image selected first in step S302 without combining two images. Is displayed on the display 103 in 2D mode.

Here, in the present embodiment, the predetermined time t is set as the time from when the shutter is pressed once by the present imaging system to when the next shutter is pressed and the image can be picked up. However, the present invention is not limited to this. Instead, the method of setting the predetermined time t is arbitrary. Since the creation date and time used as the attribute information of this image can be changed by an OS (Operating System), if the same creation date and time are recorded in two captured images, the creation date and time will be the same at the time of reproduction. By selecting an image file, two images can be reproduced simultaneously.

On the other hand, when one independent 2D image which is not a constituent image of an image to be synthesized in this reproduction mode is selected, for example, in this embodiment, as shown in FIG. "IMAGE1.bm
When "p" is selected, the left and right identification characters are not provided, and the time when the file is created includes the creation date and time of other images, so that only one image is displayed in the 2D mode in this processing. Will be displayed.

As described above, “IMAGE1_R.b
mp "," IMAGE1_L. "bmp" and the like, the identification characters "_R" and "_L" indicating the constituent images constituting the panorama composite image are added and recorded.
At the time of reproduction, the user simply selects only “IMAGE1_L.bmp”, and at the same time, selects “IMAGE1_R.bm”.
By selecting p ", the two left and right images can be automatically combined and displayed.

Further, even if an identification character not supported by this processing is used in the file name, the
By searching based on the file creation date and time in the entry,
At the same time, two left and right images can be selected and displayed in a combined manner.

In the present embodiment, an example of reproducing a panoramic captured display image has been described. However, the reproduction of a stereoscopic captured display image can be similarly described with reference to the flowcharts shown in FIGS. However, in this case, the two selected images are processed and displayed for stereoscopic display. Methods of performing stereoscopic display include a method of displaying on a stereoscopic display and a method of switching between left and right images using liquid crystal shutter glasses. In the former method of displaying on a three-dimensional display, it is necessary to alternately arrange two left and right images for each line of a frame and combine them. In the latter method using liquid crystal shutter glasses, the left and right images are displayed on one screen. It is necessary to perform a process of switching to the display.

Further, in the present embodiment, the case where the assumed imaging display system is constituted by the compound eye imaging device 101, the personal computer 102, and the separated type display 103 has been described as an example, but all these components are built-in. The present invention is similarly applicable to an integrated imaging and display system.

Further, in the present embodiment, the recording device 115 of the assumed imaging and display system is exemplified as the one built in the personal computer 102. However, the recording device 115 is not limited to this. A possible recording device may be used.

(Second Embodiment) Next, a second embodiment of the present invention will be described with reference to FIGS. Note that the basic configuration of the imaging and display system according to the present embodiment is the same as that of FIG. 1 in the above-described first embodiment, and will be described with reference to FIG.

In this embodiment, when one of the two constituent images to be combined with the panoramic image captured by the compound eye device 101 and recorded in the recording device 115 is selected, the header portion of the file is recorded at the time of recording. A method of selecting the other image based on the added file information of the other image and the date and time of creation of the file in the directory entry, automatically synthesizing the image, and reproducing the panorama synthesized image will be described.

However, the contents in the present embodiment can achieve the intended purpose by the same method for an image pickup and display system having multiple eyes or more, and therefore the description will be substituted for the case of multiple eyes. The same applies to a case in which a plurality of images obtained by performing image capturing a plurality of times using the monocular image capturing and displaying system as well as the n-eye image capturing and displaying system are used.

This embodiment differs from the first embodiment in a recording method and a method of reproducing a recorded image. This method is performed by using software loaded from a medium (not shown) on a program memory on the recording device 115.

FIG. 5 shows the recording (recording) of a compound eye image on the recording device 115 in the imaging and display system according to the present embodiment.
FIG. 6 is a flowchart showing a control procedure of an operation, and FIG. 6 is a flowchart showing a control procedure of an operation until reproduction and display of a set of images from the recording device 115 in the imaging and display system according to the present embodiment.

In FIG. 5, first, in step S501, the two image pickup optical systems 104a and 104a of the compound-eye image pickup apparatus 101 are set.
4b captures two left and right images. Now, it is assumed that the two imaging optical systems 104a and 104b are arranged for capturing a panoramic image. Therefore, the next step S5
In step 02, the file names of the images forming the pair of the composite images are written in the header information of these images, and the data is recorded in the recording device 115. Then, the processing operation ends.
As the file name, for example, in the present embodiment, the left and right image names are respectively “IMAGE1_R.bmp”,
“IMAGE1_L.bmp” and “IMAGE1_
R. In the header file of “bmp”, “IMAGE1_L. bmp ”on the other hand and“ IMAGE1_L. bmp ”is stored in the header file“ IMAGE1_R. bm
p ”is respectively written. In the header file, an area for storing a file name as attribute information of an image is newly secured, and writing is performed in that area. In this case, the compound-eye imaging apparatus 101 is further provided. , The common character string of the file name is “IMAGE2”,
"IMAGE3",... Here, the file format at the time of recording is not limited to the bitmap, and the same applies to the case where recording is performed in various file formats. The information to be written in the header file is not limited to the file name of the paired image, but may be information unique to the image, such as the size of the file, the update date and time, and the like. In particular, when processing three or more images in an imaging and display system with multiple eyes or more, it is complicated to write the file names of the remaining constituent images in the header file. Recording a character string in which each identification character is added to the character string has the advantage that it can be recorded as information independent of the file name. In this case, the same processing can be performed. Further, the creation date and time of the captured image is added as attribute information of the captured image. This is the OS of the recording device 115
(Operating system) is added on the directory entry. The directory entry has the same configuration as that of FIG. 4 in the first embodiment described above.

Next, the case of reproducing these images will be described with reference to FIG. The imaging display system according to the present embodiment includes a viewer for displaying a captured image in the software of the present invention.

When reproducing an image, first, in step S601, the file manager of the viewer starts up, and a screen for selecting a file name in the VRAM 117 as a recording medium appears. Here, the user selects an image to be reproduced using a user interface 119 such as a mouse.

Next, in step S602, each of the constituent images “IMAGE1_R.
bmp "," IMAGE1_L. bmp ”, one of the images“ IMAGE1_L. bmp ".
Conventionally, only a selected image is stored in a recording medium VRA.
Although read from M117 and displayed on the display 103, the viewer in the present embodiment has been selected in advance in a mode on the premise that a panoramic captured display image is reproduced. Therefore, the processing after step S603 is performed.

First, in step S603, “IMAGE1
_L. The header file of “bmp” is written on a directory entry on the VRAM 117, and the name of the pair image to be combined with the panorama is written. As shown in FIG. I
MAGE1_L. bmp ”header file contains
“IMAGE1_R.bmp” is recorded.

Next, in step S604, “IMAGE1_
R. bmp ”data is searched in the VRAM 117 to determine whether there is an image to be paired. If there is an image to be paired, in step S605,“ IMAGE1_R. bmp "," IMAGE1_L.
bmp "is displayed on the display 103 at the same time to determine whether or not the image is desired by the user.
If it is determined via the user interface 119 that the image is desired by the user, in step S606, a set of two constituent images "IMAGE1_"
R. bmp "," IMAGE1_L. bmp ”is synthesized in a panoramic manner, and in the next step S607, the display 103
After displaying one composite image, the processing operation is terminated. In the panorama composition, two constituent images “IMAGE1
_R. bmp "," IMAGE1_L. A corresponding point of a portion overlapping the imaging region boundary of “bmp” is determined by template matching or the like, and is combined by combining the portions.

On the other hand, if the user determines that the two images displayed in step S605 are not the desired images, it is determined that an appropriate set of two left and right images has not been selected in step S610. Step S
At 602, only one image selected by the user at first is displayed on the display 103 in the 2D mode, and then the processing operation ends.

By the way, generally, the file names of the two left and right images to be combined in a panorama do not always have a header file indicating image information to be a pair of the combined image. Therefore, there is a possibility that the selected file name cannot be appropriately determined in step S603. However, since a pair of left and right images of a panoramic composite image obtained by imaging are generated at very short intervals, the image described in the attribute information of the directory entry in the recording device 115 is used. The date and time when the data was created is considered to be very close. Therefore, if the left and right image file names do not have left and right identification signals, the creation date and time of the directory entry is checked for all the files in the recording device 115 in step S608, and the file is selected in step S602. Select the one with the closest creation date and time to the image.

However, since the difference between the creation date and time is considered to be very small, the time from when the shutter is pressed once in the present imaging system until the next time the shutter is pressed can be set as a fixed time t. In S609, it is determined whether or not the difference between the creation date and time of the image selected in step S602 and the creation date and time of the image searched in step S608 is within the predetermined time t. If the difference between the creation dates and times is within the predetermined time t, the two images are selected as constituent images constituting a composite image, and the panoramic composite image is displayed on the display 103 (steps S605 to S60).
7).

If the difference between the creation date and time is not within the predetermined time t in step S609, the process proceeds to step S610, and only the image selected first in step S602 is synthesized without combining two images. Is displayed on the display 103 in 2D mode.

Here, in the present embodiment, the predetermined time t is set as the time from when the shutter is pressed once by the present imaging system to when the next shutter is pressed and the image can be taken. However, the present invention is not limited to this. Instead, the method of setting the predetermined time t is arbitrary. Since the creation date and time used as the attribute information of this image can be changed by an OS (Operating System), if the same creation date and time are recorded in two captured images, the creation date and time will be the same at the time of reproduction. By selecting an image file, two images can be reproduced simultaneously.

On the other hand, when one independent 2D image which is not a constituent image of the image to be synthesized in this reproduction mode is selected, for example, in the present embodiment, as shown in FIG. "IMAGE1.bm
When "p" is selected, the header file on the directory entry has no information on the paired image, and the time when the file was created is the same as the creation date and time of other images. Only one image is displayed on the display 103 as the mode.

As described above, the information of each pair image of the constituent images to be subjected to the panorama composition at the time of recording is stored in the VRAM 11.
7, by reading the header file during playback, the user can select only "IMAGE1_L.bmp",
At the same time, "IMAGE1_R.bmp" can be selected to automatically combine and display the two left and right images. In this embodiment, even if the file has no header information,
By searching based on the file creation date and time in the directory entry, two left and right images can be selected and displayed at the same time.

In the present embodiment, an example of reproducing a panoramic captured display image has been described. However, reproduction of a stereoscopic captured display image can be similarly described with reference to the flowcharts shown in FIGS. However, in this case, the two selected images are processed and displayed for stereoscopic display. As a method of performing stereoscopic display, there are a method of displaying on a stereoscopic display and a method of switching between left and right images using liquid crystal shutter glasses. In the former method of displaying on a three-dimensional display, it is necessary to alternately arrange two left and right images for each line of a frame and combine them. In the latter method using liquid crystal shutter glasses, the left and right images are displayed on one screen. It is necessary to perform a process of switching to the display.

Further, in the present embodiment, the case where the assumed imaging display system is constituted by the compound-eye imaging device 101, the personal computer 102 and the separation type display 103 has been described as an example. However, all these components are built-in. The present invention is similarly applicable to an integrated imaging and display system.

Furthermore, in the present embodiment, the recording device 115 of the assumed imaging and display system is exemplified as the recording device 115 originally built in the personal computer 102. However, the recording device 115 is not limited to this. A possible recording device may be used.

[0122]

As described in detail above, according to the imaging display system of the present invention, each set of a plurality of constituent images constituting a composite image at the time of recording has information indicating that it is a constituent image. Accordingly, when one of a plurality of images is selected at the time of reproduction, the remaining images can be selected at the same time, and the composite image can be displayed at one time, which is easy for the user to use. To play.

Further, according to the control program of the present invention and the recording medium on which the control program is recorded, there is an effect that the above-described imaging and display system can be controlled smoothly and reliably.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an imaging display system according to a first embodiment of the present invention.

FIG. 2 is a flowchart showing a control procedure of a recording operation of a compound eye image to a recording device in the imaging and display system according to the first embodiment of the present invention.

FIG. 3 is a flowchart showing a control procedure of an image reproducing operation in the imaging display system according to the first embodiment of the present invention.

FIG. 4 is a diagram showing directory entries in a recording device in the imaging display system according to the first embodiment of the present invention.

FIG. 5 is a flowchart illustrating a control procedure of a recording operation of a compound eye image to a recording device in the imaging and display system according to the second embodiment of the present invention.

FIG. 6 is a diagram illustrating a control of an image reproducing operation in an imaging and display system according to a second embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 101 compound eye imaging device 102 personal computer 103 display 104a imaging optical system 104b imaging optical system 105 synchronization signal generator 106a A / D converter 106b A / D converter 107 memory 108a lens 108b lens 109a CCD 109b CCD 110 interface cable 111 parallel interface 112 CPU 113 Memory 114 Image processing unit 115 Recording device 116 Display controller 117 VRAM 118 CPU bus 119 User interface

Claims (60)

[Claims] 1. An n-eye imaging and display system that has at least two or more imaging optical systems and that captures and outputs a set of n images one or more times m times and outputs them. Recording means for recording the set of n × m images obtained so as to have information indicating that they are constituent images constituting a composite image; and a set of n × m images of the set recorded by the recording means. Selecting means for automatically selecting any one of the selected images and, at the same time, automatically selecting the remaining images; and reproduction for automatically synthesizing and reproducing the nxm images selected by the selecting means into a composite image. And an imaging display system. 2. The image processing apparatus according to claim 1, wherein the recording unit assigns a file name to the set of n × m images to which a common character string and an identification character for identifying each character are added.
The imaging display system according to the above. 3. The method according to claim 1, wherein the recording unit adds a common character string and an identification character for identifying each of the attribute information inside each file of the set of n × m images. Item 2. The imaging display system according to Item 1. 4. The apparatus according to claim 1, wherein the recording unit adds the file names of the remaining constituent images to attribute information inside each file of the set of n × m images.
The imaging display system according to the above. 5. The imaging and display system according to claim 1, wherein said recording means adds an imaging time that substantially matches the attribute information in each file of the set of n × m images. . 6. The information indicating that, when an arbitrary one of a set of n × m images recorded by the recording unit is selected, the selection unit is a constituent image constituting the composite image. 2. The image pickup and display system according to claim 1, wherein a search is made in the recording medium based on the information to automatically select a remaining image. 7. The imaging and display system according to claim 1, wherein the composite image is two panoramic images captured by the imaging and display system. 8. The imaging and display system according to claim 1, wherein the composite image is two stereoscopically captured images captured by the imaging and display system. 9. When the selection means selects an arbitrary one of a set of two panoramic images picked up by the image pickup display system, the selecting means searches the recording medium and sets the selected image within a predetermined time. 2. The image pickup and display system according to claim 1, wherein the image having the closest file creation date and time is automatically selected as another image. 10. The selection means, when selecting any one image from a set of two stereoscopically picked-up images picked up by the image pick-up display system, searches the recording medium for an arbitrary fixed time. 2. The image pickup and display system according to claim 1, wherein the image having the closest file creation date and time is automatically selected as another image. 11. Control of an imaging display system having at least two or more imaging optical systems and controlling an n-eye imaging and display system that captures and outputs a set of n images one or more times m times. A recording module for recording a set of nxm images obtained by the imaging display system so as to have information indicating that the images are constituent images constituting a composite image; A selection module for automatically selecting the remaining one of the selected n × m images from the set of n × m images, and an nxm image selected by the selection module
A control program for an imaging and display system, comprising: an algorithm having a reproduction module for automatically synthesizing a composite image from a plurality of images and reproducing the composite image. 12. The recording module according to claim 1, wherein the one set of n ×
12. The control program according to claim 11, wherein the m images have a file name in which a common character string and an identification character for identifying each character are added. 13. The recording module according to claim 1, wherein the set of n × 1
12. The control program according to claim 11, wherein a common character string and an identification character for identifying each are added to the attribute information in each file of the m images. 14. The recording module according to claim 1, wherein the set of n × 1
12. The control program according to claim 11, wherein the file names of the remaining constituent images are added to the attribute information in each file of the m images. 15. The recording module according to claim 1, wherein the one set of n ×
12. The control program according to claim 11, wherein an imaging time that substantially matches the internal attribute information of each file of the m images is added. 16. The information indicating that the selection module is a constituent image constituting the composite image when any one of a set of n × m images recorded by the recording module is selected. 12. The control program according to claim 11, wherein the recording medium is searched in the recording medium on the basis of the above to automatically select a remaining image. 17. The computer-readable storage medium according to claim 11, wherein the composite image is two panoramic images captured by the imaging display system. 18. The computer-readable storage medium according to claim 11, wherein the combined image is two stereoscopically captured images captured by the imaging display system. 19. When the selection module selects any one image of a set of two panoramic images picked up by the image pickup display system, the selection module searches the recording medium and sets the selected image within a given period of time. 12. The control program according to claim 11, wherein the image having the closest file creation date and time is automatically selected as another image. 20. The selection module, when selecting any one image from a set of two stereoscopically picked-up images picked up by the image pickup and display system, searches the recording medium and sets an arbitrary fixed time. 12. The control program according to claim 11, wherein an image having the closest file creation date and time is automatically selected as another image. 21. A recording medium having at least two or more imaging optical systems, and recording a control program of an n-eye imaging and display system that captures and outputs a set of n images one or more times m times. A recording module for recording a set of n × m images obtained by the imaging display system so as to have information indicating that the images are constituent images constituting a composite image; A selection module for selecting any one of the set of n × m images and automatically selecting the remaining images at the same time;
A recording medium having recorded thereon a control program having an algorithm comprising a reproducing module for automatically synthesizing and reproducing a synthesized image from the nxm images selected by the selection module. 22. The recording module, wherein the set n ×
22. The recording medium according to claim 21, wherein the m images have a file name in which a common character string and an identification character for identifying each are added. 23. The recording module, wherein the set n ×
22. The recording medium according to claim 21, wherein a common character string and an identification character for identifying each character are added to the attribute information in each file of the m images. 24. The recording module, wherein the set n ×
22. The recording medium according to claim 21, wherein the file names of the remaining constituent images are added to the attribute information inside each file of the m images. 25. The recording module, wherein the set n ×
22. The recording medium according to claim 21, wherein an imaging time substantially matching the attribute information in each file of the m images is added. 26. The selection module, wherein when any one of a set of n × m images recorded by the recording module is selected, information indicating that the selected image is a constituent image constituting the composite image. 22. The recording medium according to claim 21, wherein a search in the recording medium is performed on the basis of, and the remaining images are automatically selected. 27. The recording medium according to claim 21, wherein the composite image is two panoramic images captured by the image display system. 28. The recording medium according to claim 21, wherein the composite image is two stereoscopically captured images captured by the imaging display system. 29. When the selection module selects any one image from a set of two panoramic images picked up by the image pickup display system, the selection module searches the recording medium and sets the selected image within a predetermined time. 22. The recording medium according to claim 21, wherein an image having the closest file creation date and time is automatically selected as another image. 30. The selection module, when selecting any one image from a set of two stereoscopic images picked up by the image pickup display system, searches the recording medium and sets an arbitrary fixed time. 22. The recording medium according to claim 21, wherein an image having the closest file creation date and time is automatically selected as another image. 31. An imaging and display system having one imaging optical system and outputting a set of n images obtained by performing imaging a plurality of times, wherein one set n obtained by the imaging and display system is provided. A recording means for recording the images so as to have information indicating that they are constituent images constituting the composite image, and selecting any one of a set of n images recorded by the recording means. At the same time, there is provided an image pickup apparatus comprising: selecting means for automatically selecting the remaining images; and reproducing means for automatically synthesizing and reproducing a synthesized image from the n images selected by the selecting means. Display system. 32. The imaging and display system according to claim 31, wherein said recording means has a file name in which a common character string and an identification character for identifying each are added to said n images. 33. The recording apparatus according to claim 31, wherein the recording unit adds a common character string and an identification character for identifying each of the attribute information in the file of each of the n images. Imaging display system. 34. The imaging and display system according to claim 31, wherein said recording means adds the file names of the remaining constituent images to the attribute information inside each file of said n images. 35. The imaging and display system according to claim 31, wherein said recording means adds an imaging time that substantially matches the attribute information in the file of each of the n images. 36. The selection means, when selecting any one of the n images recorded by the recording means, records the selected image based on information indicating that the image is a constituent image constituting the composite image. 32. The imaging and display system according to claim 31, wherein a search in the medium is performed to automatically select a remaining image. 37. The imaging and display system according to claim 31, wherein the composite image is two panoramic images captured by the imaging and display system. 38. The imaging and display system according to claim 31, wherein the composite image is two stereoscopically captured images captured by the imaging and display system. 39. The selecting means, when selecting any one image from a set of two panoramic images picked up by the image pickup display system, searches the recording medium and sets it within any given time. 32. The imaging and display system according to claim 31, wherein an image having the closest file creation date and time is automatically selected as another image. 40. The selection means, when selecting any one image from a set of two stereoscopically picked-up images picked up by the image pick-up display system, searches the recording medium for an arbitrary fixed time. 32. The imaging and display system according to claim 31, wherein an image having the closest file creation date and time is automatically selected as another image. 41. A control program for an imaging display system which has one imaging optical system and controls an imaging display system which outputs a set of n images obtained by performing imaging a plurality of times, A recording module for recording a set of n images obtained by the imaging and displaying system so as to have information indicating that the images are constituent images constituting a composite image, and a set of n images recorded by the recording module
A selection module for automatically selecting any one of the images and simultaneously selecting the remaining images, and automatically synthesizing and reproducing a synthesized image from the n images selected by the selection module A control program for an imaging and display system, comprising: an algorithm having a reproduction module that performs the processing. 42. The recording module according to claim 4, wherein the n images have a file name in which a common character string and an identification character for identifying each of the images are added.
2. A control program for the imaging display system according to 1. 43. The recording module according to claim 41, wherein the recording module adds a common character string and an identification character for identifying each of the attribute information in the file of each of the n images. Control program for the imaging display system. 44. The recording module according to claim 4, wherein the recording module adds the file names of the remaining constituent images to internal attribute information of each file of the n images.
2. A control program for the imaging display system according to 1. 45. The computer-readable storage medium according to claim 41, wherein the recording module adds an imaging time that approximately matches the attribute information in the file of each of the n images. 46. The selection module records, based on information indicating that a selected one of the n images recorded by the recording module is a constituent image of the composite image when the image is selected. 42. The control program according to claim 41, wherein a search is made in the medium to automatically select a remaining image. 47. The control program according to claim 41, wherein the composite image is two panoramic images captured by the image display system. 48. The computer-readable storage medium according to claim 41, wherein the combined image is two stereoscopically captured images captured by the imaging display system. 49. The selection module, when selecting any one image of a set of two panoramic images picked up by the image pickup display system, searches the recording medium and sets the selected image within a certain period of time. 42. The control program according to claim 41, wherein the image having the closest file creation date and time is automatically selected as another image. 50. The selection module, when selecting any one image of a set of two stereoscopically picked-up images picked up by the image pickup display system, searches the recording medium and sets an arbitrary fixed time. 42. The control program according to claim 41, wherein an image having the closest file creation date and time is automatically selected as another image. 51. A recording medium for recording a control program for controlling an imaging display system having one imaging optical system and outputting a set of n images obtained by performing imaging a plurality of times. A recording module for recording a set of n images obtained by the imaging and display system so as to have information indicating that the images are constituent images constituting a composite image; and a set of nx images recorded by the recording module.
a selection module for automatically selecting any one of the m images and at the same time automatically selecting the remaining images, and automatically synthesizing a synthesized image from the nxm images selected by the selection module A recording medium having recorded thereon a control program having an algorithm having a reproducing module for performing reproduction. 52. The recording module according to claim 5, wherein the n images have a file name to which a common character string and an identification character for identifying each character are added.
2. The recording medium according to 1. 53. The recording module according to claim 51, wherein the recording module adds a common character string and an identification character for identifying each to the attribute information in each file of the n images. recoding media. 54. The recording module according to claim 5, wherein the recording module adds the file names of the remaining constituent images to the attribute information inside each file of the n images.
2. The recording medium according to 1. 55. The recording medium according to claim 51, wherein said recording module adds an imaging time substantially matching to attribute information inside each file of said n images. 56. The selection module records, based on information indicating that a selected one of the n images recorded by the recording module is a constituent image constituting the composite image when selecting any one of the images. 52. The recording medium according to claim 51, wherein the medium is searched to automatically select the remaining images. 57. The recording medium according to claim 51, wherein the composite image is two panoramic images captured by the image display system. 58. The recording medium according to claim 51, wherein the composite image is two stereoscopically captured images captured by the imaging and display system. 59. When the selection module selects any one image of a set of two panoramic images picked up by the image pickup display system, the selection module searches the recording medium and sets the selected panoramic image within an arbitrary period of time. 52. The recording medium according to claim 51, wherein an image having the closest file creation date and time is automatically selected as another image. 60. The selection module, when selecting any one image from a set of two stereoscopically picked-up images picked up by the image pickup display system, searches the recording medium and sets an arbitrary fixed time. 52. The recording medium according to claim 51, wherein an image having the closest file creation date and time is automatically selected as another image.