JPH11308608A - Dynamic image generating method, dynamic image generator, and dynamic image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a device with which dynamic images with high image quality over an entire part in a circumferential direction or its part area are easily acquired, regardless of a simple configuration. SOLUTION: Each of 16 cameras 1 placed in the circumferential direction at an equal interval photographs each visual scope to acquire dynamic image data. A microcomputer 2 receives dynamic image data from a CCD 1b of each camera 1, connects and composite dynamic images obtained by the adjacent cameras 1 sequentially and obtains a panorama dynamic image over the entire circumferential direction, applies compression processing to the composited dynamic image data and sends the compressed composited moving image data to a personal computer 4 via a transmission channel 3. The personal computer 4 applies expansion processing to the received composited moving image data that are compressed to obtain the original composited moving image data. A panorama dynamic image corresponding to the composited dynamic image data is displayed on a screen of a display device 5. Moreover, the compressed composited moving image data are recorded on a recording medium in a recorder 6.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving image generating method and apparatus for generating a moving image over the entire circumferential area or a part thereof, and a moving image presenting apparatus for presenting the generated moving image.

[0002]

2. Description of the Related Art Systems for installing cameras and acquiring unattended moving images at those locations for security purposes at offices, monitoring at construction sites, and the like have become widespread. Such security and surveillance cameras have a limited imaging range (imaging angle) regardless of whether they are fixed or movable, and cannot monitor the entire circumferential direction. Many.

[0003] When a camera having a limited imaging angle is used, there is always a problem that a blind spot area in the imaging range exists and the accuracy is poor. Therefore, a system in which one camera is moved over the entire circumferential direction to acquire a moving image is operated. However, since a time lag occurs in the shooting timing, it is necessary to obtain a moving image over the entire circumferential direction at the same timing. Is impossible.

[0004]

As described above, there is a high need to obtain moving images in the entire circumferential direction at the same timing.
In addition, by continuously displaying a panoramic moving image of the entire circumferential direction acquired at the same timing as described above, a moving image can be presented as if a human were looking around while moving his / her eyes. It is considered that the utility value as an entertainment at a theme park, a game machine, or the like is high.

In order to generate a moving image of this kind in the entire circumferential direction, several cameras with a high angle of view (about 100 °) are installed, and a plurality of cameras obtained by simultaneously photographing the object from different angles are obtained. A method of joining moving images is considered. However, in this method, the number of cameras to be used can be reduced, but a moving image obtained by one camera is greatly distorted in its peripheral portion, so that image processing for joining adjacent moving images is extremely complicated. In addition, there is a problem that it is difficult to obtain a moving image that can display a portion where acquired moving images overlap each other without a sense of incongruity. In addition, there is a problem that image quality is poor in a wide-angle camera image. In addition, shooting a subject from any direction and acquiring a large amount of moving image data,
A method of selecting necessary moving image data from the acquired moving image data to obtain a moving image in the entire circumferential direction is also conceivable, but it is difficult to set a criterion for selecting moving image data. There is a problem that a moving image in all directions cannot be obtained.

SUMMARY OF THE INVENTION The present invention has been made in view of such circumstances, and has a simple configuration, and a moving image generating method and apparatus capable of generating moving images covering the entire circumferential area or a part thereof at the same timing. The purpose is to provide.

It is another object of the present invention to provide a moving picture presenting apparatus capable of effectively presenting a generated moving picture over the entire circumferential area or a part thereof to a user.

[0008]

According to a first aspect of the present invention, there is provided a moving image generating method for generating a moving image over an entire circumferential area around a predetermined position or a partial area thereof. A moving image is photographed by a plurality of cameras arranged in the circumferential direction, and the photographed moving images are connected and combined.

According to a second aspect of the present invention, there is provided a moving image generating apparatus for generating a moving image covering an entire circumferential area around a predetermined position or a part of the circumferential area, wherein the moving image generating apparatus is arranged circumferentially around the predetermined position. And a synthesizing unit that stitches and combines moving images captured by the cameras.

According to a third aspect of the present invention, in the moving image generating apparatus according to the second aspect, each of the plurality of cameras is fixed, and a viewing angle thereof is constant.

According to a fourth aspect of the present invention, in the moving image generating apparatus according to the second or third aspect, the moving image generating apparatus further comprises compression means for compressing the combined moving image data obtained by the combining means.

According to a fifth aspect of the present invention, in the moving image generating apparatus according to the fourth aspect, the synthesizing unit and the compression unit are integrated into one chip.

According to a sixth aspect of the present invention, in the moving image generating apparatus according to the fourth aspect, the moving image generating apparatus further comprises a transmission unit for transmitting the compressed combined moving image data obtained by the compression unit to an external device.

According to a seventh aspect of the present invention, in the moving image generating apparatus according to the sixth aspect, the input / output unit for data communication with the camera and the external device, the synthesizing unit, and the compression unit are integrated into one chip. Features.

According to an eighth aspect of the present invention, there is provided a moving image presenting apparatus for displaying a moving image generated by the moving image generating apparatus according to any one of the second to seventh aspects. And display means for displaying the information.

According to a ninth aspect of the present invention, there is provided a moving image presenting apparatus for selecting a part of the compressed combined moving image data obtained by the moving image generating apparatus according to any one of the fourth to seventh aspects. It is characterized by comprising means for expanding compressed combined moving image data into combined moving image data, and display means for displaying a moving image corresponding to the expanded combined moving image data.

According to a tenth aspect of the present invention, in the moving image presenting apparatus according to the eighth or ninth aspect, there is further provided means for recording the compressed combined moving image data.

According to an eleventh aspect of the present invention, in the moving image presenting apparatus according to any one of the eighth to tenth aspects, the display means includes a plurality of displays for respectively displaying moving images in different regions in the circumferential direction. Features.

According to the present invention, a plurality of (ten or more) cameras having a low angle of view (about 50 ° or less) are provided in the circumferential direction around a predetermined position, and images are taken at the same timing by each camera. The combined moving images are combined to generate a moving image covering the entire circumferential area or a part thereof. Therefore, it is possible to obtain a high-quality moving image over the entire circumferential area or a part thereof in a simple configuration.

Further, the moving image data after the synthesizing process is compressed by a compression means to reduce the amount of data to be transmitted. Also,
By making the means for synthesizing moving images and the means for compressing moving image data into one chip, miniaturization can be achieved.

Further, the generated compressed moving image data is recorded in the recording means, desired compressed moving image data is selected from the recorded contents, and the selected compressed moving image data is expanded to obtain the original moving image data. And displaying it, it is possible to easily present a moving image to the user when the user turns his or her gaze in various directions.

[0022]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be specifically described below with reference to the drawings showing the embodiments.

FIG. 1 is a diagram showing an arrangement pattern of a plurality of cameras used in the moving image generating apparatus of the present invention.
(A) is a front view thereof, and FIG. 1 (b) is a plan view thereof.
In the figure, reference numeral 10 denotes a cylindrical camera mounting base whose center is slightly narrowed. On the upper side of the camera mount 10, 16 cameras 1 are equally arranged in the circumferential direction. In other words, 2
Sixteen cameras 1 are fixed at positions each having a central angle of 2.5 °. Each camera 1 is a standard camera having a low angle of view, and its viewing angle is 38 ° in the horizontal direction and 48 to 50 in the vertical direction.
°. Each of these cameras 1 is fixed, and continuously captures an image of the viewing angle area to obtain moving image data.

FIG. 2 is a schematic diagram showing an entire configuration of an example of the moving image generating apparatus according to the present invention. Each of the 16 cameras 1 has a lens 1a and a CCD 1b. Each camera 1
The microcomputer 1 is connected to the CCD 1b for performing input processing of image data from the CCD 1b, processing of synthesizing moving images, processing of compressing moving image data, processing of outputting compressed moving image data, and the like. The computer 2 captures one frame of moving image data from each CCD 1b at the same timing, performs a synthesizing process (overlapping process) on adjacent moving images obtained by the adjacent cameras 1, and then performs
A compression process is performed on the combined moving image data to obtain compressed combined moving image data.

The microcomputer 2 is connected to a personal computer 4 by a transmission line 3 and outputs compressed and combined moving image data to the transmission line 3. The personal computer 4 takes in the compressed and combined moving image data from the microcomputer 2 via the transmission line 3. Then, the personal computer 4 performs a decompression process on the captured compressed combined moving image data to return to the original combined moving image data, thereby obtaining a single panoramic combined moving image in the entire circumferential direction. The data of the obtained combined moving image is sent to the display device 5, and the panoramic moving image is displayed on the screen. Further, the compressed and combined moving image data taken into the personal computer 4 is sent to the recording device 6 and recorded on the internal medium. In addition, the personal computer 4
Transmits a control signal for controlling image data input from each camera 1 to the microcomputer 2 via the transmission line 3.

As described above, the means for performing the combining processing, the means for performing the compression processing, the means for performing the input processing of the moving image data from the camera 1, and the processing for outputting the compressed combined moving image data to the transmission line 3 are provided. By incorporating the means for performing the processing in a single chip into a single chip, a compact device can be realized.

Next, the operation will be described. FIG. 3 is a flowchart showing a processing procedure in the moving image generation device of the present invention. A subject (external scene) is continuously photographed by 16 cameras 1 fixed as shown in FIG. 1, and moving image data obtained by the CCD 1b of each camera 1 is sent to the microcomputer 2 (step). S1). Then, the microcomputer 2 performs a synthesizing process (overlapping process) of adjacent moving images, which will be described later, to obtain one panoramic moving image over the entire circumferential direction (step S2).

For example, DCT (Di
MPEG2 (Movi) using screte Cosine Transform)
The compression processing according to the ng Picture Experts Group Phase 2) is performed to obtain compressed combined moving image data (step S3). This compressed synthesized moving image data is transmitted to the personal computer 4 via the transmission line 3, for example, per second.
The data is transmitted at a rate of 16 frames (step S4).

The compressed combined moving image data taken into the personal computer 4 is subjected to decompression processing and restored to the original combined moving image data (step S5). And
The restored combined moving image data is sent to the display device 5, and a panoramic moving image corresponding to the combined moving image data is displayed on the screen of the display device 5 (step S).
6). Further, the compressed combined moving image data taken into the personal computer 4 is sent to the recording device 6, and the compressed combined moving image data is recorded on the recording medium in the recording device 6 (step S7).

FIG. 4 is a schematic diagram showing the overall configuration of another example of the moving image generating apparatus of the present invention. Each of the 16 cameras 1
Each has a lens 1a and a CCD 1b. The CCD 1b of each camera 1 is connected to one μ-CPU 7 for performing input processing of image data from the CCD 1b and processing for synthesizing a moving image, and these 16 μ-CPUs 7 It is connected to one microcomputer 8 that performs compression processing and output processing of compressed moving image data.
Each μ-CPU 7 is also connected to the CCD 1b of the camera 1 on the right side, and two adjacent cameras 1 (CCD 1b).
, One frame of moving image data is taken in at the same timing. Each μ-CPU 7 performs a combining process (overlapping process) on the captured adjacent moving images,
The combined moving image data is output to the microcomputer 8. The microcomputer 8 performs compression processing on the combined moving image data input from each μ-CPU 7 to obtain compressed combined moving image data.

The microcomputer 8 is connected to the personal computer 4 via the transmission line 3 and outputs compressed and combined moving image data to the transmission line 3. The personal computer 4 takes in compressed and combined moving image data from the microcomputer 8 via the transmission line 3. Then, the personal computer 4 performs a decompression process on the captured compressed combined moving image data to return to the original combined moving image data, thereby obtaining a single panoramic combined moving image in the entire circumferential direction. The data of the obtained combined moving image is sent to the display device 5, and the panoramic moving image is displayed on the screen. Further, the compressed and combined moving image data taken into the personal computer 4 is sent to the recording device 6 and recorded on the internal medium. In addition, the personal computer 4
Transmits a control signal for controlling image data input from each camera 1 to the microcomputer 8 via the transmission line 3.

A means for performing a synthesizing process, a means for performing a compressing process, a means for performing a process for inputting moving image data from the camera 1, and a means for performing a process for outputting the compressed combined moving image data to the transmission line 3. That is, by integrating the μ-CPU 7 and the microcomputer 8 into one chip by integrating them in the same chip, a small-sized device can be realized.

Next, the operation will be described. A subject (external scene) is continuously photographed by 16 cameras 1 fixed as shown in FIG. 1, and the moving image data obtained by the CCD 1b of each camera 1 is converted to two adjacent μ-cameras. It is sent to the CPU 7 (step S1). Then, the μ-CPU 7 performs a synthesizing process (overlapping process) of adjacent moving images as described later to obtain a synthesized moving image (step S2).

This combined moving image data is stored in each μ-CPU 7
Is sent to the microcomputer 8 and subjected to compression processing according to MPEG2 using, for example, DCT, to obtain compressed combined moving image data (step S3). The compressed and synthesized moving image data is transmitted to the personal computer 4 via the transmission line 3 at a rate of, for example, 16 frames per second (step S4).

The compressed combined moving image data taken into the personal computer 4 is subjected to decompression processing and restored to the original combined moving image data (step S5). And
The restored combined moving image data is sent to the display device 5, and a panoramic moving image corresponding to the combined moving image data is displayed on the screen of the display device 5 (step S).
6). Further, the compressed combined moving image data taken into the personal computer 4 is sent to the recording device 6, and the compressed combined moving image data is recorded on the recording medium in the recording device 6 (step S7).

In the example shown in FIG. 4, the moving image synthesizing process (overlapping process) is performed by each μ-CPU on each camera 1 side.
7, the processing is performed in a distributed manner, so that the overall processing speed can be increased as compared with the example shown in FIG.

In the configuration example shown in FIG. 4, in the above-described example, the synthesis processing is performed by each μ-CPU 7 and the compression processing is performed by the microcomputer 8, but the synthesis processing is performed by each μ-CPU 7. A part or all of the compression processing may be performed in addition to the processing. In such a case, the overall processing speed of the acquired moving image data can be further increased.

Next, a description will be given of a process of synthesizing (overlapping) moving images obtained by the adjacent cameras 1 in the moving image generating apparatus of the present invention. FIG. 5 is a flowchart showing step S in FIG.
3 is a flowchart showing an operation procedure of a subroutine of No. 2, that is, a synthesizing process (overlapping process). FIG. 6 is a conceptual diagram of a moving image in the synthesis processing (superposition processing). The processing described below is performed by software, and a program for executing the processing is read from the internal ROM of the microcomputer 2 or each μ-CPU 7 or, for example, a magnetic disk, a CD-RO.
The data is loaded into the microcomputer 2 or each μ-CPU 7 from an external recording medium such as M.

Moving image data (FIG. 6) as an original image obtained by photographing a subject (FIG. 6 (a)) with each camera 1
(B)) the microcomputer 2 or each μ-CPU
7, first, a calibration process is performed on each moving image data (step S11, FIG. 6C). The calibration process is an important process for eliminating the lens aberration of the camera 1. The lens 1a of the camera 1 has an inherent distortion, and the peripheral part generally has a larger distortion. When the moving images adjacent to each other are later matched and connected, a peripheral portion having such a large distortion is to be connected. Therefore, in the present invention, the accuracy of the calibration process has a great effect on the image quality of the final panoramic moving image in the entire circumferential direction.

Next, the two-dimensional orthogonal coordinates of each pixel of the moving image data are converted into spherical coordinates to achieve a panorama (step S12, FIG. 6 (d)).

By the way, since the specifications of each camera 1 are constant and the position of each camera 1 is fixed,
The above-described “calibration processing” (S11) and “coordinate conversion processing” (S12) exist on the algorithm of the moving image data processing, but the calculation results are always fixed values. Therefore, the calculation by these processes is performed only once,
If the calculation result is stored in a conversion table such as an LUT, the “calibration processing” (S11) and the “coordinate conversion processing” (S12) can be easily performed only by referring to the conversion table from the next time. Subsequent moving image data can be obtained, and the processing can be speeded up.

Next, a matching process is performed in which the portions where the imaging ranges overlap in adjacent moving images are identified and both moving images are overlapped (step S13, FIG. 6 (e)). In this matching process, the luminance level and the color level of adjacent moving image data are compared in pixel units, and a superposition position where the degree of coincidence is the highest is adopted. Note that it takes a long processing time to check the degree of coincidence for each of the luminance level and the three primary color levels. Therefore, it is practical to compare the blue level which is close to the luminance level and to check the degree of coincidence. In the present invention, since each camera 1 is fixed and its position is fixed, if such a matching process is performed only once at first, it is only necessary to use the processing result thereafter.

By the way, it is considered that it is difficult to accurately arrange ten or more cameras 1 vertically on the side surface of the camera mount 10. Therefore, when the camera 1 is mounted diagonally, if the correct matching processing is performed between adjacent moving images, the connected moving images become spiral and the last ends are not connected well. become.
Therefore, in order to eliminate the mounting error of the camera 1, based on the result of the above-described matching processing, the shift amount of the moving image at the last end is detected, and according to the detection result, the moving amount of each moving image is determined. A process of shifting the pixels and dispersing the mounting error is performed (step S14). Note that since the position of each camera 1 is fixed, the error dispersion processing only needs to be performed once at first, and the processing results can be used thereafter. Since such error dispersion processing is performed, it is not necessary to mount the camera 1 on the camera mount 10 with high accuracy. When each camera 1 is correctly and vertically mounted on the side surface of the camera mounting base 10, this error dispersion processing is unnecessary.

As described above, according to the present invention, when connecting the moving images obtained by the cameras 1, first, the calibration processing is performed in order to eliminate the distortion of the peripheral portion of the moving image by each camera 1. Is performed, the two-dimensional orthogonal coordinates of each pixel are converted into spherical coordinates to make a panorama, and then the moving images of the same imaging range obtained by the adjacent cameras 1 are overlaid and combined, and the combined moving images To obtain a moving image over the entire circumferential direction. Therefore, it is possible to obtain a high-quality moving image without distortion even in the overlapping area.

Finally, a moving image connection process is performed in consideration of the parallax between the left and right eyes of a human (step S15). In this connection process, the overlapping (combining) of adjacent moving images is smoothed by two processes (pixel selection and brightness correction) as described below. This connection process is performed not only for the first time but also for all the cases of moving image synthesis.

FIG. 7 is a schematic diagram for explaining a pixel selection process. As shown in FIG. 7, when two left and right moving images are combined, the combined area is made up of a region A including only pixels (marked by circles) of the left moving image and pixels of the left and right moving images. Is divided into a region B composed of only pixels (marked by x) of a moving image on the right side. In the area A corresponding to the peripheral portion of the right moving image, only the pixel (○) of the left moving image is selected, and the pixel (×) of the right moving image is not used. In the area C corresponding to the part,
Only the pixels (x) of the right moving image are selected, and the pixels (o) of the left moving image are not adopted. Further, in the region B where pixels of the left and right moving images are mixed, the ratio of the pixels of the moving image on the left side (○) increases as the region is closer to the left, and the ratio of the pixels (×) of the moving image on the right side increases as the region closer to the right side In many cases, the ratio of pixels (（, ×) in both moving images is made equal at the intermediate point between the two. By adopting such pixel selection, a smooth moving image can be synthesized.

FIG. 8 is a flowchart showing the procedure of such pixel selection processing. First, it is determined whether or not the area is a superimposition (synthesis) area (step S2).
1). If the area is not a superimposition (synthesis) area (S21: N
O), select a pixel in the corresponding area (step S2)
6). If it is a superimposition (synthesis) area (S21: Y
ES), it is determined whether or not the area is the area A (step S2)
2). If it is the area A (S22: YES), only the pixels of the left moving image are selected (step S27). If it is not the area A (S22: NO), it is determined whether or not it is the area C (step S23). If it is the area C (S23: YE
S), selecting only pixels of the right moving image (step S2)
8). If it is not the area C (S23: NO), since it is the area B, it is determined whether or not it is the left area in the area B (step S24). If it is the left area in the area B (S24: YES), the pixels of both moving images are selected so that the number of pixels of the left moving image is larger than the number of pixels of the right moving image (step S29). If it is not the left area in the area B (S24: NO), it is determined whether it is the right area in the area B (step S25). If it is the right area in the area B (S25: YES), the pixels of both moving images are selected such that the number of pixels of the right moving image is larger than the number of pixels of the left moving image (step S30). If it is not the right area in the area B (S25: NO), it is an intermediate area in the area B, so that both moving pictures are set so that the number of pixels of the right moving picture and the number of pixels of the left moving picture are equal. A pixel of the image is selected (step S31).

In general, the brightness of adjacent moving images is different from each other. That is, when shooting a part illuminated by the sun, a moving image shot dark is obtained for brightness correction, and when shooting a dark part, conversely, a moving image shot bright is obtained. can get. Therefore, it is normal that the brightness of two adjacent moving images captured including the same area is different. Therefore, by correcting the luminous intensity and brightness of the pixels in the adjacent moving images, the change in brightness is smoothly shifted to obtain a smooth synthesized moving image.

As described above, according to the present invention, when the adjacent first moving image and the second moving image are combined, the pixels of the second moving image are compared with the first moving image at the periphery of the first moving image. Many pixels are used, and more pixels of the first moving image are used than the second moving image at the peripheral portion of the second moving image. Therefore, it is possible to smoothly combine moving images in the overlapping area.

FIGS. 9 and 10 are front views showing another example of the camera arrangement in the moving image generating apparatus of the present invention. In the example shown in FIG. 1, 16
Camera 1 was installed, but as shown in FIGS. 9 and 10,
The camera 1 extends over a plurality of circumferential rows (two rows in the example shown in FIG. 9 and three rows in the example shown in FIG. 10) on the side surface of the camera mount 10.
May be installed. In the example of FIG. 9, the photographing direction is the horizontal direction in the lower row as in FIG. 1, and the photographing direction is the obliquely upper direction in the upper row.
16 cameras 1 are arranged in a row in the circumferential direction on the side of the camera. In the example of FIG. 10, the shooting direction is set obliquely downward in the lower row, the shooting direction is set horizontal in the middle row as in FIG. 1, and the shooting direction is set diagonally upward in the upper row. Sixteen cameras 1 are installed in a row in the circumferential direction of the ten sides. In such an arrangement example of the camera 1, a moving image combining process (overlapping process) is performed not only in the horizontal direction but also in the vertical direction, and a moving image covering the entire circumferential direction is obtained. Note that, in the examples shown in FIGS.
The number of cameras 1 arranged in a row may be any number.
In particular, in the upper row in which the shooting direction is obliquely upward and the lower row in which the shooting direction is obliquely downward in FIG. 10, the number of cameras 1 can be smaller than in the other rows because the overlapping of moving images increases.

In the example described above, 16 cameras 1 are installed in one row in the circumferential direction on the side surface of the camera mount 10, but the number of 16 cameras is an example, and other cameras 1 are installed. Needless to say, the number may be used. However, considering the time required for improving the image quality, the synthesis process, and the compression process, etc.,
It can be said that the optimal number of cameras 1 to be installed is about 10 to 20.

In the above-described example, the plurality of cameras 1 are installed over the entire area in the circumferential direction. However, the plurality of cameras 1 are installed over a partial area (for example, a range of 180 °) in the entire area in the circumferential direction. To obtain moving image data of a part of the area (for example, a 180 ° viewing area),
You can do exactly the same.

In order to eliminate the influence of parallax in each of the plurality of cameras 1, a polygon mirror is provided at the center position where the plurality of cameras 1 are disposed. (Mirror side), each camera 1 may be configured to photograph an image reflected on the polygon mirror.

Further, the compressed and synthesized moving image data is transmitted to the transmission line 3.
, The compressed combined moving image data from the microcomputer 2 or 8 may be directly recorded on the recording medium of the recording device provided on the camera 1 side without transmitting the data to the personal computer 4 via the. Further, although the compressed and combined moving image data is recorded, the combined moving image data may be recorded as it is.

Further, in the above-described example, the configuration is such that the compressed combined moving image data is transmitted to the personal computer 4 via the transmission line 3. However, this compressed combined moving image data is wirelessly transmitted to the personal computer 4. You may do it.

FIG. 11 is a diagram showing a specific configuration example of the present invention. In FIG. 11, reference numeral 20 denotes a moving image generation device (digital camera) having the above-described plurality of lenses 1a, CCD 1b, and microcomputer 2 (or μ-CPU 7 and microcomputer 8). Has been placed. The moving image generation apparatus 20 performs the above-described processing of capturing moving image data, synthesizing adjacent moving image data, and compressing synthesized moving image data, and transmits the obtained compressed and synthesized moving image data by radio waves.

An antenna 21 receives a radio wave (compressed synthesized moving image data) from the moving image generating device 20.
To the antenna 21, a microcomputer 22 having a function of decompressing the compressed combined moving image data to obtain the original combined moving image data, and a general-purpose video deck 23 are connected.
A general-purpose television receiver 24 is connected to the microcomputer 22.

The moving image generating apparatus 20 obtains a moving image with, for example, 16 cameras attached thereto.
When a horizontally long image is acquired by each camera having the above, there is a high possibility that distortion will be remarkable when these images are combined. Therefore, each camera is configured to acquire a vertically long image, and these are combined to obtain a horizontally long panoramic combined image with little distortion.

The moving image generating apparatus 20 performs a compression process on the synthesized moving image data. At this time, the moving image generating device 20 compresses the synthesized moving image data to a form of NTSC moving image data. The compression process may be performed on a frame basis. However, since the number of lines in the combined moving image data is the same as the number of lines in the moving image data of the NTSC system, the compression process is performed independently for each line, No compression is applied to the direction. At this time, the compression processing for each line may be performed based on the pixel data on that line, or pixels may be thinned out periodically for that line.

The compressed and synthesized moving image data conforming to the NTSC system is received by the antenna 21, and
Recorded at 23. If necessary, the compressed and synthesized moving image data is decompressed by the microcomputer 22, the original synthesized moving image data is obtained and sent to the television receiver 24, and the moving image is transmitted by the television receiver 24. Is displayed.
Here, since the compressed synthesized moving image data conforms to the NTSC system, the existing video deck 23 and the television receiver are used.
At 24, recording processing and display processing can be performed.

Next, an example of using a moving image over the entire circumferential area or a part thereof in the circumferential direction obtained in this manner will be described. Since moving images in the entire circumferential area or a part of it can be displayed, it can be used not only for preservation in buildings such as factories and offices, but also for monitoring at construction sites or grasping the progress of construction. it can. It can also be used for presentations at pavilions at expositions.

A description will be given of an example in which a moving image in a partial area is selectively displayed from the acquired moving images in the entire circumferential direction. FIG. 12 is a schematic diagram showing the configuration of such an image presenting device of the present invention. The image presentation device is
For example, a display device 5 including a general-purpose television receiver 24
And a recording device 6 comprising, for example, a general-purpose video deck 23.
And a selection device 25 for selecting desired compressed and synthesized moving image data.
And a microcomputer 26 for controlling each of these devices and performing decompression processing on the compressed and synthesized moving image data.

In such a configuration, desired compressed and synthesized moving image data is selected and reproduced from the recording device 6 based on the information input by the selecting device 25, and the compressed and synthesized moving image data is transmitted to the microcomputer 26. The original composite moving image data is expanded to the original composite moving image data, and the restored composite moving image data is sent to the display device 5 to display a moving image in a desired direction.

A specific example in such a case will be described. The moving image generation device of the present invention can generate a moving image over the entire circumferential direction at all timings. Therefore, a gyro that can detect the position and orientation of the user's head and the direction of the eyeball, and display of the moving image A user wearing three-dimensional goggles having a screen can simulate watching a moving image of a virtual three-dimensional world that changes in accordance with the movement of his / her own line of sight. In this case, the gyro corresponds to the selection device 25, and the display screen corresponds to the display device 5.

For example, as shown in FIG. 13, when a user sings karaoke, by wearing such three-dimensional goggles 30, the user sings in a desired situation such as a hall, a seaside, or a mountain. You can experience the scene. Further, when a user wearing three-dimensional goggles is playing a virtual reality game in which surrounding enemies are killed, when the user looks back, the state behind the user can be seen in real time, and the reality is further enhanced. be able to.

As described above, a moving image over the entire circumferential direction is recorded in advance using the moving image generating apparatus of the present invention,
The partial use method of selecting and using only a moving image in a necessary visual field region can contribute to the development of new content using a recording device.

FIG. 14 is a schematic diagram showing another example of the image presenting apparatus of the present invention. The image presenting apparatus is provided with a plurality of display devices 5. In each of the display devices 5, a moving image of a different visual field region selected by the selecting device 26 (for example, a moving image when the user looks in front, Statue, user
A moving image when the user turns 90 ° to the right, a moving image when the user looks right behind, and a moving image when the user turns 90 ° to the left are displayed.

[0068]

As described above, according to the present invention, a plurality of cameras are arranged in a ring, and the moving images obtained by the cameras are connected to each other. Can be generated.

Since the generated compressed moving image data is recorded in advance, desired compressed moving image data is selected from the recorded contents, and the selected compressed moving image data is expanded and displayed. Images when eyes are directed in various directions can be easily presented to the user.

[Brief description of the drawings]

FIG. 1 is a diagram showing an example of the arrangement of cameras in a moving image generation device of the present invention.

FIG. 2 is a schematic diagram illustrating an entire configuration of an example of a moving image generation device according to the present invention.

FIG. 3 is a flowchart showing a processing procedure in the moving image generation device of the present invention.

FIG. 4 is a schematic diagram showing an overall configuration of another example of the moving image generating device of the present invention.

FIG. 5 is a flowchart illustrating an operation procedure of a moving image combining process (overlapping process).

FIG. 6 is a conceptual diagram of a moving image in a synthesis process (superposition process).

FIG. 7 is an explanatory diagram of a process of selecting a pixel in an overlapping area.

FIG. 8 is a flowchart showing a procedure of pixel selection.

FIG. 9 is a diagram showing another arrangement example of the camera in the moving image generation device of the present invention.

FIG. 10 is a diagram showing another arrangement example of the camera in the moving image generation device of the present invention.

FIG. 11 is a diagram showing a specific configuration example of the present invention.

FIG. 12 is a schematic diagram showing a configuration of an image presenting device of the present invention.

FIG. 13 is a diagram showing a use example of the image presenting device of the present invention.

FIG. 14 is a schematic diagram showing another example of the image presenting device of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Camera 1a Lens 1b CCD 2.8 Microcomputer 3 Transmission line 4 Personal computer 5 Display device 6 Recording device 7 μ-CPU 10 Camera mount 20 Moving image generation device 21 Antenna 22, 26 Microcomputer 23 VCR 24 Television reception Machine 25 selection device 30 three-dimensional goggles

Claims (11)

[Claims] 1. A method of generating a moving image over the entire circumferential area around a predetermined position or a part thereof, wherein the moving image is generated by a plurality of cameras arranged circumferentially around the predetermined position. A moving image generation method comprising: capturing images of the images; and connecting and synthesizing the captured moving images. 2. An apparatus for generating a moving image over the entire circumferential area around a predetermined position or a part thereof, comprising: a plurality of cameras arranged circumferentially about the predetermined position; A moving image generating apparatus comprising: a synthesizing unit that stitches and synthesizes moving images captured by a camera. 3. Each of the plurality of cameras is fixed,
3. The moving image generation device according to claim 2, wherein the viewing angle is constant. 4. The moving image generating apparatus according to claim 2, further comprising a compression unit for compressing the combined moving image data obtained by said combining unit. 5. The moving image generating apparatus according to claim 4, wherein said synthesizing means and said compression means are integrated into one chip. 6. The moving image generation apparatus according to claim 5, further comprising a transmission unit that transmits the compressed combined moving image data obtained by said compression unit to an external device. 7. The moving image generating apparatus according to claim 6, wherein the input / output unit for data communication with the camera and the external device, the synthesizing unit, and the compression unit are integrated into one chip. 8. A moving image generating apparatus according to claim 2, further comprising a display unit for displaying a part or all of the moving image generated by said moving image generating apparatus. Moving image presentation device. 9. A means for selecting a part of the compressed combined moving image data obtained by the moving image generating apparatus according to claim 4, and combining the selected compressed combined moving image data with the combined moving image. A moving picture presenting apparatus comprising: means for expanding data; and display means for displaying a moving image according to the synthesized moving image data. 10. The moving picture presenting apparatus according to claim 8, further comprising means for recording the compressed combined moving picture data. 11. The moving image presenting apparatus according to claim 8, wherein said display means includes a plurality of displays each displaying a moving image in a different region in a circumferential direction.