JP2006094314A - Method and apparatus for reproducing forest space to obtain presence - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a simulated experience of a walk in a forest space or the like by reproducing the forest space that has been recorded by a video camera with visual and auditory presence, and to easily reproduce the video image of a place or the like while designating the place by facilitating the recognition of the place of the video image itself or a positional relationship between the video image and the camera. <P>SOLUTION: Location information from a location detection means and the azimuth/angle information of a video camera from a video camera azimuth/angle detection means are time-sequentially tuned to first video/audio information obtained by operating the video camera comprising a fisheye lens while walking in the forest, thereby generating second video/audio information with information such as the location of an image/audio recording point, a camera direction, and a camera angle superimposed thereon. At the same time, map information from a map information processing means is linked with the second video/audio information and the desired point of a moving course of the video camera on a map displayed on a display is instructed by the map information processing means, thereby obtaining the forest space reproducing system capable of reproducing the video and audio of the point and also providing photographing basic information such as a camera position, a camera direction, and a camera angle. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a forest space reproduction system and apparatus for recording a moving image and sound of a forest space and reproducing the recorded image in a realistic manner. The present invention relates to a forest space reproduction system and apparatus for reproducing a video / sound of a desired point by designation on a moving route drawn on a screen.

Background of the Invention

When you enter the forest for research or hiking, you will be surrounded by dense trees in the forest. Come. However, it is very difficult to reproduce the actual situation and scenery that humans feel in this forest from recordings with ordinary still cameras or video cameras. For example, these cameras can record the leaves and branches of trees in the forest space, but when people are actually covered with 360 ° range and overhead trees in the forest, The situation and scenery that you see and feel are too wide-angle to be recorded with normal equipment.

For this reason, in the past, when shooting a forest, it was shot a little away from the recording target, such as shooting from the opposite shore or shooting a forest near the road, but forests that can be shot under such favorable conditions limited. Unfortunately, even when explaining numerical data such as tree diameter and height at the time of research investigation in the forest, and photographs etc. in limited scenes, the surrounding atmosphere in the forest space at the time of the investigation should be sufficiently communicated Is extremely difficult.
From this point of view, the inventors of the present application have studied the development of a more intuitive survey recording method in the forest and have completed the present invention while making various trials.
The following techniques are disclosed in the following documents in relation to the present invention.

Techniques related to the present invention are disclosed in the following documents.
JP 2002-369189 JP 2002-176630 A JP 2003-153249 A JP 2000-267563 A JP 2003-153249 A JP 2003-185732 A JP2002-049307 JP2002-213984

(1) By recording the acoustic space around the forest space by surround recording, centering on the video from the video camera, the video acoustic space in the forest is recorded as it is felt by the human, and the position information and the lens direction of the video camera are also recorded. Realize a system to record forest space as objective information by adding angle information, etc., and contribute to forest management and ecological research.
(2) Targeting precious forests that cannot be easily revived once destroyed, it is possible to objectively record and replay the subjective landscapes felt when walking in dense forests, while creating a database of these records. Widely used in various applications.
As a prior example related to the present invention, CAVE (Cave Automatic Virtual Environment) published in 1992 by the University of Illinois, USA can be cited. This is a CG (Computer) in a 3m x 3m x 2.2m cube.
This is a system that builds and reproduces a three-dimensional audio-visual space with a sense of reality using Graphic). However, these images and the like are not actual but created. The present invention is intended to enable realistic experiences by reproducing realistic space environment records of forests that exist in reality.

  The present invention records a forest space image together with sound in the forest space so that a human wide-field function operates during reproduction, and reproduces these images and sound so that humans can sense the presence in the forest space. A forest space reproduction system that uses a video camera equipped with a fisheye lens to capture a forest space in a predetermined direction while moving at a predetermined speed. The present invention intends to solve the above-described conventional problems by providing a forest space reproduction method that can provide a sense of realism.

In the forest space reproduction method, the predetermined speed may be a speed that roughly corresponds to a human walking speed, and the predetermined direction may be forward in the moving direction, backward in the moving direction, and above the photographer. In addition, there may be a configuration in which a sense of reality according to various modes such as walking, running, and the like in various forest spaces may be obtained by controlling the reproduction speed of video recording.

Furthermore, in any of the above forest space reproduction methods, the position of the audio recording point is obtained by synchronizing the video camera video / audio information with the position information of the recording location and the direction / angle information of the video camera in time series. By generating second video information on which information such as direction, camera angle, and map information is superimposed, and by indicating a desired point on the moving path of the video camera on the map displayed on the second video In some cases, the image / sound of the point is reproduced, and basic photographing information such as a camera position, a camera direction, and a camera angle can be obtained.

In the present invention, the first video / audio information obtained by walking in the forest with a video camera equipped with a fisheye lens includes position information by the position detection means and video by the direction / angle detection means of the video camera. The camera direction / angle information is synchronized in time series to generate second video information on which information such as the position of the image / sound recording point, the camera direction, the camera angle, and the map information by the map information processing unit is superimposed. At the same time, by instructing a desired point on the moving path of the video camera on the map displayed on the second video, the video / audio of the point is reproduced, and the camera position, camera direction, camera angle, etc. are captured. A forest space reproduction method configured to obtain basic information is realized to solve the above-described conventional problems.

The present invention further comprises a video camera provided with a fisheye lens, a position detection means for the video camera, a direction / angle detection means for the video camera, a map information processing means, and a playback means for recording by the video camera. The video / audio recording is performed by synchronizing the position information by the position detecting unit and the direction / angle information of the video camera by the direction / angle detecting unit of the video camera in time series with the first video / audio information by the video camera. A video camera on the map displayed on the second image while generating the second video / audio information on which the position information, the camera direction, the camera angle, and the map information by the map information processing means are superimposed. By instructing the desired point on the moving path of the video, the video / audio at that point is played, and the camera position, camera direction, The realization of forest spatial reproduction apparatus which can also provide a shooting basic information such Raanguru is intended to solve the above problems.

The present invention has the following effects.
(1) The state of the human visual system during walking through the forest, that is, the video recording system that records and plays back images corresponding to a wide range of visual fields close to 180 degrees of view. It makes the viewers feel the remarkably realistic presence that is actually in the forest space. Furthermore, by controlling the video playback speed, it is possible to reproduce the realistic sensations relating to various movement modes in the forest space.
(2) Also, when playing back an image or the like, for example, a shooting movement route by a video camera is drawn on a computer display, and by specifying an arbitrary point on this route, the image at that point can be called and shot. Since information such as location, camera lens direction, and angle can also be obtained, it is easy to store forest data in a detailed database centered on video data, which greatly contributes to various forest research and surveys.

In the present invention, video and audio are recorded by a so-called digital video camera, and wide-angle photography close to 180 degrees is performed using a fisheye lens. Shooting at such a viewing angle almost corresponds to the viewing angle when a person walks through the forest, and the human visual system that sees this when reproducing the video record actually walks through the forest in response to the reproduced image As a result of selecting the same function as if you are, you will feel as if you are in the forest space. The larger the playback screen for video recording, the higher the presence. Another factor that brings this presence to life is that the images in the forest look three-dimensional. In the present invention, such an effect is considered to be due to motion parallax caused by the shooting target flowing from the center to the periphery in the moving image. As a specific photographing method, appropriate video recording can be obtained by photographing the front, upper, and rear while walking.
In addition, by controlling the playback speed of the video, it is possible to reproduce the realistic sensation corresponding to various modes of movement such as walking, running, and haruka.

Also, when recording a video while explaining the surrounding situation, it becomes easier to use as a survey record. Note that the sound of stepping on dead leaves and the sound of murmuring creeks can be recorded satisfactorily while walking, but it is desirable to stop and record, for example, the sound of small birds singing in the forest because the volume is low.

As a shooting condition in which the reproduced video is projected three-dimensionally to obtain the most realistic feeling, it is preferable that the photographer takes a picture while walking, and the photographing target is the front, rear, or overhead direction of the photographer.

In the present invention, in the video / audio recording of the forest space, the recording position information, the horizontal direction of the lens axis of the video camera, and the direction of the lens axis in the vertical direction are recorded together with the recording, and the recorded video / audio It makes it easy to specify information. In other words, video / audio recording records when, where, and what kind of camera work (camera direction, camera angle, etc.) was made, facilitating the use of information as material, and improving the accuracy of surveys, etc. Yes.

The position information, direction / angle information of the video camera, etc. are combined with video / audio information by using time data as a key for well-known GPS position data and camera work data by a direction sensor, etc. Enables reading of various data. The GPS data is linked to various well-known geographic information systems (GIS), and the moving route of the video camera or the photographer is drawn on the computer display as map information, and this is specified by specifying a specific point on the route. The video / audio information corresponding to the system can be called up, and the usability of the entire system is improved.

A first embodiment of a forest space reproduction system or apparatus according to the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of a forest space reproduction device. The forest space reproduction system will be described together with an explanation of the operation of the device.
In the figure, reference numeral 1 denotes a video camera having a fisheye lens as video / audio recording means, 2 denotes a position detection means of the video camera, 3 denotes an orientation sensor as direction / angle detection means of the video camera 1, and 4 denotes map information processing means. Reference numeral 5 denotes a recording medium for storing video / audio recording by the video camera 1, 6 denotes reproduction means for the recording medium 5, 7 denotes integrated control of position information, direction / angle information, map information, video / audio information of the video camera 1. A computer as a means.

A known GPS device is used as the position detecting means 2, and the map information processing means 4 is also selected and adopted from known GIS software. Furthermore, a direction sensor used for detecting and recording the lens direction and lens angle of a video camera is also well known.

The first video / audio information which is the original data by the video camera 1 is subjected to processing editing such as video distortion correction and clipping, and the position information and other data are added to the video / audio information by the computer 7. That is, the position information by the position detection means 2 and the direction / angle information of the video camera by the direction sensor 3 of the video camera 1 are synchronized in time series to obtain information on the position of the video / audio recording point, the camera direction, the camera angle, etc. The second video / audio information on which is superimposed is processed and generated in the computer 7. It is stored in a recording medium 5 such as a DVD.

Further, the second video / audio information is linked and integrated with the map information by the map information processing means 4 in the computer 7, and as a result, the moving route of the video camera 1 is formed and recorded as map information. In this way, by designating an arbitrary point on the moving route map displayed on the display of the computer 1 by the map information processing means 4, the video / audio of the point can be read on the computer display.

Note that the integration processing of the video / audio information and the other information is performed using a time data key. That is, the specific steps of the procedure are as follows.
(A) Divide GPS walking data (movement route) (by theme, in units of 5-10 minutes)
(B) The GPS walking data (movement route) is input in the selected and adopted GIS.
(C) Perform necessary processing such as color coding of the walking line (movement route) and addition of an arrow on the GIS.
(D) On the GIS, the walking line (movement route) data and the video / audio data are hyperlinked by using time data as a key.

FIG. 2 is a schematic diagram showing the configuration of a second embodiment of the present invention. In this embodiment, a technique for reproducing video from the computer 7 directly on the display is adopted. Other basic configurations are not different from those of the first embodiment.

FIG. 3 is a schematic configuration diagram showing the third embodiment, in which map processing is performed on a playback screen of a recording medium such as a DVD, and this is played back by playback means 6 such as a DVD deck. The basic configuration of this embodiment is exactly the same as that of the first embodiment described above.

The present invention described above can be used in various ways as required in addition to the following application examples.
(B) It is suitable as a forest and other field survey record system.
By simply specifying the desired point on the shooting route (camera movement route), video / audio information at that point can be played back, and accurate location and camera work information can be easily obtained, contributing to research and research. However, it is big.
(B) Since the forest space can be simulated visually and audibly with a sense of realism, it can be used for enlightenment of knowledge about forests, disclosure of information, etc.

It is a block diagram which shows schematic structure based on 1st Example of this invention. It is a block diagram which shows schematic structure based on 2nd Example of this invention. It is a block diagram which shows schematic structure based on 3rd Example of this invention.

Explanation of symbols

1 Video / audio recording means (video camera with fisheye lens)
2 Position detection means 3 Direction sensor 4 Map information processing means 5 Recording medium 6 Playback means 7 Integrated control means (computer)

Claims (6)

Forest space where forest space images are recorded with sound in the forest space so that the human wide-field function operates during playback, and these images and sound are played back to make humans aware of the presence in the forest space. A reproduction system that captures forest space from a predetermined direction while moving at a predetermined speed with a video camera equipped with a fish-eye lens, so that a sense of realism of the forest space is formed through the wide-field function of humans during video recording playback. Forest space reproduction system method that provides a sense of realism characterized by 2. The forest space reproduction system method according to claim 1, wherein the predetermined speed is a speed substantially corresponding to a human walking speed, and the predetermined direction is forward in the moving direction, backward in the moving direction, or above the photographer. Forest space reproduction system method that can get a feeling. 2. The forest space reproduction system according to claim 1, wherein a sense of reality is obtained by controlling the playback speed of video recording so as to obtain a sense of reality related to walking, running, and other various modes in various forest spaces. Forest space reproduction method. The forest space reproduction system method according to any one of claims 1 to 23, wherein the position information of the recording location and the direction / angle information of the video camera are synchronized in time series with the video / audio information of the video camera to determine the location of the audio recording point. Generates second video information on which information such as position, camera direction, camera angle, and map information is superimposed, and indicates a desired point on the moving path of the video camera on the map displayed in the second video information To reproduce the image / sound of the point and to obtain basic shooting information such as the camera position, camera direction, camera angle, etc. . The first video / audio information obtained by walking while walking in the forest with a video camera equipped with a fisheye lens includes the position information by the position detection means and the direction / angle of the video camera by the direction / angle detection means of the video camera. The information is chronologically synchronized to generate second video information on which information such as the position of the image / sound recording point, the camera direction, the camera angle, and the map information is superimposed, and the map information processing means Instructing the desired point of the moving path of the video camera on the map displayed on the video of 2 reproduces the video / sound of the point and provides basic shooting information such as the camera position, camera direction, camera angle, etc. A forest space reproduction system method that gives you a sense of realism. A video camera equipped with a fisheye lens, a video camera position detecting means, a video camera direction / angle detecting means, a map information processing means, and a video recording / reproducing means. The position information of the video / audio recording point is obtained by synchronizing the position information by the position detection means and the direction / angle information of the video camera by the direction / angle detection means of the video camera in time series with the video / audio information of 1 The second video information on which information such as direction, camera angle, and map information is superimposed is generated, and the moving path of the video camera on the map displayed on the second video by the map information processing means is desired. By instructing the location, the video / audio at that location is played back, and the camera position, camera direction, camera angle, etc. Forest space reproduction apparatus with a realistic sense of so as to provide even basic information.

Images