JP2009272843A - Total video display method for displaying photographing location and photographing area using digital video and frame still image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for checking photographing locations, photographing areas and detailed images simultaneously and simply through one image inexpensively without using special devices to specify the photographing locations and areas of a photographed video. <P>SOLUTION: Objects are photographed using one video camera or both of the video camera and a fixed focus camera, panorama still images are synthesized into a video using the photographed data with commercially available image editing software and video editing software, and frames that indicate photographing locations and photographing areas are displayed on the still images. Thereby, the displayed detailed video and its photographing locations and areas can be simultaneously and simply checked by one image. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention is a method for displaying a position of a video image being displayed in a still image portion so that a shooting location and a shooting area can be recognized on a single screen.

  Video images, still images, and panoramic still images are used for general images and photographs, as well as dangerous inspection objects that humans cannot easily approach, and inspections that cannot be seen at a time because of the wide range. This is used for telescopic imaging of an object or the like from an aircraft or the like for easy detailed inspection of the appearance.

The above video image, still image, and panoramic still image need to solve the following problems.
When a video image is zoomed and a detailed image is taken, it is difficult to determine which part of the whole is taken, and it is difficult to specify the part.
If you convert the video to a panoramic still image, you can check it by printing or using a personal computer to view it in detail, but if you are printing, you must print using a long sheet such as roll paper and check the corresponding part. Don't be.
When confirming a panoramic still image on a personal computer or the like, it is necessary to scroll and confirm the corresponding part, and it is difficult to find a specific part instantly.

It is difficult to confirm the shooting location and shooting area of the video. Specifically, in the case of a zoom image, there is a problem in that it is necessary to calculate the shooting time each time, because the shooting location must be assumed based on the displayed shooting time.
In the case of a panoramic still image, printing on a long sheet such as roll paper or checking with a personal computer has a serious problem in operability.

By the way, as a conventional technique for making it possible to know the shooting location and shooting area of a video image, there is the following.
a) The direction of the camera mounted on the moving body and the position of the moving body are acquired by the observation device, the zoom ratio of the camera is acquired, and the incidental data is multiplexed into the video signal to serve as a single video signal. By transmitting to the station and separating the video and the accompanying data at the receiving station, the position of the moving body and the shooting area as the video and the accompanying data are displayed on the map (Patent Document 1).
b) The recording / playback device has a function for recognizing a scene change, thereby creating a panoramic still image and a function for adding a video segmentation and its segmentation information as panoramic still image information. A function of recording a panoramic still image is realized, and when a panoramic still image is reproduced, the moving image can be reproduced when the information associated with the fixed time is stationary and viewed.
A panoramic still image recording / reproducing apparatus having information related to a moving image (Patent Document 2).
JP 11-187363 A JP 2006-5610 A

However, in the prior art a), the position of the moving body and the shooting area can be displayed on a map, and the shot video and the map display can be viewed in association with each other on one screen. Therefore, it is not a method for easily confirming a shooting location and a shooting area and a detailed video at the same time. Also, in the conventional technique b), a function for recording a panoramic still image associated with a moving image is realized, and when a panoramic still image is played back, when the still image is viewed at a position where the associated information is associated for a certain period of time, the moving image However, panoramic still images need to be specified by scrolling or using the cursor on the screen, and shooting locations and areas are not displayed on the still images with frames or enclosures when a movie is played back. Since it is difficult to check the location and the shooting area and a dedicated device is required, it is not a method for easily checking the shooting location and the shooting area and a detailed video at the same time.
The problem to be solved is that the display of the captured video, the specification of the shooting location and the shooting area are easily performed without requiring a special device or device and without cost.
The present invention has been made in view of such a problem, and it is possible to display a captured detailed image and specify a shooting location and a shooting area on a single screen with low cost and without using a special device or device. The issue is to provide a method that can be confirmed simultaneously.

  The present invention takes a picture using one video camera or both a video camera and a fixed focus camera, uses a personal computer, processes it into a panoramic still image using commercially available image editing software and video editing software, This is a method of compositing a video image and a panoramic still image, and further displaying a frame, an enclosure, etc. showing the shooting location and shooting area on the panoramic still image. The most important feature is that it is possible to easily confirm a specific video shooting location and shooting area simultaneously on a still image on a single screen.

The present invention is a method for displaying a frame, an enclosure, and the like for identifying a shooting location and a shooting area on a still image obtained by panoramic synthesis of the video and the video, and displaying a detailed shot video and specifying the shooting location and the shooting area. You can easily check on one screen at the same time.
Further, by using a personal computer and using commercially available image editing software and video editing software, a panoramic still image is synthesized into the video, so that no special device is required and the cost can be greatly reduced.

Next, an embodiment of the present invention will be described with reference to the drawings.
Shooting images taken at a minimum cost using commercially available products for the purpose of displaying a frame, an enclosure, etc. that show which position is shot on a still image that is a panoramic composite of the images. The location and shooting area can be easily identified on a single screen, allowing the user to check the shooting location and shooting area and detailed video simultaneously.

((Outline of the present invention))
FIG. 1 is a schematic diagram showing an example of the configuration of the system of the present invention. In the figure, a personal computer 30 is the center of the present system, and includes a video image data capturing / editing means 31, a mosaicing processing means 32, a panoramic composite still image editing means 33, a video / still image combining means 34, , Video synthesizing means 35, frame, enclosure, etc., and synthesizing data compression means 36.

  The HD video deck 21, video deck 22 optical disk recording device 23, and hard disk 24 connected to the personal computer 30 are examples of the video image data reading means 20, and are photographed by a video camera (not shown) and recorded as a video image data storage medium. 10 for reading video image data recorded on an HD video tape 11, a video tape 12, an optical disk 13, and a hard disk 14, which is an example, and sending it to the personal computer 30 as a data signal.

  The personal computer 41 connected to the personal computer 30, the portable player 42 capable of reproducing video, the hard disk 43, the DVD / CD? R drive 44, and the video deck 45 are examples of the composite video data storage means 40. Reference numeral 51 denotes an example of the composite data output means 50 for printing out one scene of the generated composite video.

  Here, when the HD video deck 21 is connected to the HDSDI input board, the video image data is fetched into the personal computer 30 by using, for example, an HDSDI interface as a digital signal. If the PC 30 is Apple's Macintosh (registered trademark), the data is temporarily stored internally by Apple's "Final Cut Pro" (registered trademark), and the length and color of the video to be edited. Adjust image quality such as contrast and brightness. If the video deck 22 is an analog system (for example, S-VHS system), the analog image data is converted into digital image data by using, for example, a video capture board for the digital conversion / video image data capturing / editing means 31. Can be imported into the personal computer 30 and edited by "Final Cut Pro" (registered trademark of Apple). When the video deck 22 is a digital video deck, the video image data is taken into the personal computer 30 using an interface such as IEEE1394 as it is as a digital signal. If the optical disk 13 and the hard disk 14 are digital (for example, movie), they can be imported into the personal computer 30 and edited by "Final Cut Pro" (registered trademark of Apple).

The mosaicing processing means 32 creates a developed still image from the captured video image data. For example, the developed still image is created by “Final Cut Pro” or “Quick Time Pro” (registered trademark of Apple). Is done.
In still image processing, since the lens distortion is large at the end of the still image, trimming processing is performed on the strip to remove the distortion portion.
“Adobe Photoshop” (registered trademark) of Adobe Systems is available for processing, and “Double take” (registered trademark) of Echo One is available for panorama composition.

The panoramic composite still image editing unit 33 performs image quality adjustment such as color, contrast, brightness, and image compression on the panoramic image obtained by the mosaicing process, and commercially available image editing software can be used.
For example, “Adobe Photoshop” (registered trademark) of Adobe Systems Inc. can be used.
Typical compressed image file formats include JPEG, GIF, and TIFF formats.

The video / still image synthesizing unit 34 synthesizes the video data and the panoramic synthesized still image and adjusts the color, contrast, brightness, and image quality of the video and still image, and commercially available video editing software can be used.
For example, Apple's “Final Cut Pro” (registered trademark) is available.

The video / still image synthesizing unit 34 synthesizes the video data and the panoramic synthesized still image and adjusts the color, contrast, brightness, and image quality of the video and still image, and commercially available video editing software can be used.
For example, Apple's “Final Cut Pro” (registered trademark) is available.

The image synthesizing unit 35, frame, enclosure, etc., synthesizes the panoramic still image into the image, and displays the frame, enclosure, etc., which shows the shooting location and shooting area on the still image, and displays a frame, Commercially available video composition editing software can be used to add actions such as moving or rotating the enclosure.
For example, Apple's “Motion” (registered trademark) is available.
This makes it possible to easily identify the shooting location and shooting area of the shot video simultaneously on one medium.

  The composite data compression means 36 is for compression for conversion into video data of various moving image formats so that it can be viewed in various forms. In the embodiment, compression is performed by commercially available software, and typical compression includes file formats such as Mpeg2, H.264, DivX, WMV, and AVI.

  The composite data storage / display means 40 is a means for enabling display and browsing of video data processed into video data of various moving image formats so that the video can be browsed by a device capable of viewing the video.

  FIG. 2 shows a flowchart in the case where there is one video camera for work performed by the personal computer 30 by the processing program 37 using the commercially available software. Hereinafter, a description will be given with reference to FIG.

  First, video data is read from a video tape or the like taken in step 101 by a video deck or the like, and in step 102, video is taken into a personal computer using video editing software. In step 103, edit the video and still image colors, contrast, brightness, required cuts, etc. for the required video, and use the digital video file format (for example, Mov) supported by the video editing software as digital data. Format) is saved on the hard disk (step 104).

Next, in Step 103, the edited image of the required video is edited with the color, contrast, brightness, and necessary cuts of the video and still image. In Step 105, the still image is cut out from the video data at the optimum frame. save.
In step 106, the cut image data is cut into strips (strip-shaped images) by image editing software and stored in the hard disk. In step 107, mosaicing processing for connecting the image data cut out to the strip (strip-shaped image) is performed by the panorama synthesis software.

  In step 108, the image data is saved on the hard disk as still image data (for example, TIFF file format). If necessary, adjust the image quality. If not necessary, the image is compressed and stored as compressed image data. The file format is JPEG, GIF, BMP, or the like.

  Next, in step 109, the video data stored in step 104 and the still image data stored in step 108 are synthesized by video editing software or video synthesis software.

  In step 110, the video synthesizing software synchronizes the position and time axis of the frame and enclosure linked to the movement of the video data on the still image data of the synthesized video data and still image data in step 109. Composite and save as video data.

  In step 111, the video data is converted into video data of various moving image formats and stored in each medium so that the video can be viewed on a device capable of viewing the video. File formats include HDSDI, NTSC, Mpeg2, H.264, DivX, WMV, and AVI formats.

  FIG. 3 shows a flowchart in the case where both the main video camera and the fixed focus camera perform the work performed by the personal computer 30 by the processing program 37 using the commercially available software. Hereinafter, a description will be given with reference to FIG.

  First, in step 201, video data of the photographed main video camera is taken into a personal computer with video editing software. In step 202, edit the video and still image color, contrast, brightness, necessary cuts, etc. for the required video, and use it as digital data as it is in the digital video file format (for example, Mov) supported by video editing software. Format) is saved on the hard disk (step 203).

Next, in step 204, the video of the fixed focus camera is taken into the personal computer with video editing software.
In step 205, data obtained by editing the color, contrast, brightness, and the same cut as that of the main camera image in the video and the still image are edited, and in step 206, the still image is cut out from the video data in an optimal frame and stored.
In step 207, it is determined whether or not the cut image data needs to be cut into a strip (strip-shaped image) by software. If necessary, the cut image data is converted into an image in step 208. Cut into strips (strip-shaped images) using editing software and save to hard disk. The panoramic synthesis software performs mosaicing processing that connects the image data cut out to strips (strip-shaped images). If a single image is acceptable, save it to the hard disk. FIG. 4 is a conceptual diagram thereof.

  In step 209, still image data (for example, TIFF file format) is stored on the hard disk. If necessary, adjust the image quality. If not necessary, the image is compressed and stored as compressed image data. The file format is JPEG, GIF, BMP, or the like.

  Next, in step 210, the video data saved in step 203 and the still image data saved in step 209 are synthesized by video editing software or video synthesis software.

  In step 211, the video synthesizing software synchronizes the position and time axis of the frame and enclosure linked to the movement of the video data on the still image data of the synthesized video data and still image data in step 210. Composite and save as video data.

  In step 212, the video data is converted into video data of various moving image formats and stored in each medium so that the video can be viewed on a device capable of viewing the video. File formats include HDSDI, NTSC, Mpeg2, H.264, DivX, WMV, and AVI formats.

  FIG. 4 is an image diagram of one embodiment of the present invention, where 1 is the same as FIG.

  The video image portion 1 displays a zoomed image. The still image panorama synthesizing section 2 panoramicly synthesizes a zoomed image and synthesizes it as a still image and displays it. The video image display area frame 3 is linked to the image as a frame, enclosure, or the like of the displayed image and indicates a shooting part on the still image.

In the embodiment of FIG. 5, the video image portion 1 displays a zoomed image. The still image panorama synthesizing part 2 panoramicly synthesizes an image captured by a fixed focus camera, synthesizes it as a still image, and displays it. The video image display area frame 3 is linked to the image as a frame, enclosure, or the like of the displayed image and indicates a shooting part on the still image.
A panoramic composite still image can be combined with the image even if it is deformed, and the frame, enclosure, and the like are also rotated and moved in conjunction with the image being captured.

  While checking the video, the location can be easily identified by the frame, enclosure, etc. displayed on the still image, and it can be viewed with a general device without using a special device. Can be reduced. In addition, the situation where the video is taken can be easily used for comparison on site.

1 is a schematic diagram illustrating an example of a system configuration. Flow chart of work when there is one video camera. Flow chart of work with both main video camera and fixed focus camera Example image (Example 1) Example image (Example 1)

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Video image part 2 Still image panorama synthetic | combination part 3 Video image display area frame 11 HD video tape 12 Video tape 13 Optical disk 13
14 Hard disk 21 HD video deck 22 Video deck 23 Optical disk recording device 30 Personal computer 41 Personal computer 42 Portable player capable of reproducing video 43 Hard disk 44 DVD / CD? R drive 45 Video deck 51 Printer

Claims (1)

Video footage shot using one video camera or both a video camera and a fixed focus camera is processed into a panoramic still image and combined with the captured video footage, and the shooting location and shooting area are either a still image or a panoramic still image. It is a method of displaying above,
A method of displaying a video image taken on a single panorama image and a video panoramic still image and shooting area on a processed panoramic still image.