JP4478992B1 - Video conversion device, video output device, video conversion system, video, recording medium, and video conversion method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize pixel arrangement conversion for displaying stereoscopic video on hardware.
A video conversion apparatus according to the present invention receives a multi-viewpoint video as a video signal from a video output device, and stores the multi-viewpoint video received by the receiving unit in a storage element for each frame. A storage unit and a conversion for controlling an instruction to convert the pixel arrangement of the video images of the plurality of viewpoints stored in the storage element by the storage unit into a pixel arrangement for stereoscopic video display based on preset conversion control information A control unit; a conversion unit that immediately converts the pixel arrangement according to an instruction from the conversion control unit; and a transmission unit that transmits an image whose pixel arrangement has been converted by the conversion unit to the stereoscopic video display device as a video signal. By implementing the above, it is possible to realize pixel arrangement conversion for displaying stereoscopic images of images from a plurality of viewpoints on hardware.
[Selection] Figure 1

Description

  The present invention relates to a video conversion device that converts a pixel arrangement of a video from a plurality of viewpoints into a pixel arrangement for stereoscopic video display.

  A stereoscopic video display device that realizes stereoscopic vision of a video by causing a user to generate parallax using a parallax barrier method, a lenticular method, or the like is conventionally known from Patent Document 1 and the like.

  Here, in order to stereoscopically view the video, it is necessary to transmit the video for stereoscopic display to the stereoscopic video display device. Specifically, a video produced in advance by a pixel arrangement corresponding to a stereoscopic video display device that intends to display a stereoscopic video is transmitted, or a pixel arrangement of an existing video is changed to a pixel arrangement corresponding to the stereoscopic video display device. It is necessary to convert.

  As an existing technique for converting a pixel arrangement of a video into a pixel arrangement corresponding to a stereoscopic video display device, Patent Document 1 discloses a technique for converting a pixel arrangement of a video into a pixel arrangement corresponding to a parallax barrier type stereoscopic video display device. Is disclosed in paragraph 0088 and FIG. Paragraph 0088 and FIG. 1 disclose a stereoscopic video display apparatus provided with an image synthesis circuit as a technical solution for converting the pixel arrangement of video into stereoscopic display for stereoscopic display.

  Non-Patent Document 1 discloses software for converting a pixel arrangement of an image for stereoscopic display to be executed on a personal computer.

JP 2004-179806 (released on June 24, 2004)

Manuals of “Display Configurator” and “3D Movie Center”, software provided by Visualization GMBH

  However, as described above, the stereoscopic video display device according to Patent Document 1 is expensive because it includes means for converting the pixel arrangement of the video for stereoscopic display.

  In addition, since the pixel arrangement of the video is converted for stereoscopic display, the adjustment with the parallax barrier is accurate, and calibration is not easy.

  Note that this problem is caused by the terrestrial, satellite broadcasting, set-top box acquired by streaming or downloading from the Internet, which is a device that outputs video to a stereoscopic video display device, or a stand-alone DVD player, Blu-ray Even if a device for reproducing (including those having a recording function) such as a (registered trademark) player (including a device having a recording function) is provided with means for converting the pixel arrangement of the video for stereoscopic display, it can occur in the same manner.

  And, when the personal computer executes the software according to Non-Patent Document 1 and tries to convert the pixel arrangement of the video for stereoscopic display, it is necessary to use resources such as a high-speed CPU, a large-capacity memory, and a high-performance graphic board. Consumption is large and expensive, and procurement is difficult. Also, on-site operations such as installation of personal computer specific software, content registration, OS, software startup, software termination, OS shutdown, freeze, failure, etc. require labor, making stable operation difficult. is there.

  Therefore, a dedicated personal computer that executes the software according to Non-Patent Document 1 is actually required.

  The above problems are obstacles to the spread of stereoscopic video display technology.

  Accordingly, an object of the present invention is to provide a stereoscopic image display technique that eliminates the above-described obstacles and is inexpensive and has a high level of practicality. Specifically, pixel arrangement conversion corresponding to a stereoscopic video display device is realized on hardware.

  In order to solve the above-described problems, a video conversion apparatus according to the present invention includes a receiving unit that receives a video from a plurality of viewpoints as a video signal from a video output device, and the video from the plurality of viewpoints received by the receiving unit for each frame. Storage means for storing in the storage element, and converting the pixel arrangement of the video of the plurality of viewpoints stored in the storage element by the storage means into a pixel arrangement for stereoscopic video display based on preset conversion control information Conversion control means for controlling the instruction; conversion means for immediately converting the pixel arrangement in accordance with an instruction from the conversion control means; and a video obtained by converting the pixel arrangement by the conversion means as a video signal to a stereoscopic video display device Transmitting means for transmitting.

  According to the above feature, the video conversion device according to the present invention is a device different from the video output device and the stereoscopic video display device. Video can be provided.

  It is preferable that the transmission unit transmits a video signal of the same standard as the video signal received by the reception unit from the video output device to the stereoscopic video display device.

  According to the above feature, since the standard of the video signal does not change even through the video conversion device, the video output device is different from the video conversion device according to the present invention in the case of not passing through the video conversion device. Since the video signal of the same standard can be transmitted without any change to the video signal directly transmitted to the display device, the existing video output device and the stereoscopic video display device can be used as they are.

  Preferably, the receiving unit receives a video signal from the video output device through electrical connection or wireless communication, and the transmission unit transmits the video signal to the stereoscopic video display device through electrical connection or wireless communication. .

  According to the above feature, the video conversion apparatus according to the present invention can display a 3D video image by simply setting an electrical connection or wireless communication.

  Preferably, the receiving means receives the video of the plurality of viewpoints as a video signal, which is formed by an image in which a video for each viewpoint is divided into a frame and arranged in a tile shape. .

  Preferably, the receiving unit receives the video of the plurality of viewpoints as a video signal obtained by decompressing the lossy compressed video by the video output device.

  The receiving means arranges images (kFt, t = 1 to l) forming videos for each viewpoint (k viewpoint videos) in the order of viewpoint videos (k = 1 to n) for each same time frame, It is preferable to receive, as a video signal, the video of the plurality of viewpoints, which is a video formed by images arranged in the time direction (F′t ′, t ′ = 1 to n · l).

  The receiving unit arranges the same scanning line image information (Si, i = 1 to j) of images forming the video for each viewpoint (k viewpoint video) in the order of the viewpoint video (k = 1 to n). It is preferable to receive, as a video signal, the video of the plurality of viewpoints, which is a video formed by an image (S′i ′, i = 1 to n · j) in which all of the image information is arranged in one frame image.

According to the above feature, the video conversion apparatus according to the present invention enables stereoscopic video display using the existing video file standard as it is.
<Video information recognition means>
The receiving means further receives, as a control signal, conversion control information stored in the external storage means by electrical connection or wireless communication, and when the receiving means receives the control signal, the conversion control means 3D video display based on the conversion control information stored in the external storage means, instead of the preset conversion control information, the pixel arrangement of the video images of the plurality of viewpoints stored in the storage element by the storage means It is preferable to control an instruction to convert to a pixel arrangement for use.

  According to the above feature, new conversion control information can be added to the video conversion device by the external storage means.

  The receiving means further receives a planar video as a video signal from the video output device, receives a control signal separately from the video signal, and the conversion control means receives the receiving means from the video output device. Controlling whether the video is the multi-view video, the flat video, or the multi-view video and the flat video mixed based on the control signal, and the video is the video Only when it is determined that the video is a multi-view video or a video in which the multi-view video and the planar video are mixed, an instruction to convert the multi-view video into a pixel arrangement for stereoscopic video display is controlled. The transmission means preferably further transmits the planar video as a video signal to the stereoscopic video display device.

  According to the above feature, new conversion control information corresponding to the videos of the plurality of viewpoints can be added to the video conversion device by the control signal from the video output device.

  The video conversion apparatus further includes video information analyzing means, and the receiving means is configured to replace the control signal and the video of the plurality of viewpoints with video information at a predetermined position of a first frame or all frames of the videos of the multiple viewpoints. A video signal in which a plurality of pixel information defined as is embedded based on a predetermined arrangement pattern is received as a video signal, and the video information analysis unit is configured to receive a position where the pixel information is embedded based on the predetermined arrangement pattern. And the presence / absence of a header for collating the video information is determined. When there is a header, the video information is analyzed, and the conversion control means determines that the video is a video of a plurality of viewpoints depending on the presence / absence of the header. Only when it is determined that the video is the video of the plurality of viewpoints, based on the video information analyzed by the video information analysis means. The transmission unit controls an instruction to convert a video of a plurality of viewpoints into a pixel arrangement for stereoscopic video display, and the transmission unit uses the video or the planar video whose pixel arrangement is converted by the conversion unit as a video signal to the stereoscopic video display device. It is preferable to transmit.

  According to the above feature, new conversion control information corresponding to the video of the plurality of viewpoints can be added to the video conversion device by the video information embedded in the video.

  The receiving means receives a video in which the video of the plurality of viewpoints and the flat video are mixed as a single video as a video signal, and the video information analyzing means receives the video information of all frames of the mixed video. Analyzing and controlling the instruction to convert the multi-viewpoint video to a pixel arrangement for stereoscopic video display only when the mixed video frame is determined to be the multi-viewpoint video, and the transmission means Furthermore, it is preferable to transmit the planar video as a video signal to the stereoscopic video display device.

  According to the above feature, the video conversion apparatus according to the present invention can convert only a frame of a video of a plurality of viewpoints even if a video of a plurality of viewpoints and a plane video are mixed in one video file. In particular, it has been necessary to prepare a frame that is divided into tiles and arranges the same image multiple times, even in the case of a flat image. It is possible to use a video in which one video is arranged over the entire frame like a normal flat video, and it is not necessary to prepare a video in which a plurality of the same video are arranged by dividing the tile during the flat video.

  The conversion control means, based on the video information analyzed by the video information analysis means, the scanning method of the video of the multiple viewpoints, the resolution of the video of the multiple viewpoints, the number of viewpoints of the video of the multiple viewpoints, , Recognizing and controlling at least one of the number of viewpoints of the stereoscopic image display apparatus, and replacing the preset conversion control information with the scanning method, the resolution of the images of the plurality of viewpoints, and the plurality of viewpoints It is preferable to control an instruction to convert the video images of the plurality of viewpoints into a pixel arrangement for stereoscopic video display based on the number of viewpoints of the viewpoint video and the number of viewpoints of the stereoscopic video display device.

  According to the above feature, the video conversion apparatus according to the present invention recognizes the video information embedded in the video file by itself without the user separately inputting, and based on the video information, the video of a plurality of viewpoints is converted into a stereoscopic video. It can be converted into a pixel arrangement for display.

  The receiving means receives, as a video signal, a video in which a plurality of pixel matrices in which pixel information defined as the same video information is continuously arranged in the XY direction is embedded based on a predetermined arrangement pattern, It is preferable that the video information analysis unit specifies the position where the pixel matrix is embedded based on the predetermined arrangement pattern and analyzes the video information at the predetermined position of the pixel matrix.

  According to the above feature, in the video conversion device according to the present invention, the video information analyzing unit analyzes the video information at a predetermined position of the pixel matrix, so that the video originally defined even if it is influenced by the pixels around the embedding position. Information can be analyzed.

  Preferably, the video information analysis means analyzes the video information based on an average value of pixel information at a central position or a plurality of pixel information around the central position.

  According to the above feature, the video information analysis means can analyze the video information based on the average value of the pixel information at the center position or the plurality of pixel information around the center position, which is not particularly affected by the pixels around the embedding position. Video information can be analyzed reliably.

  Preferably, the receiving unit receives a video in which the pixel matrix is embedded along an upper end of the video of the plurality of viewpoints as a video signal.

  According to the above feature, since the pixel matrix is embedded at the upper end of the video of a plurality of viewpoints that are not conspicuous to the user, it is possible to prevent the quality of the video from being deteriorated by embedding the pixel matrix.

  The receiving means interpolates the outer peripheral portion of the pixel matrix with a predetermined weight on a pixel adjacent to the pixel matrix and an intermediate value pixel or both pixels instead of the pixel information. It is preferable to receive, as a video signal, an image in which a plurality of the pixel matrix in which the arranged pixels are arranged is embedded based on a predetermined arrangement pattern.

  According to the above feature, it is possible to reduce the influence on the video by embedding the pixel matrix.

  The receiving means receives, as a video signal, a video in which only upper bits of a predetermined number of digits of the pixel information are defined as video information, and the video information analyzing means has the predetermined number of digits of the plurality of pixel information. It is preferable to analyze the video information with reference to only the upper bits.

  According to the above feature, only the upper bits of the pixel information are defined as video information, and the video information analysis means refers to only the upper bits to analyze the video information, so that even if the value of the pixel information changes, The analysis result is not affected.

  The receiving means receives a control signal from the stereoscopic video display device, and the pre-conversion control means, based on the control signal, the scanning method of the stereoscopic video display device, the resolution of the stereoscopic video display device, and the A method of recognizing and controlling at least one of the number of viewpoints of the stereoscopic video display device and the pixel arrangement method of the stereoscopic video display device, and replacing the preset conversion control information with the scanning method of the stereoscopic video display device An instruction to convert the video of the plurality of viewpoints into a pixel arrangement for stereoscopic video display based on the resolution of the stereoscopic video display apparatus, the number of viewpoints of the stereoscopic video display apparatus, and the conversion method of the pixel arrangement. It is preferable to control.

  According to the above feature, new conversion control information corresponding to the video of the plurality of viewpoints can be added to the video conversion device by the control signal from the stereoscopic video display device.

  The pixel arrangement method is formed by repeating a combination of one or more pixels, the number of rows constituting one pixel, the number of sub-pixels constituting the one pixel, and the number of pixels connected in the combination of the pixels. And the number of connected position perturbation subpixels for each pixel.

  The receiving means includes a parallax barrier formed by an invisible region and a plurality of transmissive regions arranged in a slit shape so that the slits or holes are continuous with a predetermined inclination from above to provide a predetermined gap on the front surface of the monitor. The sub-pixel corresponding to the size of the sub-pixel constituting the pixel, the average inclination of the transmissive region, and the average width of the transmissive region in the horizontal direction of the slit or the hole by the stereoscopic video display device pasted And the number of subpixels corresponding to the average distance between the centers of the adjacent slits or the holes and the resolution of the display device as control signals, and the conversion control means receives a plurality of the control signals based on the control signals. Select a pixel layout conversion method that converts the viewpoint video into a pixel layout that can most effectively display stereoscopic images, and control the instructions for conversion using the pixel layout conversion method Rukoto is preferable.

  According to the above feature, it is possible to convert the optimal pixel arrangement only by giving the video conversion device a small amount of information regarding the stereoscopic video display device.

  The video conversion apparatus further includes conversion control information storage means, and the reception means receives the control signal in which index information is further defined, or a plurality of pixel information in which index information is further defined. The conversion control information storage means receives the video embedded based on the arrangement pattern of the plurality of viewpoints based on the control signal or the video information. When conversion is instructed to the conversion means, the conversion instruction is stored as new conversion control information in association with the index information, and the conversion control means stores the control signal received by the receiving means or the When conversion control information corresponding to the index information of the video signal is stored in the conversion control information storage means, the conversion control information storage means It is preferable to control the instruction to convert the pixel arrangement of the image of the plurality of perspectives to a pixel arrangement for three-dimensional display image based on 憶 transform control information.

  According to the above feature, index information is defined in the control signal or video information, and the conversion control information storage means stores the conversion control information in association with the index information, so that the conversion control means once used When the conversion control information is used again, the conversion means can be instructed to convert the video based on the conversion control information stored in the conversion control information storage means without acquiring the control signal or the video information again.

  The receiving means further receives an input signal in which index information is defined by an external input means, and the conversion control means replaces the control signal or the video signal with the input signal received by the receiving means. When conversion control information corresponding to the index information is stored in the conversion control information storage means, the pixel arrangement of the video images of the plurality of viewpoints is stereoscopically changed based on the conversion control information stored in the conversion control information storage means. It is preferable to control an instruction to convert to a pixel arrangement for video display.

  A video output apparatus according to the present invention includes a plurality of photographing means for photographing a video for each viewpoint, and an image forming the video for each viewpoint photographed by the plurality of photographing means in a tile shape within a frame. The video is transmitted as a video signal to the video arrangement means for immediately arranging the divided and arranged image to form a video and the video conversion device for converting the arrangement of pixels constituting the video. It comprises a transmission means.

  According to the above feature, it is possible to capture a video from a plurality of viewpoints in real time and immediately output a stereoscopic video.

  The video conversion system according to the present invention includes a video output means for transmitting a video from a plurality of viewpoints as a video signal, a receiving means for receiving the videos from the plurality of viewpoints as a video signal by the video output means, and a reception by the reception means. Storage means for storing video in a storage element for each frame; conversion control means for controlling an instruction to convert the pixel arrangement of the video stored in the storage means into a predetermined pixel arrangement for stereoscopic video display; and the conversion In response to an instruction from the control unit, a conversion unit that immediately converts the pixel arrangement, a transmission unit that transmits an image whose pixel arrangement is converted by the conversion unit as a video signal, and a video signal transmitted by the transmission unit Display means for receiving and displaying a stereoscopic image.

  According to the above feature, since the video conversion device is a device different from the video output device and the stereoscopic video display device, the existing video output device and the stereoscopic video display device are used as they are to provide a stereoscopic video. It becomes possible.

  The video conversion system includes a plurality of photographing means for photographing the video for each viewpoint, and an image forming the video for each viewpoint photographed by the plurality of photographing means, divided into tiles in a frame. A video placement unit that immediately arranges the generated image to form a video and transmits the video to the video reproduction unit, and the video output unit transmits the video converted by the video placement unit as a video signal. Is preferred.

  The display means includes a parallax barrier formed by an invisible region and a plurality of transmissive regions arranged in a slit shape so that slits or holes are continuous at a predetermined inclination from above to provide a predetermined gap on the front surface of the monitor. 3D image display means pasted, wherein the receiving means includes an average inclination of the transmissive region, a number of subpixels corresponding to an average width of the transmissive region in the horizontal direction of the slit or the hole, The number of subpixels corresponding to the average distance between the centers of the matching slits or the holes, the size of the subpixels constituting the pixels, and the resolution of the display device are received as control signals. Based on the control signal, a pixel arrangement conversion method for converting a video from a plurality of viewpoints into a pixel arrangement that can display a stereoscopic image most effectively is selected, and the pixel arrangement conversion method is selected in the conversion means. It is preferable to control the instruction to convert by law.

  In the video according to the present invention, a plurality of pixel information defined as video information includes a header for collating video information and conversion control information at a predetermined position of a first frame or all frames of a video of multiple viewpoints. It is embedded based on the arrangement pattern.

  The video according to the present invention is a video in which a video of a plurality of viewpoints and a planar video are mixed as one video, and the first video is a video at a predetermined position of the first frame in the video of the multi-viewpoint. The information further includes discrimination information as to the mixed video, and when the first video is the plane video, a header for checking the video information and the discrimination information as to the mixed video are located at a predetermined position of the first frame. It is preferable that a plurality of pieces of pixel information defined as video information are embedded based on a predetermined arrangement pattern.

  In the video according to the present invention, it is preferable that the pixel information defined as the same video information is embedded with the same arrangement pattern over a predetermined number of frames.

  A video according to the present invention has a predetermined arrangement of a pixel matrix in which a header for collating video information and conversion control information are defined as video information, and a plurality of identical pixel information are continuously arranged in the XY directions. It is characterized by being embedded based on a pattern.

  In the video, pixel information obtained by linearly complementing pixel information adjacent to the pixel matrix and pixel information defining the video information with a predetermined weight, in place of the pixel information, in an outer peripheral portion of the pixel matrix. It is preferable that a plurality of the pixel matrices in which the pixels are arranged are embedded based on a predetermined arrangement pattern.

  The video information includes discrimination information for discriminating whether the video from a plurality of viewpoints and a plane video are mixed as one video, and whether the video scanning method is an interlaced method or a progressive method. It is preferable that the discrimination information for discriminating, the resolution of the video, and the number of viewpoints of the video.

  The video is preferably recorded on a recording medium.

The video conversion method according to the present invention receives video from a plurality of viewpoints as a video signal from a video output device, stores the received videos from the plurality of viewpoints for each frame in a storage element, and stores the plurality of videos stored in the storage element. An instruction is given to convert the pixel arrangement of the viewpoint video to a pixel arrangement for stereoscopic video display based on preset conversion control information, and in response to the instruction, the pixel arrangement is immediately converted and the pixel arrangement is converted. The video output method according to the present invention is characterized in that a video for each viewpoint is photographed by a plurality of photographing means and photographed by the plurality of photographing means. Further, the image forming the video for each viewpoint is immediately arranged on the image arranged in a tile shape in the frame by the video arrangement means to form one video, and the arrangement of the pixels constituting the one video is arranged. One video is transmitted as a video signal by a transmission means to the video conversion device to be converted.

  ADVANTAGE OF THE INVENTION According to this invention, the cheap and practical 3D video display technique can be provided by implement | achieving pixel arrangement conversion corresponding to the video 3D video display apparatus on hardware.

1 is an external view showing an example of an embodiment of a video conversion device 1 according to the present invention. 1 is an external view showing an example of an embodiment of a video conversion device 1 according to the present invention. 1 is an external view showing an example of an embodiment of a video conversion device 1 according to the present invention. 1 is an external view showing an example of an embodiment of a video conversion device 1 according to the present invention. 1 is an external view showing an example of an embodiment of a video conversion device 1 according to the present invention. 1 is an external view showing an example of an embodiment of a video conversion device 1 according to the present invention. It is a block diagram which shows an example of embodiment of the video converter 1 concerning this invention. It is a block diagram which shows an example of embodiment of the video converter 1 concerning this invention. It is a block diagram which shows an example of embodiment of the video converter 1 concerning this invention. It is a block diagram which shows an example of embodiment of the video converter 1 concerning this invention. It is a block diagram which shows an example of embodiment of the video converter 1 concerning this invention. It is a block diagram which shows an example of embodiment of the video converter 1 concerning this invention. It is a figure which shows an example of the shape of the parallax barrier of the three-dimensional video display apparatus used in the video converter 1 concerning this invention. It is a figure which shows the 1st Example of the image | video of the several viewpoint which the video conversion apparatus 1 concerning this invention receives as a video signal. It is a figure which shows the 2nd Example of the image | video of the several viewpoint which the video conversion apparatus 1 concerning this invention receives as a video signal. It is a figure which shows the 3rd Example of the image | video of the several viewpoint which the video conversion apparatus 1 concerning this invention receives as a video signal. It is a figure which shows the 4th Example of the image | video of the several viewpoint which the video converter 1 concerning this invention receives as a video signal. It is a figure which shows the 5th Example of the image | video of the several viewpoint which the video conversion apparatus 1 concerning this invention receives as a video signal. It is a figure which shows the 1st Example of the image | video of several viewpoints which the pixel information 21 in which the video information was defined which the video conversion apparatus 1 concerning this invention received as a video signal was embedded. It is a figure which shows the 2nd Example of the image | video of the multi-viewpoint which the pixel information 21 in which the video information was defined which the video conversion apparatus 1 concerning this invention received as a video signal was embedded. It is a figure which shows the 3rd Example of the image | video of the several viewpoint with which the pixel information 21 with which the video information was defined which the video conversion apparatus 1 concerning this invention received as a video signal was embedded. It is a figure which shows the 4th Example of the image | video of the several viewpoint with which the pixel information 21 in which the video information was defined which the video conversion apparatus 1 concerning this invention received as a video signal was embedded. It is an image figure of the original image file 23 of 8 colors. It is an image figure of the pixel embedding video file 24 with which seven pixel matrices 23 were embedded. It is a figure explaining what kind of information the video information actually means. It is a figure explaining what kind of information the video information actually means. It is the flowchart which showed the method of discriminating a plane image and a video of multiple viewpoints by always embedding pixel information 21 defined as video information in a video of multiple viewpoints. It is the flowchart which showed the method of discriminating a planar image | video and a multi-viewpoint image | video by embedding the pixel information 21 defined as image | video information only in the image | video at the time of the start and completion | finish of a multi-viewpoint image | video. It is a figure explaining the example of a 1st pixel structure and a blend method. It is a figure which shows arrangement | positioning of the concrete subpixel unit in a 1st pixel structure and the blend method. It is a figure explaining the example of a 2nd pixel structure and a blend method. It is a figure which shows arrangement | positioning of the concrete subpixel unit in a 2nd pixel structure and the blend method. It is a figure explaining the example of a 3rd pixel structure and a blend method. It is a figure which shows arrangement | positioning of the concrete subpixel unit in a 3rd pixel structure and the blend method. FIG. 4 is a diagram illustrating a blend corresponding to “RL2L3P2 + 3, + 2” as an example of RGB pixel automatic blend description. It is a figure which shows the example of the blend method corresponding to an RGB pixel automatic blend description. It is a figure which shows the example of the blend method corresponding to an RGB pixel automatic blend description. It is a figure which shows the example of the blend method corresponding to an RGB pixel automatic blend description. It is a figure which shows the example of the blend method corresponding to an RGB pixel automatic blend description. It is a figure which shows the example of the blend method corresponding to an RGB pixel automatic blend description. It is a figure which shows the example of the blend method corresponding to an RGB pixel automatic blend description. It is a figure which shows the setting method of TMPGEncPlus2.5. It is a figure which shows the setting method of TMPGEncPlus2.5. It is a figure which shows the setting method of TMPGEncPlus2.5. It is a figure which shows the setting method of TMPGEncPlus2.5.

  An embodiment of the present invention will be described as follows.

<Overview>
Below, the general outline | summary of the video converter 1 concerning this invention is demonstrated using an external view and a block diagram.

<Appearance>
FIG. 1 is an external view showing an example of an embodiment of a video conversion apparatus 1 according to the present invention.

  As shown in the figure, a video conversion device 1 according to the first embodiment is electrically connected by a video cable 4 between a general video output device 2 and a general stereoscopic video display device 3 (display). Connected to each other, receives a video from a plurality of viewpoints transmitted as video signals (video input signals) from the video output device 2, and sets conversion control information (scanning method, number of viewpoints, resolution, pixel arrangement method) set in advance. (The details will be described later.) The image is converted into a pixel arrangement for stereoscopic video display, and the video after the pixel arrangement conversion is transmitted to the stereoscopic video display device 3 as a video signal (video output signal).

  Here, the video cable 4 that electrically connects the video conversion device 1, the video output device 2, and the stereoscopic video display device 3 specifically includes the video output device 2 and the stereoscopic video of standards such as VDI and HMVI. As a cable for electrically connecting the display device 3 and transmitting a video signal, a cable that has been widely used can be used.

  FIG. 2 is an external view showing an example of the embodiment of the video conversion apparatus 1 according to the present invention.

  Further, as shown in the figure, the video conversion device 1 is further electrically connected to one or both of the video output device 2 and the stereoscopic video display device 3 by a control cable 5 to thereby transmit a control signal. You may receive it.

  Although the details will be described later, the control signal means a signal that gives the video conversion apparatus 1 conversion control information other than video such as a scanning method, resolution, the number of viewpoints, and a pixel arrangement method.

  Here, specifically, the control cable 5 that has been widely used as the control cable 5 that electrically connects the video output device 2 of the standard such as i · LINK and serial and the stereoscopic video display device 3 is used. be able to.

  For convenience of explanation, the video cable 4 and the control cable 5 have been described as separate cables in the figure, but these cables may be bundled to form one cable.

  FIG. 3 is an external view showing an example of the embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, the video conversion device 1 in this embodiment receives a video of a plurality of viewpoints transmitted as a video signal (video input signal) from the video output device 2 by a wireless communication means (not shown), and a stereoscopic video. The image is converted into a display pixel arrangement, and the image after the pixel arrangement conversion is transmitted to the stereoscopic video display device 3 as a video signal (video output signal).

  Here, as the wireless communication means, those that have been widely used as wireless communication means of standards such as wireless LAN, Bluetooth (registered trademark), UWB, etc. can be used.

  FIG. 4 is an external view showing an example of the embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, the video conversion apparatus 1 in this embodiment stores a plurality of conversion control information in advance as a first table 6 associated with index information, and the index information is input by an input device such as a remote controller 7. , It is possible to output conversion control information corresponding to the index information.

  In the figure, the scanning method and the number of viewpoints are illustrated as being stored as conversion control information. However, information such as the resolution and the pixel arrangement method can be naturally stored.

  In addition to the conversion control information stored in advance in the video conversion device 1, conversion control information stored as a second table 9 associated with index information in an external storage medium such as the USB memory 8 may be used. . However, although not shown, the data may be downloaded not only from an external storage medium but also from the Internet, and acquired from terrestrial or satellite broadcasting.

  Furthermore, when the video conversion apparatus 1 acquires conversion control information that is not stored in advance, the third table 10 to which the acquired conversion control information is added may be newly generated. In this case, the conversion control information can be switched only by inputting the index information from the next time.

  FIG. 5 is an external view showing an example of an embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, in the video conversion device 1 according to this embodiment, the video output device 2 converts the video for each viewpoint captured by the multi-viewpoint camera 11 in real time into a video of multiple viewpoints arranged in a tile shape. The converted and output video is received, converted into a pixel arrangement for stereoscopic video display, and the video after the pixel arrangement conversion is transmitted to the stereoscopic video display device 3 as a video signal (video output signal).

  FIG. 6 is an external view showing an example of the embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, the video conversion apparatus 1 in this embodiment is directly connected to a multi-viewpoint camera 11, and the video for each viewpoint captured by the camera 11 in real time is directly used as a multi-viewpoint video. The received image is converted into a pixel arrangement for stereoscopic video display, and the video after the pixel arrangement conversion is transmitted to the stereoscopic video display device 3 as a video signal (video output signal).

  The video conversion device 1, the video output device 2, and the stereoscopic video display device 3 according to the present invention are collectively referred to as a video conversion system.

<Block diagram>
FIG. 7 is a block diagram showing an example of an embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, the video conversion device 1 according to this embodiment includes a receiving unit 12 that receives videos from a plurality of viewpoints as video signals from the video output device 2, and the plurality received by the receiving unit 12 (receiving means). A storage unit 13 (storage unit) that stores viewpoint video in a storage element for each frame, and conversion control information that is set in advance for pixel arrangements of the multiple viewpoint video stored in the storage element by the storage unit 13 Based on the conversion control unit 14 (conversion control means) for controlling an instruction to convert to a pixel arrangement for stereoscopic video display, and a conversion unit 15 (conversion) for immediately converting the pixel arrangement according to an instruction from the conversion control unit 14 And a transmission unit 16 (transmission unit) of the video conversion apparatus that transmits the video whose pixel arrangement has been converted by the conversion unit 15 to the stereoscopic video display device 3 as a video signal.

  FIG. 8 is a block diagram showing an example of an embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, the video conversion device 1 in this embodiment further includes a video information analysis unit 17 (video information analysis means) between the storage unit 13 and the conversion control unit 14.

  FIG. 9 is a third block diagram showing an example of the embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, in the video conversion device 1 in this embodiment, a conversion control information storage unit 18 (conversion control information storage unit) is further connected to the conversion control unit 14.

  FIG. 10 is a block diagram showing an example of an embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, the video conversion apparatus 1 in this embodiment includes both the video information analysis unit 17 and the conversion control information storage unit 18 described above.

  FIG. 11 is a block diagram showing an example of an embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, the video conversion device 1 according to this embodiment includes a multi-viewpoint camera 11 (photographing unit), a video arrangement unit 19 (video arrangement unit), and a transmission unit 20 of a video output device. The video output device 2 is connected.

  FIG. 12 is a block diagram showing an example of an embodiment of the video conversion apparatus 1 according to the present invention.

  As shown in the figure, the video conversion apparatus 1 in this embodiment is connected to a camera 11 for multiple viewpoints.

<Video output device>
Below, the video output device 2 in which the video conversion device 1 according to the present invention receives a video signal (video input signal) will be described.

  In view of the gist of the present invention, it is most preferable that the video output device 2 uses the existing video output technology as it is. That is, the video output device 2 is an existing set-top box that acquires video by terrestrial broadcasting, satellite broadcasting, streaming from the Internet or download, or a stand-alone DVD player, Blu-ray (registered trademark) player, or the like. It is preferable that the playback device (including those having a recording function).

Further, as shown in FIG. 5, the video output device 2 may include a camera 11 for a plurality of viewpoints. In this case, a plurality of videos taken by the camera 11 can be converted into a video of a plurality of viewpoints arranged on the tile by the video arrangement unit 19 and converted in real time.
<3D image display device 3>
The stereoscopic video display device 3 (display) to which the video conversion device 1 according to the present invention transmits a video signal (video output signal) will be described below.

In view of the spirit of the present invention, it is most preferable to use the stereoscopic video display device 3 as it is without any improvement to the existing stereoscopic video display device. That is, the stereoscopic image display device 3 is preferably a stereoscopic image display device such as a liquid crystal display, a plasma display, or an organic EL display that employs an existing parallax barrier method, lenticular method, or the like. However, it goes without saying that the video conversion apparatus 1 according to the present invention can be used in addition to the stereoscopic video display apparatus described above.
<Specific examples of parallax barrier>
As shown in FIG. 13A, the shape of the slit of the parallax barrier included in the stereoscopic image display device 3 is an oblique linear slit, and FIG. 13B is an oblique step-like slit. c) is a dumpling-like slit connected with elliptical arcs, (d) is a lantern-shaped hole, (e) is a parallax barrier in which parallelogram-shaped holes are arranged in an oblique direction. May be used.

<Video used in the present invention>
The images converted by the image conversion apparatus 1 according to the present invention are as follows.

<8 tile video>
FIG. 14 is a diagram showing a first embodiment of a video from a plurality of viewpoints received as a video signal by the video conversion device 1 according to the present invention. Such video is well known, and can be created by a tile format in which videos from a plurality of viewpoints are arranged in a tile shape. Usually, a predetermined moving image compression file is generated after being arranged in a tile format. The resolution is arbitrary, and usually the video compression standard MPG2, which is irreversible compression, is often used. Although not shown in the figure, a tile format corresponding to an arbitrary number of viewpoints (for example, 4 to 9 viewpoints) may be generated to generate a video with a plurality of viewpoints.

<Standardized 6-tile video>
FIG. 15 is a diagram showing a second embodiment of a multi-viewpoint video received as a video signal by the video conversion apparatus 1 according to the present invention. This is a recommended standardized tile format for multi-viewpoint video according to the present invention, in which only pixels to be read from the multi-viewpoint video are arranged for conversion into a stereoscopic pixel display pixel layout. Although not shown in the figure, a tile format corresponding to an arbitrary number of viewpoints (for example, 4 to 9 viewpoints) may be generated to generate a video with a plurality of viewpoints. In particular, a pixel arrangement method in which 3 sub-pixels constituting RGB of 1 pixel are arranged diagonally in 3 rows and 3 columns, and an image of an arbitrary resolution with a 16: 9 aspect ratio is normalized to horizontal 960 pixels and vertical 360 pixels Thus, it is desirable to convert each viewpoint image into a pixel arrangement for stereoscopic video display. As a result, the resolution of the six-view tile video is 1920 × 1080, and the tile video can be received as a high-definition video and converted into a stereoscopic video with the least image quality loss.
<Multi-streaming video>
FIG. 16 is a diagram showing a third embodiment of a video from a plurality of viewpoints received as a video signal by the video conversion apparatus 1 according to the present invention. Such video is well known and can be created by multi-streaming of the video compression standard MPG4. A plurality of moving images synchronized with one moving image file can be recorded. The received images from one viewpoint to n viewpoints are stored in a storage unit in a predetermined arrangement and converted into a pixel arrangement for stereoscopic video display.
<Allocating multiple viewpoint videos repeatedly in the time direction>
FIG. 17 is a diagram showing a fourth embodiment of a video from a plurality of viewpoints received as a video signal by the video conversion device 1 according to the present invention. Multiple viewpoint videos are repeatedly formed in the time direction by assigning each viewpoint video to successive frames. The received images from one viewpoint to n viewpoints are sequentially stored in the storage means and converted into a pixel arrangement for stereoscopic video display.
<Multiple viewpoint video is assigned repeatedly for each scan line>
FIG. 18 is a diagram showing a fifth embodiment of video images of a plurality of viewpoints received as video signals by the video conversion device 1 according to the present invention. Multiple viewpoint images are repeatedly formed in the scanning line direction by assigning the images of each viewpoint to each continuous scanning line. The received image is stored in the storage means, and the pixel on the scanning line forming the image of each viewpoint is converted into a pixel arrangement for stereoscopic video display.

  Note that a single video file may be created in which the above-described video from a plurality of viewpoints and a planar video are mixed.

<Video format>
FIG. 19 is a diagram showing a first embodiment of a video of a plurality of viewpoints embedded with pixel information 21 in which video information is defined, which is received by the video conversion apparatus 1 according to the present invention as a video signal.

FIG. 5A is a diagram showing the embedding position of the pixel information 21 on the video. According to FIG. 5A, the pixel information 21 is embedded in the upper left corner of the video. However, since the embedding position of the pixel information 21 is based on a predefined arrangement pattern, it is not always necessary to be at the upper left end, but the end of the video is a portion that overlaps the monitor frame of the stereoscopic video display device 3. However, since it is not visible to the user, there is a merit that even if the pixel information 21 is embedded, the stereoscopic video display for the user is not affected. FIG. 5B is an enlarged view showing the embedded pixel information 21. According to FIG. 5B, the pixel information 21 is embedded in the horizontal line without a gap. However, although not shown, it may be embedded at a predetermined interval.

  FIG. 20 is a diagram showing a second embodiment of a video of a plurality of viewpoints embedded with pixel information 21 in which video information is defined, which is received by the video conversion apparatus 1 according to the present invention as a video signal.

  FIG. 5A is a diagram showing the embedding position of the pixel information 21 on the video.

  FIG. 2B is an enlarged view of a portion where the pixel information 21 is embedded. In the second embodiment, a pixel matrix 22 is embedded in which a plurality of pixel information 21 defined as the same video information is continuously arranged in the XY direction.

  FIG. 2C is an enlarged view showing one of the pixel matrixes 22 in FIG. A 3 × 3 matrix surrounded by a central thick frame is a pixel matrix 22, and nine pieces of pixel information Cm · n in which the same video information is defined are arranged. In the video conversion apparatus 1 according to the present invention, video information is analyzed from the pixel information 21 at the center of the pixel matrix 22 indicated by a circle. The position of the pixel information 21 at the center of the pixel matrix 22 is suitably specified by specifying the XY coordinates of the pixel information 21 based on a predefined arrangement pattern. However, video information may be obtained from an average value of a plurality of pieces of pixel information 21 in the pixel matrix 22.

  FIG. 21 is a diagram showing a third embodiment of a video of a plurality of viewpoints embedded with pixel information 21 in which video information is defined, which is received as a video signal by the video conversion apparatus 1 according to the present invention.

  FIG. 5A is a diagram showing the embedding position of the pixel information 21 on the video.

  FIG. 2B is an enlarged view of a portion where the pixel information 21 is embedded.

  FIG. 2C is an enlarged view showing one of the pixel matrixes 22 in FIG. In the third embodiment, pixel information 21 defined as video information is arranged in the center of the pixel matrix 22, and an intermediate portion between the pixel adjacent to the pixel matrix 22 and the pixel information 21 in the outer peripheral portion of the pixel matrix 22. Value pixel information 21 is embedded.

  FIG. 22 is a diagram showing a fourth embodiment of a video from a plurality of viewpoints embedded with pixel information 21 in which video information is defined, which is received by the video conversion apparatus 1 according to the present invention as a video signal.

  FIG. 5A is a diagram showing the embedding position of the pixel information 21 on the video.

  FIG. 2B is an enlarged view of a portion where the pixel information 21 is embedded. In the fourth embodiment, the pixel matrix 22 is composed of 2 × 3, and compared with the pixel matrix 22 of the third embodiment, the pixel information 21 in the upper line is removed and arranged at the upper end of the image. Yes. This embodiment is suitable because the influence on the video is reduced when the area occupied by the pixel matrix 22 is reduced.

  FIG. 2C is an enlarged view showing one of the pixel matrixes 22 in FIG. The pixel information 21 defining the video information is arranged at the center of the row above the pixel matrix 22, and the pixel information 22 has an intermediate value between the pixel adjacent to the pixel matrix 22 and the pixel information 21 in the outer periphery of the pixel matrix 22. Pixels that are interpolated with predetermined weights are arranged on both pixels.

  Here, weighting means multiplying the value of the pixel information 21 by a predetermined number when obtaining the intermediate value in order to analyze the video information defined by the pixel information 21 more reliably. According to FIG. 5C, the weighting is double the value of the pixel information 21, but may be tripled or quadrupled as necessary. It should be noted that weighting is possible in the third embodiment.

  The following describes an experimental method for examining changes in the RGB values of the pixel information 21 in which video information is defined when the videos of the multiple viewpoints of the second to fourth embodiments are compressed with mpeg2.

  First, as the first step of this experiment, the entire image used as the background is black (Black), red (R), green (G), blue (B), cyan (C), magenta (M), yellow (Y ), White (White) eight-color original video file 23 (AVI format) is prepared. FIG. 23 is an image diagram of the original video file 23. The RGB values of the original video file 23 are as shown in Table 1.

  Next, as the second step of this experiment, the pixel matrix 22 is embedded in the original video file 23 of the above eight colors. In the present embodiment, the video composite tool “Adobe (registered trademark) After Effects (registered trademark) CS3 Professional” is used to create the original video file 23 in the first stroke and to embed the pixel matrix 22 in the second stroke. I use it.

  In this experiment, pixel information 21 of seven different colors, red (R), green (G), blue (B), cyan (C), magenta (M), yellow (Y), and white (White), The same pixel information 21 is arranged at positions adjacent to the five directions around the video information, that is, the left, right, lower, lower left, and lower right of the pixel information 21, or an intermediate value with the RGB value of the original video file 23 or A 2 × 3 pixel matrix in which pixels taking RGB values weighted based on a predetermined ratio are arranged is embedded in the upper left corner of the original video file 23 of eight colors. The values of the pixel information 21 are as shown in Table 2.

  As a result, as shown in FIG. 24, the pixel-embedded video file 24 in which the seven pixel matrices 23 are embedded can be provided for eight colors.

  Note that the pixel information 21 always has a value of “0” in the upper third bit, such as “11011111 (223)”, “10011111 (159)”, “01011111 (95)”, and “00011111 (31)”. To be. This is to prevent the values of the first and second bits from being affected when the value is changed by mpeg2 compression. For example, when the value of the pixel information 21 is “01111111”, the value of the entire pixel information becomes “10000000 (128)” just by incrementing the value by 1 by mpeg2 compression, and the first and second bits The value of will change. On the other hand, if the value of the pixel information 21 is “01011111 (95)”, even if the value is incremented by 1 by mpeg2 compression, the value becomes “01100000 (96)”. The eye value does not change.

  In particular, the RGB value of the pixel information 21 is preferably an intermediate value between an upper limit value and a lower limit value that are allowed to change in value due to mpeg2 compression. That is, when the value of the upper first bit and the second bit is “10”, the upper limit value is “10111111 (191)”, the lower limit value is “10000000 (128)”, and these intermediate values are By setting a certain “10011111 (159)” as the initial RGB value, even if the RGB value changes due to mpeg2 compression, the values of the first and second bits are less likely to change.

  However, the value of the pixel information 21 may be “11111111 (255)” or “00000000 (0)”. Since this value is the upper limit value (lower limit value) of the RGB value, the value changes only downward (upward) by mpeg2 compression, so the value of the upper third bit does not have to be “0”.

  As the third step of this experiment, the pixel embedded video file 24 is compressed by mpeg2. “TMPGEnc Plus2.5” is used for compression, and the setting at the time of compression is based on the setting shown in FIGS.

  As the fourth step of this experiment, the compressed mpeg2 video file 25 is decompressed using “Adobe (registered trademark) After Effects (registered trademark) CS3 Professional”, and the pixel information 21 of the pixel embedded video file 24 before compression is extracted. Measure the RGB value of the pixel at the corresponding coordinates.

Tables 3 to 7 are diagrams for explaining the results of this experiment.

  Table 3 shows pixel information 21 of seven colors by setting the R value, G value, and B value of the pixel information 21 to “223” or “0”, respectively. It is a table | surface which shows the measured value of RGB of the pixel information 21 of the mpeg2 video file 25 after compression at the time of embedding the pixel matrix 22 which has arrange | positioned the pixel with the same RGB value as the information 21 in the original video file 23, and compressing mpeg2. .

  Table 4 is a table showing the maximum and minimum RGB values of each pixel information among the RGB measurement values in Table 3.

  Here, the pixel information 21 can define the video information only by the R value (the color of the pixel information 21 is red), or the video information can be defined by the G value and the B value (the color of the pixel information 21 is cyan). ), Video information can also be defined using all of the R value, G value, and B value (the color of the pixel information 21 is white).

  For example, it is assumed that the pixel information 21 defines the value “11” of the first and second bits as video information. In this case, even if the RGB values after compression are changed, the values after the change are “11000000” to “11111111” in which the value of the first and second bits is “11”, that is, “192” to “255”. If the value between is taken, video information can be read even from the pixel information 21 after compression.

  According to Table 3 and Table 4, since the R value, G value, or B value after compression of the pixel information 21 defined as the video information takes a value between “192” and “255”, the video information The information analysis unit 17 can analyze the first and second bits from the compressed pixel information 21 as video information.

  Further, if the pixel information 21 defines the value “1” of the upper first bit as video information, even if the RGB value after compression changes, the changed value is the upper first bit. If the value is between “10000000” and “11111111”, ie, “128” to “255”, the video information can be read even from the compressed pixel information 21.

  According to Table 3 and Table 4, since the R value, G value, or B value after compression of the pixel information 21 defined as the video information takes a value between “128” and “255”, the video information The information analysis unit 17 can analyze the upper first bit from the compressed pixel information 21 as video information.

  Table 5 shows that the R value, the G value, and the B value of the pixel information 21 are “159” or “0”, respectively, so that the pixel information 21 of seven colors is obtained. It is a table | surface which shows the measured value of RGB of the pixel information 21 of the mpeg2 video file 25 after compression at the time of embedding the pixel matrix 22 which has arrange | positioned the pixel with the same RGB value as the information 21 in the original video file 23, and compressing mpeg2. .

  Table 6 is a table showing the maximum and minimum RGB values of each pixel information among the RGB measurement values in Table 5.

  For example, it is assumed that the pixel information 21 defines the value “10” of the first and second bits as video information. In this case, even if the RGB value after compression changes, the value after the change is “10000000” to “10111111” in which the value of the first and second bits is “10”, that is, “128” to “191”. If the value between is taken, video information can be read even from the pixel information 21 after compression.

  According to Table 5 and Table 6, since the R value, G value, or B value after compression of the pixel information 21 defined as the video information takes a value between “128” and “191”, The information analysis unit 17 can analyze the first and second bits from the compressed pixel information 21 as video information.

  Further, if the pixel information 21 defines the value “1” of the upper first bit as video information, even if the RGB value after compression changes, the changed value is the upper first bit. If the value is between “10000000” and “11111111”, ie, “128” to “255”, the video information can be read even from the compressed pixel information 21.

According to Table 5 and Table 6, since the R value, G value, or B value after compression of the pixel information 21 defined as the video information takes a value between “128” and “255”, the video information The information analysis unit 17 can analyze the upper first bit from the compressed pixel information 21 as video information.

  Table 7 shows pixel information 21 of seven colors by setting the R value, G value, and B value of the pixel information 21 to “95” or “0”, respectively. It is a table | surface which shows the measured value of RGB of the pixel information 21 of the mpeg2 video file 25 after compression at the time of embedding the pixel matrix 22 which has arrange | positioned the pixel with the same RGB value as the information 21 in the original video file 23, and compressing mpeg2. .

  Table 8 is a table showing the maximum and minimum RGB values of each pixel information among the RGB measurement values in Table 7.

  For example, it is assumed that the pixel information 21 defines the value “01” of the first and second bits as video information. In this case, even if the RGB value after compression changes, the value after the change is “01000000” to “01111111” in which the value of the first and second bits is “01”, that is, “64” to “127”. If the value between is taken, video information can be read even from the pixel information 21 after compression.

  According to Tables 7 and 8, since the R value, G value, or B value after compression of the pixel information 21 defined as the video information takes a value between “64” and “127”, the video information The information analysis unit 17 can analyze the first and second bits from the compressed pixel information 21 as video information.

  Further, if the pixel information 21 defines the value “0” of the upper first bit as video information, even if the RGB value after compression changes, the changed value is the upper first bit. If the value is “0000000” to “01111111”, that is, “0” to “127”, the video information can be read even from the pixel information 21 after compression.

  According to Tables 7 and 8, the R value, G value, and B value after compression of the pixel information 21 defined as the video information all take values between “0” and “127”. The information analysis unit 17 can analyze the upper first bit from the compressed pixel information 21 as video information.

  Table 9 shows pixel information 21 of seven colors by setting the R value, G value, and B value of the pixel information 21 to “31” or “0”, respectively. It is a table | surface which shows the measured value of RGB of the pixel information 21 of the mpeg2 video file 25 after compression at the time of embedding the pixel matrix 22 which has arrange | positioned the pixel with the same RGB value as the information 21 in the original video file 23, and compressing mpeg2. .

  Table 10 is a table showing the maximum and minimum RGB values of each pixel information among the RGB measurement values in Table 9.

  For example, it is assumed that the pixel information 21 defines the value “00” of the first and second bits as video information. In this case, even if the RGB value after the compression changes, the value after the change is “00000000” to “00111111” in which the value of the first and second bits is “00”, that is, “0” to “63”. If the value between is taken, video information can be read even from the pixel information 21 after compression.

  According to Table 9 and Table 10, the R value, G value, or B value after compression of the pixel information 21 defined as the video information takes a value between “0” and “63”. The information analysis unit 17 can analyze the first and second bits from the compressed pixel information 21 as video information.

  Further, if the pixel information 21 defines the value “0” of the upper first bit as video information, even if the RGB value after compression changes, the changed value is the upper first bit. If the value is “0000000” to “01111111”, that is, “0” to “127”, the video information can be read even from the pixel information 21 after compression.

According to Table 9 and Table 10, the R value, G value, or B value after compression of the pixel information 21 defined as the video information takes a value between “0” and “127”. The information analysis unit 17 can analyze the upper first bit from the compressed pixel information 21 as video information.

  Table 11 shows that the R value, the G value, and the B value of the pixel information 21 are “255” or “0”, respectively, so that the pixel information 21 of seven colors is obtained. A pixel matrix 22 in which pixels having RGB values obtained by weighting the RGB values of the information 21 and the RGB values of the pixels of the original video file 23 at a ratio of 2: 1 is embedded in the original video file 23 and compressed by mpeg2 It is a table | surface which shows the measured value of RGB of the pixel information 21 of the mpeg2 video file 25 after compression in the case of doing.

  Table 12 is a table showing the maximum and minimum RGB values of each pixel information among the RGB measurement values in Table 11.

  For example, it is assumed that the pixel information 21 defines the value “11” of the first and second bits as video information. In this case, even if the RGB values after compression are changed, the values after the change are “11000000” to “11111111” in which the value of the first and second bits is “11”, that is, “192” to “255”. If the value between is taken, video information can be read even from the pixel information 21 after compression.

  However, according to Table 11 and Table 12, the R value, G value, or B value after compression of the pixel information 21 defined as video information does not take a value between “192” and “255”. Since there is something, only the upper 1 bit can be defined as video information.

  Assuming that the pixel information 21 defines the value “1” of the upper first bit as video information, even if the RGB value after compression changes, the value after the change is the value of the upper first bit. If a value between “10000000” to “11111111”, ie, “128” to “255”, which is “1” is taken, video information can be read even from the pixel information 21 after compression.

  According to Table 11 and Table 12, since the R value, G value, or B value after compression of the pixel information 21 defined as the video information takes a value between “128” and “255”, the video information The information analysis unit 17 can analyze the upper first bit from the compressed pixel information 21 as video information.

  The experimental results of Table 11 and Table 12 were obtained by the pixel matrix 22 by weighting the RGB values of the pixel information 21 and the RGB values of the pixels of the original video file 23 around the pixel information 21 at a ratio of 2: 1. There is a reason for having a configuration in which pixels having RGB values are arranged. That is, weighting increases the influence from the original video file 23 on the pixel information 21 defined as video information, and the RGB value after mpeg2 compression changes greatly. However, since the influence on the original video file 23 by embedding the pixel matrix 22 is relatively small, that is, there is a merit that the pixel matrix 22 becomes inconspicuous, it is suitable when it is desired to suppress the influence on the original video file. . On the other hand, from the experimental results in Tables 3 to 6, by making all the pixels constituting the pixel matrix 22 the same as the pixel information 21, the influence of the mpeg2 compression on the RGB value of the pixel information 21 is prevented. This makes it possible to embed this information, and the advantage of not weighting becomes clear.

FIG. 25 and FIG. 26 are diagrams for explaining what information the video information actually means in the above embodiment. According to FIG. 25, from the code _{C 0} to _{C 23} is used as a determination code (header). The video information analysis unit 17 recognizes that the combination of the RGB values of the determination code is a combination that is almost impossible in nature, and that the pixel information is embedded as defining the video information. Will be able to.

Codes C ₂₄ to C ₂₉ are used for parity check as shown in FIG. Codes C ₃₀ to C ₈₉ mean conversion control information and a pixel arrangement method, as specifically shown in FIG. Details of the conversion control information and the pixel arrangement method will be described later. Codes C ₉₀ to C ₉₅ are used for parity check as shown in FIG.

<Conversion control information>
The conversion control information used in the video conversion apparatus 1 according to the present invention will be described in detail.

  The conversion control information means information necessary for transmitting a plurality of viewpoint videos received by the video conversion device 1 to the stereoscopic video display device for stereoscopic display. The conversion control information includes those that the video conversion device 1 has set in advance, those that are input by the above-described control signals, and those that are input by the above-described video information, and the video conversion device 1 includes them. Based on this, the pixel arrangement of the video from a plurality of viewpoints is converted so that the stereoscopic display can be optimally performed.

  Specifically, the conversion control information means a scanning method such as NTSC or PAL, a transmission method such as interlace or progressive, the number of viewpoints, resolution, a pixel arrangement method, and the like.

<Pixel arrangement method>
Specifically, the pixel arrangement method includes the number of rows constituting one pixel, the number of sub-pixels constituting the one pixel, the number of pixels connected in the combination of the pixels, and the connection position perturbation for each pixel. It means the number of subpixels.

<Function of each member>
Below, the function of each member of the video conversion device 1 according to the present invention will be described in detail.

<Receiver>
The receiving unit 12 has a function of receiving a video transmitted as a video signal from the video output device 2. Also, it has a function of receiving conversion control information transmitted as a control signal from the video output device 2 or the stereoscopic video display device 3. When receiving the video, the receiving unit 12 transmits it to the storage unit 13 and, when receiving the conversion control information, transmits it to the conversion control unit 14.

<Storage unit>
The storage unit 13 has a function of storing the video received as the video signal by the receiving unit 12 in a storage element (frame buffer).

<Video Information Analysis Department>
The video information analysis unit 17 has a function of analyzing video information with reference to the video stored in the storage element by the storage unit 13. The video information analysis unit 17 is necessary when using the pixel information 21 defined as the video information embedded in the video.

  Note that the pixel information 21 is normally embedded only in a stereoscopic video. This is to save the trouble of newly embedding the pixel information 21 in a plane image in which a huge amount of content already exists. Of course, the pixel information 21 may be embedded in the planar video.

  The most basic application of the video information analysis unit 17 is to use video information for determining whether the video received by the reception unit 12 as a video signal is a planar video or a video of a plurality of viewpoints (stereoscopic video). There is to analyze. This is because, when the video received by the receiving unit 12 is a flat video, it is necessary to output the flat video as it is to the stereoscopic video display device 3 without performing any processing for stereoscopic video display such as pixel arrangement conversion. Because.

  Note that since the RGB value of the pixel information 21 changes due to irreversible compression as described above, it is preferable to analyze the video information with reference to only the upper bits of a predetermined number of digits.

  The video information analysis unit 17 identifies the position where the pixel information 21 is embedded based on a predetermined arrangement pattern, determines the presence or absence of a header for collating video information, and analyzes the video information when there is a header. .

<Conversion control unit>
First, the conversion control unit 14 instructs the conversion unit 15 to convert a video image of a plurality of viewpoints into a pixel arrangement for stereoscopic video display based on preset conversion control information (control instruction). Have a function.

  Secondly, the conversion control unit 14 determines whether the video received by the receiving unit 12 from the video output device 2 is the video of the plurality of viewpoints or the planar video, or the video of the multiple viewpoints and the planar video are mixed. It has a function of discriminating whether it is a video to be performed based on video information or control signals (controlling discrimination).

  Third, the conversion control unit 14 replaces the preset conversion control information with the conversion control information recognized based on the video information or the control signal, or the conversion control information stored in the conversion control information storage unit 18 described later. The conversion unit 15 is instructed to convert the video from a plurality of viewpoints into a pixel arrangement for stereoscopic video display based on the above.

<Conversion control information storage unit>
The conversion control information storage unit 18 displays a video of a plurality of viewpoints for stereoscopic video display based on conversion control information recognized based on video information or a control signal instead of the conversion control information set in advance by the conversion control unit 14. This function has a function of storing the new conversion control information when the conversion unit 15 is instructed to convert to the pixel arrangement.

<Conversion unit>
In response to an instruction from the conversion control unit 14, the conversion unit 15 has a function of converting a pixel arrangement of a video from a plurality of viewpoints into a pixel arrangement for stereoscopic video display. That is, it has a blending function. The blending method will be described later.

<Conversion control flow>
When one video file in which a plane video and a video of multiple viewpoints are mixed is converted by the video conversion apparatus 1 according to the present invention, it is necessary to recognize a plane video portion and a video portion of a plurality of viewpoints in the video file. When discriminating between a planar video and a multi-view video based on the video information, a method of always embedding pixel information 21 defined as video information in the multi-view video, and a moment when the multi-view video starts and ends. There are two methods of embedding pixel information 21 defined as video information only in video.

  FIG. 27 is a flowchart showing a method for discriminating between a planar video and a multi-view video by always embedding pixel information 21 defined as video information in a multi-view video.

  However, in order to prevent irreversible compression from affecting the time direction, the frame before and after the frame at the moment when the multi-view video starts and the frame before and after the frame at the moment when the multi-view video ends are respectively The pixel information 21 defined as the same video information may be embedded.

  According to the figure, when the receiving unit 12 receives a video, the video information analyzing unit 17 analyzes the presence / absence of a header at a predetermined position for each frame based on a predetermined pixel arrangement pattern defined in advance. (1) When there is a header, the frame is a video frame of a plurality of viewpoints, and since the video information is defined in the frame, the video information analysis unit 17 analyzes the video information. (2) When there is no header, the frame is a plane video frame, and video information is not defined in the frame, so the video information analysis unit 17 does not analyze the video information. When the above analysis is completed, the video information analysis unit 17 proceeds to analysis of the next frame.

  FIG. 28 is a flowchart showing a method of discriminating between a planar video and a multi-view video by embedding pixel information 21 defined as video information only in the video at the moment when the multi-view video starts and ends. .

  In the figure, the video information analysis unit 17 refers to the multi-view video identifier i3D and the previous video state identifier j3D, so that a video frame in which the pixel information 21 is not embedded is a multi-view video frame. It is possible to determine whether the frame is a flat image frame.

<About blend>
The blending, that is, how the pixels for each viewpoint are arranged on the surface of the stereoscopic image display device 3 depends on the number of viewpoints and the slits of the parallax barrier in order to suppress a decrease in horizontal resolution due to a plurality of viewpoints and to alleviate jump points. This is an important design condition for forming the shape, width, inclination, and spacing between slits.

  Examples of typical blends are shown below.

<About blending and compression (1)>
Next, an example of the first pixel configuration and blending method will be described.

  As shown in FIG. 29 (a), the arrangement of the R, G, and B sub-pixels constituting each viewpoint pixel is an arrangement that extends over three rows and is a pixel for the first viewpoint. The arrangement is such that the R subpixel is in the third row from the top, the G subpixel is in the second upper right row, and the B subpixel is in the upper right row. For the next second viewpoint, the order is G, B, R from the bottom. In this example, the pixels for each viewpoint are drawn separately in the horizontal direction so that the sub-pixel arrangement for six viewpoints is easy to understand, but in actuality, they are continuous in the horizontal direction.

  FIG. 29B shows the pixel arrangement in the k-th viewpoint image before compression. For example, the display “11” represents a pixel located in the first row and the first column in the compressed image.

  In FIG. 29 (c), a compressed image is shown by omitting a portion (shown by hatching in the figure) for the viewpoint other than the k-th viewpoint from the image shown in FIG. 29 (b).

  In this blending method, the resolution of the compressed video before blending can be obtained by the following calculation.

  The stereoscopic image display device 3 has a horizontal resolution of 1920, a number of viewpoints of 6, and 3 subpixels were used before to represent one pixel per row. Three times as only pixels are used. The following formula is established.

1920 × 3/6 = 960
That is, 960 can be used as the horizontal resolution of the compressed image.

  In addition, the vertical resolution of the stereoscopic image display device 3 is 1080, the number of viewpoints is 1 in the vertical direction, and in order to represent one pixel per column, it was previously represented by one row. In this blending method, since three rows are used, the vertical resolution is 1/3. The following formula is established.

1080/3 = 360
That is, 360 can be used as the vertical resolution of the compressed image.

  As shown in FIG. 29 (c), it is assumed that the pixel for the kth viewpoint is represented as kPmn with respect to the pixel of m rows and n columns of the compressed image.

  FIG. 30 shows a specific arrangement of subpixel units.

  FIG. 30 also shows correspondence between one pixel of the compressed image and a sub-pixel group corresponding to the one pixel after blending on the high-definition display.

  As shown in this figure, in this blending method, the subpixel group in the second row is shifted by 3 subpixels to the left with respect to the position of the subpixel group in the first row, and the subpixel group in the third row Is shifted by 3 subpixels to the right with respect to the subpixel group in the second row. There is no horizontal shift between the sub-pixel groups in the first and third rows.

  In order to eliminate this shift, the pixel for the kth viewpoint in FIG. 29B is arranged. For example, a pixel “21” is arranged three rows below and one column left of the pixel “11”, and a pixel “31” is arranged three columns below and one column right.

<About blending and compression (2)>
Next, a second example of pixel configuration and blending method will be described.

  FIG. 31 (a) shows the arrangement of sub-pixels constituting each viewpoint pixel.

  FIG. 31B shows the pixel arrangement in the k-th viewpoint image before compression.

  In FIG. 31 (c), a compressed image is shown by omitting a portion (shown by hatching in the figure) for viewpoints other than the kth viewpoint from the image shown in FIG. 31 (b).

  In this blending method, the resolution of the compressed video before blending can be obtained by the same calculation as described above.

  The following calculation formula is established for the horizontal resolution of the stereoscopic video display device 3.

(1920 × 3) / 6 = 960
Further, the following calculation formula is established for the vertical resolution of the stereoscopic image display device 3.

1080/5 = 216
FIG. 32 shows a specific arrangement of subpixel units and subpixel groups constituting a pixel.

  Since a shift occurs even in this blending method, the pixel for the kth viewpoint in FIG. 31B is arranged in order to eliminate the shift. For example, “21” pixels are arranged in the same column 5 rows below “11” pixels, and “31” pixels are arranged in the same column 5 rows below.

<About blending and compression (3)>
Next, a third example of pixel configuration and blending method will be described.

  The arrangement of the pixels for each viewpoint is shown in FIG.

  FIG. 33A shows the pixel arrangement in the k-th viewpoint image before compression.

  In FIG. 33 (b), a compressed image is shown by omitting a portion for the viewpoint other than the kth viewpoint (shown by hatching in the drawing) from the image shown in FIG. 33 (a).

  In this blending method, the resolution of the compressed video before blending can be obtained by the same calculation as described above.

  The following calculation formula is established for the horizontal resolution of the stereoscopic video display device 3.

(1920 × 3) / 6 = 960
Further, the following calculation formula is established for the vertical resolution of the stereoscopic image display device 3.

1080 / 2.5 = 532
FIG. 34 shows a specific arrangement of subpixel units and subpixel groups constituting a pixel.

  Since a shift occurs even in this blending method, the pixel for the k-th viewpoint in FIG. 33A is arranged in order to eliminate the shift. For example, a pixel “21” is arranged two rows below and one column left of the pixel “11”, and a pixel “31” is arranged three rows below and one column right.

<RGB pixel automatic blend description>
In the stereoscopic video display device 3 that supports multiple viewpoints, it is important how the pixels (pixels) for each visual point are mixed and arranged on the stereoscopic video display device 3 in units of subpixels. This arrangement is called blending.

  In the video conversion device 1 according to the present invention, the slit arrangement shape (for example, vertical line shape, diagonal straight line shape, etc.) of the parallax barrier and the edge shape (straight line shape, step shape, elliptical arc) of the parallax barrier attached to the existing stereoscopic image display device. Is not predetermined. Conversely, the video conversion device 1 of the present invention can be applied to any slit arrangement shape and any edge-shaped parallax barrier.

  Therefore, it is necessary to assume various types of slits of the parallax barrier installed on the stereoscopic image display device 3 and to select a blending method suitable for the slits.

  For example, when reproducing autostereoscopic content, the video conversion apparatus 1 according to the present invention automatically recognizes the installed parallax barrier, or the user inputs an ID of the parallax barrier. The “RGB pixel automatic blend description” is received and blending is performed in accordance with the description.

  This method (understands what parallax barrier is used on the playback device side, blends the image data for each viewpoint based on the grasp result, creates an image for autostereoscopic display, Since the autostereoscopic content to be played back does not depend on the shape of the parallax barrier at the time of playback, the autostereoscopic TV that cannot be identified by which stereoscopic video display device 3 is played back is displayed. This is effective when broadcasting programs.

Hereinafter, “RL2L3P2 + 3, + 2” will be described as an example of RGB pixel automatic blend description. A blend corresponding to this description is shown in FIG.
1. The first character string “RL” indicates that pixels are arranged in an oblique direction from the upper right to the lower left as viewed from the front of the monitor. In this case, the coordinate system is + in the direction from right to left. “LR” indicates that pixels are arranged in an oblique direction from the upper left to the lower right. In this case, it is a coordinate system in which the direction from left to right is +.
2. The next character string “2L3P” indicates that one pixel is composed of two rows and three subpixels.
3. The next character string “2 + 3, +2” defines an arrangement rule of two pixels connected from the first pixel, and indicates that these two pixels are arranged repeatedly. The pixel arrangement is based on the upper left sub-pixel (indicated by a circle in the figure) that constitutes the first pixel, and the horizontal alignment of the next connected pixel up to the upper left sub-pixel (indicated by a circle in the figure) The leftward deviation width is indicated by the number of subpixels “+3”. Further, the horizontal shift width of the next connected pixel is indicated by the number of subpixels “+2”. When the first character string is “LR”, the rightward deviation width in the horizontal direction is represented by “+”.

  36 to 41 show examples of the RGB pixel automatic blend description and the corresponding blend method. The right side of each figure shows the arrangement pattern of a plurality of sub-pixels constituting each pixel in the blending method shown in the figure.

<Parameters related to selection>
When selecting a blending method, the video conversion apparatus 1 according to the present invention is a table describing the types of installed parallax barriers, for example, combinations of parallax barriers created and distributed in advance and blending methods. To select a blending method.

  When a parallax barrier is manufactured for a specific stereoscopic video display device 3, a parallax barrier sheet is manufactured using the resolution, pixel width, and number of multi-view viewpoints of the stereoscopic video display device 3 as parameters.

<Transmitter>
The transmission unit 16 of the video conversion device has a function of transmitting the video whose pixel arrangement has been converted by the conversion unit 15 to the stereoscopic video display device 3 as a video signal.

  As described above, according to the video conversion apparatus of the present invention, it is possible to provide a stereoscopic video display technique that is inexpensive and practical.

  The present invention is not limited to each of the embodiments described above, and various combinations are possible within the scope shown in the claims, and obtained by appropriately combining technical means disclosed in different embodiments. Such embodiments are also included in the technical scope of the present invention.

  The video conversion apparatus according to the present invention can perform a stereoscopic display optimal for a stereoscopic video display device by converting a video from a plurality of viewpoints into a pixel arrangement corresponding to the existing video output device and the stereoscopic video display device. .

1 Video conversion device 2 Video output device 3 Video display device 4 Video cable 5 Control cable 6 First table 7 Remote control 8 USB memory 9 Second table 10 Third table 11 Camera 12 Reception unit 13 Storage unit 14 Conversion control unit DESCRIPTION OF SYMBOLS 15 Conversion part 16 Transmission part 17 of image | video conversion apparatus Video information analysis part 18 Conversion control information memory | storage part 19 Image | video arrangement | positioning part 20 Transmission part 21 of image | video output apparatus Pixel information 22 Pixel matrix 23 Original image file 24 Pixel embedded image file 25 mpeg2 image | video File

Claims (23)

From a video output device , a video of a plurality of viewpoints or a plane video in which a plurality of pixel information defined as video information is embedded at a predetermined position of the first frame or all frames based on a predetermined arrangement pattern is received as a display video signal. Receiving means;
Storage means for storing the images of the plurality of viewpoints or the planar image received by the receiving means in a storage element for each frame;
Video information analysis means for identifying the position where the pixel information is embedded based on the predetermined arrangement pattern, determining the presence or absence of a header for collating the video information, and analyzing the video information when there is a header When,
Only when it is determined that the video is a multi-view video or a plane video according to the presence or absence of the header, and the video information analysis means Conversion control means for controlling an instruction to convert the video of the plurality of viewpoints into a pixel arrangement for stereoscopic video display based on the video information analyzed by
Conversion means for converting the pixel arrangement according to an instruction from the conversion control means;
A transmission unit that transmits the image obtained by converting the pixel arrangement by the conversion unit or the planar image to the stereoscopic image display device as a display image signal,
A video conversion device characterized in that a video from a plurality of viewpoints can be immediately converted into a stereoscopic display video and viewed .
Receiving means for receiving video from a plurality of viewpoints as video signals for display from the video output device;
Storage means for storing the images of the plurality of viewpoints received by the reception means in a storage element for each frame;
Conversion control means for controlling an instruction to convert the pixel arrangement of the video images of the plurality of viewpoints stored in the storage element by the storage means into a pixel arrangement for stereoscopic video display based on preset conversion control information;
Conversion means for converting the pixel arrangement according to an instruction from the conversion control means;
A transmission unit that transmits the video whose pixel arrangement is converted by the conversion unit to the stereoscopic video display device as a display video signal;
Instantly convert multi-viewpoint video to 3D video for viewing
A video conversion device,
The receiving means includes
Furthermore, the conversion control information stored in the external storage means by electrical connection or wireless communication is received as a control signal,
The conversion control means includes
When the receiving means receives the control signal,
A pixel arrangement of the video images of the plurality of viewpoints stored in the storage element by the storage unit,
A video conversion apparatus that controls an instruction to convert to a pixel arrangement for stereoscopic video display based on conversion control information stored in the external storage means instead of the preset conversion control information.
Receiving means for receiving video from a plurality of viewpoints as video signals for display from the video output device;
Storage means for storing the images of the plurality of viewpoints received by the reception means in a storage element for each frame;
Conversion control means for controlling an instruction to convert the pixel arrangement of the video images of the plurality of viewpoints stored in the storage element by the storage means into a pixel arrangement for stereoscopic video display based on preset conversion control information;
Conversion means for converting the pixel arrangement according to an instruction from the conversion control means;
A transmission unit that transmits the video whose pixel arrangement is converted by the conversion unit to the stereoscopic video display device as a display video signal;
Instantly convert multi-viewpoint video to 3D video for viewing
A video conversion device,
The receiving means includes
Receiving a control signal from the stereoscopic image display device;
The conversion control means includes
Based on the control signal,
A scanning method of the stereoscopic image display device;
The resolution of the stereoscopic image display device;
Recognizing and controlling at least one of the number of viewpoints of the stereoscopic video display device and the pixel arrangement method of the stereoscopic video display device;
In place of the preset conversion control information, the stereoscopic video display device scanning method, the stereoscopic video display device resolution, the number of viewpoints of the stereoscopic video display device, and the pixel arrangement conversion method, Based on the instruction to convert the video of the plurality of viewpoints into a pixel arrangement for stereoscopic video display ,
The pixel arrangement method includes:
Formed by repeating a combination of one or more pixels,
The number of rows comprising one pixel;
The number of sub-pixels constituting the one pixel;
The number of pixels connected in the pixel combination;
An image conversion device comprising: the number of connected position perturbation subpixels for each pixel .
Receiving means for receiving video from a plurality of viewpoints as video signals for display from the video output device;
Storage means for storing the images of the plurality of viewpoints received by the reception means in a storage element for each frame;
Conversion control means for controlling an instruction to convert the pixel arrangement of the video images of the plurality of viewpoints stored in the storage element by the storage means into a pixel arrangement for stereoscopic video display based on preset conversion control information;
Conversion means for converting the pixel arrangement according to an instruction from the conversion control means;
A transmission unit that transmits the video whose pixel arrangement is converted by the conversion unit to the stereoscopic video display device as a display video signal;
Instantly convert multi-viewpoint video to 3D video for viewing
A video conversion device,
The receiving means includes
A parallax barrier formed by an invisible region and a plurality of transmissive regions arranged in a slit shape so that slits or holes are continuous with a predetermined inclination from above to below is pasted with a predetermined gap in front of the monitor By the stereoscopic image display device,
The size of the sub-pixels constituting the pixel, the average slope of the transmissive region, the number of sub-pixels corresponding to the average width of the transmissive region in the horizontal direction of the slit or the hole, and the center of the adjacent slit or the hole Receiving the number of subpixels corresponding to the average distance between them and the resolution of the stereoscopic image display device as control signals,
The conversion control means is based on the control signal,
An image conversion apparatus, comprising: selecting a pixel arrangement conversion method for converting an image of a plurality of viewpoints into a pixel arrangement that can most effectively display a stereoscopic image, and controlling an instruction for conversion using the pixel arrangement conversion method.
The transmission means includes
5. The display device according to claim 1, wherein the receiving unit transmits a display video signal of the same standard as the display video signal received from the video output device to the stereoscopic video display device. Video conversion device.
The receiving means includes
Receiving a video signal for display from the video output device by electrical connection or wireless communication;
The transmission means includes
5. The video conversion device according to claim 1, wherein a display video signal is transmitted to the stereoscopic video display device by electrical connection or wireless communication.
The receiving means includes
An image forming a video for each viewpoint is formed by an image arranged in a tile shape by dividing the inside of the frame, and the video for the plurality of viewpoints as one video is received as a display video signal. Item 5. The video conversion device according to any one of Items 1 to 4.
The receiving means includes
5. The multi-viewpoint video or the planar video , which is a video obtained by decompressing an irreversibly compressed video by the video output device, is received as a display video signal. The video conversion device described in 1.
The receiving means includes
The images (kFt, t = 1 to l) forming the video for each viewpoint (k viewpoint video) are arranged in the order of the viewpoint video (k = 1 to n) for each same frame and further arranged in the time direction. 5. The display device according to claim 1, wherein the video of the plurality of viewpoints, which is a video formed by an image (F′t ′, t ′ = 1 to n · l), is received as a video signal for display. The video conversion device described in 1.
The receiving means includes
The same scanning line image information (Si, i = 1 to j) of the images forming the video for each viewpoint (k viewpoint video) is arranged in the order of the viewpoint video (k = 1 to n), and all of the scanning line image information is displayed. The multi-viewpoint video, which is a video formed by images (S′i ′, i = 1 to n · j) arranged in an image of one frame, is received as a display video signal. 5. The video conversion device according to any one of 1 to 4.
The receiving means includes
Receiving a video in which the video of the plurality of viewpoints and the flat video are mixed as one video as a video signal for display ;
The video information analyzing means includes
Analyzing the video information of all frames of the mixed video;
The conversion control means includes
Only when the video is further controlled to determine whether the video is a multi-view video or a flat video according to the presence or absence of the header and the mixed video frame is determined to be the multi-view video, the multi-view video Control the instruction to convert to the pixel arrangement for stereoscopic video display,
The transmission means includes
The video conversion apparatus according to claim 1, further comprising transmitting the planar video as a display video signal to the stereoscopic video display device.
The conversion control means includes
Based on the video information analyzed by the video information analysis means,
A scanning method of the images of the plurality of viewpoints;
The resolution of the video of the multiple viewpoints;
The number of viewpoints of the video of the plurality of viewpoints,
Recognizing and controlling at least one of the number of viewpoints of the stereoscopic image display device;
Instead of the preset conversion control information, based on the scanning method, the resolution of the videos of the multiple viewpoints, the number of viewpoints of the videos of the multiple viewpoints, and the number of viewpoints of the stereoscopic video display device, The video conversion apparatus according to claim 1, wherein an instruction to convert a video from a plurality of viewpoints into a pixel arrangement for stereoscopic video display is controlled.
The receiving means includes
A pixel matrix in which a plurality of pixel information defined as the same video information is continuously arranged in the XY direction receives a plurality of embedded images based on a predetermined arrangement pattern as a display video signal,
The video information analyzing means includes
2. The video conversion apparatus according to claim 1, wherein a position where the pixel matrix is embedded is specified based on the predetermined arrangement pattern, and the video information at the predetermined position of the pixel matrix is analyzed.
The video information analyzing means includes
The video conversion apparatus according to claim 13, wherein the video information is analyzed based on pixel information at the center position or an average value of a plurality of pieces of pixel information around the center position.
The receiving means includes
The video conversion apparatus according to claim 13, wherein the pixel matrix receives a video embedded along an upper end of the video of the plurality of viewpoints as a display video signal.
The receiving means includes
Instead of the pixel information, a pixel adjacent to the pixel matrix and an intermediate value pixel between the pixel matrix or a pixel obtained by interpolating with a predetermined weight are arranged on the outer periphery of the pixel matrix. 14. The video conversion apparatus according to claim 13, wherein a video in which a plurality of pixel matrices are embedded based on a predetermined arrangement pattern is received as a display video signal.
The receiving means includes
Receiving a video in which video information is defined only in upper bits of a predetermined number of digits of the pixel information as a display video signal;
The video information analyzing means includes
17. The video conversion apparatus according to claim 1, wherein the video information is analyzed with reference to only the high-order bits of the predetermined number of digits of the plurality of pixel information.
The video conversion device includes:
Further comprising conversion control information storage means,
The receiving means includes
Receiving the control signal further defined with index information, or
A plurality of pieces of pixel information in which index information is further defined is received as a display video signal in which video is embedded based on a predetermined arrangement pattern,
The conversion control information storage means includes
When the conversion control unit instructs the conversion unit to convert the pixel arrangement of the video images of the plurality of viewpoints based on the control signal or the video information, the conversion instruction is used as new conversion control information. Memorize it in correspondence with information,
The conversion control means includes:
When conversion control information corresponding to the control signal received by the reception means or the index information of the display video signal is stored in the conversion control information storage means, the conversion control information storage means stores the conversion control information. 18. The instruction for converting the pixel arrangement of the video images of the plurality of viewpoints into a pixel arrangement for stereoscopic video display is controlled based on the conversion control information, according to any one of claims 1 to 4 or 11 to 17. Video conversion device.
The receiving means includes
Furthermore, an input signal in which index information is defined by an external input means is received,
The conversion control means includes
Instead of the control signal or the display video signal,
When conversion control information corresponding to the index information of the input signal received by the receiving means is stored in the conversion control information storage means, based on the conversion control information stored in the conversion control information storage means 19. The video conversion apparatus according to claim 18, wherein an instruction for converting the pixel arrangement of the video images of the plurality of viewpoints into a pixel arrangement for stereoscopic video display is controlled.
The video output device according to claim 1 ;
The video conversion device according to claim 1,
By providing the stereoscopic image display device according to claim 1 ,
A video conversion system characterized in that a video from a plurality of viewpoints can be immediately converted into a stereoscopic display video for viewing .
The video conversion system includes:
It further comprises a plurality of photographing means for photographing the video for each viewpoint ,
The video output device
The image forming the video for each viewpoint shot by the plurality of shooting means is arranged in an image divided and arranged in a tile shape in the frame to form one video, and the video conversion as a display video signal video conversion system of claim 20, wherein the transmitting device.
The stereoscopic image display device includes:
A parallax barrier formed by an invisible region and a plurality of transmissive regions arranged in a slit shape so that slits or holes are continuous with a predetermined inclination from above to below is pasted with a predetermined gap in front of the monitor A stereoscopic image display device,
The receiving means of the video conversion device includes:
The average inclination of the transmissive region, the number of subpixels corresponding to the average width of the transmissive region in the horizontal direction of the slit or the hole, and the number of subpixels corresponding to the average distance between the centers of the adjacent slit or the hole And the size of the sub-pixel constituting the pixel and the resolution of the display device are received as control signals,
The conversion control means is based on the control signal,
The method of selecting a pixel arrangement conversion method for converting a video of a plurality of viewpoints into a pixel arrangement that can display a stereoscopic image most effectively, and controlling an instruction to convert the conversion means using the pixel arrangement conversion method. 20. The video conversion system according to 20. Receiving means as a video signal for display from a video output device as a video signal for display from a plurality of viewpoints or a plane video in which a plurality of pixel information defined as video information is embedded in a predetermined position of a first frame or all frames from a video output device and received by,
Storing the received images of the plurality of viewpoints or the planar image for each frame by a storage means in a storage element;
The position where the pixel information is embedded is identified based on the predetermined arrangement pattern, the presence or absence of a header for collating the video information is determined, and when there is a header, the video information is analyzed by the video information analysis means And
The presence or absence of the said header, and further controls the discrimination the video is whether the video or plane image of a plurality of viewpoints, only when the video is determined to be an image of the plurality of viewpoints, pixel arrangement of the image of the plurality of viewpoints Is controlled by the conversion control means based on the analyzed video information and converted into a pixel arrangement for stereoscopic video display,
In accordance with the instruction, the pixel arrangement is converted by a conversion means ,
By transmitting the transmission means to the stereoscopic image display device an image or the planar image that has been converted to pixel placement by the conversion as the display image signal,
A video conversion method characterized in that a video from a plurality of viewpoints can be immediately converted into a stereoscopic display video for viewing .

Images