WO2013174181A1 - 3d视频源存储方法和装置及3d视频播放方法和装置 - Google Patents
3d视频源存储方法和装置及3d视频播放方法和装置 Download PDFInfo
- Publication number
- WO2013174181A1 WO2013174181A1 PCT/CN2013/073968 CN2013073968W WO2013174181A1 WO 2013174181 A1 WO2013174181 A1 WO 2013174181A1 CN 2013073968 W CN2013073968 W CN 2013073968W WO 2013174181 A1 WO2013174181 A1 WO 2013174181A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video source
- eye video
- file
- eye
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/189—Recording image signals; Reproducing recorded image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
Definitions
- the present invention relates to multimedia technology, and in particular to a 3 A video source storage method and apparatus, and a 3D video playback method and apparatus, and a computer storage medium including instructions for executing a 3D video source storage method, and a computer storage including instructions for executing a 3D video playback method medium.
- the generation of 3D images is due to the "visual shift".
- the eyes of the person are about 6 cm apart from each other.
- the two eyes are viewed from the left and right viewpoints.
- the left eye will see the left side of the object, while the right eye will see her middle or right side.
- the impressions on the left and right sides are combined and the final three-dimensional feeling is obtained.
- the effect of obtaining a three-dimensional effect is "visual displacement."
- 3D video sources In order to form a 3D image, one scene needs to capture two movies simultaneously, a left eye video source and a right eye video source.
- Traditional methods of storing 3D video sources typically store left-eye video sources and right-eye video sources in separate files. When the 3D video is played, the left and right eye video sources are read from the two files, and the left and right video sources are further combined into a 3D video.
- the left and right video sources are stored in two files respectively, and it is possible that the 3D video cannot be synthesized due to the loss of one of the files during the transmission and saving process, especially when the client plays the 3D video online while playing on the Internet.
- the data can be read from the file to synthesize the 3D video, and then the 3D video can be played, which cannot meet the requirement of playing while downloading, so that the speed of playing the 3D video online is very slow.
- a 3D video source storage method includes the following steps:
- the media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
- a 3D video source storage device includes:
- a media data storage module configured to store video frames of the left-eye video source and the right-eye video source in a chronological order in a media data storage unit of the multimedia storage file
- the media information storage module is configured to separately store the media information of the left-eye video source and the media information of the right-eye video source in different media information storage units of the multimedia storage file.
- One or more computer storage media containing computer executable instructions for performing a 3D video source storage method comprising the steps of:
- the media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
- the above 3D video source storage method and apparatus and executable instructions for executing a 3D video source storage method in a computer storage medium store a left eye video source and a right eye video source of a video in a multimedia storage file, and a video corresponds to a video
- the file is stored without storing the left and right eye video sources in two files, which facilitates the transmission and storage of the video file, and avoids the loss of one file during the transmission and saving process, so that the 3D video cannot be synthesized and played.
- the above 3D video source storage method and device store the video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file, and when playing the 3D video online, one side can be Downloading the continuous media stream data of the multimedia storage file, and synthesizing the video frames of the left and right eye video sources from the already downloaded media stream data, and synthesizing the 3D media files without downloading all the media stream data of the multimedia storage file.
- Video images which meet the need to play 3D video while downloading.
- a 3D video playing method includes the following steps:
- Reading according to the media information of the left-eye video source and the media information of the right-eye video source, the video frames of the left-eye video source and the video frames of the right-eye video source that are consistent in time from the media data storage unit of the multimedia storage file;
- the video frames of the left-eye video source and the right-eye video source corresponding to the time are arranged in a preset manner to synthesize the 3D video image;
- the synthesized 3D video image is played.
- a 3D video playback device comprising:
- a file obtaining module configured to acquire a multimedia storage file storing a left-eye video source and a right-eye video source, where the video frames of the left-eye video source and the right-eye video source are interleaved and stored in the media data of the multimedia storage file in chronological order In the storage unit;
- the media information obtaining module is configured to read the media information of the left-eye video source and the media information of the right-eye video source, respectively, from the media information storage unit corresponding to the left-eye video source and the media information storage unit corresponding to the right-eye video source;
- a media data obtaining module configured to read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frame and the right eye of the left-eye video source with corresponding time correspondingly from the media data storage unit of the multimedia storage file Video frame of the video source;
- a synthesizing module configured to arrange video frames of a left-eye video source and a video source of a right-eye video source that are consistent in time according to a preset manner to synthesize a 3D video image
- a playing module for playing the synthesized 3D video image.
- One or more computer storage media containing computer executable instructions for performing a 3D video playback method comprising the steps of:
- Reading according to the media information of the left-eye video source and the media information of the right-eye video source, the video frames of the left-eye video source and the video frames of the right-eye video source that are consistent in time from the media data storage unit of the multimedia storage file;
- the video frames of the left-eye video source and the right-eye video source corresponding to the time are arranged in a preset manner to synthesize the 3D video image;
- the synthesized 3D video image is played.
- the above 3D video playing method and device and the executable instruction for executing the 3D video playing method in the computer storage medium can be read from the media data storage unit of the multimedia storage file according to the media information of the left eye video source and the media information of the right eye video source.
- the video frame corresponding to the consistent left-eye video source and the video frame of the right-eye video source are taken, and the video frames of the left and right-eye video sources corresponding to the time are combined into a 3D video image, and all media data of the multimedia storage file are not required.
- the download is completed, the synthesis operation is performed, and the 3D video image can be synthesized while obtaining the media data of the multimedia storage file, thereby satisfying the requirement of playing and playing while playing the 3D video online.
- FIG. 1 is a schematic flow chart of a 3D video source storage method in an embodiment
- FIG. 2 is a schematic structural diagram of a 3D video source storage device in an embodiment
- 3 is a schematic flow chart of a 3D video playing method in an embodiment
- FIG. 4 is a schematic structural diagram of a 3D video playback device in an embodiment.
- a 3D video source storage method includes the following steps:
- Step S101 The video frames of the left-eye video source and the right-eye video source are interleaved and stored in the media data storage unit of the multimedia storage file in chronological order.
- the multimedia storage file can be an MP4 file, an MP5 file, or other specific types of files.
- the multimedia storage file is an MP4 file
- the media data storage unit is a Media Data of the MP4 file. Box.
- the MP4 file is installed in the box (atom in QuickTime), that is to say, the MP4 file is composed of several boxes, each box has a type and a length, and the box can be understood as a data object block.
- the box can contain another box, this box is called container Box.
- the MP4 file contains one and only one "moov” type of box ( Movie Box ) It is a container box, the subbox contains information about the media data of the MP4 file, and the related information of the media data is referred to as media information.
- Track Box is a sub-box of "moov", each Track Box Contains media information for a single video stream.
- Another type of box for MP4 files is the “mdat” type of box (Media Data Box).
- Media Data The box contains media data of the multimedia storage file. The structure of the media data is described by the media information contained in the Movie Box.
- the video frames of the left-eye video source are arranged in a media data storage unit of the multimedia storage file according to time from first to last, and the video frames of the right-eye video source are time-dependent in the media data storage unit of the multimedia storage file. Arrange first and then.
- the adjacent left-eye video source in the media data storage unit of the multimedia storage file corresponds to the time of the video frame of the right-eye video source.
- the time corresponding to the video frames corresponds to the same or similar time of the video frames (the interval is less than the preset threshold).
- the video frames of the left and right eye video sources may be stored in the media data storage unit in the following order: the first frame video of the left eye video source, the first frame video of the right eye video source, and the second frame of the left eye video source.
- the left and right eye video sources are obtained by simultaneously capturing the same scene from different angles. Therefore, the number of video frames of the left and right eye video sources is the same or similar, and the time of the video frames corresponding to the sequence numbers is also consistent.
- the video frame is a frame of video or a group of consecutive video frames.
- a unit consisting of a set of consecutive video frames is called a chunk.
- the chunks of the left-eye video source and the right-eye video source may be interleaved in chronological order, and the adjacent left-eye video source and the right-eye video source have the same time.
- the chunks of the left and right eye video sources may be stored in the media data storage unit in the following order: chunks within 0 to 1 second of the left eye video source, chunks within 0 to 1 ⁇ k seconds of the right eye video source, The chunk within 1 to 2 seconds of the left-eye video source, and the chunk of the right-eye video source within 1 ⁇ k to 2 ⁇ k seconds, where k is a preset threshold.
- Step S102 The media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
- the media information storage unit is a Track Box of the MP4 file.
- the media information includes time information of the video frame in the video source, location information, and codec information of the video frame.
- the location information of the video frame corresponding to the relevant time may be obtained according to the time information and the location information of the video frame, and read from the media data storage unit of the multimedia storage file according to the location information. Take video frame data. Further, the video frame data can be decoded according to the codec information.
- video frames of the left and right eye video sources are interleaved and stored in a chronological order in a media data storage unit of the multimedia storage file, and adjacent left-eye video sources and right-eye videos in the media data storage unit are provided.
- the time of the video frame of the source corresponds to the same.
- the video frames of the left and right eye video sources can be conveniently obtained from the continuous media stream of the multimedia storage file, so that the media stream data of the MP4 can be downloaded while being downloaded.
- the continuous media stream data acquires a real-time synthesized 3D video image of the video frames of the left and right eye video sources corresponding to the time, which satisfies the requirement of playing while playing the 3D video.
- the foregoing 3D video source storage method further includes the steps of: encoding the left-eye video source according to a preset format, and encoding the right-eye video source of the video according to a preset format.
- step S101 is: interleaving the encoded video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file.
- the left-eye video source and the right-eye video source of the video may be encoded according to a conventional video encoding format (such as the h264 format). Further, the encoded left and right eye video sources can be stored.
- a conventional video encoding format such as the h264 format.
- a 3D video source storage device includes a media data storage module 201 and a media information storage module 202, wherein:
- the media data storage module 201 is configured to store the video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file.
- the multimedia storage file can be an MP4 file, an MP5 file, or other specific types of files.
- the multimedia storage file is an MP4 file
- the media data storage unit is a Media Data of the MP4 file. Box.
- the video frames of the left-eye video source are arranged in a media data storage unit of the multimedia storage file according to time from first to last, and the video frames of the right-eye video source are time-dependent in the media data storage unit of the multimedia storage file. Arrange first and then.
- the adjacent left-eye video source in the media data storage unit of the multimedia storage file corresponds to the time of the video frame of the right-eye video source.
- the time corresponding to the video frames corresponds to the same or similar time of the video frames (the interval is less than the preset threshold).
- the media data storage module 201 may store the video frames of the left and right eye video sources in the media data storage unit in the following order: the first frame video of the left eye video source, the first frame video of the right eye video source, and the left eye.
- the left and right eye video sources are obtained by simultaneously capturing the same scene from different angles. Therefore, the number of video frames of the left and right eye video sources is the same or similar, and the time of the video frames corresponding to the sequence numbers is also consistent.
- the video frame is a frame of video or a group of consecutive video frames.
- a unit consisting of a set of consecutive video frames is called a chunk.
- the media data storage module 201 may store the left-eye video source and the right-eye video source in a chronological order, and the adjacent left-eye video source and the right-eye video source correspond to the chunk time. Consistent.
- the media data storage module 201 may store the chunks of the left and right eye video sources in the media data storage unit in the following order: chunks in the 0 to 1 second of the left eye video source, and 0 to 1 ⁇ k in the right eye video source. Chun in seconds, chunk in 1 to 2 seconds of the left-eye video source, chunk in 1 ⁇ k to 2 ⁇ k seconds of the right-eye video source, where k is a preset threshold.
- the media information storage module 202 is configured to store the media information of the left-eye video source and the media information of the right-eye video source in different media information storage units of the multimedia storage file, respectively.
- the media information storage unit is a Track Box of the MP4 file.
- the media information includes time information of the video frame in the video source, location information, and codec information of the video frame.
- the location information of the video frame corresponding to the relevant time may be obtained according to the time information and the location information of the video frame, and read from the media data storage unit of the multimedia storage file according to the location information. Take video frame data. Further, the video frame data can be decoded according to the codec information.
- video frames of the left and right eye video sources are interleaved and stored in a chronological order in a media data storage unit of the multimedia storage file, and adjacent left-eye video sources and right-eye videos in the media data storage unit are provided.
- the time of the video frame of the source corresponds to the same.
- the video frames of the left and right eye video sources can be conveniently obtained from the continuous media stream of the multimedia storage file, so that the media stream data of the MP4 can be downloaded while being downloaded.
- the continuous media stream data acquires a real-time synthesized 3D video image of the video frames of the left and right eye video sources corresponding to the time, which satisfies the requirement of playing while playing the 3D video.
- the foregoing 3D video source storage device further includes an encoding module (not shown) for encoding the left-eye video source according to a preset format, and the right-eye video source of the video is in a preset format. Encode.
- the media data storage module 201 is configured to interleave the encoded video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file.
- the encoding module may encode the left eye video source and the right eye video source of the video according to a conventional video encoding format (eg, h.264 format). Further, the media data storage module 201 can store the encoded left and right eye video sources.
- a conventional video encoding format eg, h.264 format
- the above 3D video source storage method and device store the left eye video source and the right eye video source of the video in a multimedia storage file, and one video corresponds to one storage file, and the left and right eye video sources need not be stored in two files. In the middle, it is convenient to transfer and save video files, avoiding the loss of one file during transmission and saving, and the 3D video cannot be synthesized and played.
- the above 3D video source storage method and device store the video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file, and when playing the 3D video online, one side can be Downloading the continuous media stream data of the multimedia storage file, and synthesizing the video frames of the left and right eye video sources from the already downloaded media stream data, and synthesizing the 3D media files without downloading all the media stream data of the multimedia storage file.
- Video images which meet the need to play 3D video while downloading.
- the above 3D video source storage mode can facilitate the synthesis of the 3D video according to different formats according to the needs of the subsequent 3D video synthesis.
- the file can meet different 3D video synthesis needs without storing multiple video files of different composite formats. Therefore, the above method saves storage resources and saves transmission resources when video files need to be transmitted.
- a 3D video playing method includes the following steps:
- Step S301 Acquire a multimedia storage file storing a left-eye video source and a right-eye video source, and the video frames of the left-eye video source and the right-eye video source are interleaved and stored in the media data storage unit of the multimedia storage file in chronological order.
- the media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
- the multimedia storage file may be obtained according to the specified path, or the multimedia storage file may be downloaded according to the Internet address.
- the multimedia storage file can be an MP4 file, an MP5 file, or other specific types of files.
- the multimedia storage file is an MP4 file
- the media data storage unit is a Media Data of the MP4 file. Box.
- the video frames of the left-eye video source are arranged first to last in time in the media data storage unit of the multimedia storage file, and the video frames of the right-eye video source are first in time in the media data storage unit of the multimedia storage file. Arrange afterwards.
- the time of the adjacent left-eye video source and the video frame of the right-eye video source in the media data storage unit of the multimedia storage file are consistent.
- the time corresponding to the video frames corresponds to the same or similar time of the video frames (the interval is less than the preset threshold).
- Step S302 The media information of the left-eye video source and the media information of the right-eye video source are respectively read from the media information storage unit corresponding to the left-eye video source and the media information storage unit corresponding to the right-eye video source.
- the media information storage unit is a track of an MP4 file. Box.
- the media information includes time information of the video frame in the video source, location information, and codec information of the video frame.
- Step S303 Read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frames of the left-eye video source and the video of the right-eye video source that are consistent in time from the media data storage unit of the multimedia storage file. frame.
- the location information of the video frames corresponding to the left and right eye video sources may be obtained according to the time information and the location information of the video frames of the left and right eye video sources, respectively, according to the left and right eyes.
- the location information of the video frame of the video source reads the video frame data corresponding to the time from the media data storage unit of the multimedia storage file.
- Step S304 the video frames of the left-eye video source and the right-eye video source corresponding to the time are arranged in a preset manner to synthesize the 3D video image.
- the required 3D video image can be synthesized according to a conventional 3D video image synthesis method, such as a left-right arrangement, an up-and-down arrangement, a staggered arrangement, and the like, and a video frame in which the time of the left-eye video source and the right-eye video source are consistent.
- the left and right arrangement method arranges the video frame of the left-eye video source to the left, and the video frame of the right-eye video source to the right; the upper and lower arrangement manners the video frame of the left-eye video source to the upper side, and the right-eye video source
- the video frames are arranged below; the staggered arrangement staggers the pixel columns of the video frames of the left and right eye video sources.
- the format of 3D video images that can be played by different 3D playback devices is also different, and the synthesis mode of 3D video images can be selected according to the 3D playback device.
- video frames of the left and right eye video sources are interleaved and stored in a chronological order in a media data storage unit of the multimedia storage file, and adjacent left-eye video sources and right-eye videos in the media data storage unit are provided.
- the time of the video frame of the source corresponds to the same.
- the video frames of the left and right eye video sources can be conveniently obtained from the continuous media stream of the multimedia storage file, so that the media stream data of the MP4 can be downloaded while being downloaded.
- the continuous media stream data acquires a real-time synthesized 3D video image of the video frames of the left and right eye video sources corresponding to the time, which satisfies the requirement of playing while playing the 3D video.
- Step S305 playing the synthesized 3D video image.
- the left-eye video source and the right-eye video source are video sources encoded in a preset format.
- the above 3D video playing method further comprises the step of decoding the video frame data of the left-eye video source and the right-eye video source according to a format corresponding to the preset format.
- the specific process of step S304 is: arranging the video frames of the left-eye video source and the right-eye video source corresponding to the decoded time in a preset manner to synthesize the 3D video image.
- a 3D video playback device includes a file acquisition module 401, a media information acquisition module 402, a media data acquisition module 403, a synthesis module 404, and a playback module 405, where:
- the file obtaining module 401 is configured to obtain a multimedia storage file in which the left-eye video source and the right-eye video source are stored, and the video frames of the left-eye video source and the right-eye video source are sequentially chronologically stored in the media data storage unit of the multimedia storage file. in.
- the media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
- the file obtaining module 401 can obtain the multimedia storage file according to the specified path, or download the multimedia storage file according to the Internet address.
- the multimedia storage file can be an MP4 file, an MP5 file, or other specific types of files.
- the multimedia storage file is an MP4 file
- the media data storage unit is a Media Data of the MP4 file. Box.
- the video frames of the left-eye video source are arranged first to last in time in the media data storage unit of the multimedia storage file, and the video frames of the right-eye video source are first in time in the media data storage unit of the multimedia storage file. Arrange afterwards.
- the time of the adjacent left-eye video source and the video frame of the right-eye video source in the media data storage unit of the multimedia storage file are consistent.
- the time corresponding to the video frames corresponds to the same or similar time of the video frames (the interval is less than the preset threshold).
- the media information obtaining module 402 is configured to read the media information of the left-eye video source and the media information of the right-eye video source, respectively, from the media information storage unit corresponding to the left-eye video source and the media information storage unit corresponding to the right-eye video source.
- the media information storage unit is a track of an MP4 file. Box.
- the media information includes time information of the video frame in the video source, location information, and codec information of the video frame.
- the media data obtaining module 403 is configured to respectively read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frame and the right eye of the left-eye video source whose time is consistently consistent from the media data storage unit of the multimedia storage file.
- the video frame of the video source is configured to respectively read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frame and the right eye of the left-eye video source whose time is consistently consistent from the media data storage unit of the multimedia storage file.
- the media data acquiring module 403 may obtain the location information of the video frames corresponding to the left and right eye video sources according to the time information and the location information of the video frames of the left and right eye video sources, respectively.
- the video frame data corresponding to the time is read from the media data storage unit of the multimedia storage file according to the location information of the video frames of the left and right eye video sources.
- the synthesizing module 404 is configured to arrange the video frames of the left-eye video source and the right-eye video source whose time corresponds to each other in a preset manner to synthesize the 3D video image.
- the synthesizing module 404 can synthesize the required 3D video image by combining the video frames of the left-eye video source and the right-eye video source according to a conventional 3D video image synthesizing manner, such as a left-right arrangement, an up-and-down arrangement, a staggered arrangement, and the like.
- the left and right arrangement method arranges the video frame of the left-eye video source to the left, and the video frame of the right-eye video source to the right; the upper and lower arrangement manners the video frame of the left-eye video source to the upper side, and the right-eye video source
- the video frames are arranged below; the staggered arrangement staggers the pixel columns of the video frames of the left and right eye video sources.
- the format of the 3D video image that can be played by different 3D playback devices is also different, and the synthesizing module 404 can select the synthesis mode of the 3D video image according to the 3D playback device.
- video frames of the left and right eye video sources are interleaved and stored in a chronological order in a media data storage unit of the multimedia storage file, and adjacent left-eye video sources and right-eye videos in the media data storage unit are provided.
- the time of the video frame of the source corresponds to the same.
- the video frames of the left and right eye video sources can be conveniently obtained from the continuous media stream of the multimedia storage file, so that the media stream data of the MP4 can be downloaded while being downloaded.
- the continuous media stream data acquires a real-time synthesized 3D video image of the video frames of the left and right eye video sources corresponding to the time, which satisfies the requirement of playing while playing the 3D video.
- the play module 405 is for playing a synthesized 3D video image.
- the left-eye video source and the right-eye video source are video sources encoded in a preset format.
- the above 3D video playback apparatus further includes a decoding module (not shown) for decoding video frame data of the left-eye video source and the right-eye video source in a format corresponding to the preset format.
- the synthesizing module 404 is configured to arrange the video frames of the left-eye video source and the right-eye video source corresponding to the decoded time in a preset manner to synthesize the 3D video image.
- the above 3D video playing method and device reads a left-eye video source and a right-eye video source from a multimedia storage file, and synthesizes the video frames of the left and right-eye video sources whose times correspond to each other into a 3D video image.
- the above method does not need to read the left and right eye video sources from two files, and one video only corresponds to one video file, which can avoid the problem that one video file is lost and the 3D video cannot be synthesized and played in the process of acquiring the video. .
- the foregoing manner may read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frame and the right-eye video source of the left-eye video source that are consistent in time from the media data storage unit of the multimedia storage file.
- the video frame synthesizes the video frames of the left and right eye video sources with the same time into the 3D video image, and does not need to download all the media data of the multimedia storage file before performing the synthesizing operation, and can obtain the media data of the multimedia storage file.
- the 3D video image is synthesized at the same time, so as to satisfy the requirement of playing and playing while playing 3D video online.
- the above 3D video playing method and device can synthesize 3D video according to different formats of the left and right eye video sources, so as to meet the playing needs of different playing devices.
- the storage medium may be a magnetic disk, an optical disk, or a read-only storage memory (Read-Only) Memory, ROM) or Random Access Memory (RAM).
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Television Signal Processing For Recording (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Description
Claims (18)
- 一种3D视频源存储方法,包括以下步骤:将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
- 根据权利要求1所述的3D视频源存储方法,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致;所述媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
- 根据权利要求 1或 2 所述的 3D 视频源存储方法 , 其特征在于 , 所述多媒体存储文件为 MP4 文件 , 所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
- 一种3D视频源存储装置,其特征在于,包括:媒体数据存储模块,用于将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;媒体信息存储模块,用于将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
- 根据权利要求4所述的3D视频源存储装置,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致;所述媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
- 根据权利要求 4或 5 所述的 3D 视频源存储装置 , 其特征在于 , 所述多媒体存储文件为 MP4 文件 , 所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
- 一种3D视频播放方法,包括以下步骤:获取存储了左眼视频源和右眼视频源的多媒体存储文件,所述左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息;根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧;将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像;播放所述合成的3D视频图像。
- 根据权利要求7所述的3D视频播放方法,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。
- 根据权利要求7或8所述的3D视频播放方法,其特征在于,所述多媒体存储文件为MP4文件,所述媒体数据存储单元为MP4文件中的Media Data Box,所述媒体信息存储单元为MP4文件中的Track Box。
- 一种3D视频播放装置,其特征在于,包括:文件获取模块,用于获取存储了左眼视频源和右眼视频源的多媒体存储文件,所述左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;媒体信息获取模块,用于从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息;媒体数据获取模块,用于根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧;合成模块,用于将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像;播放模块,用于播放所述合成的3D视频图像。
- 根据权利要求10所述的3D视频播放方法,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。
- 根据权利要求 10或 11 所述的 3D 视频播放方法 ,其特征在于 , 所述多媒体存储文件为 MP4 文件 ,所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
- 一个或多个包含计算机可执行指令的计算机存储介质,所述计算机可执行指令用于执行一种3D视频源存储方法,其特征在于,所述方法包括以下步骤:将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
- 根据权利要求13所述的计算机存储介质,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致;所述媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
- 根据权利要求 13或 14 所述的计算机存储介质 , 其特征在于 , 所述多媒体存储文件为 MP4 文件 , 所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
- 一个或多个包含计算机可执行指令的计算机存储介质,所述计算机可执行指令用于执行一种3D视频播放方法,其特征在于,所述方法包括以下步骤:获取存储了左眼视频源和右眼视频源的多媒体存储文件,所述左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息;根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧;将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像;播放所述合成的3D视频图像。
- 根据权利要求16所述的计算机存储介质,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。
- 根据权利要求 16或 17 所述的计算机存储介质 , 其特征在于 , 所述多媒体存储文件为 MP4 文件 , 所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020147007133A KR101630720B1 (ko) | 2012-05-19 | 2013-04-09 | 3d 비디오 소스 저장 방법 및 장치와 3d 비디오 재생 방법 및 장치 |
| JP2014537486A JP5801497B2 (ja) | 2012-05-19 | 2013-04-09 | 3dビデオソース格納方法及び装置、及び3dビデオ再生方法及び装置 |
| US14/249,770 US20140219640A1 (en) | 2012-05-19 | 2014-04-10 | Method and apparatus for storing and playing 3d video source |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210156555.6 | 2012-05-19 | ||
| CN201210156555.6A CN103428463B (zh) | 2012-05-19 | 2012-05-19 | 3d视频源存储方法和装置及3d视频播放方法和装置 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/249,770 Continuation US20140219640A1 (en) | 2012-05-19 | 2014-04-10 | Method and apparatus for storing and playing 3d video source |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2013174181A1 true WO2013174181A1 (zh) | 2013-11-28 |
Family
ID=49623082
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2013/073968 Ceased WO2013174181A1 (zh) | 2012-05-19 | 2013-04-09 | 3d视频源存储方法和装置及3d视频播放方法和装置 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20140219640A1 (zh) |
| JP (1) | JP5801497B2 (zh) |
| KR (1) | KR101630720B1 (zh) |
| CN (1) | CN103428463B (zh) |
| WO (1) | WO2013174181A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113643685A (zh) * | 2021-08-18 | 2021-11-12 | 百度在线网络技术(北京)有限公司 | 数据处理方法、装置、电子设备及计算机存储介质 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1462981A (zh) * | 2002-05-27 | 2003-12-24 | 矽统科技股份有限公司 | 交错式立体影像的产生装置及方法 |
| WO2011083625A1 (ja) * | 2010-01-08 | 2011-07-14 | ソニー株式会社 | 画像処理装置、情報記録媒体、および画像処理方法、並びにプログラム |
| CN102137268A (zh) * | 2011-04-08 | 2011-07-27 | 清华大学 | 立体视频的行交错和棋盘格的渲染方法及装置 |
| CN102197655A (zh) * | 2009-06-10 | 2011-09-21 | Lg电子株式会社 | 暂停模式中的立体图像再现方法及使用该方法的立体图像再现装置 |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4490074B2 (ja) * | 2003-04-17 | 2010-06-23 | ソニー株式会社 | 立体視画像処理装置、立体視画像表示装置、立体視画像提供方法、および立体視画像処理システム |
| EP2001235B1 (en) * | 2007-06-08 | 2013-05-22 | Samsung Electronics Co., Ltd. | MPEG-4 format extension for recording stereoscopic or synthetic 3D video data with related metadata |
| ES2659717T3 (es) * | 2008-01-17 | 2018-03-19 | Panasonic Intellectual Property Management Co., Ltd. | Medio de grabación en el que se graba vídeo en 3D, aparato de grabación para grabar vídeo en 3D y dispositivo de reproducción y método para reproducir vídeo en 3D |
| JP2010088092A (ja) * | 2008-09-02 | 2010-04-15 | Panasonic Corp | 立体映像伝送システム、映像表示装置および映像出力装置 |
| US8369693B2 (en) * | 2009-03-27 | 2013-02-05 | Dell Products L.P. | Visual information storage methods and systems |
| JP2011082666A (ja) * | 2009-10-05 | 2011-04-21 | Sony Corp | 信号伝送方法、信号送信装置及び信号受信装置 |
| JP5482254B2 (ja) * | 2009-11-05 | 2014-05-07 | ソニー株式会社 | 受信装置、送信装置、通信システム、表示制御方法、プログラム、及びデータ構造 |
| JP2011142586A (ja) * | 2010-01-08 | 2011-07-21 | Sony Corp | 画像処理装置、情報記録媒体、および画像処理方法、並びにプログラム |
-
2012
- 2012-05-19 CN CN201210156555.6A patent/CN103428463B/zh active Active
-
2013
- 2013-04-09 KR KR1020147007133A patent/KR101630720B1/ko active Active
- 2013-04-09 WO PCT/CN2013/073968 patent/WO2013174181A1/zh not_active Ceased
- 2013-04-09 JP JP2014537486A patent/JP5801497B2/ja active Active
-
2014
- 2014-04-10 US US14/249,770 patent/US20140219640A1/en not_active Abandoned
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1462981A (zh) * | 2002-05-27 | 2003-12-24 | 矽统科技股份有限公司 | 交错式立体影像的产生装置及方法 |
| CN102197655A (zh) * | 2009-06-10 | 2011-09-21 | Lg电子株式会社 | 暂停模式中的立体图像再现方法及使用该方法的立体图像再现装置 |
| WO2011083625A1 (ja) * | 2010-01-08 | 2011-07-14 | ソニー株式会社 | 画像処理装置、情報記録媒体、および画像処理方法、並びにプログラム |
| CN102137268A (zh) * | 2011-04-08 | 2011-07-27 | 清华大学 | 立体视频的行交错和棋盘格的渲染方法及装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2015501590A (ja) | 2015-01-15 |
| KR101630720B1 (ko) | 2016-06-17 |
| JP5801497B2 (ja) | 2015-10-28 |
| KR20140057611A (ko) | 2014-05-13 |
| CN103428463B (zh) | 2016-10-12 |
| US20140219640A1 (en) | 2014-08-07 |
| CN103428463A (zh) | 2013-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5193291B2 (ja) | 2d映像メディア標準に基づいて3d映像ファイルを生成及び再生するためのシステム及び方法 | |
| CN102197655B (zh) | 暂停模式中的立体图像再现方法及使用该方法的立体图像再现装置 | |
| US20080252719A1 (en) | Apparatus, method, and system for generating stereo-scopic image file based on media standards | |
| JP2009135686A5 (zh) | ||
| JP6320366B2 (ja) | 2d映像メディア標準に基づいて3d立体映像ファイルを生成及び再生するシステム及び方法 | |
| JP2011223482A (ja) | 画像処理装置、画像処理方法、およびプログラム | |
| WO2016123057A1 (en) | Systems and methods for merging digital cinema packages for a multiscreen environment | |
| KR20120037208A (ko) | 3차원 영상 제공 및 처리 방법과 3차원 영상 제공 및 처리 장치 | |
| WO2012147354A1 (ja) | 映像処理装置及び映像処理方法 | |
| JP2011228862A (ja) | データ構造、画像処理装置、画像処理方法、およびプログラム | |
| JP2013093755A (ja) | 映像記録装置及び映像記録方法 | |
| CN102144395A (zh) | 高速搜索模式中的立体图像再现方法和使用该方法的立体图像再现装置 | |
| WO2013174181A1 (zh) | 3d视频源存储方法和装置及3d视频播放方法和装置 | |
| CN102342123B (zh) | 再现装置、再现方法、记录装置、记录方法、程序和数据结构 | |
| JP5778673B2 (ja) | コンテンツ配信システム、再生装置、配信サーバ、再生方法及び配信方法 | |
| JP2012249137A (ja) | 記録装置、記録方法、再生装置、再生方法、プログラム、および記録再生装置 | |
| JP2011146828A (ja) | データ構造、記録装置および記録方法、再生装置および再生方法、並びにプログラム | |
| JP3918114B2 (ja) | 立体映像2画面連結映像システム | |
| Wimmer | Stereoscopic player and stereoscopic multiplexer: a computer-based system for stereoscopic video playback and recording | |
| JP2002345000A (ja) | カラーグラス方式(rgb−3d方式)を利用した3d立体動画映像の生成方法及び装置 | |
| WO2003105490A1 (en) | Method and system for stereoscopic representation | |
| JP4594432B1 (ja) | 動画再生方法、動画再生システム、およびプログラム | |
| JP2005006266A (ja) | 3dビデオカメラ、3dビデオカメラ付き携帯電話及び3d再生グラス | |
| CN121603642A (zh) | 空间视频的生成方法、播放方法、装置、电子设备、存储介质和程序产品 | |
| Aas | 3D Video Production |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13793917 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 20147007133 Country of ref document: KR Kind code of ref document: A |
|
| ENP | Entry into the national phase |
Ref document number: 2014537486 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17/04/15) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 13793917 Country of ref document: EP Kind code of ref document: A1 |