WO2013174181A1 - 3d视频源存储方法和装置及3d视频播放方法和装置 - Google Patents

3d视频源存储方法和装置及3d视频播放方法和装置 Download PDF

Info

Publication number
WO2013174181A1
WO2013174181A1 PCT/CN2013/073968 CN2013073968W WO2013174181A1 WO 2013174181 A1 WO2013174181 A1 WO 2013174181A1 CN 2013073968 W CN2013073968 W CN 2013073968W WO 2013174181 A1 WO2013174181 A1 WO 2013174181A1
Authority
WO
WIPO (PCT)
Prior art keywords
video source
eye video
file
eye
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2013/073968
Other languages
English (en)
French (fr)
Inventor
赖晶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to KR1020147007133A priority Critical patent/KR101630720B1/ko
Priority to JP2014537486A priority patent/JP5801497B2/ja
Publication of WO2013174181A1 publication Critical patent/WO2013174181A1/zh
Priority to US14/249,770 priority patent/US20140219640A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189Recording image signals; Reproducing recorded image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor

Definitions

  • the present invention relates to multimedia technology, and in particular to a 3 A video source storage method and apparatus, and a 3D video playback method and apparatus, and a computer storage medium including instructions for executing a 3D video source storage method, and a computer storage including instructions for executing a 3D video playback method medium.
  • the generation of 3D images is due to the "visual shift".
  • the eyes of the person are about 6 cm apart from each other.
  • the two eyes are viewed from the left and right viewpoints.
  • the left eye will see the left side of the object, while the right eye will see her middle or right side.
  • the impressions on the left and right sides are combined and the final three-dimensional feeling is obtained.
  • the effect of obtaining a three-dimensional effect is "visual displacement."
  • 3D video sources In order to form a 3D image, one scene needs to capture two movies simultaneously, a left eye video source and a right eye video source.
  • Traditional methods of storing 3D video sources typically store left-eye video sources and right-eye video sources in separate files. When the 3D video is played, the left and right eye video sources are read from the two files, and the left and right video sources are further combined into a 3D video.
  • the left and right video sources are stored in two files respectively, and it is possible that the 3D video cannot be synthesized due to the loss of one of the files during the transmission and saving process, especially when the client plays the 3D video online while playing on the Internet.
  • the data can be read from the file to synthesize the 3D video, and then the 3D video can be played, which cannot meet the requirement of playing while downloading, so that the speed of playing the 3D video online is very slow.
  • a 3D video source storage method includes the following steps:
  • the media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
  • a 3D video source storage device includes:
  • a media data storage module configured to store video frames of the left-eye video source and the right-eye video source in a chronological order in a media data storage unit of the multimedia storage file
  • the media information storage module is configured to separately store the media information of the left-eye video source and the media information of the right-eye video source in different media information storage units of the multimedia storage file.
  • One or more computer storage media containing computer executable instructions for performing a 3D video source storage method comprising the steps of:
  • the media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
  • the above 3D video source storage method and apparatus and executable instructions for executing a 3D video source storage method in a computer storage medium store a left eye video source and a right eye video source of a video in a multimedia storage file, and a video corresponds to a video
  • the file is stored without storing the left and right eye video sources in two files, which facilitates the transmission and storage of the video file, and avoids the loss of one file during the transmission and saving process, so that the 3D video cannot be synthesized and played.
  • the above 3D video source storage method and device store the video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file, and when playing the 3D video online, one side can be Downloading the continuous media stream data of the multimedia storage file, and synthesizing the video frames of the left and right eye video sources from the already downloaded media stream data, and synthesizing the 3D media files without downloading all the media stream data of the multimedia storage file.
  • Video images which meet the need to play 3D video while downloading.
  • a 3D video playing method includes the following steps:
  • Reading according to the media information of the left-eye video source and the media information of the right-eye video source, the video frames of the left-eye video source and the video frames of the right-eye video source that are consistent in time from the media data storage unit of the multimedia storage file;
  • the video frames of the left-eye video source and the right-eye video source corresponding to the time are arranged in a preset manner to synthesize the 3D video image;
  • the synthesized 3D video image is played.
  • a 3D video playback device comprising:
  • a file obtaining module configured to acquire a multimedia storage file storing a left-eye video source and a right-eye video source, where the video frames of the left-eye video source and the right-eye video source are interleaved and stored in the media data of the multimedia storage file in chronological order In the storage unit;
  • the media information obtaining module is configured to read the media information of the left-eye video source and the media information of the right-eye video source, respectively, from the media information storage unit corresponding to the left-eye video source and the media information storage unit corresponding to the right-eye video source;
  • a media data obtaining module configured to read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frame and the right eye of the left-eye video source with corresponding time correspondingly from the media data storage unit of the multimedia storage file Video frame of the video source;
  • a synthesizing module configured to arrange video frames of a left-eye video source and a video source of a right-eye video source that are consistent in time according to a preset manner to synthesize a 3D video image
  • a playing module for playing the synthesized 3D video image.
  • One or more computer storage media containing computer executable instructions for performing a 3D video playback method comprising the steps of:
  • Reading according to the media information of the left-eye video source and the media information of the right-eye video source, the video frames of the left-eye video source and the video frames of the right-eye video source that are consistent in time from the media data storage unit of the multimedia storage file;
  • the video frames of the left-eye video source and the right-eye video source corresponding to the time are arranged in a preset manner to synthesize the 3D video image;
  • the synthesized 3D video image is played.
  • the above 3D video playing method and device and the executable instruction for executing the 3D video playing method in the computer storage medium can be read from the media data storage unit of the multimedia storage file according to the media information of the left eye video source and the media information of the right eye video source.
  • the video frame corresponding to the consistent left-eye video source and the video frame of the right-eye video source are taken, and the video frames of the left and right-eye video sources corresponding to the time are combined into a 3D video image, and all media data of the multimedia storage file are not required.
  • the download is completed, the synthesis operation is performed, and the 3D video image can be synthesized while obtaining the media data of the multimedia storage file, thereby satisfying the requirement of playing and playing while playing the 3D video online.
  • FIG. 1 is a schematic flow chart of a 3D video source storage method in an embodiment
  • FIG. 2 is a schematic structural diagram of a 3D video source storage device in an embodiment
  • 3 is a schematic flow chart of a 3D video playing method in an embodiment
  • FIG. 4 is a schematic structural diagram of a 3D video playback device in an embodiment.
  • a 3D video source storage method includes the following steps:
  • Step S101 The video frames of the left-eye video source and the right-eye video source are interleaved and stored in the media data storage unit of the multimedia storage file in chronological order.
  • the multimedia storage file can be an MP4 file, an MP5 file, or other specific types of files.
  • the multimedia storage file is an MP4 file
  • the media data storage unit is a Media Data of the MP4 file. Box.
  • the MP4 file is installed in the box (atom in QuickTime), that is to say, the MP4 file is composed of several boxes, each box has a type and a length, and the box can be understood as a data object block.
  • the box can contain another box, this box is called container Box.
  • the MP4 file contains one and only one "moov” type of box ( Movie Box ) It is a container box, the subbox contains information about the media data of the MP4 file, and the related information of the media data is referred to as media information.
  • Track Box is a sub-box of "moov", each Track Box Contains media information for a single video stream.
  • Another type of box for MP4 files is the “mdat” type of box (Media Data Box).
  • Media Data The box contains media data of the multimedia storage file. The structure of the media data is described by the media information contained in the Movie Box.
  • the video frames of the left-eye video source are arranged in a media data storage unit of the multimedia storage file according to time from first to last, and the video frames of the right-eye video source are time-dependent in the media data storage unit of the multimedia storage file. Arrange first and then.
  • the adjacent left-eye video source in the media data storage unit of the multimedia storage file corresponds to the time of the video frame of the right-eye video source.
  • the time corresponding to the video frames corresponds to the same or similar time of the video frames (the interval is less than the preset threshold).
  • the video frames of the left and right eye video sources may be stored in the media data storage unit in the following order: the first frame video of the left eye video source, the first frame video of the right eye video source, and the second frame of the left eye video source.
  • the left and right eye video sources are obtained by simultaneously capturing the same scene from different angles. Therefore, the number of video frames of the left and right eye video sources is the same or similar, and the time of the video frames corresponding to the sequence numbers is also consistent.
  • the video frame is a frame of video or a group of consecutive video frames.
  • a unit consisting of a set of consecutive video frames is called a chunk.
  • the chunks of the left-eye video source and the right-eye video source may be interleaved in chronological order, and the adjacent left-eye video source and the right-eye video source have the same time.
  • the chunks of the left and right eye video sources may be stored in the media data storage unit in the following order: chunks within 0 to 1 second of the left eye video source, chunks within 0 to 1 ⁇ k seconds of the right eye video source, The chunk within 1 to 2 seconds of the left-eye video source, and the chunk of the right-eye video source within 1 ⁇ k to 2 ⁇ k seconds, where k is a preset threshold.
  • Step S102 The media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
  • the media information storage unit is a Track Box of the MP4 file.
  • the media information includes time information of the video frame in the video source, location information, and codec information of the video frame.
  • the location information of the video frame corresponding to the relevant time may be obtained according to the time information and the location information of the video frame, and read from the media data storage unit of the multimedia storage file according to the location information. Take video frame data. Further, the video frame data can be decoded according to the codec information.
  • video frames of the left and right eye video sources are interleaved and stored in a chronological order in a media data storage unit of the multimedia storage file, and adjacent left-eye video sources and right-eye videos in the media data storage unit are provided.
  • the time of the video frame of the source corresponds to the same.
  • the video frames of the left and right eye video sources can be conveniently obtained from the continuous media stream of the multimedia storage file, so that the media stream data of the MP4 can be downloaded while being downloaded.
  • the continuous media stream data acquires a real-time synthesized 3D video image of the video frames of the left and right eye video sources corresponding to the time, which satisfies the requirement of playing while playing the 3D video.
  • the foregoing 3D video source storage method further includes the steps of: encoding the left-eye video source according to a preset format, and encoding the right-eye video source of the video according to a preset format.
  • step S101 is: interleaving the encoded video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file.
  • the left-eye video source and the right-eye video source of the video may be encoded according to a conventional video encoding format (such as the h264 format). Further, the encoded left and right eye video sources can be stored.
  • a conventional video encoding format such as the h264 format.
  • a 3D video source storage device includes a media data storage module 201 and a media information storage module 202, wherein:
  • the media data storage module 201 is configured to store the video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file.
  • the multimedia storage file can be an MP4 file, an MP5 file, or other specific types of files.
  • the multimedia storage file is an MP4 file
  • the media data storage unit is a Media Data of the MP4 file. Box.
  • the video frames of the left-eye video source are arranged in a media data storage unit of the multimedia storage file according to time from first to last, and the video frames of the right-eye video source are time-dependent in the media data storage unit of the multimedia storage file. Arrange first and then.
  • the adjacent left-eye video source in the media data storage unit of the multimedia storage file corresponds to the time of the video frame of the right-eye video source.
  • the time corresponding to the video frames corresponds to the same or similar time of the video frames (the interval is less than the preset threshold).
  • the media data storage module 201 may store the video frames of the left and right eye video sources in the media data storage unit in the following order: the first frame video of the left eye video source, the first frame video of the right eye video source, and the left eye.
  • the left and right eye video sources are obtained by simultaneously capturing the same scene from different angles. Therefore, the number of video frames of the left and right eye video sources is the same or similar, and the time of the video frames corresponding to the sequence numbers is also consistent.
  • the video frame is a frame of video or a group of consecutive video frames.
  • a unit consisting of a set of consecutive video frames is called a chunk.
  • the media data storage module 201 may store the left-eye video source and the right-eye video source in a chronological order, and the adjacent left-eye video source and the right-eye video source correspond to the chunk time. Consistent.
  • the media data storage module 201 may store the chunks of the left and right eye video sources in the media data storage unit in the following order: chunks in the 0 to 1 second of the left eye video source, and 0 to 1 ⁇ k in the right eye video source. Chun in seconds, chunk in 1 to 2 seconds of the left-eye video source, chunk in 1 ⁇ k to 2 ⁇ k seconds of the right-eye video source, where k is a preset threshold.
  • the media information storage module 202 is configured to store the media information of the left-eye video source and the media information of the right-eye video source in different media information storage units of the multimedia storage file, respectively.
  • the media information storage unit is a Track Box of the MP4 file.
  • the media information includes time information of the video frame in the video source, location information, and codec information of the video frame.
  • the location information of the video frame corresponding to the relevant time may be obtained according to the time information and the location information of the video frame, and read from the media data storage unit of the multimedia storage file according to the location information. Take video frame data. Further, the video frame data can be decoded according to the codec information.
  • video frames of the left and right eye video sources are interleaved and stored in a chronological order in a media data storage unit of the multimedia storage file, and adjacent left-eye video sources and right-eye videos in the media data storage unit are provided.
  • the time of the video frame of the source corresponds to the same.
  • the video frames of the left and right eye video sources can be conveniently obtained from the continuous media stream of the multimedia storage file, so that the media stream data of the MP4 can be downloaded while being downloaded.
  • the continuous media stream data acquires a real-time synthesized 3D video image of the video frames of the left and right eye video sources corresponding to the time, which satisfies the requirement of playing while playing the 3D video.
  • the foregoing 3D video source storage device further includes an encoding module (not shown) for encoding the left-eye video source according to a preset format, and the right-eye video source of the video is in a preset format. Encode.
  • the media data storage module 201 is configured to interleave the encoded video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file.
  • the encoding module may encode the left eye video source and the right eye video source of the video according to a conventional video encoding format (eg, h.264 format). Further, the media data storage module 201 can store the encoded left and right eye video sources.
  • a conventional video encoding format eg, h.264 format
  • the above 3D video source storage method and device store the left eye video source and the right eye video source of the video in a multimedia storage file, and one video corresponds to one storage file, and the left and right eye video sources need not be stored in two files. In the middle, it is convenient to transfer and save video files, avoiding the loss of one file during transmission and saving, and the 3D video cannot be synthesized and played.
  • the above 3D video source storage method and device store the video frames of the left-eye video source and the right-eye video source in a chronological order in the media data storage unit of the multimedia storage file, and when playing the 3D video online, one side can be Downloading the continuous media stream data of the multimedia storage file, and synthesizing the video frames of the left and right eye video sources from the already downloaded media stream data, and synthesizing the 3D media files without downloading all the media stream data of the multimedia storage file.
  • Video images which meet the need to play 3D video while downloading.
  • the above 3D video source storage mode can facilitate the synthesis of the 3D video according to different formats according to the needs of the subsequent 3D video synthesis.
  • the file can meet different 3D video synthesis needs without storing multiple video files of different composite formats. Therefore, the above method saves storage resources and saves transmission resources when video files need to be transmitted.
  • a 3D video playing method includes the following steps:
  • Step S301 Acquire a multimedia storage file storing a left-eye video source and a right-eye video source, and the video frames of the left-eye video source and the right-eye video source are interleaved and stored in the media data storage unit of the multimedia storage file in chronological order.
  • the media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
  • the multimedia storage file may be obtained according to the specified path, or the multimedia storage file may be downloaded according to the Internet address.
  • the multimedia storage file can be an MP4 file, an MP5 file, or other specific types of files.
  • the multimedia storage file is an MP4 file
  • the media data storage unit is a Media Data of the MP4 file. Box.
  • the video frames of the left-eye video source are arranged first to last in time in the media data storage unit of the multimedia storage file, and the video frames of the right-eye video source are first in time in the media data storage unit of the multimedia storage file. Arrange afterwards.
  • the time of the adjacent left-eye video source and the video frame of the right-eye video source in the media data storage unit of the multimedia storage file are consistent.
  • the time corresponding to the video frames corresponds to the same or similar time of the video frames (the interval is less than the preset threshold).
  • Step S302 The media information of the left-eye video source and the media information of the right-eye video source are respectively read from the media information storage unit corresponding to the left-eye video source and the media information storage unit corresponding to the right-eye video source.
  • the media information storage unit is a track of an MP4 file. Box.
  • the media information includes time information of the video frame in the video source, location information, and codec information of the video frame.
  • Step S303 Read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frames of the left-eye video source and the video of the right-eye video source that are consistent in time from the media data storage unit of the multimedia storage file. frame.
  • the location information of the video frames corresponding to the left and right eye video sources may be obtained according to the time information and the location information of the video frames of the left and right eye video sources, respectively, according to the left and right eyes.
  • the location information of the video frame of the video source reads the video frame data corresponding to the time from the media data storage unit of the multimedia storage file.
  • Step S304 the video frames of the left-eye video source and the right-eye video source corresponding to the time are arranged in a preset manner to synthesize the 3D video image.
  • the required 3D video image can be synthesized according to a conventional 3D video image synthesis method, such as a left-right arrangement, an up-and-down arrangement, a staggered arrangement, and the like, and a video frame in which the time of the left-eye video source and the right-eye video source are consistent.
  • the left and right arrangement method arranges the video frame of the left-eye video source to the left, and the video frame of the right-eye video source to the right; the upper and lower arrangement manners the video frame of the left-eye video source to the upper side, and the right-eye video source
  • the video frames are arranged below; the staggered arrangement staggers the pixel columns of the video frames of the left and right eye video sources.
  • the format of 3D video images that can be played by different 3D playback devices is also different, and the synthesis mode of 3D video images can be selected according to the 3D playback device.
  • video frames of the left and right eye video sources are interleaved and stored in a chronological order in a media data storage unit of the multimedia storage file, and adjacent left-eye video sources and right-eye videos in the media data storage unit are provided.
  • the time of the video frame of the source corresponds to the same.
  • the video frames of the left and right eye video sources can be conveniently obtained from the continuous media stream of the multimedia storage file, so that the media stream data of the MP4 can be downloaded while being downloaded.
  • the continuous media stream data acquires a real-time synthesized 3D video image of the video frames of the left and right eye video sources corresponding to the time, which satisfies the requirement of playing while playing the 3D video.
  • Step S305 playing the synthesized 3D video image.
  • the left-eye video source and the right-eye video source are video sources encoded in a preset format.
  • the above 3D video playing method further comprises the step of decoding the video frame data of the left-eye video source and the right-eye video source according to a format corresponding to the preset format.
  • the specific process of step S304 is: arranging the video frames of the left-eye video source and the right-eye video source corresponding to the decoded time in a preset manner to synthesize the 3D video image.
  • a 3D video playback device includes a file acquisition module 401, a media information acquisition module 402, a media data acquisition module 403, a synthesis module 404, and a playback module 405, where:
  • the file obtaining module 401 is configured to obtain a multimedia storage file in which the left-eye video source and the right-eye video source are stored, and the video frames of the left-eye video source and the right-eye video source are sequentially chronologically stored in the media data storage unit of the multimedia storage file. in.
  • the media information of the left-eye video source and the media information of the right-eye video source are respectively stored in different media information storage units of the multimedia storage file.
  • the file obtaining module 401 can obtain the multimedia storage file according to the specified path, or download the multimedia storage file according to the Internet address.
  • the multimedia storage file can be an MP4 file, an MP5 file, or other specific types of files.
  • the multimedia storage file is an MP4 file
  • the media data storage unit is a Media Data of the MP4 file. Box.
  • the video frames of the left-eye video source are arranged first to last in time in the media data storage unit of the multimedia storage file, and the video frames of the right-eye video source are first in time in the media data storage unit of the multimedia storage file. Arrange afterwards.
  • the time of the adjacent left-eye video source and the video frame of the right-eye video source in the media data storage unit of the multimedia storage file are consistent.
  • the time corresponding to the video frames corresponds to the same or similar time of the video frames (the interval is less than the preset threshold).
  • the media information obtaining module 402 is configured to read the media information of the left-eye video source and the media information of the right-eye video source, respectively, from the media information storage unit corresponding to the left-eye video source and the media information storage unit corresponding to the right-eye video source.
  • the media information storage unit is a track of an MP4 file. Box.
  • the media information includes time information of the video frame in the video source, location information, and codec information of the video frame.
  • the media data obtaining module 403 is configured to respectively read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frame and the right eye of the left-eye video source whose time is consistently consistent from the media data storage unit of the multimedia storage file.
  • the video frame of the video source is configured to respectively read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frame and the right eye of the left-eye video source whose time is consistently consistent from the media data storage unit of the multimedia storage file.
  • the media data acquiring module 403 may obtain the location information of the video frames corresponding to the left and right eye video sources according to the time information and the location information of the video frames of the left and right eye video sources, respectively.
  • the video frame data corresponding to the time is read from the media data storage unit of the multimedia storage file according to the location information of the video frames of the left and right eye video sources.
  • the synthesizing module 404 is configured to arrange the video frames of the left-eye video source and the right-eye video source whose time corresponds to each other in a preset manner to synthesize the 3D video image.
  • the synthesizing module 404 can synthesize the required 3D video image by combining the video frames of the left-eye video source and the right-eye video source according to a conventional 3D video image synthesizing manner, such as a left-right arrangement, an up-and-down arrangement, a staggered arrangement, and the like.
  • the left and right arrangement method arranges the video frame of the left-eye video source to the left, and the video frame of the right-eye video source to the right; the upper and lower arrangement manners the video frame of the left-eye video source to the upper side, and the right-eye video source
  • the video frames are arranged below; the staggered arrangement staggers the pixel columns of the video frames of the left and right eye video sources.
  • the format of the 3D video image that can be played by different 3D playback devices is also different, and the synthesizing module 404 can select the synthesis mode of the 3D video image according to the 3D playback device.
  • video frames of the left and right eye video sources are interleaved and stored in a chronological order in a media data storage unit of the multimedia storage file, and adjacent left-eye video sources and right-eye videos in the media data storage unit are provided.
  • the time of the video frame of the source corresponds to the same.
  • the video frames of the left and right eye video sources can be conveniently obtained from the continuous media stream of the multimedia storage file, so that the media stream data of the MP4 can be downloaded while being downloaded.
  • the continuous media stream data acquires a real-time synthesized 3D video image of the video frames of the left and right eye video sources corresponding to the time, which satisfies the requirement of playing while playing the 3D video.
  • the play module 405 is for playing a synthesized 3D video image.
  • the left-eye video source and the right-eye video source are video sources encoded in a preset format.
  • the above 3D video playback apparatus further includes a decoding module (not shown) for decoding video frame data of the left-eye video source and the right-eye video source in a format corresponding to the preset format.
  • the synthesizing module 404 is configured to arrange the video frames of the left-eye video source and the right-eye video source corresponding to the decoded time in a preset manner to synthesize the 3D video image.
  • the above 3D video playing method and device reads a left-eye video source and a right-eye video source from a multimedia storage file, and synthesizes the video frames of the left and right-eye video sources whose times correspond to each other into a 3D video image.
  • the above method does not need to read the left and right eye video sources from two files, and one video only corresponds to one video file, which can avoid the problem that one video file is lost and the 3D video cannot be synthesized and played in the process of acquiring the video. .
  • the foregoing manner may read, according to the media information of the left-eye video source and the media information of the right-eye video source, the video frame and the right-eye video source of the left-eye video source that are consistent in time from the media data storage unit of the multimedia storage file.
  • the video frame synthesizes the video frames of the left and right eye video sources with the same time into the 3D video image, and does not need to download all the media data of the multimedia storage file before performing the synthesizing operation, and can obtain the media data of the multimedia storage file.
  • the 3D video image is synthesized at the same time, so as to satisfy the requirement of playing and playing while playing 3D video online.
  • the above 3D video playing method and device can synthesize 3D video according to different formats of the left and right eye video sources, so as to meet the playing needs of different playing devices.
  • the storage medium may be a magnetic disk, an optical disk, or a read-only storage memory (Read-Only) Memory, ROM) or Random Access Memory (RAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Television Signal Processing For Recording (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Description

3D视频源存储方法和装置及3D视频播放方法和装置
本申请要求于 2012 年 5 月 19 日提交中国专利局、申请号为 201210156555.6 、发明名称为' 3D 视频源存储方法和装置及 3D 视频播放方法和装置 '的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
【技术领域】
本发明涉及多媒体技术,特别的涉及一种3 D视频源存储方法和装置及3D视频播放方法和装置、以及一种包含用于执行3D视频源存储方法的指令的计算机存储介质、以及一种包含用于执行3D视频播放方法的指令的计算机存储介质。
【背景技术】
3D影像的产生归结起来是“视觉移位”的原因。人的两眼左右相隔大约6厘米,观看物体时,两只眼睛是从左右两个视点分别观看的。左眼将看到物体的左侧,而右眼则会看到她的中间或右侧。当两眼看到的物体在视网膜上成像时,左右两面的印象合起来,就会得到最后的立体感觉。而这种获得立体感的效应就是“视觉位移”。
基于上述原理,拍摄影像时,只要用两台摄影机模拟左右两眼视差,分别拍摄两条影片,然后将这两条影片同时放映到银幕上,放映时加入必要的技术手段,让观众左眼只能看到左眼图像,右眼只能看到右眼图像。最后两幅图像经过大脑叠合后,我们就能看到具有立体纵深感的画面。
为了形成3D影像,一个场景需要同时拍摄两个影片,即左眼视频源和右眼视频源。传统的存储3D视频源的方法一般将左眼视频源和右眼视频源分别存储在不同的文件中。播放3D视频时,从两个文件中读取出左、右眼视频源,进一步将左、右视频源合成3D视频。
将左、右视频源分别存储在两个文件中,有可能在传输和保存过程中由于其中一个文件丢失而导致不能合成3D视频,尤其是在Internet中播放客户端在线播放3D视频时,需要将两个文件都下载完后,才能从文件中读取数据合成3D视频,进而播放3D视频,不能满足边下载边播放的需求,使得在线播放3D视频的速度很慢。
【发明内容】
基于此,有必要提供一种能将左、右眼视频源存储在一个文件中且能满足在线播放时边下载边播放需求的3D视频源存储方法。
一种3D视频源存储方法,包括以下步骤:
将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
基于此,还有必要提供一种能将左、右眼视频源存储在一个文件中且能满足在线播放时边下载边播放需求的3D视频源存储装置。
一种3D视频源存储装置,包括:
媒体数据存储模块,用于将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
媒体信息存储模块,用于将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
此外,还提供一种计算机存储介质。
一个或多个包含计算机可执行指令的计算机存储介质,所述计算机可执行指令用于执行一种3D视频源存储方法,其特征在于,所述方法包括以下步骤:
将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
上述3D视频源存储方法和装置以及计算机存储介质中用于执行3D视频源存储方法的可执行指令,将视频的左眼视频源与右眼视频源存储在一个多媒体存储文件中,一段视频对应一个存储文件,不需要将左、右眼视频源存储在两个文件中,可方便视频文件的传输和保存,避免在传输和保存过程中一个文件丢失而导致3D视频不能合成和播放。另外,上述3D视频源存储方法和装置,将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中,当在线播放3D视频时,可一边下载多媒体存储文件的连续的媒体流数据,一边从已经下载的媒体流数据中获取左、右眼视频源的视频帧进行合成,不需要多媒体存储文件的所有媒体流数据都下载完成后再合成3D视频图像,从而可满足边下载边播放3D视频的需求。
基于此,还有必要提供一种能满足在线播放时边下载边播放需求的3D视频播放方法。
一种3D视频播放方法,包括以下步骤:
获取存储了左眼视频源和右眼视频源的多媒体存储文件,所述左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息;
根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧;
将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像;
播放所述合成的3D视频图像。
基于此,还有必要提供一种能满足在线播放时边下载边播放需求的3D视频播放装置。
一种3D视频播放装置,包括:
文件获取模块,用于获取存储了左眼视频源和右眼视频源的多媒体存储文件,所述左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
媒体信息获取模块,用于从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息;
媒体数据获取模块,用于根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧;
合成模块,用于将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像;
播放模块,用于播放所述合成的3D视频图像。
此外,还提供一种计算机存储介质。
一个或多个包含计算机可执行指令的计算机存储介质,所述计算机可执行指令用于执行一种3D视频播放方法,其特征在于,所述方法包括以下步骤:
获取存储了左眼视频源和右眼视频源的多媒体存储文件,所述左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息;
根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧;
将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像;
播放所述合成的3D视频图像。
上述3D视频播放方法和装置以及计算机存储介质中执行3D视频播放方法的可执行指令,可根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧,将时间对应一致的左、右眼视频源的视频帧合成3D视频图像,不需要将多媒体存储文件的所有媒体数据都下载完成后再进行合成操作,可边获取多媒体存储文件的媒体数据边合成3D视频图像,从而可满足在线播放3D视频时边下载边播放的需求。
【附图说明】
图1为一个实施例中的3D视频源存储方法的流程示意图;
图2为一个实施例中的3D视频源存储装置的结构示意图;
图3为一个实施例中的3D视频播放方法的流程示意图;
图4为一个实施例中的3D视频播放装置的结构示意图。
【具体实施方式】
如图1所示,在一个实施例中,一种3D视频源存储方法,包括以下步骤:
步骤S101,将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中。
多媒体存储文件可为MP4文件、MP5文件或其他特定类型的文件等。
在一个实施例中,多媒体存储文件为MP4文件,媒体数据存储单元是MP4文件的Media Data Box。
MP4文件中的所有数据都装在box(QuickTime中为atom)中,也就是说MP4文件由若干个box组成,每个box有类型和长度,可以将box理解为一个数据对象块。box中可以包含另一个box,这种box称为container box。
MP4文件包含一个且只包含一个“moov”类型的box ( Movie Box ) ,它是一种container box,子box包含了MP4文件的媒体数据的相关信息,下文中媒体数据的相关信息简称为媒体信息。Track Box为“moov”的一种子box,每个 Track Box 中包含一个单独视频流的媒体信息。MP4文件的另外一种类型的box为“mdat”类型的box(Media Data Box)。Media Data Box中包含多媒体存储文件的媒体数据。媒体数据的结构由Movie Box包含的媒体信息进行描述。
具体的,左眼视频源的视频帧在多媒体存储文件的媒体数据存储单元中按照时间由先到后排列,右眼视频源的视频帧在所述多媒体存储文件的媒体数据存储单元中按照时间由先到后排列。
在一个实施例中,多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。视频帧的时间对应一致表示视频帧的时间相同或相近(间隔小于预设阈值)。
例如,可在媒体数据存储单元中按照以下顺序存储左、右眼视频源的视频帧:左眼视频源的第一帧视频、右眼视频源的第一帧视频、左眼视频源的第二帧视频、右眼视频源的第二帧视频……。左、右眼视频源是对同一场景从不同角度同时拍摄得到的,因此,左、右眼视频源的视频帧数量相同或相近,其中,序号对应的视频帧的时间也对应一致。
在一个实施例中,视频帧为一帧视频或一组连续视频帧。一组连续视频帧构成的单元称为chunk。在一个实施例中,可将左眼视频源与右眼视频源的chunk按时间先后顺序进行交错存储,且相邻的左眼视频源与右眼视频源的chunk的时间对应一致。
例如,可在媒体数据存储单元中按照以下顺序存储左、右眼视频源的chunk:左眼视频源的0~1秒内的chunk、右眼视频源的0~1±k秒内的chunk、左眼视频源的1~2秒内的chunk、右眼视频源的1±k~2±k秒内的chunk、……,其中,k为预设阈值。
步骤S102,将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
在一个实施例中,媒体信息存储单元为MP4文件的Track Box。
具体的,媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
当需要获取左、右眼视频源的视频帧时,可根据视频帧的时间信息和位置信息,获取相关时间对应的视频帧的位置信息,根据位置信息从多媒体存储文件的媒体数据存储单元中读取视频帧数据。进一步的,可根据编解码信息将视频帧数据进行解码。
本实施例中,将左、右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中,并使媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。在合成3D视频时,可方便的从多媒体存储文件的连续的媒体流中获取到左、右眼视频源的时间对应一致的视频帧,从而可边下载MP4的媒体流数据,边从下载到的连续的媒体流数据中获取时间对应一致的左、右眼视频源的视频帧实时的合成3D视频图像,满足在线播放3D视频时边下载边播放的需求。
在一个实施例中,在步骤S101之前,上述3D视频源存储方法还包括步骤:将左眼视频源按照预设格式进行编码,并将视频的右眼视频源按照预设格式进行编码。
本实施例中,步骤S101的具体过程为:将编码后的左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中。
具体的,可将视频的左眼视频源和右眼视频源分别按照传统的视频编码格式(如h264格式)进行编码。进一步的,可将编码后的左、右眼视频源进行存储。
如图2所示,在一个实施例中,一种3D视频源存储装置,包括媒体数据存储模块201、媒体信息存储模块202,其中:
媒体数据存储模块201用于将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中。
多媒体存储文件可为MP4文件、MP5文件或其他特定类型的文件等。
在一个实施例中,多媒体存储文件为MP4文件,媒体数据存储单元是MP4文件的Media Data Box。
具体的,左眼视频源的视频帧在多媒体存储文件的媒体数据存储单元中按照时间由先到后排列,右眼视频源的视频帧在所述多媒体存储文件的媒体数据存储单元中按照时间由先到后排列。
在一个实施例中,多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。视频帧的时间对应一致表示视频帧的时间相同或相近(间隔小于预设阈值)。
例如,媒体数据存储模块201可在媒体数据存储单元中按照以下顺序存储左、右眼视频源的视频帧:左眼视频源的第一帧视频、右眼视频源的第一帧视频、左眼视频源的第二帧视频、右眼视频源的第二帧视频……。左、右眼视频源是对同一场景从不同角度同时拍摄得到的,因此,左、右眼视频源的视频帧数量相同或相近,其中,序号对应的视频帧的时间也对应一致。
在一个实施例中,视频帧为一帧视频或一组连续视频帧。一组连续视频帧构成的单元称为chunk。在一个实施例中,媒体数据存储模块201可将左眼视频源与右眼视频源的chunk按时间先后顺序进行交错存储,且相邻的左眼视频源与右眼视频源的chunk的时间对应一致。
例如,媒体数据存储模块201可在媒体数据存储单元中按照以下顺序存储左、右眼视频源的chunk:左眼视频源的0~1秒内的chunk、右眼视频源的0~1±k秒内的chunk、左眼视频源的1~2秒内的chunk、右眼视频源的1±k~2±k秒内的chunk、……,其中,k为预设阈值。
媒体信息存储模块202用于将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
在一个实施例中,媒体信息存储单元为MP4文件的Track Box。
具体的,媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
当需要获取左、右眼视频源的视频帧时,可根据视频帧的时间信息和位置信息,获取相关时间对应的视频帧的位置信息,根据位置信息从多媒体存储文件的媒体数据存储单元中读取视频帧数据。进一步的,可根据编解码信息将视频帧数据进行解码。
本实施例中,将左、右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中,并使媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。在合成3D视频时,可方便的从多媒体存储文件的连续的媒体流中获取到左、右眼视频源的时间对应一致的视频帧,从而可边下载MP4的媒体流数据,边从下载到的连续的媒体流数据中获取时间对应一致的左、右眼视频源的视频帧实时的合成3D视频图像,满足在线播放3D视频时边下载边播放的需求。
在一个实施例中,上述3D视频源存储装置还包括编码模块(图中未示出),用于将左眼视频源按照预设格式进行编码,并将视频的右眼视频源按照预设格式进行编码。
本实施例中,媒体数据存储模块201用于将编码后的左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中。
具体的,编码模块可将视频的左眼视频源和右眼视频源分别按照传统的视频编码格式(如h.264格式)进行编码。进一步的,媒体数据存储模块201可将编码后的左、右眼视频源进行存储。
上述3D视频源存储方法和装置,将视频的左眼视频源与右眼视频源存储在一个多媒体存储文件中,一段视频对应一个存储文件,不需要将左、右眼视频源存储在两个文件中,可方便视频文件的传输和保存,避免在传输和保存过程中一个文件丢失而导致3D视频不能合成和播放。
另外,上述3D视频源存储方法和装置,将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中,当在线播放3D视频时,可一边下载多媒体存储文件的连续的媒体流数据,一边从已经下载的媒体流数据中获取左、右眼视频源的视频帧进行合成,不需要多媒体存储文件的所有媒体流数据都下载完成后再合成3D视频图像,从而可满足边下载边播放3D视频的需求。
其次,相对于将左、右视频按照某一固定格式合成3D视频后再存储的方式,上述3D视频源存储方式,可方便后续进行3D视频合成时根据需要按照不同的格式合成3D视频,一个视频文件可满足不同的3D视频合成需要,而不需要存储多个不同合成格式的视频文件,因此,上述方式更加节省存储资源,当需要传输视频文件时,还可节约传输资源。
如图3所示,在一个实施例中,一种3D视频播放方法,包括以下步骤:
步骤S301,获取存储了左眼视频源和右眼视频源的多媒体存储文件,左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中。左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
具体的,可根据指定路径获取多媒体存储文件,或根据Internet地址下载多媒体存储文件。
多媒体存储文件可为MP4文件、MP5文件或其他特定类型的文件等。
在一个实施例中,多媒体存储文件为MP4文件,媒体数据存储单元为MP4文件的Media Data Box。
左眼视频源的视频帧在多媒体存储文件的媒体数据存储单元中按照时间由先到后排列,所述右眼视频源的视频帧在所述多媒体存储文件的媒体数据存储单元中按照时间由先到后排列。
多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。视频帧的时间对应一致表示视频帧的时间相同或相近(间隔小于预设阈值)。
步骤S302,从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息。
在一个实施例中,媒体信息存储单元为MP4文件的Track Box。媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
步骤S303,根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧。
具体的,在一个实施例中,可根据左、右眼视频源的视频帧的时间信息和位置信息,获取时间对应一致左、右眼视频源的视频帧的位置信息,分别根据左、右眼视频源的视频帧的位置信息从多媒体存储文件的媒体数据存储单元中读取时间对应一致的视频帧数据。
步骤S304,将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像。
具体的,可按照传统的3D视频图像合成方式,例如左右排列、上下排列、交错排列等,将左眼视频源和右眼视频源的时间对应一致的视频帧合成需要的3D视频图像。其中,左右排列方式将左眼视频源的视频帧排在左边,将右眼视频源的视频帧排在右边;上下排列方式将左眼视频源的视频帧排在上边,将右眼视频源的视频帧排在下边;交错排列方式将左、右眼视频源的视频帧的像素列交错排列。不同的3D播放设备可播放的3D视频图像的格式也不同,可根据3D播放设备来选择3D视频图像的合成方式。
本实施例中,将左、右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中,并使媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。在合成3D视频时,可方便的从多媒体存储文件的连续的媒体流中获取到左、右眼视频源的时间对应一致的视频帧,从而可边下载MP4的媒体流数据,边从下载到的连续的媒体流数据中获取时间对应一致的左、右眼视频源的视频帧实时的合成3D视频图像,满足在线播放3D视频时边下载边播放的需求。
步骤S305,播放合成的3D视频图像。
在一个实施例中,左眼视频源和右眼视频源为按照预设格式进行编码而成的视频源。在步骤S304之前,上述3D视频播放方法还包括步骤:按照与预设格式相应的格式解码左眼视频源和右眼视频源的视频帧数据。步骤S304的具体过程为:将解码后的时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像。
如图4所示,在一个实施例中,一种3D视频播放装置,包括文件获取模块401、媒体信息获取模块402、媒体数据获取模块403、合成模块404、播放模块405,其中:
文件获取模块401用于获取存储了左眼视频源和右眼视频源的多媒体存储文件,左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中。左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
具体的,文件获取模块401可根据指定路径获取多媒体存储文件,或根据Internet地址下载多媒体存储文件。
多媒体存储文件可为MP4文件、MP5文件或其他特定类型的文件等。
在一个实施例中,多媒体存储文件为MP4文件,媒体数据存储单元为MP4文件的Media Data Box。
左眼视频源的视频帧在多媒体存储文件的媒体数据存储单元中按照时间由先到后排列,所述右眼视频源的视频帧在所述多媒体存储文件的媒体数据存储单元中按照时间由先到后排列。
多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。视频帧的时间对应一致表示视频帧的时间相同或相近(间隔小于预设阈值)。
媒体信息获取模块402用于从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息。
在一个实施例中,媒体信息存储单元为MP4文件的Track Box。媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
媒体数据获取模块403用于根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧。
具体的,在一个实施例中,媒体数据获取模块403可根据左、右眼视频源的视频帧的时间信息和位置信息,获取时间对应一致左、右眼视频源的视频帧的位置信息,分别根据左、右眼视频源的视频帧的位置信息从多媒体存储文件的媒体数据存储单元中读取时间对应一致的视频帧数据。
合成模块404用于将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像。
具体的,合成模块404可按照传统的3D视频图像合成方式,例如左右排列、上下排列、交错排列等,将左眼视频源和右眼视频源的时间对应一致的视频帧合成需要的3D视频图像。其中,左右排列方式将左眼视频源的视频帧排在左边,将右眼视频源的视频帧排在右边;上下排列方式将左眼视频源的视频帧排在上边,将右眼视频源的视频帧排在下边;交错排列方式将左、右眼视频源的视频帧的像素列交错排列。不同的3D播放设备可播放的3D视频图像的格式也不同,合成模块404可根据3D播放设备来选择3D视频图像的合成方式。
本实施例中,将左、右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中,并使媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。在合成3D视频时,可方便的从多媒体存储文件的连续的媒体流中获取到左、右眼视频源的时间对应一致的视频帧,从而可边下载MP4的媒体流数据,边从下载到的连续的媒体流数据中获取时间对应一致的左、右眼视频源的视频帧实时的合成3D视频图像,满足在线播放3D视频时边下载边播放的需求。
播放模块405用于播放合成的3D视频图像。
在一个实施例中,左眼视频源和右眼视频源为按照预设格式进行编码而成的视频源。上述3D视频播放装置还包括解码模块(图中未示出),用于按照与预设格式相应的格式解码左眼视频源和右眼视频源的视频帧数据。合成模块404用于将解码后的时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像。
上述3D视频播放方法和装置,从多媒体存储文件中读取左眼视频源和右眼视频源,并将时间对应一致的左、右眼视频源的视频帧合成3D视频图像。上述方式不需要从两个文件中读取左、右眼视频源,一个视频只对应一个视频文件,可避免在获取视频的过程中,其中一个视频文件丢失而导致不能合成和播放3D视频的问题。
另外,上述方式可根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧,将时间对应一致的左、右眼视频源的视频帧合成3D视频图像,不需要将多媒体存储文件的所有媒体数据都下载完成后再进行合成操作,可边获取多媒体存储文件的媒体数据边合成3D视频图像,从而可满足在线播放3D视频时边下载边播放的需求。
其次,上述3D视频播放方法和装置,可将左、右眼视频源按照不同的格式合成3D视频,满足不同播放设备的播放需要。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序控制相关的硬件来完成的,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。
以上所述实施例仅表达了本发明的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进,这些都属于本发明的保护范围。因此,本发明专利的保护范围应以所附权利要求为准。

Claims (18)

  1. 一种3D视频源存储方法,包括以下步骤:
    将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
    将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
  2. 根据权利要求1所述的3D视频源存储方法,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致;
    所述媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
  3. 根据权利要求 1或 2 所述的 3D 视频源存储方法 , 其特征在于 , 所述多媒体存储文件为 MP4 文件 , 所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
  4. 一种3D视频源存储装置,其特征在于,包括:
    媒体数据存储模块,用于将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
    媒体信息存储模块,用于将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
  5. 根据权利要求4所述的3D视频源存储装置,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致;
    所述媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
  6. 根据权利要求 4或 5 所述的 3D 视频源存储装置 , 其特征在于 , 所述多媒体存储文件为 MP4 文件 , 所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
  7. 一种3D视频播放方法,包括以下步骤:
    获取存储了左眼视频源和右眼视频源的多媒体存储文件,所述左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
    从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息;
    根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧;
    将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像;
    播放所述合成的3D视频图像。
  8. 根据权利要求7所述的3D视频播放方法,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。
  9. 根据权利要求7或8所述的3D视频播放方法,其特征在于,所述多媒体存储文件为MP4文件,所述媒体数据存储单元为MP4文件中的Media Data Box,所述媒体信息存储单元为MP4文件中的Track Box。
  10. 一种3D视频播放装置,其特征在于,包括:
    文件获取模块,用于获取存储了左眼视频源和右眼视频源的多媒体存储文件,所述左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
    媒体信息获取模块,用于从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息;
    媒体数据获取模块,用于根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧;
    合成模块,用于将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像;
    播放模块,用于播放所述合成的3D视频图像。
  11. 根据权利要求10所述的3D视频播放方法,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。
  12. 根据权利要求 10或 11 所述的 3D 视频播放方法 ,其特征在于 , 所述多媒体存储文件为 MP4 文件 ,所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
  13. 一个或多个包含计算机可执行指令的计算机存储介质,所述计算机可执行指令用于执行一种3D视频源存储方法,其特征在于,所述方法包括以下步骤:
    将左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
    将左眼视频源的媒体信息与右眼视频源的媒体信息分别存储在多媒体存储文件的不同的媒体信息存储单元中。
  14. 根据权利要求13所述的计算机存储介质,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致;
    所述媒体信息包括视频源中视频帧的时间信息、位置信息以及视频帧的编解码信息。
  15. 根据权利要求 13或 14 所述的计算机存储介质 , 其特征在于 , 所述多媒体存储文件为 MP4 文件 , 所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
  16. 一个或多个包含计算机可执行指令的计算机存储介质,所述计算机可执行指令用于执行一种3D视频播放方法,其特征在于,所述方法包括以下步骤:
    获取存储了左眼视频源和右眼视频源的多媒体存储文件,所述左眼视频源与右眼视频源的视频帧按时间先后顺序交错存储在多媒体存储文件的媒体数据存储单元中;
    从左眼视频源对应的媒体信息存储单元和右眼视频源对应的媒体信息存储单元中分别读取左眼视频源的媒体信息和右眼视频源的媒体信息;
    根据左眼视频源的媒体信息和右眼视频源的媒体信息从多媒体存储文件的媒体数据存储单元中分别读取时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧;
    将时间对应一致的左眼视频源的视频帧和右眼视频源的视频帧按照预设方式进行排列,合成3D视频图像;
    播放所述合成的3D视频图像。
  17. 根据权利要求16所述的计算机存储介质,其特征在于,所述多媒体存储文件的媒体数据存储单元中相邻的左眼视频源与右眼视频源的视频帧的时间对应一致。
  18. 根据权利要求 16或 17 所述的计算机存储介质 , 其特征在于 , 所述多媒体存储文件为 MP4 文件 , 所述媒体数据存储单元为 MP4 文件中的 Media Data Box , 所述媒体信息存储单元为MP4文件中的Track Box。
PCT/CN2013/073968 2012-05-19 2013-04-09 3d视频源存储方法和装置及3d视频播放方法和装置 Ceased WO2013174181A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
KR1020147007133A KR101630720B1 (ko) 2012-05-19 2013-04-09 3d 비디오 소스 저장 방법 및 장치와 3d 비디오 재생 방법 및 장치
JP2014537486A JP5801497B2 (ja) 2012-05-19 2013-04-09 3dビデオソース格納方法及び装置、及び3dビデオ再生方法及び装置
US14/249,770 US20140219640A1 (en) 2012-05-19 2014-04-10 Method and apparatus for storing and playing 3d video source

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210156555.6 2012-05-19
CN201210156555.6A CN103428463B (zh) 2012-05-19 2012-05-19 3d视频源存储方法和装置及3d视频播放方法和装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/249,770 Continuation US20140219640A1 (en) 2012-05-19 2014-04-10 Method and apparatus for storing and playing 3d video source

Publications (1)

Publication Number Publication Date
WO2013174181A1 true WO2013174181A1 (zh) 2013-11-28

Family

ID=49623082

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/073968 Ceased WO2013174181A1 (zh) 2012-05-19 2013-04-09 3d视频源存储方法和装置及3d视频播放方法和装置

Country Status (5)

Country Link
US (1) US20140219640A1 (zh)
JP (1) JP5801497B2 (zh)
KR (1) KR101630720B1 (zh)
CN (1) CN103428463B (zh)
WO (1) WO2013174181A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113643685A (zh) * 2021-08-18 2021-11-12 百度在线网络技术(北京)有限公司 数据处理方法、装置、电子设备及计算机存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1462981A (zh) * 2002-05-27 2003-12-24 矽统科技股份有限公司 交错式立体影像的产生装置及方法
WO2011083625A1 (ja) * 2010-01-08 2011-07-14 ソニー株式会社 画像処理装置、情報記録媒体、および画像処理方法、並びにプログラム
CN102137268A (zh) * 2011-04-08 2011-07-27 清华大学 立体视频的行交错和棋盘格的渲染方法及装置
CN102197655A (zh) * 2009-06-10 2011-09-21 Lg电子株式会社 暂停模式中的立体图像再现方法及使用该方法的立体图像再现装置

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4490074B2 (ja) * 2003-04-17 2010-06-23 ソニー株式会社 立体視画像処理装置、立体視画像表示装置、立体視画像提供方法、および立体視画像処理システム
EP2001235B1 (en) * 2007-06-08 2013-05-22 Samsung Electronics Co., Ltd. MPEG-4 format extension for recording stereoscopic or synthetic 3D video data with related metadata
ES2659717T3 (es) * 2008-01-17 2018-03-19 Panasonic Intellectual Property Management Co., Ltd. Medio de grabación en el que se graba vídeo en 3D, aparato de grabación para grabar vídeo en 3D y dispositivo de reproducción y método para reproducir vídeo en 3D
JP2010088092A (ja) * 2008-09-02 2010-04-15 Panasonic Corp 立体映像伝送システム、映像表示装置および映像出力装置
US8369693B2 (en) * 2009-03-27 2013-02-05 Dell Products L.P. Visual information storage methods and systems
JP2011082666A (ja) * 2009-10-05 2011-04-21 Sony Corp 信号伝送方法、信号送信装置及び信号受信装置
JP5482254B2 (ja) * 2009-11-05 2014-05-07 ソニー株式会社 受信装置、送信装置、通信システム、表示制御方法、プログラム、及びデータ構造
JP2011142586A (ja) * 2010-01-08 2011-07-21 Sony Corp 画像処理装置、情報記録媒体、および画像処理方法、並びにプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1462981A (zh) * 2002-05-27 2003-12-24 矽统科技股份有限公司 交错式立体影像的产生装置及方法
CN102197655A (zh) * 2009-06-10 2011-09-21 Lg电子株式会社 暂停模式中的立体图像再现方法及使用该方法的立体图像再现装置
WO2011083625A1 (ja) * 2010-01-08 2011-07-14 ソニー株式会社 画像処理装置、情報記録媒体、および画像処理方法、並びにプログラム
CN102137268A (zh) * 2011-04-08 2011-07-27 清华大学 立体视频的行交错和棋盘格的渲染方法及装置

Also Published As

Publication number Publication date
JP2015501590A (ja) 2015-01-15
KR101630720B1 (ko) 2016-06-17
JP5801497B2 (ja) 2015-10-28
KR20140057611A (ko) 2014-05-13
CN103428463B (zh) 2016-10-12
US20140219640A1 (en) 2014-08-07
CN103428463A (zh) 2013-12-04

Similar Documents

Publication Publication Date Title
JP5193291B2 (ja) 2d映像メディア標準に基づいて3d映像ファイルを生成及び再生するためのシステム及び方法
CN102197655B (zh) 暂停模式中的立体图像再现方法及使用该方法的立体图像再现装置
US20080252719A1 (en) Apparatus, method, and system for generating stereo-scopic image file based on media standards
JP2009135686A5 (zh)
JP6320366B2 (ja) 2d映像メディア標準に基づいて3d立体映像ファイルを生成及び再生するシステム及び方法
JP2011223482A (ja) 画像処理装置、画像処理方法、およびプログラム
WO2016123057A1 (en) Systems and methods for merging digital cinema packages for a multiscreen environment
KR20120037208A (ko) 3차원 영상 제공 및 처리 방법과 3차원 영상 제공 및 처리 장치
WO2012147354A1 (ja) 映像処理装置及び映像処理方法
JP2011228862A (ja) データ構造、画像処理装置、画像処理方法、およびプログラム
JP2013093755A (ja) 映像記録装置及び映像記録方法
CN102144395A (zh) 高速搜索模式中的立体图像再现方法和使用该方法的立体图像再现装置
WO2013174181A1 (zh) 3d视频源存储方法和装置及3d视频播放方法和装置
CN102342123B (zh) 再现装置、再现方法、记录装置、记录方法、程序和数据结构
JP5778673B2 (ja) コンテンツ配信システム、再生装置、配信サーバ、再生方法及び配信方法
JP2012249137A (ja) 記録装置、記録方法、再生装置、再生方法、プログラム、および記録再生装置
JP2011146828A (ja) データ構造、記録装置および記録方法、再生装置および再生方法、並びにプログラム
JP3918114B2 (ja) 立体映像2画面連結映像システム
Wimmer Stereoscopic player and stereoscopic multiplexer: a computer-based system for stereoscopic video playback and recording
JP2002345000A (ja) カラーグラス方式(rgb−3d方式)を利用した3d立体動画映像の生成方法及び装置
WO2003105490A1 (en) Method and system for stereoscopic representation
JP4594432B1 (ja) 動画再生方法、動画再生システム、およびプログラム
JP2005006266A (ja) 3dビデオカメラ、3dビデオカメラ付き携帯電話及び3d再生グラス
CN121603642A (zh) 空间视频的生成方法、播放方法、装置、电子设备、存储介质和程序产品
Aas 3D Video Production

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13793917

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 20147007133

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2014537486

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17/04/15)

122 Ep: pct application non-entry in european phase

Ref document number: 13793917

Country of ref document: EP

Kind code of ref document: A1