WO2012159440A1 - Internet-based method and system for transcoding stereo video in real time on serving end - Google Patents

Internet-based method and system for transcoding stereo video in real time on serving end Download PDF

Info

Publication number
WO2012159440A1
WO2012159440A1 PCT/CN2011/084951 CN2011084951W WO2012159440A1 WO 2012159440 A1 WO2012159440 A1 WO 2012159440A1 CN 2011084951 W CN2011084951 W CN 2011084951W WO 2012159440 A1 WO2012159440 A1 WO 2012159440A1
Authority
WO
WIPO (PCT)
Prior art keywords
format
video
picture frame
stereo
stereo video
Prior art date
Application number
PCT/CN2011/084951
Other languages
French (fr)
Chinese (zh)
Inventor
连惠城
Original Assignee
未序网络科技(上海)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 未序网络科技(上海)有限公司 filed Critical 未序网络科技(上海)有限公司
Publication of WO2012159440A1 publication Critical patent/WO2012159440A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/139Format conversion, e.g. of frame-rate or size
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6582Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Definitions

  • the invention belongs to the technical field of video conversion, and relates to a stereoscopic video conversion method, in particular to a real-time transcoding method based on an Internet server stereoscopic video; and the invention also relates to a stereoscopic video real-time transcoding system based on an Internet service end. Background technique
  • the common stereo video formats are: left and right format, top and bottom format, red and blue format, shutter format, etc., wherein the left and right format stereoscopic video is regarded as a general stereo format, because the left and right format stereo video can be converted into other formats.
  • Stereo video Therefore, if you want to convert ordinary flat video into stereo video, you only need to convert ordinary flat video into left and right stereo video.
  • Other stereo video formats can also be converted according to the same principle. In the 1997 Visual Studies (Vision Research, 1997, pp. 1683-1698), Ning Qian and Richard A.
  • this patent also includes the entire system framework for converting video to form a video on the Internet and converting the stereoscopic video into other formats, including how to transmit video over the Internet. How to convert video on the server side, and how to display modules such as stereo video on the client. Summary of the invention
  • the technical problem to be solved by the present invention is to provide a real-time transcoding method based on the Internet server stereoscopic video, which can conveniently and quickly convert the ordinary video file or the ordinary stereo video into a stereo video of the set format and display it.
  • the present invention also provides a stereoscopic video real-time transcoding system based on the Internet server, which can conveniently and quickly convert an ordinary video file or a normal stereo video into a stereo video of a set format and display it.
  • a real-time transcoding method for stereoscopic video based on Internet server comprising:
  • the server stores a normal video file or a stereo video file in a common format
  • the client accesses a normal video file stored in the server or a stereo video file in a common format through the network;
  • the server converts the normal video file into a body video in real time, or converts the stereo video of the universal format into a stereo video of a non-generic format; the server transmits the converted video data to the client.
  • a real-time transcoding method for stereoscopic video based on Internet server comprising the following steps:
  • the server stores a normal video file or a stereo video file in a common format for client access;
  • the client accesses a common video file stored in the server or a stereo video file in a common format through the network;
  • the server converts the normal video file into a stereo video format selected by the user or a stereoscopic video format set by the system in real time, and transmits the same to the user;
  • the server converts the stereo video file of the universal format into a stereoscopic video format selected by the user in real time. Or a stereoscopic video format set by the system and transmitted to the user;
  • the server converts the ordinary video file into a stereoscopic video format selected by the user, or converts the stereoscopic video file in the universal stereo format into a stereoscopic video format selected by the user; when the user selects to access the stereoscopic video, the server directly Send the pre-converted stereo video to the client.
  • the normal video file refers to a plane view.
  • Frequency that is, non-stereo video files
  • the stereoscopic video file of the universal format adopts a stereoscopic video file of a left and right format or a stereoscopic video file of an upper and lower format.
  • the method for the server to convert the normal video file into the body video in real time includes converting the plane frame of the ordinary video file into the left picture frame and the right picture frame.
  • the user-selectable or system-set stereoscopic video format includes one or more of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format. details as follows:
  • Left and right format stereo video conversion method after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video, then displayed;
  • Up and down format stereo video conversion method After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video, then displayed;
  • Red and blue format stereo video conversion method after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the red color component of the left picture frame is used as the red component of the red and blue format stereo video, and the right picture frame is The blue component and the green component are used as the blue component and the green component of the stereoscopic video in red and blue format, and then displayed;
  • Shutter format stereo video conversion method after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are displayed in sequential time order;
  • Interlaced format stereo video conversion method After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed.
  • step S32 is specifically:
  • step S321 or step S322 is performed according to the stereoscopic video format selected by the user or the system; if the stereoscopic video selected by the user or the system is a stereoscopic video of the universal format, the execution is performed. Step S321; If the stereoscopic video selected by the user or set by the system is a stereoscopic video of a non-generic format, step S322 is performed; 5321.
  • the server directly transmits the stereoscopic video file that has been stored in the universal format to the user; otherwise, the stereoscopic video file in the common format is stored. Convert to a stereoscopic video of other common formats selected by the user or set by the system;
  • the server converts the stereo video file of the universal format into a stereo video format of a non-generic format selected by the user or set by the system in real time, and transmits the video to the user.
  • the stereo video file of the universal format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format;
  • the stereoscopic video of the non-generic format includes a red-blue format, a shutter format, and an interlace. Formatted stereo video;
  • the method for converting the stereoscopic video file that has been stored in the common format into the stereoscopic video of the other common format selected by the user or the system includes:
  • the method of converting the left and right format stereo video into the upper and lower format stereo video using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; the second left picture frame As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed;
  • a method for converting a stereoscopic video into a left and right format stereo video by using the upper and lower format stereo video the lower half image and the upper half image of the upper and lower format stereo video are used as the second left frame frame and the second right frame frame; the second left frame frame is used as the second left frame frame The left half of the left-right format stereo video is used as the right half of the left-right format stereo video, and then displayed;
  • step S322 the server converts the stereo video file in the common format into a stereo video format selected by the user or in a non-generic format set by the system in real time, and transmits the video to the user.
  • the video conversion method includes: Step S3221: The left half picture and the right half picture of the stereoscopic video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part picture of the top and bottom format stereo video are used as the second left picture frame and the second picture Right picture frame;
  • Step S3222 Convert the left and right format stereo video or the upper and lower format stereo video into a stereoscopic video in red-blue format or shutter format or interlaced format as follows:
  • Red and blue format stereo video conversion method the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the red and blue format stereoscopic view.
  • Shutter format stereo video conversion method displaying the second left picture frame and the second right picture frame in sequential time order;
  • Interlaced format stereo video conversion method the second left picture frame and the second right picture frame are interleaved and displayed.
  • a stereoscopic video real-time transcoding system based on internet server, the system comprises a server and a client
  • the server stores a normal video file or a stereo video file in a common format for client access; the client accesses a normal video file stored in the server or a stereo video file in a common format through the network;
  • the server includes:
  • the common video conversion unit is configured to convert the ordinary video file into a stereo video format selected by the user or a stereoscopic video format set by the system in real time when the client accesses the normal video file, and transmits the video file to the user;
  • the stereoscopic video conversion unit is configured to convert the stereo format video file of the universal format into a user-selected real-time when the client accesses the stereoscopic video file in a common format and the stereoscopic video format selected by the user or the system is a non-universal format.
  • the user-selectable or system-set stereoscopic video format includes one of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format.
  • the conversion method of the ordinary video conversion unit is specifically as follows:
  • Left and right format stereo video conversion method after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video, then displayed;
  • Up and down format stereo video conversion method After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video, then displayed;
  • Red and blue format stereo video conversion method convert the plane frame of the ordinary video file into the left picture frame and After the right picture frame, the red color component of the left picture frame is used as the red component of the stereoscopic video of the red and blue format, and the blue component and the green component of the right picture frame are used as the blue component and the green component of the stereoscopic video of the red and blue format, and then displayed. come out;
  • Shutter format stereo video conversion method after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are displayed in sequential time order;
  • Interlaced format stereo video conversion method After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed.
  • the stereoscopic video conversion unit when the client accesses the stereoscopic video file in the universal format, performs the unsynchronization according to the stereoscopic video format selected by the user or the system;
  • the server will store the stereoscopic video file of the universal format. Directly transmitted to the user; otherwise, the stereoscopic video conversion unit of the server converts the stereoscopic video file that has been stored in the common format into a stereoscopic video of other common formats selected by the user or set by the system;
  • the stereoscopic video conversion unit of the server converts the stereo video file of the universal format into a stereoscopic video format of a non-universal format set by the user or the system. And transmitted to the user.
  • the stereo video file of the universal format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format;
  • the stereoscopic video of the non-universal format includes a stereoscopic video of a red-blue format, a shutter format, and an interlaced format;
  • a method of converting a stereoscopic video file that has been stored in a general format into a stereoscopic video of other general format selected by the user or the system includes:
  • the method of converting the left and right format stereo video into the upper and lower format stereo video using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; the second left picture frame As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed;
  • a method of converting a stereo video into a left and right format by using an existing upper and lower format stereo video The lower half picture and the upper half picture of the body video are used as the second left picture frame and the second right picture frame; the second left picture frame is used as the left half picture of the left and right format stereo video, and the second right picture frame is used as the left and right format The right half of the stereo video, then displayed;
  • the stereoscopic video conversion unit of the server converts the stereo video file of the existing common format into a stereo video format of a non-universal format selected by the user or set by the system, and transmits the video to the user.
  • the video conversion method includes:
  • Step S3221 The left half picture and the right half picture of the left and right format stereo video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part picture of the upper and lower format stereo video are used as the second a left picture frame and a second right picture frame;
  • Step S3222 Convert the left and right format stereo video or the upper and lower format stereo video into a stereoscopic video in red-blue format or shutter format or interlaced format as follows:
  • Red and blue format stereo video conversion method the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the blue of the red and blue format stereoscopic video. The component and the green component are then displayed;
  • Shutter format stereo video conversion method displaying the second left picture frame and the second right picture frame in sequential order;
  • Interlaced format stereo video conversion method the second left picture frame and the second right picture frame are interleaved and displayed.
  • the invention has the beneficial effects that the method and system for real-time transcoding of the stereoscopic video based on the Internet server according to the present invention firstly save the ordinary video file or the stereo video file in the common format on the Internet server for the client to access;
  • the Internet server converts the normal video file into a body video in real time, or converts the stereo video of the universal format into a stereo video of other formats;
  • the Internet server will The converted video data is transmitted to the Internet client; the user can select the stereoscopic video format to be converted according to his own needs, including the left and right format, the upper and lower format, the red and blue format, the shutter format, the interlaced format, etc., thereby achieving stereoscopic video viewing through the Internet. the goal of. DRAWINGS
  • FIG. 1 is a schematic diagram of a stereoscopic video system based on real-time transcoding of an Internet server according to the present invention.
  • FIG. 2 is a flow chart of a stereo video real-time transcoding method according to the present invention.
  • FIG. 3 is a flowchart of a stereoscopic video system based on real-time transcoding of an Internet server according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of a stereoscopic video system based on real-time transcoding of an Internet server according to another embodiment of the present invention. detailed description
  • the present invention discloses a real-time transcoding method for stereoscopic video based on an Internet server, and the method includes:
  • the server stores a normal video file or a stereo video file in a common format
  • the client accesses a normal video file stored in the server or a stereo video file in a common format through the network;
  • the server converts the normal video file into a body video in real time, or converts the stereo video of the universal format into a stereo video of a non-generic format; the server transmits the converted video data to the client.
  • the stereo video real-time transcoding method of the present invention includes the following steps: [Step S1]
  • the server stores a normal video file or a stereo video file in a common format for client access;
  • Step S2 The client accesses a normal video file stored in the server or a stereo video file in a common format through the network;
  • Step S31 When the client accesses the normal video file, the server converts the ordinary video file into a stereoscopic video format selected by the user or a stereoscopic video format set by the system in real time, and transmits the same to the user;
  • Step S32 When the client accesses the stereoscopic video file in a common format, and the stereoscopic video format selected by the user or the system is a non-universal format, the server can perform the stereo video file of the universal format in real time. It is converted into a stereoscopic video format selected by the user or a stereoscopic video format set by the system, and transmitted to the user.
  • the common video file refers to a plane video, that is, a non-stereo video file; the storage format of the video file is in the FLV, F4V or MP4 format, but is not limited to the above three formats, the video file.
  • the compression method uses h. 263 or h.
  • the stereo video file of the universal format adopts a stereo video file of a left and right format or a stereo video file of a top and bottom format; the storage format and compression mode are the same as those of a normal video file.
  • step S2 the Internet client accesses a common video file or a stereo video file in a common format through the Internet, wherein the network transmission uses the http protocol or the rtsp protocol, but is not limited to the above two transmission protocols, wherein the network access method includes a wired internet. Access method or wireless internet access method.
  • the method for the server to convert the normal video file into the body video in real time includes: converting the plane frame of the ordinary video file into the left picture frame and the right picture frame.
  • the planar frame of the ordinary video file can be converted into a left picture frame and a right picture frame by the method disclosed in the "Physiological Model of a Sports Stereo Combination and the General Interpretation of the Like-Pulture phenomenon" mentioned in the background art.
  • the user-selectable or system-set stereoscopic video format may include one or more of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format, and the conversion methods of the various formats are specifically as follows: :
  • Left and right format stereo video conversion method after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video is then displayed.
  • Up and down format stereo video conversion method After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video is then displayed.
  • Red and blue format stereo video conversion method after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the red color component of the left picture frame is used as the red component of the red and blue format stereo video, and the right picture frame is The blue component and the green component are used as the blue component and the green component of the stereoscopic video in red and blue format, and then displayed.
  • Shutter format stereo video conversion method convert the plane frame of the ordinary video file into the left picture frame and After the right picture frame, the left picture frame and the right picture frame are displayed in sequential order.
  • Interlaced format stereo video conversion method After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed.
  • the step S32 may specifically include the following steps:
  • Step S320 When the client accesses the stereoscopic video file in the universal format, step S321 or step S322 is performed according to the stereoscopic video format selected by the user or the system; if the stereoscopic video selected by the user or the system is in the general format For the stereoscopic video, step S321 is performed; if the stereoscopic video selected by the user or set by the system is a stereoscopic video of a non-generic format, step S322 is performed.
  • Step S321 If the stereoscopic video selected by the user or the system is a stored stereo video file of a common format, the server directly transmits the stereoscopic video file that has been stored in the universal format to the user. Otherwise, the stereoscopic video files that have been stored in the common format are converted into stereoscopic videos of other common formats selected by the user or set by the system. Conversion methods include:
  • the method of converting the left and right format stereo video into the upper and lower format stereo video using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; the second left picture frame As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed.
  • a method for converting a stereoscopic video into a left and right format stereo video by using the upper and lower format stereo video the lower half image and the upper half image of the upper and lower format stereo video are used as the second left frame frame and the second right frame frame; the second left frame frame is used as the second left frame frame
  • the left half of the left-right format stereo video is used as the right half of the left-right format stereo video, and then displayed.
  • Step S322 The server converts the stereo video file of the universal format into a stereo video format selected by the user or a non-universal format set by the system in real time, and transmits the video to the user.
  • the stereoscopic video file in the common format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format;
  • the stereoscopic video of the non-universal format includes a stereoscopic video of a red-blue format, a shutter format, and an interlaced format.
  • the server converts the stereo video file in the common format into a stereoscopic video format selected by the user or set in the system in real time, and transmits the video to the user.
  • the video conversion method includes:
  • Step S3221 The left half picture and the right half picture of the left and right format stereo video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part of the top and bottom format stereo video are The picture is used as a second left picture frame and a second right picture frame;
  • Step S3222 Convert the left and right format stereo video or the upper and lower format stereo video into a stereoscopic video in red-blue format or shutter format or interlaced format as follows:
  • Red and blue format stereo video conversion method the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the blue of the red and blue format stereoscopic video. The component and the green component are then displayed;
  • Shutter format stereo video conversion method displaying the second left picture frame and the second right picture frame in sequential order;
  • Interlaced format stereo video conversion method the second left picture frame and the second right picture frame are interleaved and displayed.
  • Step S33 the server converts the normal video file into a stereoscopic video format selected by the user, or converts the stereoscopic video file in the universal stereo format into a stereoscopic video format selected by the user; when the user selects to access the stereoscopic video, the service
  • the terminal directly sends the pre-converted stereo video to the client.
  • the above is a stereoscopic video real-time transcoding method of the present invention.
  • the present invention also discloses a stereoscopic video real-time transcoding system. Referring to FIG.
  • the system includes a server and a client; the server stores a normal video file or a stereo video file in a common format for client access; and the client accesses a common video file or a universal file stored in the server through a network. Formatted stereo video file.
  • the server includes: a common video conversion unit and a stereoscopic video conversion unit.
  • the ordinary video conversion unit is configured to convert the ordinary video file into a stereoscopic video format selected by the user or a stereoscopic video format set by the system in real time when the client accesses the normal video file, and transmits the video file to the user.
  • the stereoscopic video conversion unit is configured to convert the stereoscopic video file of the universal format into a stereo selected by the user in real time when the client accesses the stereoscopic video file in a common format and the stereoscopic video format selected by the user or the system is a non-universal format. The stereo format of the video format or system settings is transmitted to the user.
  • the user-selectable or system-set stereoscopic video format includes one or more of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format;
  • the conversion method of the conversion unit is as follows: 1) Left and right format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video, then displayed;
  • Up and down format stereo video conversion method After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video, then displayed;
  • Red and blue format stereo video conversion method after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the red color component of the left picture frame is used as the red component of the red and blue format stereo video, and the right picture frame is The blue component and the green component are used as the blue component and the green component of the stereoscopic video in red and blue format, and then displayed;
  • Shutter format stereo video conversion method after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are displayed in sequential time order;
  • Interlaced format stereo video conversion method After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed.
  • the stereoscopic video conversion unit When the client accesses a stereoscopic video file of a general format, the stereoscopic video conversion unit performs different steps according to a stereoscopic video format selected by the user or set by the system.
  • the server will store the stereoscopic video file of the universal format. Directly transmitted to the user; otherwise, the stereoscopic video conversion unit of the server converts the stereoscopic video file that has been stored in the common format into stereoscopic video of other common formats selected by the user or set by the system.
  • the stereoscopic video conversion unit of the server converts the stereo video file of the universal format into a stereoscopic video format of a non-universal format set by the user or the system. And transmitted to the user.
  • the stereoscopic video file of the universal format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format;
  • the stereoscopic video of the non-universal format includes a stereoscopic video of a red-blue format, a shutter format, and an interlaced format.
  • a method of converting a stereoscopic video file that has been stored in a common format into a stereoscopic video format selected by a user or a system includes: The method of converting the left and right format stereo video into the upper and lower format stereo video: using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; the second left picture frame As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed;
  • a method for converting a stereoscopic video into a left and right format stereo video by using the upper and lower format stereo video the lower half image and the upper half image of the upper and lower format stereo video are used as the second left frame frame and the second right frame frame; the second left frame frame is used as the second left frame frame
  • the left half of the left-right format stereo video is used as the right half of the left-right format stereo video, and then displayed.
  • the stereoscopic video conversion unit of the server converts the stereo video file of the existing common format into a stereo video format of a non-universal format selected by the user or set by the system in real time, and is transmitted to the user.
  • Video conversion methods include:
  • Step S3221 The left half picture and the right half picture of the left and right format stereo video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part picture of the upper and lower format stereo video are used as the second a left picture frame and a second right picture frame;
  • Step S3222 Convert the left and right format stereo video or the upper and lower format stereo video into a stereoscopic video in red-blue format or shutter format or interlaced format as follows:
  • Red and blue format stereo video conversion method the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the blue of the red and blue format stereoscopic video. The component and the green component are then displayed;
  • Shutter format stereo video conversion method displaying the second left picture frame and the second right picture frame in sequential order;
  • Interlaced format stereo video conversion method the second left picture frame and the second right picture frame are interleaved and displayed.
  • Embodiment 2 the second left picture frame and the second right picture frame are interleaved and displayed.
  • this embodiment discloses a stereoscopic video system based on real-time transcoding of an Internet server.
  • the real-time transcoding method of the system includes the following steps:
  • the Internet server saves the normal video file, and the video encoding method adopts H.264; 2)
  • the Internet client accesses the ordinary video file through the Internet http protocol;
  • the network server uses C++ to convert the ordinary video files into red and blue stereo videos in real time and send them to the client for display to the user.
  • this embodiment discloses a stereoscopic video system based on real-time transcoding of an Internet server.
  • the real-time transcoding method of the system includes the following steps:
  • the Internet server saves the normal video file, and the video encoding method adopts H.264;
  • the Internet client accesses the ordinary video file through the Internet RTSP protocol
  • the network server uses C++ to convert the ordinary video files into red and blue stereo videos in real time and send them to the client for display to the user.
  • a common video file or a stereo video file in a general format is stored on the Internet server for client access; when the Internet client When accessing a normal video file or a stereo video file in a universal format through the network, the Internet server converts the normal video file into a body video in real time, or converts the stereo video of the universal format into a stereo video of another format; the Internet server will convert The video data is transmitted to the Internet client; the user can select the stereoscopic video format to be converted according to his own needs, including the left and right format, the upper and lower format, the red and blue format, the shutter format, the interlaced format, etc., thereby achieving the purpose of viewing the stereoscopic video through the Internet.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Disclosed are an Internet-based method and system for transcoding a stereo video in real time on a serving end. The method comprises: a serving end storing a common video file or a stereo video file in a general format; a client accessing a video file stored in the serving end through a network; when the client accesses the common video file, the serving end converting in real time the common video file into a stereo video format selected by a user or a stereo video format set by a system and outputting the file to the user; and when the client accesses the stereo video file in the general format, and the stereo video format selected by the user or set by the system is a non-general format, the serving end converting in real time the stereo video file in the general format into the stereo video format selected by the user or the stereo video format set by the system and outputting the file to the user. The present invention can easily and conveniently convert a common video file or a common stereo video into a stereo video of a set format for displaying, so that the stereo video can be viewed over the Internet.

Description

基于互联网服务端立体视频实时转码方法及系统  Real-time transcoding method and system for stereoscopic video based on internet server
技术领域 Technical field
本发明属于视频转换技术领域,涉及一种立体视频转换方法, 尤其涉及一种 基于互联网服务端立体视频实时转码方法;同时本发明还涉及一种基于互联网服 务端立体视频实时转码系统。 背景技术  The invention belongs to the technical field of video conversion, and relates to a stereoscopic video conversion method, in particular to a real-time transcoding method based on an Internet server stereoscopic video; and the invention also relates to a stereoscopic video real-time transcoding system based on an Internet service end. Background technique
随着视频网络的发展,视频节目呈海量增长之势, 上网观看视频的网民越来 越多, 可是网络中绝大部分的视频都是普通的二维平面视频。对于喜欢观看立体 视频的网络用户来说, 找到充足的立体视频片源观看是一件困难的的事情。如何 将普通的视频实时转换成立体视频, 并显示给用户观看, 成为互联网视频一个亟 待解决的问题。  With the development of video networks, video programs are experiencing massive growth. More and more netizens are watching videos online, but most of the videos in the network are ordinary two-dimensional video. For network users who like to watch stereoscopic video, it is difficult to find enough stereo video sources to watch. How to convert ordinary video into a body video in real time and display it to the user for viewing, becoming an urgent problem for Internet video.
目前常见的立体视频格式有:左右格式,上下格式, 红蓝格式,快门格式等, 其中的左右格式立体视频被视为是通用立体格式, 这是因为, 可以将左右格式立 体视频转换成其他格式的立体视频。所以, 如果要将普通的平面视频转换成立体 视频的话, 只需要将普通的平面视频转换成左右立体视频即可, 则其他的立体视 频格式也可以按相同的原理进行转换。在 1997年的《视觉研究》 (Vision Research, 1997, pp. 1683-1698 ) 中, Ning Qian 和 Richard A. Andersen发表了 《一个 运动立体组合的生理学模型和类普尔弗里希现象的一般性解释》 (A Physiological Model for Motion-Stereo Integration and a Unified Explanation of Pulfrich-l ike Phenomena) 的文章。 这篇文章中, 他们公开了 一种将平面视频转换为左右立体视频的方法。本专利采用该方法进行平面视频和 立体视频的转换。  Currently, the common stereo video formats are: left and right format, top and bottom format, red and blue format, shutter format, etc., wherein the left and right format stereoscopic video is regarded as a general stereo format, because the left and right format stereo video can be converted into other formats. Stereo video. Therefore, if you want to convert ordinary flat video into stereo video, you only need to convert ordinary flat video into left and right stereo video. Other stereo video formats can also be converted according to the same principle. In the 1997 Visual Studies (Vision Research, 1997, pp. 1683-1698), Ning Qian and Richard A. Andersen published "A Physiological Model of a Stereoscopic Combination of Motions and a General Interpretation of the Pulquish Phenomenon" (A Physiological Model for Motion-Stereo Integration and a Unified Explanation of Pulfrich-l ike Phenomena). In this article, they expose a way to convert flat video to left and right stereo video. This patent uses this method to convert planar video and stereo video.
除了涉及上述平面视频转换成立体视频的技术外,本专利还包括互联网上平 面视频转换成立体视频,以及通用立体视频转换成其他格式立体视频的整个系统 框架, 包括如何在互联网络上传输视频, 如何在服务端转换视频, 以及如何在客 户端显示立体视频等模块。 发明内容 In addition to the above-mentioned techniques for planar video conversion to form a body video, this patent also includes the entire system framework for converting video to form a video on the Internet and converting the stereoscopic video into other formats, including how to transmit video over the Internet. How to convert video on the server side, and how to display modules such as stereo video on the client. Summary of the invention
本发明所要解决的技术问题是:提供一种基于互联网服务端立体视频实时转 码方法,可方便快捷地将普通视频文件或普通立体视频转换成设定格式的立体视 频并显示出来。  The technical problem to be solved by the present invention is to provide a real-time transcoding method based on the Internet server stereoscopic video, which can conveniently and quickly convert the ordinary video file or the ordinary stereo video into a stereo video of the set format and display it.
此外, 本发明还提供一种基于互联网服务端立体视频实时转码系统, 可方便 快捷地将普通视频文件或普通立体视频转换成设定格式的立体视频并显示出来。  In addition, the present invention also provides a stereoscopic video real-time transcoding system based on the Internet server, which can conveniently and quickly convert an ordinary video file or a normal stereo video into a stereo video of a set format and display it.
为解决上述技术问题, 本发明采用如下技术方案:  In order to solve the above technical problem, the present invention adopts the following technical solutions:
一种基于互联网服务端立体视频实时转码方法, 所述方法包括:  A real-time transcoding method for stereoscopic video based on Internet server, the method comprising:
服务端存储普通视频文件或通用格式的立体视频文件;  The server stores a normal video file or a stereo video file in a common format;
客户端通过网络访问服务端中存储的普通视频文件或通用格式的立体视频 文件;  The client accesses a normal video file stored in the server or a stereo video file in a common format through the network;
服务端实时将普通视频文件转换成立体视频,或者将通用格式的立体视频转 换成非通用格式的立体视频; 服务端将转换后视频数据传输给客户端。 一种基于互联网服务端立体视频实时转码方法, 所述方法包括如下步骤: The server converts the normal video file into a body video in real time, or converts the stereo video of the universal format into a stereo video of a non-generic format; the server transmits the converted video data to the client. A real-time transcoding method for stereoscopic video based on Internet server, the method comprising the following steps:
S1、服务端存储普通视频文件或通用格式的立体视频文件,以备客户端访问; S2、客户端通过网络访问服务端中存储的普通视频文件或通用格式的立体视 频文件; S1, the server stores a normal video file or a stereo video file in a common format for client access; S2, the client accesses a common video file stored in the server or a stereo video file in a common format through the network;
531、 当客户端访问的是普通视频文件时, 服务端实时将普通视频文件转换 成用户选择的立体视频格式或系统设定的立体视频格式, 并传输给用户;  531. When the client accesses the normal video file, the server converts the normal video file into a stereo video format selected by the user or a stereoscopic video format set by the system in real time, and transmits the same to the user;
532、 当客户端访问的是通用格式的立体视频文件、 且用户选择或系统设定 的立体视频格式为非通用格式时,服务端实时将通用格式的立体视频文件转换成 用户选择的立体视频格式或系统设定的立体视频格式, 并传输给用户;  532. When the client accesses a stereoscopic video file in a universal format, and the stereoscopic video format selected by the user or the system is a non-universal format, the server converts the stereo video file of the universal format into a stereoscopic video format selected by the user in real time. Or a stereoscopic video format set by the system and transmitted to the user;
533、 或者, 服务端预先将普通视频文件转换成用户选择的立体视频格式, 或将通用立体格式的立体视频文件转换成用户选择的立体视频格式;当用户选择 访问立体视频的时候, 服务端直接将预先转换的立体视频发送给客户端。  533. Alternatively, the server converts the ordinary video file into a stereoscopic video format selected by the user, or converts the stereoscopic video file in the universal stereo format into a stereoscopic video format selected by the user; when the user selects to access the stereoscopic video, the server directly Send the pre-converted stereo video to the client.
作为本发明的一种优选方案, 所述步骤 S 1中, 所述普通视频文件指平面视 频, 即非立体视频文件; As a preferred solution of the present invention, in the step S1, the normal video file refers to a plane view. Frequency, that is, non-stereo video files;
所述通用格式的立体视频文件,采用的是左右格式的立体视频文件或上下格 式的立体视频文件。  The stereoscopic video file of the universal format adopts a stereoscopic video file of a left and right format or a stereoscopic video file of an upper and lower format.
作为本发明的一种优选方案,所述步骤 S31中,服务端实时将普通视频文件 转换成立体视频的方法包括:将普通视频文件的平面帧转换成左画面帧和右画面 帧。  As a preferred solution of the present invention, in the step S31, the method for the server to convert the normal video file into the body video in real time includes converting the plane frame of the ordinary video file into the left picture frame and the right picture frame.
作为本发明的一种优选方案,所述步骤 S31中,用户可选择或系统设定的立 体视频格式包括左右格式、 上下格式、 红蓝格式、 快门格式和交错格式中的一种 或多种, 具体如下:  As a preferred solution of the present invention, in the step S31, the user-selectable or system-set stereoscopic video format includes one or more of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format. details as follows:
1)左右格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧作为左右格式立体视频的左半部分画面, 将右画面帧作 为左右格式立体视频的右半部分画面, 然后显示出来;  1) Left and right format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video, then displayed;
2)上下格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧作为上下格式立体视频的上半部分画面, 将右画面帧作 为上下格式立体视频的下半部分画面, 然后显示出来;  2) Up and down format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video, then displayed;
3)红蓝格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧的红颜色分量作为红蓝格式立体视频的红色分量, 将右 画面帧的蓝色分量和绿色分量作为红蓝格式立体视频的蓝色分量和绿色分量,然 后显示出来;  3) Red and blue format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the red color component of the left picture frame is used as the red component of the red and blue format stereo video, and the right picture frame is The blue component and the green component are used as the blue component and the green component of the stereoscopic video in red and blue format, and then displayed;
4)快门格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后, 将左画面帧和右画面帧按先后时间顺序显示出来;  4) Shutter format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are displayed in sequential time order;
5)交错格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后, 将左画面帧和右画面帧交错叠加后显示出来。  5) Interlaced format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed.
作为本发明的一种优选方案, 所述步骤 S32具体为:  As a preferred solution of the present invention, the step S32 is specifically:
当客户端访问的是通用格式的立体视频文件时,根据用户选择或系统设定的 立体视频格式执行步骤 S321或步骤 S322 ; 若用户选择或系统设定的立体视频为 通用格式的立体视频, 执行步骤 S321 ; 若用户选择或系统设定的立体视频为非 通用格式的立体视频, 执行步骤 S322 ; 5321、若用户选择或系统设定的立体视频为已存储的通用格式的立体视频文 件, 服务端将已存储通用格式的立体视频文件直接传输给用户; 否则, 将已存储 通用格式的立体视频文件转换为用户选择或系统设定的其他通用格式的立体视 频; When the client accesses the stereoscopic video file in the common format, step S321 or step S322 is performed according to the stereoscopic video format selected by the user or the system; if the stereoscopic video selected by the user or the system is a stereoscopic video of the universal format, the execution is performed. Step S321; If the stereoscopic video selected by the user or set by the system is a stereoscopic video of a non-generic format, step S322 is performed; 5321. If the stereoscopic video selected by the user or the system is a stereoscopic video file in a stored general format, the server directly transmits the stereoscopic video file that has been stored in the universal format to the user; otherwise, the stereoscopic video file in the common format is stored. Convert to a stereoscopic video of other common formats selected by the user or set by the system;
5322、服务端实时将通用格式的立体视频文件转换成用户选择或系统设定的 非通用格式的立体视频格式, 并传输给用户。  5322. The server converts the stereo video file of the universal format into a stereo video format of a non-generic format selected by the user or set by the system in real time, and transmits the video to the user.
作为本发明的一种优选方案,所述步骤 S32中, 通用格式的立体视频文件为 左右格式立体视频或上下格式的立体视频;所述非通用格式的立体视频包括红蓝 格式、 快门格式和交错格式的立体视频;  As a preferred solution of the present invention, in the step S32, the stereo video file of the universal format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format; the stereoscopic video of the non-generic format includes a red-blue format, a shutter format, and an interlace. Formatted stereo video;
步骤 S321中, 将已存储通用格式的立体视频文件转换为用户选择或系统设 定的其他通用格式的立体视频的方法包括:  In the step S321, the method for converting the stereoscopic video file that has been stored in the common format into the stereoscopic video of the other common format selected by the user or the system includes:
通过已有左右格式立体视频转换成上下格式立体视频的方法:将左右格式立 体视频的左半部分画面和右半部分画面作为第二左画面帧和第二右画面帧;将第 二左画面帧作为上下格式立体视频的上半部分画面,将第二右画面帧作为上下格 式立体视频的下半部分画面, 然后显示出来;  The method of converting the left and right format stereo video into the upper and lower format stereo video: using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; the second left picture frame As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed;
通过已有上下格式立体视频转换成左右格式立体视频的方法:将上下格式立 体视频的下半部分画面和上半部分画面作为第二左画面帧和第二右画面帧;第二 左画面帧作为左右格式立体视频的左半部分画面,将第二右画面帧作为左右格式 立体视频的右半部分画面, 然后显示出来;  A method for converting a stereoscopic video into a left and right format stereo video by using the upper and lower format stereo video: the lower half image and the upper half image of the upper and lower format stereo video are used as the second left frame frame and the second right frame frame; the second left frame frame is used as the second left frame frame The left half of the left-right format stereo video is used as the right half of the left-right format stereo video, and then displayed;
步骤 S322中, 服务端实时将已有通用格式的立体视频文件转换成用户选择 的或系统设定的非通用格式的立体视频格式,并传输给用户;视频转换方法包括: 步骤 S3221 : 将左右格式立体视频的左半部分画面和右半部分画面作为第二 左画面帧和第二右画面帧,或者将上下格式立体视频的下半部分画面和上半部分 画面作为第二左画面帧和第二右画面帧;  In step S322, the server converts the stereo video file in the common format into a stereo video format selected by the user or in a non-generic format set by the system in real time, and transmits the video to the user. The video conversion method includes: Step S3221: The left half picture and the right half picture of the stereoscopic video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part picture of the top and bottom format stereo video are used as the second left picture frame and the second picture Right picture frame;
步骤 S3222 : 按照如下方法将左右格式立体视频或上下格式立体视频转换成 红蓝格式或快门格式或交错格式的立体视频:  Step S3222: Convert the left and right format stereo video or the upper and lower format stereo video into a stereoscopic video in red-blue format or shutter format or interlaced format as follows:
红蓝格式立体视频转换方法:将第二左画面帧的红颜色分量作为红蓝格式立 体视频的红色分量,将第二右画面帧的蓝色分量和绿色分量作为红蓝格式立体视 快门格式立体视频转换方法:将第二左画面帧和第二右画面帧按先后时间顺 序显示出来; Red and blue format stereo video conversion method: the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the red and blue format stereoscopic view. Shutter format stereo video conversion method: displaying the second left picture frame and the second right picture frame in sequential time order;
交错格式立体视频转换方法:将第二左画面帧和第二右画面帧交错叠加后显 示出来。 一种基于互联网服务端立体视频实时转码系统, 所述系统包括服务端、客户 Interlaced format stereo video conversion method: the second left picture frame and the second right picture frame are interleaved and displayed. A stereoscopic video real-time transcoding system based on internet server, the system comprises a server and a client
^山 ^Mountain
¾;  3⁄4;
服务端存储普通视频文件或通用格式的立体视频文件, 以备客户端访问; 客 户端通过网络访问服务端中存储的普通视频文件或通用格式的立体视频文件; 所述服务端包括:  The server stores a normal video file or a stereo video file in a common format for client access; the client accesses a normal video file stored in the server or a stereo video file in a common format through the network; the server includes:
普通视频转换单元,用以在客户端访问的是普通视频文件时, 实时将普通视 频文件转换成用户选择的立体视频格式或系统设定的立体视频格式,并传输给用 户;  The common video conversion unit is configured to convert the ordinary video file into a stereo video format selected by the user or a stereoscopic video format set by the system in real time when the client accesses the normal video file, and transmits the video file to the user;
立体视频转换单元,用以在客户端访问的是通用格式的立体视频文件、且用 户选择或系统设定的立体视频格式为非通用格式时,实时将通用格式的立体视频 文件转换成用户选择的立体视频格式或系统设定的立体视频格式, 并传输给用 户。  The stereoscopic video conversion unit is configured to convert the stereo format video file of the universal format into a user-selected real-time when the client accesses the stereoscopic video file in a common format and the stereoscopic video format selected by the user or the system is a non-universal format. A stereo video format or a stereoscopic video format set by the system and transmitted to the user.
作为本发明的一种优选方案,在客户端访问的是普通视频文件时,用户可选 择或系统设定的立体视频格式包括左右格式、 上下格式、 红蓝格式、 快门格式和 交错格式中的一种或多种; 所述普通视频转换单元的转换方法具体如下:  As a preferred solution of the present invention, when the client accesses a normal video file, the user-selectable or system-set stereoscopic video format includes one of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format. One or more types; the conversion method of the ordinary video conversion unit is specifically as follows:
1)左右格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧作为左右格式立体视频的左半部分画面, 将右画面帧作 为左右格式立体视频的右半部分画面, 然后显示出来;  1) Left and right format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video, then displayed;
2)上下格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧作为上下格式立体视频的上半部分画面, 将右画面帧作 为上下格式立体视频的下半部分画面, 然后显示出来;  2) Up and down format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video, then displayed;
3)红蓝格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧的红颜色分量作为红蓝格式立体视频的红色分量, 将右 画面帧的蓝色分量和绿色分量作为红蓝格式立体视频的蓝色分量和绿色分量,然 后显示出来; 3) Red and blue format stereo video conversion method: convert the plane frame of the ordinary video file into the left picture frame and After the right picture frame, the red color component of the left picture frame is used as the red component of the stereoscopic video of the red and blue format, and the blue component and the green component of the right picture frame are used as the blue component and the green component of the stereoscopic video of the red and blue format, and then displayed. come out;
4)快门格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后, 将左画面帧和右画面帧按先后时间顺序显示出来;  4) Shutter format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are displayed in sequential time order;
5)交错格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后, 将左画面帧和右画面帧交错叠加后显示出来。  5) Interlaced format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed.
作为本发明的一种优选方案, 当客户端访问的是通用格式的立体视频文件 时,所述立体视频转换单元根据用户选择或系统设定的立体视频格式执行不同步 骤;  As a preferred solution of the present invention, when the client accesses the stereoscopic video file in the universal format, the stereoscopic video conversion unit performs the unsynchronization according to the stereoscopic video format selected by the user or the system;
若用户选择或系统设定的立体视频为通用格式的立体视频一一若用户选择 或系统设定的立体视频为已存储的通用格式的立体视频文件,服务端将已存储通 用格式的立体视频文件直接传输给用户; 否则,服务端的立体视频转换单元将已 存储通用格式的立体视频文件转换为用户选择或系统设定的其他通用格式的立 体视频;  If the stereoscopic video selected by the user or the system is a stereoscopic video of a universal format, if the stereoscopic video selected by the user or set by the system is a stereoscopic video file of the stored universal format, the server will store the stereoscopic video file of the universal format. Directly transmitted to the user; otherwise, the stereoscopic video conversion unit of the server converts the stereoscopic video file that has been stored in the common format into a stereoscopic video of other common formats selected by the user or set by the system;
若用户选择或系统设定的立体视频为非通用格式的立体视频一一服务端的 立体视频转换单元实时将通用格式的立体视频文件转换成用户选择或系统设定 的非通用格式的立体视频格式, 并传输给用户。  If the stereoscopic video selected by the user or the system is a non-universal format stereoscopic video, the stereoscopic video conversion unit of the server converts the stereo video file of the universal format into a stereoscopic video format of a non-universal format set by the user or the system. And transmitted to the user.
作为本发明的一种优选方案,通用格式的立体视频文件为左右格式立体视频 或上下格式的立体视频; 所述非通用格式的立体视频包括红蓝格式、快门格式和 交错格式的立体视频;  As a preferred solution of the present invention, the stereo video file of the universal format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format; the stereoscopic video of the non-universal format includes a stereoscopic video of a red-blue format, a shutter format, and an interlaced format;
将已存储通用格式的立体视频文件转换为用户选择或系统设定的其他通用 格式的立体视频的方法包括:  A method of converting a stereoscopic video file that has been stored in a general format into a stereoscopic video of other general format selected by the user or the system includes:
通过已有左右格式立体视频转换成上下格式立体视频的方法:将左右格式立 体视频的左半部分画面和右半部分画面作为第二左画面帧和第二右画面帧;将第 二左画面帧作为上下格式立体视频的上半部分画面,将第二右画面帧作为上下格 式立体视频的下半部分画面, 然后显示出来;  The method of converting the left and right format stereo video into the upper and lower format stereo video: using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; the second left picture frame As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed;
通过已有上下格式立体视频转换成左右格式立体视频的方法:将上下格式立 体视频的下半部分画面和上半部分画面作为第二左画面帧和第二右画面帧;第二 左画面帧作为左右格式立体视频的左半部分画面,将第二右画面帧作为左右格式 立体视频的右半部分画面, 然后显示出来; A method of converting a stereo video into a left and right format by using an existing upper and lower format stereo video: The lower half picture and the upper half picture of the body video are used as the second left picture frame and the second right picture frame; the second left picture frame is used as the left half picture of the left and right format stereo video, and the second right picture frame is used as the left and right format The right half of the stereo video, then displayed;
服务端的立体视频转换单元实时将已有通用格式的立体视频文件转换成用 户选择的或系统设定的非通用格式的立体视频格式, 并传输给用户; 视频转换方 法包括:  The stereoscopic video conversion unit of the server converts the stereo video file of the existing common format into a stereo video format of a non-universal format selected by the user or set by the system, and transmits the video to the user. The video conversion method includes:
步骤 S3221 : 将左右格式立体视频的左半部分画面和右半部分画面作为第二 左画面帧和第二右画面帧,或者将上下格式立体视频的下半部分画面和上半部分 画面作为第二左画面帧和第二右画面帧;  Step S3221: The left half picture and the right half picture of the left and right format stereo video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part picture of the upper and lower format stereo video are used as the second a left picture frame and a second right picture frame;
步骤 S3222 : 按照如下方法将左右格式立体视频或上下格式立体视频转换成 红蓝格式或快门格式或交错格式的立体视频:  Step S3222: Convert the left and right format stereo video or the upper and lower format stereo video into a stereoscopic video in red-blue format or shutter format or interlaced format as follows:
红蓝格式立体视频转换方法:将第二左画面帧的红颜色分量作为红蓝格式立 体视频的红色分量,将第二右画面帧的蓝色分量和绿色分量作为红蓝格式立体视 频的蓝色分量和绿色分量, 然后显示出来;  Red and blue format stereo video conversion method: the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the blue of the red and blue format stereoscopic video. The component and the green component are then displayed;
快门格式立体视频转换方法:将第二左画面帧和第二右画面帧按先后时间顺 序显示出来;  Shutter format stereo video conversion method: displaying the second left picture frame and the second right picture frame in sequential order;
交错格式立体视频转换方法:将第二左画面帧和第二右画面帧交错叠加后显 示出来。 本发明的有益效果在于:本发明提出的基于互联网服务端立体视频实时转码 方法及系统,首先在互联网服务端上保存普通视频文件或通用格式的立体视频文 件, 以备客户端访问; 当互联网客户端通过网络访问普通视频文件或通用格式的 立体视频文件的时候, 互联网服务端实时将普通视频文件转换成立体视频, 或者 将通用格式的立体视频转换成其他格式的立体视频;互联网服务端将转换后视频 数据传输给互联网客户端; 用户可以根据自身的需求,选择需要转换的立体视频 格式, 包括左右格式、 上下格式、 红蓝格式、 快门格式、 交错格式等, 从而达到 通过互联网观看立体视频的目的。 附图说明 Interlaced format stereo video conversion method: the second left picture frame and the second right picture frame are interleaved and displayed. The invention has the beneficial effects that the method and system for real-time transcoding of the stereoscopic video based on the Internet server according to the present invention firstly save the ordinary video file or the stereo video file in the common format on the Internet server for the client to access; When the client accesses a normal video file or a stereo video file in a common format through the network, the Internet server converts the normal video file into a body video in real time, or converts the stereo video of the universal format into a stereo video of other formats; the Internet server will The converted video data is transmitted to the Internet client; the user can select the stereoscopic video format to be converted according to his own needs, including the left and right format, the upper and lower format, the red and blue format, the shutter format, the interlaced format, etc., thereby achieving stereoscopic video viewing through the Internet. the goal of. DRAWINGS
图 1为本发明基于互联网服务端实时转码的立体视频系统的示意图。  FIG. 1 is a schematic diagram of a stereoscopic video system based on real-time transcoding of an Internet server according to the present invention.
图 2为本发明立体视频实时转码方法的流程图。  2 is a flow chart of a stereo video real-time transcoding method according to the present invention.
图 3 为本发明一个实施例中基于互联网服务端实时转码的立体视频系统的 流程图。  FIG. 3 is a flowchart of a stereoscopic video system based on real-time transcoding of an Internet server according to an embodiment of the present invention.
图 4 为本发明另一实施例中基于互联网服务端实时转码的立体视频系统的 流程图。 具体实施方式  FIG. 4 is a flowchart of a stereoscopic video system based on real-time transcoding of an Internet server according to another embodiment of the present invention. detailed description
下面结合附图详细说明本发明的优选实施例。  Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
实施例一  Embodiment 1
请参阅图 1, 本发明揭示了一种基于互联网服务端立体视频实时转码方法, 所述方法包括:  Referring to FIG. 1, the present invention discloses a real-time transcoding method for stereoscopic video based on an Internet server, and the method includes:
服务端存储普通视频文件或通用格式的立体视频文件;  The server stores a normal video file or a stereo video file in a common format;
客户端通过网络访问服务端中存储的普通视频文件或通用格式的立体视频 文件;  The client accesses a normal video file stored in the server or a stereo video file in a common format through the network;
服务端实时将普通视频文件转换成立体视频,或者将通用格式的立体视频转 换成非通用格式的立体视频; 服务端将转换后视频数据传输给客户端。  The server converts the normal video file into a body video in real time, or converts the stereo video of the universal format into a stereo video of a non-generic format; the server transmits the converted video data to the client.
具体地, 请参阅图 2, 本发明立体视频实时转码方法包括如下步骤: 【步骤 Sl】服务端存储普通视频文件或通用格式的立体视频文件, 以备客 户端访问;  Specifically, referring to FIG. 2, the stereo video real-time transcoding method of the present invention includes the following steps: [Step S1] The server stores a normal video file or a stereo video file in a common format for client access;
【步骤 S2】客户端通过网络访问服务端中存储的普通视频文件或通用格式 的立体视频文件;  [Step S2] The client accesses a normal video file stored in the server or a stereo video file in a common format through the network;
【步骤 S31】当客户端访问的是普通视频文件时, 服务端实时将普通视频文 件转换成用户选择的立体视频格式或系统设定的立体视频格式, 并传输给用户; [Step S31] When the client accesses the normal video file, the server converts the ordinary video file into a stereoscopic video format selected by the user or a stereoscopic video format set by the system in real time, and transmits the same to the user;
【步骤 S32】当客户端访问的是通用格式的立体视频文件、 且用户选择或系 统设定的立体视频格式为非通用格式时,服务端实时将通用格式的立体视频文件 转换成用户选择的立体视频格式或系统设定的立体视频格式, 并传输给用户。 其中, 所述步骤 S1中, 所述普通视频文件指平面视频, 即非立体视频文件; 这种视频文件的存储格式采用的是 FLV, F4V或 MP4格式,但不限于上述三种格式, 视频文件的压缩方式采用 h. 263或 h. 264, 但不限于上述两种压缩方式。 所述通 用格式的立体视频文件,采用的是左右格式的立体视频文件或上下格式的立体视 频文件; 其存储格式和压缩方式与普通视频文件相同。 [Step S32] When the client accesses the stereoscopic video file in a common format, and the stereoscopic video format selected by the user or the system is a non-universal format, the server can perform the stereo video file of the universal format in real time. It is converted into a stereoscopic video format selected by the user or a stereoscopic video format set by the system, and transmitted to the user. In the step S1, the common video file refers to a plane video, that is, a non-stereo video file; the storage format of the video file is in the FLV, F4V or MP4 format, but is not limited to the above three formats, the video file. The compression method uses h. 263 or h. 264, but is not limited to the above two compression methods. The stereo video file of the universal format adopts a stereo video file of a left and right format or a stereo video file of a top and bottom format; the storage format and compression mode are the same as those of a normal video file.
步骤 S2中, 互联网客户端通过互联网访问普通视频文件或通用格式的立体 视频文件, 其中网络传输采用的是 http协议或 rtsp协议,但不限于上述两种传 输协议,其中的网络访问方式包括有线互联网访问方式或无线互联网网络访问方 式。  In step S2, the Internet client accesses a common video file or a stereo video file in a common format through the Internet, wherein the network transmission uses the http protocol or the rtsp protocol, but is not limited to the above two transmission protocols, wherein the network access method includes a wired internet. Access method or wireless internet access method.
所述步骤 S31中, 服务端实时将普通视频文件转换成立体视频的方法包括: 将普通视频文件的平面帧转换成左画面帧和右画面帧。可采用背景技术中提及的 《一个运动立体组合的生理学模型和类普尔弗里希现象的一般性解释》文中公开 的方法, 将普通视频文件的平面帧转换成左画面帧和右画面帧。  In the step S31, the method for the server to convert the normal video file into the body video in real time includes: converting the plane frame of the ordinary video file into the left picture frame and the right picture frame. The planar frame of the ordinary video file can be converted into a left picture frame and a right picture frame by the method disclosed in the "Physiological Model of a Sports Stereo Combination and the General Interpretation of the Like-Pulture phenomenon" mentioned in the background art.
所述步骤 S31中, 用户可选择或系统设定的立体视频格式可包括左右格式、 上下格式、 红蓝格式、 快门格式和交错格式中的一种或多种, 各种格式的转换方 法具体如下:  In the step S31, the user-selectable or system-set stereoscopic video format may include one or more of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format, and the conversion methods of the various formats are specifically as follows: :
1)左右格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧作为左右格式立体视频的左半部分画面, 将右画面帧作 为左右格式立体视频的右半部分画面, 然后显示出来。  1) Left and right format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video is then displayed.
2)上下格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧作为上下格式立体视频的上半部分画面, 将右画面帧作 为上下格式立体视频的下半部分画面, 然后显示出来。  2) Up and down format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video is then displayed.
3)红蓝格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧的红颜色分量作为红蓝格式立体视频的红色分量, 将右 画面帧的蓝色分量和绿色分量作为红蓝格式立体视频的蓝色分量和绿色分量,然 后显示出来。  3) Red and blue format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the red color component of the left picture frame is used as the red component of the red and blue format stereo video, and the right picture frame is The blue component and the green component are used as the blue component and the green component of the stereoscopic video in red and blue format, and then displayed.
4)快门格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后, 将左画面帧和右画面帧按先后时间顺序显示出来。 4) Shutter format stereo video conversion method: convert the plane frame of the ordinary video file into the left picture frame and After the right picture frame, the left picture frame and the right picture frame are displayed in sequential order.
5)交错格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后, 将左画面帧和右画面帧交错叠加后显示出来。  5) Interlaced format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed.
所述步骤 S32具体可包括如下步骤:  The step S32 may specifically include the following steps:
【步骤 S320】 当客户端访问的是通用格式的立体视频文件时, 根据用户选 择或系统设定的立体视频格式执行步骤 S321或步骤 S322 ; 若用户选择或系统设 定的立体视频为通用格式的立体视频, 执行步骤 S321 ; 若用户选择或系统设定 的立体视频为非通用格式的立体视频, 执行步骤 S322。  [Step S320] When the client accesses the stereoscopic video file in the universal format, step S321 or step S322 is performed according to the stereoscopic video format selected by the user or the system; if the stereoscopic video selected by the user or the system is in the general format For the stereoscopic video, step S321 is performed; if the stereoscopic video selected by the user or set by the system is a stereoscopic video of a non-generic format, step S322 is performed.
【步骤 S321】若用户选择或系统设定的立体视频为已存储的通用格式的立 体视频文件, 服务端将已存储通用格式的立体视频文件直接传输给用户。 否则, 将已存储通用格式的立体视频文件转换为用户选择或系统设定的其他通用格式 的立体视频。 转换方法包括:  [Step S321] If the stereoscopic video selected by the user or the system is a stored stereo video file of a common format, the server directly transmits the stereoscopic video file that has been stored in the universal format to the user. Otherwise, the stereoscopic video files that have been stored in the common format are converted into stereoscopic videos of other common formats selected by the user or set by the system. Conversion methods include:
通过已有左右格式立体视频转换成上下格式立体视频的方法:将左右格式立 体视频的左半部分画面和右半部分画面作为第二左画面帧和第二右画面帧;将第 二左画面帧作为上下格式立体视频的上半部分画面,将第二右画面帧作为上下格 式立体视频的下半部分画面, 然后显示出来。  The method of converting the left and right format stereo video into the upper and lower format stereo video: using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; the second left picture frame As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed.
通过已有上下格式立体视频转换成左右格式立体视频的方法:将上下格式立 体视频的下半部分画面和上半部分画面作为第二左画面帧和第二右画面帧;第二 左画面帧作为左右格式立体视频的左半部分画面,将第二右画面帧作为左右格式 立体视频的右半部分画面, 然后显示出来。  A method for converting a stereoscopic video into a left and right format stereo video by using the upper and lower format stereo video: the lower half image and the upper half image of the upper and lower format stereo video are used as the second left frame frame and the second right frame frame; the second left frame frame is used as the second left frame frame The left half of the left-right format stereo video is used as the right half of the left-right format stereo video, and then displayed.
【步骤 S322】服务端实时将通用格式的立体视频文件转换成用户选择的立 体视频格式或系统设定的非通用格式的立体视频格式, 并传输给用户。  [Step S322] The server converts the stereo video file of the universal format into a stereo video format selected by the user or a non-universal format set by the system in real time, and transmits the video to the user.
所述步骤 S32中,通用格式的立体视频文件为左右格式立体视频或上下格式 的立体视频; 所述非通用格式的立体视频包括红蓝格式、快门格式和交错格式的 立体视频。服务端实时将已有通用格式的立体视频文件转换成用户选择的或系统 设定的立体视频格式, 并传输给用户; 视频转换方法包括:  In the step S32, the stereoscopic video file in the common format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format; the stereoscopic video of the non-universal format includes a stereoscopic video of a red-blue format, a shutter format, and an interlaced format. The server converts the stereo video file in the common format into a stereoscopic video format selected by the user or set in the system in real time, and transmits the video to the user. The video conversion method includes:
步骤 S3221 : 将左右格式立体视频的左半部分画面和右半部分画面作为第二 左画面帧和第二右画面帧,或者将上下格式立体视频的下半部分画面和上半部分 画面作为第二左画面帧和第二右画面帧; Step S3221: The left half picture and the right half picture of the left and right format stereo video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part of the top and bottom format stereo video are The picture is used as a second left picture frame and a second right picture frame;
步骤 S3222 : 按照如下方法将左右格式立体视频或上下格式立体视频转换成 红蓝格式或快门格式或交错格式的立体视频:  Step S3222: Convert the left and right format stereo video or the upper and lower format stereo video into a stereoscopic video in red-blue format or shutter format or interlaced format as follows:
红蓝格式立体视频转换方法:将第二左画面帧的红颜色分量作为红蓝格式立 体视频的红色分量,将第二右画面帧的蓝色分量和绿色分量作为红蓝格式立体视 频的蓝色分量和绿色分量, 然后显示出来;  Red and blue format stereo video conversion method: the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the blue of the red and blue format stereoscopic video. The component and the green component are then displayed;
快门格式立体视频转换方法:将第二左画面帧和第二右画面帧按先后时间顺 序显示出来;  Shutter format stereo video conversion method: displaying the second left picture frame and the second right picture frame in sequential order;
交错格式立体视频转换方法:将第二左画面帧和第二右画面帧交错叠加后显 示出来。  Interlaced format stereo video conversion method: the second left picture frame and the second right picture frame are interleaved and displayed.
【步骤 S33】或者, 服务端预先将普通视频文件转换成用户选择的立体视频 格式,或将通用立体格式的立体视频文件转换成用户选择的立体视频格式; 当用 户选择访问立体视频的时候, 服务端直接将预先转换的立体视频发送给客户端。 以上介绍了本发明立体视频实时转码方法,本发明在揭示上述立体视频实时 转码方法的同时, 还揭示一种立体视频实时转码系统。 可参阅图 1, 所述系统包 括服务端、 客户端; 服务端存储普通视频文件或通用格式的立体视频文件, 以备 客户端访问;客户端通过网络访问服务端中存储的普通视频文件或通用格式的立 体视频文件。  [Step S33] Alternatively, the server converts the normal video file into a stereoscopic video format selected by the user, or converts the stereoscopic video file in the universal stereo format into a stereoscopic video format selected by the user; when the user selects to access the stereoscopic video, the service The terminal directly sends the pre-converted stereo video to the client. The above is a stereoscopic video real-time transcoding method of the present invention. The present invention also discloses a stereoscopic video real-time transcoding system. Referring to FIG. 1, the system includes a server and a client; the server stores a normal video file or a stereo video file in a common format for client access; and the client accesses a common video file or a universal file stored in the server through a network. Formatted stereo video file.
所述服务端包括: 普通视频转换单元、 立体视频转换单元。普通视频转换单 元用以在客户端访问的是普通视频文件时,实时将普通视频文件转换成用户选择 的立体视频格式或系统设定的立体视频格式, 并传输给用户。立体视频转换单元 用以在客户端访问的是通用格式的立体视频文件、且用户选择或系统设定的立体 视频格式为非通用格式时,实时将通用格式的立体视频文件转换成用户选择的立 体视频格式或系统设定的立体视频格式, 并传输给用户。  The server includes: a common video conversion unit and a stereoscopic video conversion unit. The ordinary video conversion unit is configured to convert the ordinary video file into a stereoscopic video format selected by the user or a stereoscopic video format set by the system in real time when the client accesses the normal video file, and transmits the video file to the user. The stereoscopic video conversion unit is configured to convert the stereoscopic video file of the universal format into a stereo selected by the user in real time when the client accesses the stereoscopic video file in a common format and the stereoscopic video format selected by the user or the system is a non-universal format. The stereo format of the video format or system settings is transmitted to the user.
当客户端访问的是普通视频文件时,用户可选择或系统设定的立体视频格式 包括左右格式、 上下格式、 红蓝格式、 快门格式和交错格式中的一种或多种; 所 述普通视频转换单元的转换方法具体如下: 1)左右格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧作为左右格式立体视频的左半部分画面, 将右画面帧作 为左右格式立体视频的右半部分画面, 然后显示出来; When the client accesses a normal video file, the user-selectable or system-set stereoscopic video format includes one or more of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format; The conversion method of the conversion unit is as follows: 1) Left and right format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video, then displayed;
2)上下格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧作为上下格式立体视频的上半部分画面, 将右画面帧作 为上下格式立体视频的下半部分画面, 然后显示出来;  2) Up and down format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video, then displayed;
3)红蓝格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后,将左画面帧的红颜色分量作为红蓝格式立体视频的红色分量, 将右 画面帧的蓝色分量和绿色分量作为红蓝格式立体视频的蓝色分量和绿色分量,然 后显示出来;  3) Red and blue format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the red color component of the left picture frame is used as the red component of the red and blue format stereo video, and the right picture frame is The blue component and the green component are used as the blue component and the green component of the stereoscopic video in red and blue format, and then displayed;
4)快门格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后, 将左画面帧和右画面帧按先后时间顺序显示出来;  4) Shutter format stereo video conversion method: after converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are displayed in sequential time order;
5)交错格式立体视频转换方法:将普通视频文件的平面帧转换成左画面帧和 右画面帧后, 将左画面帧和右画面帧交错叠加后显示出来。  5) Interlaced format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed.
当客户端访问的是通用格式的立体视频文件时,所述立体视频转换单元根据 用户选择或系统设定的立体视频格式执行不同步骤。  When the client accesses a stereoscopic video file of a general format, the stereoscopic video conversion unit performs different steps according to a stereoscopic video format selected by the user or set by the system.
若用户选择或系统设定的立体视频为通用格式的立体视频一一若用户选择 或系统设定的立体视频为已存储的通用格式的立体视频文件,服务端将已存储通 用格式的立体视频文件直接传输给用户; 否则,服务端的立体视频转换单元将已 存储通用格式的立体视频文件转换为用户选择或系统设定的其他通用格式的立 体视频。  If the stereoscopic video selected by the user or the system is a stereoscopic video of a universal format, if the stereoscopic video selected by the user or set by the system is a stereoscopic video file of the stored universal format, the server will store the stereoscopic video file of the universal format. Directly transmitted to the user; otherwise, the stereoscopic video conversion unit of the server converts the stereoscopic video file that has been stored in the common format into stereoscopic video of other common formats selected by the user or set by the system.
若用户选择或系统设定的立体视频为非通用格式的立体视频一一服务端的 立体视频转换单元实时将通用格式的立体视频文件转换成用户选择或系统设定 的非通用格式的立体视频格式, 并传输给用户。  If the stereoscopic video selected by the user or the system is a non-universal format stereoscopic video, the stereoscopic video conversion unit of the server converts the stereo video file of the universal format into a stereoscopic video format of a non-universal format set by the user or the system. And transmitted to the user.
通用格式的立体视频文件为左右格式立体视频或上下格式的立体视频;所述 非通用格式的立体视频包括红蓝格式、 快门格式和交错格式的立体视频。  The stereoscopic video file of the universal format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format; the stereoscopic video of the non-universal format includes a stereoscopic video of a red-blue format, a shutter format, and an interlaced format.
将已存储通用格式的立体视频文件转换为用户选择或系统设定的立体视频 格式的方法包括: 通过已有左右格式立体视频转换成上下格式立体视频的方法:将左右格式立 体视频的左半部分画面和右半部分画面作为第二左画面帧和第二右画面帧;将第 二左画面帧作为上下格式立体视频的上半部分画面,将第二右画面帧作为上下格 式立体视频的下半部分画面, 然后显示出来; A method of converting a stereoscopic video file that has been stored in a common format into a stereoscopic video format selected by a user or a system includes: The method of converting the left and right format stereo video into the upper and lower format stereo video: using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; the second left picture frame As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed;
通过已有上下格式立体视频转换成左右格式立体视频的方法:将上下格式立 体视频的下半部分画面和上半部分画面作为第二左画面帧和第二右画面帧;第二 左画面帧作为左右格式立体视频的左半部分画面,将第二右画面帧作为左右格式 立体视频的右半部分画面, 然后显示出来。  A method for converting a stereoscopic video into a left and right format stereo video by using the upper and lower format stereo video: the lower half image and the upper half image of the upper and lower format stereo video are used as the second left frame frame and the second right frame frame; the second left frame frame is used as the second left frame frame The left half of the left-right format stereo video is used as the right half of the left-right format stereo video, and then displayed.
服务端的立体视频转换单元实时将已有通用格式的立体视频文件转换成用 户选择的或系统设定的非通用格式的立体视频格式, 并传输给用户。视频转换方 法包括:  The stereoscopic video conversion unit of the server converts the stereo video file of the existing common format into a stereo video format of a non-universal format selected by the user or set by the system in real time, and is transmitted to the user. Video conversion methods include:
步骤 S3221 : 将左右格式立体视频的左半部分画面和右半部分画面作为第二 左画面帧和第二右画面帧,或者将上下格式立体视频的下半部分画面和上半部分 画面作为第二左画面帧和第二右画面帧;  Step S3221: The left half picture and the right half picture of the left and right format stereo video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part picture of the upper and lower format stereo video are used as the second a left picture frame and a second right picture frame;
步骤 S3222 : 按照如下方法将左右格式立体视频或上下格式立体视频转换成 红蓝格式或快门格式或交错格式的立体视频:  Step S3222: Convert the left and right format stereo video or the upper and lower format stereo video into a stereoscopic video in red-blue format or shutter format or interlaced format as follows:
红蓝格式立体视频转换方法:将第二左画面帧的红颜色分量作为红蓝格式立 体视频的红色分量,将第二右画面帧的蓝色分量和绿色分量作为红蓝格式立体视 频的蓝色分量和绿色分量, 然后显示出来;  Red and blue format stereo video conversion method: the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the blue of the red and blue format stereoscopic video. The component and the green component are then displayed;
快门格式立体视频转换方法:将第二左画面帧和第二右画面帧按先后时间顺 序显示出来;  Shutter format stereo video conversion method: displaying the second left picture frame and the second right picture frame in sequential order;
交错格式立体视频转换方法:将第二左画面帧和第二右画面帧交错叠加后显 示出来。 实施例二  Interlaced format stereo video conversion method: the second left picture frame and the second right picture frame are interleaved and displayed. Embodiment 2
如图 2 所示, 本实施例揭示一种基于互联网服务端实时转码的立体视频系 统, 该系统的实时转码方法包括以下步骤:  As shown in FIG. 2, this embodiment discloses a stereoscopic video system based on real-time transcoding of an Internet server. The real-time transcoding method of the system includes the following steps:
1 ) 互联网服务端保存普通视频文件,视频编码方式采用 H. 264; 2 ) 互联网客户端通过互联网络 http协议访问普通视频文件;1) The Internet server saves the normal video file, and the video encoding method adopts H.264; 2) The Internet client accesses the ordinary video file through the Internet http protocol;
3 ) 联网服务端采用 C++编实时将普通视频文件转换成红蓝立体视频, 并传 送给客户端显示给用户。 实施例三 3) The network server uses C++ to convert the ordinary video files into red and blue stereo videos in real time and send them to the client for display to the user. Embodiment 3
如图 3 所示, 本实施例揭示一种基于互联网服务端实时转码的立体视频系 统, 该系统的实时转码方法包括以下步骤:  As shown in FIG. 3, this embodiment discloses a stereoscopic video system based on real-time transcoding of an Internet server. The real-time transcoding method of the system includes the following steps:
1 ) 互联网服务端保存普通视频文件,视频编码方式采用 H. 264;  1) The Internet server saves the normal video file, and the video encoding method adopts H.264;
2 ) 互联网客户端通过互联网络 RTSP协议访问普通视频文件;  2) The Internet client accesses the ordinary video file through the Internet RTSP protocol;
3 ) 联网服务端采用 C++编实时将普通视频文件转换成红蓝立体视频, 并传 送给客户端显示给用户。 综上所述, 本发明提出的基于互联网服务端立体视频实时转码方法及系统, 首先在互联网服务端上保存普通视频文件或通用格式的立体视频文件,以备客户 端访问;当互联网客户端通过网络访问普通视频文件或通用格式的立体视频文件 的时候, 互联网服务端实时将普通视频文件转换成立体视频, 或者将通用格式的 立体视频转换成其他格式的立体视频;互联网服务端将转换后视频数据传输给互 联网客户端; 用户可以根据自身的需求, 选择需要转换的立体视频格式, 包括左 右格式、 上下格式、 红蓝格式、 快门格式、 交错格式等, 从而达到通过互联网观 看立体视频的目的。 这里本发明的描述和应用是说明性的,并非想将本发明的范围限制在上述实 施例中。这里所披露的实施例的变形和改变是可能的,对于那些本领域的普通技 术人员来说实施例的替换和等效的各种部件是公知的。本领域技术人员应该清楚 的是, 在不脱离本发明的精神或本质特征的情况下, 本发明可以以其它形式、 结 构、 布置、 比例, 以及用其它组件、 材料和部件来实现。 在不脱离本发明范围和 精神的情况下, 可以对这里所披露的实施例进行其它变形和改变。  3) The network server uses C++ to convert the ordinary video files into red and blue stereo videos in real time and send them to the client for display to the user. In summary, the method and system for real-time transcoding of a stereoscopic video based on an Internet server is proposed, and firstly, a common video file or a stereo video file in a general format is stored on the Internet server for client access; when the Internet client When accessing a normal video file or a stereo video file in a universal format through the network, the Internet server converts the normal video file into a body video in real time, or converts the stereo video of the universal format into a stereo video of another format; the Internet server will convert The video data is transmitted to the Internet client; the user can select the stereoscopic video format to be converted according to his own needs, including the left and right format, the upper and lower format, the red and blue format, the shutter format, the interlaced format, etc., thereby achieving the purpose of viewing the stereoscopic video through the Internet. . The description and application of the present invention are intended to be illustrative, and not intended to limit the scope of the invention. Variations and modifications of the embodiments disclosed herein are possible, and various alternative and equivalent components of the embodiments are well known to those of ordinary skill in the art. It is apparent to those skilled in the art that the present invention may be embodied in other forms, configurations, arrangements, ratios, and other components, materials and components without departing from the spirit or essential characteristics of the invention. Other variations and modifications of the embodiments disclosed herein may be made without departing from the scope and spirit of the invention.

Claims

权利要求  Rights request
、 一种基于互联网服务端立体视频实时转码方法, 其特征在于, 所述方法包括 如下步骤: A method for real-time transcoding of a stereoscopic video based on an Internet server, characterized in that the method comprises the following steps:
51、 服务端存储普通视频文件或通用格式的立体视频文件, 以备客户端 访问;  51. The server stores a normal video file or a stereo video file in a common format for client access.
52、 客户端通过网络访问服务端中存储的普通视频文件或通用格式的立 体视频文件;  52. The client accesses a common video file stored in the server or a stereo video file in a common format through the network;
531、 当客户端访问的是普通视频文件时,服务端实时将普通视频文件转 换成用户选择的立体视频格式或系统设定的立体视频格式, 并传输给用户; 531. When the client accesses the normal video file, the server converts the normal video file into a stereo video format selected by the user or a stereoscopic video format set by the system, and transmits the video file to the user.
532、 当客户端访问的是通用格式的立体视频文件、且用户选择或系统设 定的立体视频格式为非通用格式时, 服务端实时将通用格式的立体视频文件 转换成用户选择的立体视频格式或系统设定的立体视频格式,并传输给用户;532. When the client accesses the stereo video file in a common format, and the stereoscopic video format selected by the user or the system is a non-universal format, the server converts the stereo video file in the universal format into the stereo video format selected by the user in real time. Or a stereoscopic video format set by the system and transmitted to the user;
533、或者,服务端预先将普通视频文件转换成用户选择的立体视频格式, 或将通用立体格式的立体视频文件转换成用户选择的立体视频格式; 当用户 选择访问立体视频的时候, 服务端直接将预先转换的立体视频发送给客户 533. Alternatively, the server converts the ordinary video file into a stereoscopic video format selected by the user in advance, or converts the stereoscopic video file in the universal stereo format into a stereoscopic video format selected by the user; when the user selects to access the stereoscopic video, the server directly Send pre-converted stereo video to customers
、 根据权利要求 1所述的基于互联网服务端立体视频实时转码方法, 其特征在 于: The method for real-time transcoding of a stereoscopic video based on an Internet server according to claim 1, wherein:
所述步骤 S1中, 所述普通视频文件指平面视频, 即非立体视频文件; 所述通用格式的立体视频文件, 采用的是左右格式的立体视频文件或上 下格式的立体视频文件。 、 根据权利要求 1所述的基于互联网服务端立体视频实时转码方法, 其特征在 于:  In the step S1, the common video file refers to a planar video, that is, a non-stereoscopic video file; and the stereoscopic video file in the universal format adopts a stereoscopic video file in a left-right format or a stereoscopic video file in a top-down format. The method for real-time transcoding of a stereoscopic video based on an Internet server according to claim 1, wherein:
所述步骤 S31中, 服务端实时将普通视频文件转换成立体视频的方法包 括: 将普通视频文件的平面帧转换成左画面帧和右画面帧。 、 根据权利要求 1所述的基于互联网服务端立体视频实时转码方法, 其特征在 于: In the step S31, the method for the server to convert the normal video file into the body video in real time includes: converting the plane frame of the ordinary video file into the left picture frame and the right picture frame. The method for real-time transcoding of a stereoscopic video based on an Internet server according to claim 1, wherein:
所述步骤 S31中,用户可选择或系统设定的立体视频格式包括左右格式、 上下格式、 红蓝格式、 快门格式和交错格式中的一种或多种, 各视频格式的 转换方法如下:  In the step S31, the user-selectable or system-set stereoscopic video format includes one or more of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format. The conversion method of each video format is as follows:
1)左右格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧作为左右格式立体视频的左半部分画面, 将右 画面帧作为左右格式立体视频的右半部分画面, 然后显示出来;  1) Left and right format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video, then displayed;
2)上下格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧作为上下格式立体视频的上半部分画面, 将右 画面帧作为上下格式立体视频的下半部分画面, 然后显示出来;  2) Up and down format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video, then displayed;
3)红蓝格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧的红颜色分量作为红蓝格式立体视频的红色分 量, 将右画面帧的蓝色分量和绿色分量作为红蓝格式立体视频的蓝色分量和 绿色分量, 然后显示出来;  3) Red and blue format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the red color component of the left picture frame is used as the red component of the red and blue format stereo video, and the right picture frame is The blue component and the green component are used as the blue component and the green component of the stereoscopic video in red and blue format, and then displayed;
4)快门格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧和右画面帧按先后时间顺序显示出来;  4) Shutter format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are displayed in sequential time order;
5)交错格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧和右画面帧交错叠加后显示出来。 、 根据权利要求 1所述的基于互联网服务端立体视频实时转码方法, 其特征在 于:  5) Interlaced format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed. The method for real-time transcoding of a stereoscopic video based on an Internet server according to claim 1, wherein:
所述步骤 S32具体包括:  The step S32 specifically includes:
S320、 当客户端访问的是通用格式的立体视频文件时, 根据用户选择或 系统设定的立体视频格式执行步骤 S321或步骤 S322 ; 若用户选择或系统设 定的立体视频为通用格式的立体视频, 执行步骤 S321 ; 若用户选择或系统设 定的立体视频为非通用格式的立体视频, 执行步骤 S322 ;  S320. When the client accesses the stereoscopic video file in the universal format, step S321 or step S322 is performed according to the stereoscopic video format selected by the user or the system; if the stereoscopic video selected by the user or the system is a stereoscopic video of the universal format Step S321 is performed; if the stereoscopic video selected by the user or set by the system is a stereoscopic video of a non-universal format, step S322 is performed;
S32 K 若用户选择或系统设定的立体视频为已存储的通用格式立体视频 文件, 服务端将已存储的通用格式立体视频文件直接传输给用户; 否则, 将 已存储的通用格式立体视频文件转换为用户选择或系统设定的其他通用格式 的立体视频; S32 K If the user selects or the system-set stereoscopic video is a stored universal format stereo video a file, the server directly transmits the stored universal format stereo video file to the user; otherwise, converting the stored general format stereo video file into a stereoscopic video of other common format selected by the user or set by the system;
S322、 服务端实时将通用格式的立体视频文件转换成用户选择或系统设 定的非通用格式的立体视频格式, 并传输给用户。 、 根据权利要求 5所述的基于互联网服务端立体视频实时转码方法, 其特征在 于:  S322: The server converts the stereo video file of the universal format into a stereo video format of a non-generic format selected by the user or set by the system in real time, and transmits the video to the user. The method for real-time transcoding of a stereoscopic video based on an Internet server according to claim 5, wherein:
所述步骤 S32中, 通用格式的立体视频文件为左右格式立体视频或上下 格式的立体视频; 所述非通用格式的立体视频包括红蓝格式、 快门格式和交 错格式的立体视频;  In the step S32, the stereoscopic video file in the common format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format; the stereoscopic video of the non-universal format includes a stereoscopic video of a red-blue format, a shutter format, and an interleaved format;
步骤 S321中,将已存储通用格式的立体视频文件转换为用户选择或系统 设定的其他通用格式的立体视频的方法包括:  In step S321, the method for converting the stereoscopic video file that has been stored in the common format into the stereoscopic video of other common formats selected by the user or the system includes:
通过已有左右格式立体视频转换成上下格式立体视频的方法: 将左右格 式立体视频的左半部分画面和右半部分画面作为第二左画面帧和第二右画面 帧; 将第二左画面帧作为上下格式立体视频的上半部分画面, 将第二右画面 帧作为上下格式立体视频的下半部分画面, 然后显示出来;  The method of converting the left and right format stereo video into the upper and lower format stereo video: using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed;
通过已有上下格式立体视频转换成左右格式立体视频的方法: 将上下格 式立体视频的下半部分画面和上半部分画面作为第二左画面帧和第二右画面 帧; 第二左画面帧作为左右格式立体视频的左半部分画面, 将第二右画面帧 作为左右格式立体视频的右半部分画面, 然后显示出来;  A method for converting a stereo video into a left and right format by using an existing upper and lower format stereo video: using a lower half picture and a top half picture of the upper and lower format stereo video as a second left picture frame and a second right picture frame; The left half of the left-right format stereo video, the second right frame is used as the right half of the left-right format stereo video, and then displayed;
步骤 S322中,服务端实时将已有通用格式的立体视频文件转换成用户选 择的或系统设定的非通用格式的立体视频格式, 并传输给用户; 视频转换方 法包括:  In step S322, the server converts the stereo video file in the common format into a stereo video format selected by the user or in a non-generic format set by the system in real time, and transmits the video to the user. The video conversion method includes:
步骤 S3221 : 将左右格式立体视频的左半部分画面和右半部分画面作为 第二左画面帧和第二右画面帧, 或者将上下格式立体视频的下半部分画面和 上半部分画面作为第二左画面帧和第二右画面帧;  Step S3221: The left half picture and the right half picture of the left and right format stereo video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part picture of the upper and lower format stereo video are used as the second a left picture frame and a second right picture frame;
步骤 S3222 : 按照如下方法将左右格式立体视频或上下格式立体视频转 换成红蓝格式或快门格式或交错格式的立体视频: Step S3222: Turn left and right format stereo video or upper and lower format stereo video as follows Change to stereo video in red or blue format or shutter format or interlaced format:
红蓝格式立体视频转换方法: 将第二左画面帧的红颜色分量作为红蓝格 式立体视频的红色分量, 将第二右画面帧的蓝色分量和绿色分量作为红蓝格 式立体视频的蓝色分量和绿色分量, 然后显示出来;  Red and blue format stereo video conversion method: the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the blue color of the red and blue format stereoscopic video. The component and the green component are then displayed;
快门格式立体视频转换方法: 将第二左画面帧和第二右画面帧按先后时 间顺序显示出来;  Shutter format stereo video conversion method: displaying the second left picture frame and the second right picture frame in sequential order;
交错格式立体视频转换方法: 将第二左画面帧和第二右画面帧交错叠加 后显示出来。 、 一种基于互联网服务端立体视频实时转码方法, 其特征在于,所述方法包括: 服务端存储普通视频文件或通用格式的立体视频文件;  Interlaced format stereo video conversion method: The second left picture frame and the second right picture frame are interleaved and displayed. The method for real-time transcoding of a stereoscopic video based on an Internet server, wherein the method comprises: the server storing a normal video file or a stereo video file in a universal format;
客户端通过网络访问服务端中存储的普通视频文件或通用格式的立体视 频文件;  The client accesses a normal video file stored in the server or a stereo video file in a common format through the network;
服务端实时将普通视频文件转换成立体视频, 或者将通用格式的立体视 频转换成非通用格式的立体视频; 服务端将转换后视频数据传输给客户端。 、 一种基于互联网服务端立体视频实时转码系统, 其特征在于, 所述系统包括 服务端、 客户端;  The server converts the ordinary video file into a body video in real time, or converts the stereo video of the universal format into a stereo video of a non-generic format; the server transmits the converted video data to the client. A real-time transcoding system for a stereoscopic video based on an Internet server, wherein the system includes a server and a client;
服务端存储普通视频文件或通用格式的立体视频文件,以备客户端访问; 客户端通过网络访问服务端中存储的普通视频文件或通用格式的立体视频文 件;  The server stores a normal video file or a stereo video file in a common format for client access; the client accesses a normal video file stored in the server or a stereo video file in a common format through the network;
所述服务端包括:  The server includes:
普通视频转换单元, 用以在客户端访问的是普通视频文件时, 实时将普 通视频文件转换成用户选择的立体视频格式或系统设定的立体视频格式, 并 传输给用户;  The common video conversion unit is configured to convert the normal video file into a stereoscopic video format selected by the user or a stereoscopic video format set by the system in real time when the client accesses the normal video file, and transmits the video file to the user;
立体视频转换单元, 用以在客户端访问的是通用格式的立体视频文件、 且用户选择或系统设定的立体视频格式为非通用格式时, 实时将通用格式的 立体视频文件转换成用户选择的立体视频格式或系统设定的立体视频格式, 并传输给用户。 、 根据权利要求 8所述的基于互联网服务端立体视频实时转码系统, 其特征在 于: The stereoscopic video conversion unit is configured to convert the stereo video file of the universal format into a user-selected manner in real time when the client accesses a stereoscopic video file in a universal format and the stereoscopic video format selected by the user or the system is a non-universal format. Stereoscopic video format or stereoscopic video format set by the system, And transmitted to the user. The Internet server-based stereoscopic video real-time transcoding system according to claim 8, wherein:
在客户端访问的是普通视频文件时, 用户可选择或系统设定的立体视频 格式包括左右格式、 上下格式、 红蓝格式、 快门格式和交错格式中的一种或 多种; 所述普通视频转换单元的转换方法具体如下:  When the client accesses a normal video file, the user-selectable or system-set stereoscopic video format includes one or more of a left-right format, a top-and-bottom format, a red-blue format, a shutter format, and an interlaced format; The conversion method of the conversion unit is as follows:
1)左右格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧作为左右格式立体视频的左半部分画面, 将右 画面帧作为左右格式立体视频的右半部分画面, 然后显示出来;  1) Left and right format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the left half of the left and right format stereo video, and the right picture frame is used as the left and right format stereo The right half of the video, then displayed;
2)上下格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧作为上下格式立体视频的上半部分画面, 将右 画面帧作为上下格式立体视频的下半部分画面, 然后显示出来;  2) Up and down format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame is used as the upper part of the upper and lower format stereo video, and the right picture frame is used as the upper and lower format stereo The lower part of the video, then displayed;
3)红蓝格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧的红颜色分量作为红蓝格式立体视频的红色分 量, 将右画面帧的蓝色分量和绿色分量作为红蓝格式立体视频的蓝色分量和 绿色分量, 然后显示出来;  3) Red and blue format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the red color component of the left picture frame is used as the red component of the red and blue format stereo video, and the right picture frame is The blue component and the green component are used as the blue component and the green component of the stereoscopic video in red and blue format, and then displayed;
4)快门格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧和右画面帧按先后时间顺序显示出来;  4) Shutter format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are displayed in sequential time order;
5)交错格式立体视频转换方法: 将普通视频文件的平面帧转换成左画面 帧和右画面帧后, 将左画面帧和右画面帧交错叠加后显示出来。 0、 根据权利要求 8所述的基于互联网服务端立体视频实时转码系统,其特征 在于:  5) Interlaced format stereo video conversion method: After converting the plane frame of the ordinary video file into the left picture frame and the right picture frame, the left picture frame and the right picture frame are interleaved and displayed. 0. The Internet server-based stereoscopic video real-time transcoding system according to claim 8, wherein:
当客户端访问的是通用格式的立体视频文件时, 所述立体视频转换单元 根据用户选择或系统设定的立体视频格式执行不同步骤;  When the client accesses a stereoscopic video file in a universal format, the stereoscopic video conversion unit performs different steps according to a stereoscopic video format selected by the user or set by the system;
若用户选择或系统设定的立体视频为通用格式的立体视频——若用户选 择或系统设定的立体视频为已存储的通用格式的立体视频文件, 服务端将已 存储通用格式的立体视频文件直接传输给用户; 否则, 服务端的立体视频转 换单元将已存储通用格式的立体视频文件转换为用户选择或系统设定的其他 通用格式的立体视频; If the stereo video selected by the user or the system is a stereo video in a common format - if the stereo video selected by the user or the system is a stereo video file stored in a common format, the server will have The stereoscopic video file storing the general format is directly transmitted to the user; otherwise, the stereoscopic video conversion unit of the server converts the stereoscopic video file that has been stored in the common format into a stereoscopic video of other common formats selected by the user or set by the system;
若用户选择或系统设定的立体视频为非通用格式的立体视频一一服务端 的立体视频转换单元实时将通用格式的立体视频文件转换成用户选择或系统 设定的非通用格式的立体视频格式, 并传输给用户。 、 根据权利要求 10所述的基于互联网服务端立体视频实时转码系统, 其特 征在于:  If the stereoscopic video selected by the user or the system is a non-universal format stereoscopic video, the stereoscopic video conversion unit of the server converts the stereo video file of the universal format into a stereoscopic video format of a non-universal format set by the user or the system. And transmitted to the user. The Internet server-based stereoscopic video real-time transcoding system according to claim 10, wherein the feature is:
通用格式的立体视频文件为左右格式立体视频或上下格式的立体视频; 所述非通用格式的立体视频包括红蓝格式、快门格式和交错格式的立体视频; 将已存储通用格式的立体视频文件转换为用户选择或系统设定的其他通 用格式的立体视频的方法包括:  The stereoscopic video file of the universal format is a stereoscopic video of a left-right format or a stereoscopic video of a top-and-bottom format; the stereoscopic video of the non-universal format includes a stereoscopic video of a red-blue format, a shutter format, and an interlaced format; converting a stereoscopic video file that has been stored in a common format Other methods for stereoscopic video of other common formats selected or set by the system include:
通过已有左右格式立体视频转换成上下格式立体视频的方法: 将左右格 式立体视频的左半部分画面和右半部分画面作为第二左画面帧和第二右画面 帧; 将第二左画面帧作为上下格式立体视频的上半部分画面, 将第二右画面 帧作为上下格式立体视频的下半部分画面, 然后显示出来;  The method of converting the left and right format stereo video into the upper and lower format stereo video: using the left half picture and the right half picture of the left and right format stereo video as the second left picture frame and the second right picture frame; As the upper half of the upper and lower format stereo video, the second right frame is used as the lower half of the upper and lower format stereo video, and then displayed;
通过已有上下格式立体视频转换成左右格式立体视频的方法: 将上下格 式立体视频的下半部分画面和上半部分画面作为第二左画面帧和第二右画面 帧; 第二左画面帧作为左右格式立体视频的左半部分画面, 将第二右画面帧 作为左右格式立体视频的右半部分画面, 然后显示出来;  A method for converting a stereo video into a left and right format by using an existing upper and lower format stereo video: using a lower half picture and a top half picture of the upper and lower format stereo video as a second left picture frame and a second right picture frame; The left half of the left-right format stereo video, the second right frame is used as the right half of the left-right format stereo video, and then displayed;
服务端的立体视频转换单元实时将已有通用格式的立体视频文件转换成 用户选择的或系统设定的非通用格式的立体视频格式, 并传输给用户; 视频 转换方法包括:  The stereoscopic video conversion unit of the server converts the stereo video file of the existing common format into a stereo video format of a non-generic format selected by the user or set by the system, and transmits the video to the user. The video conversion method includes:
步骤 S3221 : 将左右格式立体视频的左半部分画面和右半部分画面作为 第二左画面帧和第二右画面帧, 或者将上下格式立体视频的下半部分画面和 上半部分画面作为第二左画面帧和第二右画面帧;  Step S3221: The left half picture and the right half picture of the left and right format stereo video are used as the second left picture frame and the second right picture frame, or the lower half picture and the upper part picture of the upper and lower format stereo video are used as the second a left picture frame and a second right picture frame;
步骤 S3222 : 按照如下方法将左右格式立体视频或上下格式立体视频转 换成红蓝格式或快门格式或交错格式的立体视频: Step S3222: Turn left and right format stereo video or upper and lower format stereo video as follows Change to stereo video in red or blue format or shutter format or interlaced format:
红蓝格式立体视频转换方法: 将第二左画面帧的红颜色分量作为红蓝格 式立体视频的红色分量, 将第二右画面帧的蓝色分量和绿色分量作为红蓝格 式立体视频的蓝色分量和绿色分量, 然后显示出来;  Red and blue format stereo video conversion method: the red color component of the second left picture frame is used as the red component of the red and blue format stereo video, and the blue component and the green component of the second right picture frame are used as the blue color of the red and blue format stereoscopic video. The component and the green component are then displayed;
快门格式立体视频转换方法: 将第二左画面帧和第二右画面帧按先后时 间顺序显示出来;  Shutter format stereo video conversion method: displaying the second left picture frame and the second right picture frame in sequential order;
交错格式立体视频转换方法: 将第二左画面帧和第二右画面帧交错叠加 后显示出来。  Interlaced format stereo video conversion method: The second left picture frame and the second right picture frame are interleaved and displayed.
PCT/CN2011/084951 2011-05-24 2011-12-29 Internet-based method and system for transcoding stereo video in real time on serving end WO2012159440A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110135714.X 2011-05-24
CN201110135714.XA CN102801990B (en) 2011-05-24 2011-05-24 Based on Internet service end three-dimensional video-frequency real-time transcoding method and system

Publications (1)

Publication Number Publication Date
WO2012159440A1 true WO2012159440A1 (en) 2012-11-29

Family

ID=47200945

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/084951 WO2012159440A1 (en) 2011-05-24 2011-12-29 Internet-based method and system for transcoding stereo video in real time on serving end

Country Status (2)

Country Link
CN (1) CN102801990B (en)
WO (1) WO2012159440A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104837005B (en) * 2014-02-11 2017-06-16 深圳市云帆世纪科技有限公司 Method and its device that a kind of 2D videos are played with 3D Video Quality Metrics
CN105957130B (en) * 2016-04-18 2019-08-02 北京小鸟看看科技有限公司 A kind of method and apparatus for realizing virtual reality system plane starting animation

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1444186A (en) * 2002-03-11 2003-09-24 矽统科技股份有限公司 Equipment for producing instantaneous stereofilm
WO2008040123A1 (en) * 2006-10-02 2008-04-10 Aftercad Software Inc. Method and system for delivering and interactively displaying three-dimensional graphics
CN101193322A (en) * 2006-11-20 2008-06-04 广达电脑股份有限公司 3D video display method and display system using this method
WO2009014325A1 (en) * 2007-07-20 2009-01-29 Thinkware Systems Corporation Method for providing three dimensional map service and geographic information system
CN101662677A (en) * 2008-08-29 2010-03-03 深圳华为通信技术有限公司 Code stream conversion system, code stream conversion method, code stream identification unit and scheme determination unit
CN101795419A (en) * 2010-02-01 2010-08-04 周晓民 Technical scheme for transforming 2D video image signals to 3D video image signals and application thereof

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101982979B (en) * 2002-07-16 2013-01-02 韩国电子通信研究院 Apparatus and method for adapting 2d and 3d stereoscopic video signal
CN1756317A (en) * 2004-10-01 2006-04-05 三星电子株式会社 The equipment of transforming multidimensional video format and method
CN101662665B (en) * 2009-08-31 2015-07-22 传线网络科技(上海)有限公司 Real-time VOD system and VOD method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1444186A (en) * 2002-03-11 2003-09-24 矽统科技股份有限公司 Equipment for producing instantaneous stereofilm
WO2008040123A1 (en) * 2006-10-02 2008-04-10 Aftercad Software Inc. Method and system for delivering and interactively displaying three-dimensional graphics
CN101193322A (en) * 2006-11-20 2008-06-04 广达电脑股份有限公司 3D video display method and display system using this method
WO2009014325A1 (en) * 2007-07-20 2009-01-29 Thinkware Systems Corporation Method for providing three dimensional map service and geographic information system
CN101662677A (en) * 2008-08-29 2010-03-03 深圳华为通信技术有限公司 Code stream conversion system, code stream conversion method, code stream identification unit and scheme determination unit
CN101795419A (en) * 2010-02-01 2010-08-04 周晓民 Technical scheme for transforming 2D video image signals to 3D video image signals and application thereof

Also Published As

Publication number Publication date
CN102801990B (en) 2016-09-07
CN102801990A (en) 2012-11-28

Similar Documents

Publication Publication Date Title
Zhao et al. QoE in video transmission: A user experience-driven strategy
AU2010345675B2 (en) Method for synchronized content playback
CN109218734A (en) For Video coding and decoded method, apparatus and computer program product
CN105491393A (en) Method for implementing multi-user live video business
WO2012043356A1 (en) Content transmitting device, content transmitting method, content reproduction device, content reproduction method, program, and content delivery system
CN102202210B (en) Method for mobile phone to play real-time monitoring video and mobile phone to play real-time monitoring video
CN106817628B (en) Network live broadcast platform
US20200304551A1 (en) Immersive Media Metrics For Display Information
WO2014044059A1 (en) Method, device and system for video conference recording and playing
JP2014513903A (en) Networking method, server device, and client device
WO2012125198A3 (en) Method and apparatus for enabling purchase of or information requests for objects in digital content
CN104079870A (en) Video monitoring method and system for single-channel video and multiple-channel audio frequency
WO2012159441A1 (en) Internet-based method and system for transcoding stereo video in real time on client
WO2016119504A1 (en) Method and apparatus for sharing media programme
JP2011139209A (en) Image processing apparatus and method
TW201129098A (en) Method and video receiving system for adaptively decoding embedded video bitstream
CN104363511A (en) Method and system for online playing F4v videos on mobile device
CN104219571A (en) Method and device for automatically providing watching focus
CN109756744A (en) Data processing method, electronic equipment and computer storage medium
WO2012159440A1 (en) Internet-based method and system for transcoding stereo video in real time on serving end
CN202385222U (en) Remote monitoring system of network liquid crystal display television
CN108989833A (en) A kind of generation method and device of video cover image
CN102685599B (en) TV program interaction system and method
CN103533295A (en) Full high-definition video meeting system
CN116527852A (en) Real-time video monitoring system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11866391

Country of ref document: EP

Kind code of ref document: A1

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11866391

Country of ref document: EP

Kind code of ref document: A1