CN1184815C - Multi viewing angle video frequency programme network retransmitting method based on multi process - Google Patents

Multi viewing angle video frequency programme network retransmitting method based on multi process Download PDF

Info

Publication number
CN1184815C
CN1184815C CN 01144709 CN01144709A CN1184815C CN 1184815 C CN1184815 C CN 1184815C CN 01144709 CN01144709 CN 01144709 CN 01144709 A CN01144709 A CN 01144709A CN 1184815 C CN1184815 C CN 1184815C
Authority
CN
China
Prior art keywords
video
information
network
computer
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 01144709
Other languages
Chinese (zh)
Other versions
CN1427618A (en
Inventor
黄晁
李锦涛
史宏周
林守勋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Luoyang Zhongke Information Industry Research Institute
Original Assignee
Institute of Computing Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Computing Technology of CAS filed Critical Institute of Computing Technology of CAS
Priority to CN 01144709 priority Critical patent/CN1184815C/en
Publication of CN1427618A publication Critical patent/CN1427618A/en
Application granted granted Critical
Publication of CN1184815C publication Critical patent/CN1184815C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Abstract

The present invention relates to a plenoptic network retransmitting method of video programs, which is based on multiple processes. The method comprises the steps that video information collected by a camera arranged on a program site and connected with a computer is received by the computer; the received video information is compressed; the compressed information is synthesized; composite signals are decomposed and played at a client end by a multi-process method after being transmitted through the network. The plenoptic network retransmitting method of video programs, which is provided by the present invention, utilizes multiple cameras on site and computers to carry out digital processing on the video information on site, synthesizes multiple signals, transmits the signals through the network and finally breaks down and plays the composite signals by the multi-process method at the client end, so that the plenoptic network retransmitting of video programs is realized. A computer at the service end can dynamically regulate the synthesizing mode of the plenoptic video signals according to network conditions and users' requests.

Description

Multi viewing angle video frequency programme network relaying method based on multi-process
Technical field
The present invention relates to the method that a kind of multi viewing angle video frequency programme network is relayed, especially refer to that a kind of utilization is arranged on on-the-spot multichannel camera head and computer the video information at scene is carried out digitized processing, and it is multiple signals are compound, and by Network Transmission, last client is decomposed composite signal the method for playing with the method for multi-process.
Background technology
Along with developing rapidly of Internet, it is broadband that network progressively moves towards, along with the raising of transmission speed and the development of video compression technology, propagate on the internet continuous look, audio signal satisfies the requirements.Especially real-time as sports cast, the program that property of participation is strong is issued on Internet and more is necessary.Utilize the unrivaled interactivity of Internet, can make spectators obtain more lively experience and stronger sense of participation.
Existing Internet video transmission technology has following characteristics: the one, can only be based on the PC+ fixed network environment, and can not be applicable to that difference accesses terminal and the complicated especially increasing mobile radio network environment of network environment; The 2nd, can only simply transmit the video data identical and give spectators with video source, lack interactivity, promptly as TV programme, TV station is when relaying, having a plurality of video cameras takes from different perspectives, by director's layout, between the video camera of different angles, switch and broadcast, like this, sometime, spectators can only watch the program of certain angle, and can not go to select oneself to want the angle seen according to the wish of oneself, perhaps watch several angles simultaneously.Such as, in football match, have several video cameras simultaneously from different perspectives facing to the goal, like this, when shooting occurring, just have the picture of several different angles, but spectators but can only see an angle, that can't select oneself to want to see or see different angles simultaneously, so just can not embody the characteristics of network technology interactivity, can't attract the more network user.
Summary of the invention
The method that the object of the present invention is to provide a kind of multi viewing angle video frequency programme network to relay, this method is carried out digitized processing to the video information of the video frequency program of collection, and it is multiple signals are compound, and by Network Transmission, last client is decomposed broadcast according to user's requirement with composite signal with the method for multi-process.
For achieving the above object, the method based on the multi viewing angle video frequency programme network relaying method of multi-process comprises step:
Computer receives by being arranged on the video information that program is on-the-spot and camera head that be attached thereto is gathered;
The video information that receives is compressed processing;
The information that compression is handled is carried out synchronous Combined Processing, and described synchronous Combined Processing comprises:
Synchronization video information: the field data that each video camera is gathered sends to computer, after compressing with a kind of video-frequency compression method, the temporal information of in corresponding each video flowing, annotating, temporal information according to each video flowing, by same video synchronization method all video flowings are carried out synchronously
The divided video object: dynamic image distribution is carried out cutting apart of object video to corresponding dividing processing module, comprise different foreground object and background object,
Horizontal video information compression: at first manually determine leading role's degree video flowing,, the corresponding video object in other video flowings and leading role's degree video flowing are compared according to synchronizing information, the compression redundant information,
Set up scene description: according to the effect of wanting at last to present, set up the scene that comprises the different angles video information,
Compound multi-channel video information: multi-path video stream and scene description data corresponding that will be after overcompression is handled be information combined in a video flowing;
Composite signal is decomposed with the method for multi-process by client after the Network Transmission, display the play according to the multi-angle video mode.
The method that multi viewing angle video frequency programme network provided by the present invention is relayed, utilization is arranged on on-the-spot multichannel camera head and computer the video information at scene is carried out digitized processing, and it is multiple signals are compound, and pass through Network Transmission, last client is decomposed broadcast with the method for multi-process with composite signal, has realized that the network of multi viewing angle video frequency programme is relayed.
Description of drawings
The present invention is described in further detail below in conjunction with drawings and Examples:
Fig. 1 is the hybrid system schematic diagram of multi-channel video information of the present invention.
Fig. 2 is the complex flow schematic diagram of multi-channel video information of the present invention.
Fig. 3 is the branch decoding/playing system schematic diagram of multi-channel video information client of the present invention multi-process.
Fig. 4 is the decomposition playing flow schematic diagram of multi-channel video information client of the present invention multi-process.
Fig. 5, Fig. 6 for the present invention alternately the multi viewing angle video frequency programme network of dynamic adjustments complex method relay schematic flow sheet.
The system schematic that Fig. 7 relays for multi viewing angle video frequency programme network of the present invention.
Embodiment
As shown in Figure 7, computer receives by being arranged on program on-the-spot and be attached thereto, the video information that more than one camera head is gathered, after overcompression, these information are carried out Combined Processing, by Network Transmission, last client is decomposed composite signal the method for playing with the method for multi-process.
As Fig. 1, shown in 2: the complex method of multi-channel video information of the present invention, computer 3 receives by being arranged on the video information 2 that program is on-the-spot and more than one camera head 1 that be attached thereto is gathered, after overcompression, send these information to computer 4 and carry out Combined Processing, obtain various visual angles composite video data flow 5.
Above-mentioned Combined Processing comprises the steps:
1. synchronization video information: the field data 2 that each video camera 1 is gathered sends to computer 3, after compressing with a kind of video-frequency compression method, the temporal information of in corresponding each video flowing, annotating, according to the temporal information of each video flowing, all video flowings are carried out synchronously by same video synchronization method
2. divided video object: dynamic image distribution is carried out cutting apart of object video to corresponding dividing processing module, comprise different foreground object and background object
3. horizontal video information compression: compressed and multiplexed dynamic image distribution to computer 4, is at first determined leading role's degree video flowing, can be prior appointment, also can be selected by computer random, according to synchronizing information, the corresponding video object in other video flowings is compared the compression redundant information with it
4. set up scene description: according to the effect of wanting at last to present, set up the scene that comprises the different angles video information, can specify in advance, also can generate by computer random
5. compound multi-channel video information: multi-path video stream and scene description data corresponding that will be after overcompression is handled be information combined in a video flowing 5
As Fig. 1,3, shown in 4, the method that the decomposition of multi-channel video information client of the present invention multi-process is play, computer 3 receives by being arranged on the video information 2 that program is on-the-spot and more than one camera head 1 that be attached thereto is gathered, after overcompression, send these information to computer 4 and carry out Combined Processing, obtain various visual angles composite video data flow 5.By Network Transmission, the method and the broadcast relay system 6 of last client computer 7 usefulness multi-process are set up session, accept video flowing, and composite signal is decomposed broadcast.
The method that the decomposition of above-mentioned multi-channel video information client multi-process is play comprises the steps:
1. client computer 7 sends request to relaying server 6;
2. client computer 7 is set up session with service end 6, intercourses information;
3. client computer 7 is set up buffer memory;
4. client computer 7 startup multi-process are set up session with service end 6 respectively, receive the video information data that sent by network;
5. client computer 7 generates scene according to the scene description information that receives;
6. client computer 7 is according to decode all video informations and playing of the leading role's degree video data that receives and compressed information.
As Fig. 1,3,5, shown in 6: the multi viewing angle video frequency programme network relaying method of dynamic adjustments complex method alternately of the present invention, computer 3 receives by being arranged on the video information 2 that program is on-the-spot and more than one camera head 1 that be attached thereto is gathered, after overcompression, send these information to computer 4 and carry out Combined Processing, obtain various visual angles composite video data flow 5.By Network Transmission, the method and the broadcast relay system 6 of last client computer 7 usefulness multi-process are set up session, accept video flowing, and composite signal is decomposed broadcast, and the service end computer is regulated complex method according to network condition and user's request dynamic.
The method that the multi viewing angle video frequency programme network of above-mentioned dynamic adjustments complex method is alternately relayed comprises the steps:
1. service end computer 5 and client computer 7 sessions, service end computer 6 are detected network thus and are connected situation;
2. when network generation congestion situation, service end computer 5 is regulated complex methods, keeps the video information of leading role's degree complete, and the frame per second of the video information of other angles is done suitable reduction; When taking a turn for the better, network condition then does corresponding recovery;
3. client computer 7 sends the video quality request according to user's needs or requirement to service end computer 5;
4. service end computer 5 is regulated complex method, with the video quality raising of customer requirements angle, with the video information quality reduction of other angles.

Claims (5)

1. method based on the multi viewing angle video frequency programme network relaying method of multi-process is characterized in that comprising step:
Computer receives by being arranged on the video information that program is on-the-spot and camera head that be attached thereto is gathered;
The video information that receives is compressed processing;
The information that compression is handled is carried out synchronous Combined Processing, and described synchronous Combined Processing comprises:
Synchronization video information: the field data that each video camera is gathered sends to computer, after compressing with a kind of video-frequency compression method, the temporal information of in corresponding each video flowing, annotating, temporal information according to each video flowing, by same video synchronization method all video flowings are carried out synchronously
The divided video object: dynamic image distribution is carried out cutting apart of object video to corresponding dividing processing module, comprise different foreground object and background object,
Horizontal video information compression: at first manually determine leading role's degree video flowing,, the corresponding video object in other video flowings and leading role's degree video flowing are compared according to synchronizing information, the compression redundant information,
Set up scene description: according to the effect of wanting at last to present, set up the scene that comprises the different angles video information,
Compound multi-channel video information: multi-path video stream and scene description data corresponding that will be after overcompression is handled be information combined in a video flowing;
Composite signal is decomposed with the method for multi-process by client after the Network Transmission, display the play according to the multi-angle video mode.
2. by the described method of claim 1, it is characterized in that: the camera head that is arranged on the program scene is more than 1.
3. by the complex method of claim 1 or 2 described multi-channel video informations, it is characterized in that: be arranged on the program scene the camera head collection be the information of same program different angles.
4. by the described method of claim 1, it is characterized in that: the method that described decomposition is play comprises step:
A. client is sent request to relaying server;
B. client and service end are set up session, intercourse information;
C. client is set up buffer memory;
D. the client terminal start-up multi-process is set up session with service end respectively, receives the video information data that sent by network;
E. generate scene according to the scene description information that receives;
F. according to decode all video informations and playing of the leading role's degree video data that receives and compressed information;
G. the user controls the display mode of multi-angle video in the scene, comprise the video of certain angle amplification, dwindle, also can set the demonstration speed of each angle simultaneously.
5. by the described method of claim 1, it is characterized in that also comprising step:
A. service end computer and client computer session, service end computer are detected network thus and are connected situation;
B. when network generation congestion situation, service end computer regulated complex method keeps the video information of leading role's degree complete, and the frame per second of the video information of other angles is done suitable reduction, then does corresponding recovery when network condition takes a turn for the better;
C. client is sent the video quality request according to user's requirement to the service end computer;
D. service end computer regulated complex method improves the video quality of customer requirements angle, and the video information quality of other angles is reduced.
CN 01144709 2001-12-20 2001-12-20 Multi viewing angle video frequency programme network retransmitting method based on multi process Expired - Fee Related CN1184815C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 01144709 CN1184815C (en) 2001-12-20 2001-12-20 Multi viewing angle video frequency programme network retransmitting method based on multi process

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 01144709 CN1184815C (en) 2001-12-20 2001-12-20 Multi viewing angle video frequency programme network retransmitting method based on multi process

Publications (2)

Publication Number Publication Date
CN1427618A CN1427618A (en) 2003-07-02
CN1184815C true CN1184815C (en) 2005-01-12

Family

ID=4677787

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 01144709 Expired - Fee Related CN1184815C (en) 2001-12-20 2001-12-20 Multi viewing angle video frequency programme network retransmitting method based on multi process

Country Status (1)

Country Link
CN (1) CN1184815C (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101854529A (en) * 2010-04-30 2010-10-06 第一视频通信传媒有限公司 Multi-picture webcast method for audience segmentation
CN101540652B (en) * 2009-04-09 2011-11-16 上海交通大学 Terminal heterogeneous self-matching transmission method of multi-angle video Flow
CN102347043A (en) * 2010-07-30 2012-02-08 腾讯科技(北京)有限公司 Method for playing multi-angle video and system

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100499805C (en) * 2006-12-15 2009-06-10 清华大学 Free viewpoint video IP network transmission method based on light field exaggeration
CN101668160B (en) * 2009-09-10 2012-08-29 华为终端有限公司 Video image data processing method, device, video conference system and terminal
CN102075696B (en) * 2011-01-07 2013-03-27 卢泳 Signal acquisition, transmission, signal editing and integration, broadcasting and viewing method and system
CN102186038A (en) * 2011-05-17 2011-09-14 浪潮(山东)电子信息有限公司 Method for synchronously playing multi-viewing-angle pictures on digital television screen
CN103023934B (en) * 2011-09-23 2017-03-15 中兴通讯股份有限公司 Multi-stream service synchronous method in virtual terminal system and virtual terminal system
CN103024447B (en) * 2012-12-31 2017-03-08 合一网络技术(北京)有限公司 A kind of many videos mobile terminal editing high in the clouds synthetic method shooting in the same time and place and server
CN103051830B (en) * 2012-12-31 2015-12-23 北京中科大洋科技发展股份有限公司 A kind of system and method to clapped target multi-angle live event
CN109474849B (en) * 2018-11-12 2019-11-26 广东乐心医疗电子股份有限公司 Multimedia data processing method, system, terminal and computer readable storage medium

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101540652B (en) * 2009-04-09 2011-11-16 上海交通大学 Terminal heterogeneous self-matching transmission method of multi-angle video Flow
CN101854529A (en) * 2010-04-30 2010-10-06 第一视频通信传媒有限公司 Multi-picture webcast method for audience segmentation
CN101854529B (en) * 2010-04-30 2012-01-11 第一视频通信传媒有限公司 Multi-picture network broadcast method for audience segmentation
CN102347043A (en) * 2010-07-30 2012-02-08 腾讯科技(北京)有限公司 Method for playing multi-angle video and system
CN102347043B (en) * 2010-07-30 2014-10-22 腾讯科技(北京)有限公司 Method for playing multi-angle video and system

Also Published As

Publication number Publication date
CN1427618A (en) 2003-07-02

Similar Documents

Publication Publication Date Title
CN101917391B (en) Method for playing network video and system for playing network video
CN106992959B (en) 3D panoramic audio and video live broadcast system and audio and video acquisition method
KR101350754B1 (en) Method for reducing channel change times and synchronizing audio/video content during channel change
KR101574031B1 (en) Real-time multi-media streaming bandwidth management
US10341672B2 (en) Method and system for media synchronization
US20020154691A1 (en) System and process for compression, multiplexing, and real-time low-latency playback of networked audio/video bit streams
CN1184815C (en) Multi viewing angle video frequency programme network retransmitting method based on multi process
CN101909160A (en) Broadcast control switching method and device in network video live broadcast
KR101934200B1 (en) Method and system for media synchronization
KR101640148B1 (en) Device and method for synchronizing an interactive mark to streaming content
CN1976440A (en) Method and system for accurately positioning playing progress rate in IPTV
US11553215B1 (en) Providing alternative live media content
CN1801885A (en) Multimedia signal matching system and method for performing picture-in-picture function
CN111147362B (en) Multi-user instant messaging method, system, device and electronic equipment
KR20120133006A (en) System and method for providing a service to streaming IPTV panorama image
CN107835435B (en) Event wide-view live broadcasting equipment and associated live broadcasting system and method
JP2003333572A (en) Virtual customer forming apparatus and method thereof, virtual customer forming reception apparatus and method thereof, and virtual customer forming program
CN1529504A (en) Television programme on-line broad casting method
CN114885198B (en) Mixed network-oriented accompanying sound and video collaborative presentation system
KR20170130883A (en) Method and apparatus for virtual reality broadcasting service based on hybrid network
CN112738609A (en) Multi-channel video stream transmission method and device and multi-channel video stream playing system
KR20030013012A (en) Unmanned remote module for internet live broadcasting system and remote control apparatus thereof
CN112003875A (en) Video focus content transmission system and method
CA2824708C (en) Video content generation
CN104796578A (en) Multi-screen synchronization method based on program audio features

Legal Events

Date Code Title Description
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: BEIJING ZHONGKE ZHIYUAN YUCHENG INFORMATION TECHNO

Free format text: FORMER OWNER: INST. OF COMPUTING TECHNOLOGY, CHINESE ACADEMY OF SCIENCES

Effective date: 20100910

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 100080 NO.6, KEXUEYUAN SOUTH ROAD, ZHONGGUANCUN, HAIDIAN DISTRICT, BEIJING TO: 100190 NO.6, KEXUEYUAN SOUTH ROAD, ZHONGGUANCUN, HAIDIAN DISTRICT, BEIJING

TR01 Transfer of patent right

Effective date of registration: 20100910

Address after: 100190 Haidian District, Zhongguancun Academy of Sciences, South Road, No. 6, No.

Patentee after: Beijing Zhongke Zhiyuan bred Information Technology Co. Ltd.

Address before: 100080 Haidian District, Zhongguancun Academy of Sciences, South Road, No. 6, No.

Patentee before: Institute of Computing Technology, Chinese Academy of Sciences

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20150922

Address after: 471934, east of Henan, Luoyang Province, intersection of Pioneer Road and Baita Road, 100 meters east

Patentee after: Luoyang Zhongke Information Industry Research Institute

Address before: 100190 Haidian District, Zhongguancun Academy of Sciences, South Road, No. 6, No.

Patentee before: Beijing Zhongke Zhiyuan bred Information Technology Co. Ltd.

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20050112

Termination date: 20151220

EXPY Termination of patent right or utility model