CN102307309A - Somatosensory interactive broadcasting guide system and method based on free viewpoints - Google Patents
Somatosensory interactive broadcasting guide system and method based on free viewpoints Download PDFInfo
- Publication number
- CN102307309A CN102307309A CN201110214935A CN201110214935A CN102307309A CN 102307309 A CN102307309 A CN 102307309A CN 201110214935 A CN201110214935 A CN 201110214935A CN 201110214935 A CN201110214935 A CN 201110214935A CN 102307309 A CN102307309 A CN 102307309A
- Authority
- CN
- China
- Prior art keywords
- video
- streaming media
- client
- panoramic
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to a somatosensory interactive broadcasting guide system and method based on free viewpoints. The system comprises a server side, a video transmission network and a client side, wherein, the server side comprises a multi-camera system, a video processing server and a streaming media server which are used for completing multi-channel video capture, panoramic video synthesis, H.264 encoding and RTSP (real time streaming protocol) streaming media service; the video transmission network is a local area network (LAN) or wide area network (WAN) based on a TCP/IP (transmission control protocol/Internet protocol); and the client side comprises a free viewpoint playing terminal and a somatosensory sensor, wherein, the free viewpoint playing terminal comprises functional modules which are used for completing video streaming media receiving and decoding, gesture recognition based on a somatosensory controller, free viewpoint generation and other tasks. The somatosensory interactive broadcasting guide system and method have the beneficial effects that by combining multi-channel video into panoramic video, software and hardware investment and technical cost can be saved by directly utilizing the currently mature video coding and streaming media transmission technology, and meanwhile panoramic seamless roaming at 360 degrees and free viewpoint switchover can be really realized.
Description
Technical field
The invention belongs to computer vision field; Particularly a kind of body sense mutual instructor in broadcasting system and implementation method based on free viewpoint video; More particularly a kind of spectators carry out man-machine interaction through body sense interactive device, realize the body sense mutual instructor in broadcasting system and the implementation method of freedom of network viewpoint video.
Background technology
Video/video system has become mass media with strongest influence power in the current information society.In conventional video/video system, the visual angle that spectators can only accept photographer or instructor in broadcasting person passively selects or camera lens switches, and at the visual angle or camera lens have the jump of viewpoint position and video pictures when switching, cause spectators to lack telepresenc and presence when watching.
Along with the fast development of digital multimedia technology in recent years, people have higher requirement for independence in the video-see process and sensory experience.Under this background, free viewpoint video arises at the historic moment.Free viewpoint video through many cameras video synthetic with technology such as virtual view interpolation, can provide scene arbitrarily angled video information with yardstick, make to watch to have the better degree of freedom and three-dimensional feeling of immersion in the process.Existing free viewpoint video technology can be divided into two types according to basic principle.First kind of method that is based on threedimensional model for obtaining the image of any viewpoint in the scene, needs scene is carried out three-dimensional modeling, then according to the viewpoint position of selecting, generates virtual visual point image through three-dimensional re-projection technology.This method major defect is to be difficult to obtain in real time accurate Three-Dimensional Dynamic model of place.Second kind is based on the two dimensional image interpolation method, and this method is according to the viewpoint position of selecting, and from the discrete visual point image that has obtained, chooses the adjacent viewpoint image, through the synthetic width of cloth virtual visual point image that generates of interpolation technique.These method characteristics are to need not to consider the geological information in the actual scene.
Along with the breakthrough development of the trend of industry development and the Internet video technology of China's " unification of three nets ", interactive video becomes the main flow of global multimedia digital video display of new generation and digital entertainment technology gradually.Equipment such as mouse, keyboard, touch-screen have become requisite human-computer interaction device in present internet video live broadcasting/VOD system, yet there are limitation such as distance limited, reciprocal process is not directly perceived, dumb in these traditional interactive devices.Propose in the recent period body sense control technology (like the Kinect of Microsoft equipment) for man-machine interaction mode provides the novelty change, contactless and interactive mode that need not any operation has become development trend.
Summary of the invention
The present invention is directed to the deficiency and the limitation of conventional video/video system; Through merging free view-point generation technique, network flow-medium transmission technology and body sense interaction technique; Realize a kind of body sense mutual instructor in broadcasting system and implementation method; Make spectators can fully independently select the viewpoint of watching, have the viewing experience of stronger presence and telepresenc.
For realizing above-mentioned purpose, the present invention takes following technical scheme: a kind of mutual director method of body sense based on free view-point may further comprise the steps:
Step (1) multi-channel video collection;
Described multi-channel video capture method is specially:
Adopt many camera systems photographed scene video data that constitutes by 5 CCD cameras.5 cameras are taken from fixing separately viewpoint direction simultaneously, and its video data is uploaded to the Video processing server respectively;
Step (2) panoramic video is synthetic;
Described panoramic video synthesis method is specially:
On the Video processing server, the frame of video that 5 cameras are collected at synchronization according to the camera inside and outside parameter of off-line calibration in advance, is used image split-joint method with its synthetic in real time panoramic video frame, thereby is obtained panoramic video.Described image split-joint method is a mature technology;
Step (3) adopts image encoding standard H.264 that panoramic video synthetic in the step (2) is carried out real-time coding, and the H.264 code stream after the completion of will encode transfers to the RTSP streaming media server through local area network (LAN);
Step (4) RTSP streaming media server is to the H.264 code stream that transmits in the step (3) encapsulation of packing; With the form issue video link of unified resource positioning address (URL), supply client to select and program request simultaneously;
Step (5) client to RTSP streaming media server request Video service, and is set up a new Video service stream according to the video link of RTSP streaming media server issue;
Step (6) client receives from the RTSP streaming media server and stays stream medium data, and carries out RTSP and unpack and H.264 decoding, restores panoramic video;
Step (7) is carried out the virtual view location through step (9), the described interactive mode of step (10), confirms the synthetic needed video area of virtual view scope;
Step (8) virtual view generates and shows;
Described virtual view generates and display packing is specially:
Video area scope according to obtaining in the step (7) maps to the virtual view position with respective regions in the panoramic video frame through coordinate system, and carries out viewpoint distortion correction and demonstration; Described coordinate system mapping method and viewpoint distortion correction method are maturation method;
Step (9) client is obtained the degree of depth and the color image sequence of user's human region through body propagated sensation sensor;
Step (10) is extracted human skeleton and key node position thereof according to the degree of depth in the step (9) and color image sequence; Described human skeleton and key point method for distilling are maturation method;
Described step 9 and step 10 constitute interactive mode;
Step (11) is analyzed the movement locus and the action of identification user hand key node according to resulting human skeleton and key node position thereof in the step (10);
Step (12) is mated according to user's hand motion that obtains in the step (11) and the described predefine action of step (13); And carry out corresponding instructor in broadcasting and operate; Comprise that video pictures furthers/zooms out, viewpoint left, to the right level and smooth series of interactive instructor in broadcasting's action such as move.
Step (13) system predefine a series of hand motions corresponding to different instructors in broadcasting operation, its hand motion judges it is to confirm according to hand key node coordinate motion.For example left hand is brandished left and is represented that viewpoint smoothly moves, left hand is upwards brandished and represented that video pictures furthers, left hand is brandished and represented that video pictures zooms out, the right hand is brandished and represented that viewpoint is smoothly mobile to the right to the right downwards left.
A kind of mutual instructor in broadcasting of body sense system based on free view-point comprises server end, video delivery network and three parts of client;
Said server end comprises many camera systems, Video processing server, streaming media server according to the video data processing sequence.Wherein many camera systems are connected through video data line at a high speed with the Video processing server, link to each other through the local area network (LAN) based on ICP/IP protocol between Video processing server and the streaming media server;
Said video delivery network is based on the local area network (LAN) or the wide area network of ICP/IP protocol;
Said client comprises free view-point playback terminal and body propagated sensation sensor.The operating system of free view-point playback terminal need be supported OpenGL, links to each other with streaming media server through video delivery network, and its graphic user interface is exactly that the user watches window.Body propagated sensation sensor is used to obtain user's hand attitude information.Be connected through USB interface between body propagated sensation sensor and free view-point playback terminal.
Said server end comprises the software of Video processing server and two parts of streaming media server.The Video processing server software comprises multi-path video data acquiring module, video processing server GUI user interface, panoramic video synthesis module and H.264 normal video coding module and top control module.The multi-path video data acquiring module receives the video data that 5 cameras are gathered synchronously, and video processing server GUI user interface is that camera video acquisition and the synthetic parameter setting of panoramic video provide visual interactive interface.The video data that the panoramic video synthesis module is gathered 5 cameras synthesizes panoramic video in real time through merging algorithm for images.H.264 the normal video coding module carries out the H.264 coding of standard with panoramic video.Top control module comprises that the synthetic result of video data, real time monitoring panoramic video, preview and simulant-client virtual view that each camera of real time monitoring is gathered generate multinomial functions such as result, the control of camera parameter, video record control.Streaming media server software mainly is that RTSP encapsulation packing, the customer in response of H.264 video code flow looked closely the streaming media services such as asking to serve, set up video flowing frequently and the management function of Internet video resource file.Comprise the operation of increase to releasing resources, deletion, modification.
Said client comprises free view-point playback terminal software.Free view-point playback terminal software comprises video reception decoder module, body sense control module, free view-point generation module and client GUI user interface.The video reception decoder module is accomplished the video stream data reception, RTSP unpacks and H.264 decoding, and the panoramic video that will obtain after will decoding is passed to the free view-point generation module.Body sense control module realizes the human hands gesture recognition; Its processing procedure is following: through analyzing the degree of depth and the color image sequence that from body propagated sensation sensor, obtains; Extract and analyze the key node coordinate (like head, shoulder, hand, knee etc.) of human skeleton, analyze and discern user's hand key node coordinate motion then.The free view-point generation module is according to user's hand exercise of discerning in the body sense control module; Mate with the predefine action; Carry out corresponding instructor in broadcasting's operation; And calculate virtual view position to be shown; Confirm the synthetic needed video area of virtual view scope; Then this video area is mapped to the virtual view position through coordinate system, and adopt the viewpoint distortion correction to generate distortionless free viewpoint video.Client GUI user interface also is the last carrier that shows of free viewpoint video for the user provides the interface of controlling client software.
The present invention is owing to adopt above technical scheme; Have the following advantages: 1, the present invention synthesizes a frame panoramic picture through the panorama synthesis method with frame data of a plurality of camera collections of synchronization; Can directly utilize the coding standard and the transmission technology of current single view two-dimensional video; Software and hardware investment and technical costs be can save, and live type real-time coding and transmission system can be applicable to.2, it is synthetic to the present invention is based on panoramic video, the seamless roam that can realize real 360 ° of whole audience scapes through the mutual instructor in broadcasting of body sense with freely switch.3, use body propagated sensation sensor to realize the interactive intelligent instructor in broadcasting, the user has complete independence and independence to the selection of watching viewpoint, the free view-point technique guarantee flatness that viewpoint is switched in autonomous instructor in broadcasting's process, strengthened feeling of immersion and telepresenc when watching.4, need not scene is carried out three-dimensional modeling, low to server and client side's disposal ability and performance demands.
Description of drawings
Fig. 1 is the system construction drawing among the present invention.
Fig. 2 is camera lens distribution pattern figure of the present invention.
Fig. 3 is the method realization flow figure among the present invention.
Embodiment
Below in conjunction with accompanying drawing the present invention is described further.In method realization flow figure
As shown in Figure 1, the mutual instructor in broadcasting's system and method for a kind of body sense based on free view-point of the present invention is made up of server end 10, video delivery network 20,30 3 parts of client.Wherein server end comprises multi-camera system 11, Video processing server 12,13 3 parts of streaming media server.Client comprises free view-point playback terminal 31, body propagated sensation sensor 32.Video delivery network is based on the local area network (LAN) or the wide area network 21 of ICP/IP protocol.
As shown in Figure 2, multi-camera system 11 is combined by the CCD camera of 5 fixed-site.5 camera visual angles are that horizontal direction distributes, 72 ° of the angles between two cameras, and camera links to each other with the Video processing server through live wire, the uploading in real time of realization multi-channel video.
As shown in Figure 3, the mutual instructor in broadcasting's system and method for a kind of body sense of the present invention based on free view-point, its operating procedure is following:
Step (1) multi-channel video collection;
Described multi-channel video capture method is specially:
Adopt many camera systems photographed scene video data that constitutes by 5 CCD cameras.5 cameras are taken from fixing separately viewpoint direction simultaneously, and its video data is uploaded to the Video processing server respectively;
Step (2) panoramic video is synthetic;
Described panoramic video synthesis method is specially:
On the Video processing server, the frame of video that 5 cameras are collected at synchronization according to the camera inside and outside parameter of off-line calibration in advance, is used image split-joint method with its synthetic in real time panoramic video frame, thereby is obtained panoramic video.Described image split-joint method is a mature technology;
Step (3) adopts image encoding standard H.264 that panoramic video synthetic in the step (2) is carried out real-time coding, and the H.264 code stream after the completion of will encode transfers to the RTSP streaming media server through local area network (LAN);
Step (4) RTSP streaming media server is to the H.264 code stream that transmits in the step (3) encapsulation of packing; With the form issue video link of unified resource positioning address (URL), supply client to select and program request simultaneously;
Step (5) client to RTSP streaming media server request Video service, and is set up a new Video service stream according to the video link of RTSP streaming media server issue;
Step (6) client receives from the RTSP streaming media server and stays stream medium data, and carries out RTSP and unpack and H.264 decoding, restores panoramic video;
Step (7) is carried out the virtual view location through step (9), the described interactive mode of step (10), confirms the synthetic needed video area of virtual view scope;
(8) virtual view generates and shows;
Described virtual view generates and display packing is specially:
Video area scope according to obtaining in the step (7) maps to the virtual view position with respective regions in the panoramic video frame through coordinate system, and carries out viewpoint distortion correction and demonstration; Described coordinate system mapping method and viewpoint distortion correction method are maturation method;
Step (9) client is obtained the degree of depth and the color image sequence of user's human region through body propagated sensation sensor;
Step (10) is extracted human skeleton and key node position thereof according to the degree of depth in the step (9) and color image sequence; Described human skeleton and key point method for distilling are maturation method;
Step (11) is analyzed the movement locus and the action of identification user hand key node according to resulting human skeleton and key node position thereof in the step (10);
Step (12) is mated according to user's hand motion that obtains in the step (11) and the described predefine action of step (13); And carry out corresponding instructor in broadcasting and operate; Comprise that video pictures furthers/zooms out, viewpoint left, to the right level and smooth series of interactive instructor in broadcasting's action such as move.
Step (13) system predefine a series of hand motions corresponding to different instructors in broadcasting operation, its hand motion judges it is to confirm according to hand key node coordinate motion.For example left hand is brandished left and is represented that viewpoint smoothly moves, left hand is upwards brandished and represented that video pictures furthers, left hand is brandished and represented that video pictures zooms out, the right hand is brandished and represented that viewpoint is smoothly mobile to the right to the right downwards left.
Claims (2)
1. the mutual director method of body sense based on free view-point is characterized in that this method comprises the steps:
Step (1) multi-channel video collection;
Described multi-channel video capture method is specially:
Adopt many camera systems photographed scene video data that constitutes by 5 CCD cameras; 5 cameras are taken from fixing separately viewpoint direction simultaneously, and its video data is uploaded to the Video processing server respectively;
Step (2) panoramic video is synthetic;
Described panoramic video synthesis method is specially:
On the Video processing server, the frame of video that 5 cameras are collected at synchronization according to the camera inside and outside parameter of off-line calibration in advance, is used image split-joint method with its synthetic in real time panoramic video frame, thereby is obtained panoramic video;
Step (3) adopts image encoding standard H.264 that panoramic video synthetic in the step (2) is carried out real-time coding, and the H.264 code stream after the completion of will encode transfers to the RTSP streaming media server through local area network (LAN);
Step (4) RTSP streaming media server is to the H.264 code stream that transmits in the step (3) encapsulation of packing; With the form issue video link of unified resource positioning address (URL), supply client to select and program request simultaneously;
Step (5) client to RTSP streaming media server request Video service, and is set up a new Video service stream according to the video link of RTSP streaming media server issue;
Step (6) client receives from the RTSP streaming media server and stays stream medium data, and carries out RTSP and unpack and H.264 decoding, restores panoramic video;
Step (7) is carried out the virtual view location through step (9), the described interactive mode of step (10), confirms the synthetic needed video area of virtual view scope;
Step (8) virtual view generates and shows;
Described virtual view generates and display packing is specially:
Video area scope according to obtaining in the step (7) maps to the virtual view position with respective regions in the panoramic video frame through coordinate system, and carries out viewpoint distortion correction and demonstration; Step (9) client is obtained the degree of depth and the color image sequence of user's human region through body propagated sensation sensor;
Step (10) is extracted human skeleton and key node position thereof according to the degree of depth in the step (9) and color image sequence;
Described step 9 and step 10 constitute interactive mode;
Step (11) is analyzed the movement locus and the action of identification user hand key node according to resulting human skeleton and key node position thereof in the step (10);
Step (12) according to the user's hand motion that obtains in the step (11) and step (13) described predefine action mate, and carry out corresponding instructor in broadcasting's operation, comprise that video pictures furthers/zooms out, viewpoint left, level and smooth moving to the right;
Step (13) system predefine a series of hand motions corresponding to different instructors in broadcasting operation, its hand motion judges it is to confirm according to hand key node coordinate motion.
2. the mutual instructor in broadcasting of body sense system based on free view-point is characterized in that:
Comprise server end, video delivery network and three parts of client;
Said server end comprises many camera systems, Video processing server, streaming media server according to the video data processing sequence; Wherein many camera systems are connected through video data line at a high speed with the Video processing server, link to each other through the local area network (LAN) based on ICP/IP protocol between Video processing server and the streaming media server;
Said video delivery network is based on the local area network (LAN) or the wide area network of ICP/IP protocol;
Said client comprises free view-point playback terminal and body propagated sensation sensor; The operating system of free view-point playback terminal need be supported OpenGL, links to each other with streaming media server through video delivery network, and its graphic user interface is exactly that the user watches window; Body propagated sensation sensor is used to obtain user's hand attitude information; Be connected through USB interface between body propagated sensation sensor and free view-point playback terminal;
Said server end comprises the software of Video processing server and two parts of streaming media server;
Said Video processing server software comprises multi-path video data acquiring module, video processing server GUI user interface, panoramic video synthesis module and H.264 normal video coding module and top control module;
Said multi-path video data acquiring module receives the video data that 5 cameras are gathered synchronously;
Said video processing server GUI user interface is that camera video acquisition and the synthetic parameter setting of panoramic video provide visual interactive interface;
The video data that said panoramic video synthesis module is gathered 5 cameras synthesizes panoramic video in real time through merging algorithm for images;
Said H.264 normal video coding module carries out the H.264 coding of standard with panoramic video;
Said top control module comprises that the synthetic result of video data, real time monitoring panoramic video, preview and simulant-client virtual view generation result, the camera parameter that each camera of real time monitoring is gathered controlled, video record is controlled multinomial function;
Said streaming media server software comprises that mainly H.264 RTSP encapsulation packing, the customer in response of video code flow are looked closely the streaming media services such as asking to serve, set up video flowing frequently and the management function of Internet video resource file; Comprise the operation of increase to releasing resources, deletion, modification;
Said client comprises free view-point playback terminal software; Said free view-point playback terminal software comprises video reception decoder module, body sense control module, free view-point generation module and client GUI user interface;
Said video reception decoder module is accomplished the video stream data reception, RTSP unpacks and H.264 decoding, and the panoramic video that will obtain after will decoding is passed to the free view-point generation module;
Said body sense control module realizes the human hands gesture recognition; Its processing procedure is following: through analyzing the degree of depth and the color image sequence that from body propagated sensation sensor, obtains; Extract and analyze the key node coordinate of human skeleton, analyze and discern user's hand key node coordinate motion then;
Said free view-point generation module is according to user's hand exercise of discerning in the body sense control module; Mate with the predefine action; Carry out corresponding instructor in broadcasting's operation; And calculate virtual view position to be shown; Confirm the synthetic needed video area of virtual view scope; Then this video area is mapped to the virtual view position through coordinate system, and adopt the viewpoint distortion correction to generate distortionless free viewpoint video;
Said client GUI user interface also is the last carrier that shows of free viewpoint video for the user provides the interface of controlling client software.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110214935A CN102307309A (en) | 2011-07-29 | 2011-07-29 | Somatosensory interactive broadcasting guide system and method based on free viewpoints |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110214935A CN102307309A (en) | 2011-07-29 | 2011-07-29 | Somatosensory interactive broadcasting guide system and method based on free viewpoints |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102307309A true CN102307309A (en) | 2012-01-04 |
Family
ID=45381105
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110214935A Pending CN102307309A (en) | 2011-07-29 | 2011-07-29 | Somatosensory interactive broadcasting guide system and method based on free viewpoints |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102307309A (en) |
Cited By (42)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708769A (en) * | 2012-05-18 | 2012-10-03 | 澜景图（北京）数字科技有限公司 | Interactive demonstrating and reporting system |
| CN103051978A (en) * | 2012-12-16 | 2013-04-17 | 华南理工大学 | H264-based real-time mobile video service control method |
| CN103092349A (en) * | 2013-01-23 | 2013-05-08 | 宁凯 | Panoramic experience method based on Kinect somatosensory equipment |
| CN103220543A (en) * | 2013-04-25 | 2013-07-24 | 同济大学 | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect |
| CN103279191A (en) * | 2013-06-18 | 2013-09-04 | 北京科技大学 | 3D (three dimensional) virtual interaction method and system based on gesture recognition technology |
| CN103646425A (en) * | 2013-11-20 | 2014-03-19 | 深圳先进技术研究院 | A method and a system for body feeling interaction |
| CN103686270A (en) * | 2012-09-10 | 2014-03-26 | 联发科技股份有限公司 | Image viewing method based on user interaction input and related image viewing system |
| CN103777748A (en) * | 2012-10-26 | 2014-05-07 | 华为技术有限公司 | Motion sensing input method and device |
| CN104144349A (en) * | 2014-07-09 | 2014-11-12 | 中电科华云信息技术有限公司 | SPICE video coding and decoding expansion method and system based on H264 |
| WO2014180291A1 (en) * | 2013-05-07 | 2014-11-13 | Li Dongge | Method and device for generating motion signature on the basis of motion signature information |
| CN104243961A (en) * | 2013-06-18 | 2014-12-24 | 财团法人资讯工业策进会 | Display system and method of multi-view image |
| CN104349197A (en) * | 2013-08-09 | 2015-02-11 | 联想(北京)有限公司 | Data processing method and device |
| CN104363439A (en) * | 2014-10-24 | 2015-02-18 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
| WO2015106501A1 (en) * | 2014-01-16 | 2015-07-23 | 苏州阔地网络科技有限公司 | Intelligent broadcasting instruction method and system for online synchronous classroom |
| CN104010225B (en) * | 2014-06-20 | 2016-02-10 | 合一网络技术(北京)有限公司 | The method and system of display panoramic video |
| CN105704501A (en) * | 2016-02-06 | 2016-06-22 | 普宙飞行器科技（深圳）有限公司 | Unmanned plane panorama video-based virtual reality live broadcast system |
| CN106060518A (en) * | 2016-06-06 | 2016-10-26 | 武汉斗鱼网络科技有限公司 | Method and system for implementing 720-degree panoramic player with view angle switching function |
| CN106210754A (en) * | 2016-07-07 | 2016-12-07 | 腾讯科技（深圳）有限公司 | A kind of control the method for net cast, relevant device and system |
| CN106231317A (en) * | 2016-09-29 | 2016-12-14 | 三星电子（中国）研发中心 | Video processing, coding/decoding method and device, VR terminal, audio/video player system |
| CN106375347A (en) * | 2016-11-18 | 2017-02-01 | 上海悦野健康科技有限公司 | Tourism live broadcast platform based on virtual reality |
| CN106851244A (en) * | 2017-01-10 | 2017-06-13 | 北京阿吉比科技有限公司 | The method and system of 3D panoramic videos are watched based on internet video live broadcasting platform |
| CN106954093A (en) * | 2017-03-15 | 2017-07-14 | 北京小米移动软件有限公司 | Panoramic video processing method, apparatus and system |
| CN107087145A (en) * | 2017-06-02 | 2017-08-22 | 深圳市本道科技有限公司 | Multi-channel video carries out the method and device that 360 degree of panoramic videos are shown |
| CN107396133A (en) * | 2017-07-20 | 2017-11-24 | 深圳市佳创视讯技术股份有限公司 | Free viewpoint video director method and system |
| CN107404602A (en) * | 2016-05-18 | 2017-11-28 | 广州市索广电子技术有限公司 | A kind of remote prompts method based on the braiding of video traffic channel data |
| CN108024071A (en) * | 2017-11-24 | 2018-05-11 | 腾讯数码（天津）有限公司 | Video content generation method, video content generating means and storage medium |
| CN108701294A (en) * | 2016-02-29 | 2018-10-23 | 微软技术许可有限责任公司 | The cooperation camera view control presented for interactive remote |
| CN108874141A (en) * | 2018-06-25 | 2018-11-23 | 北京京东金融科技控股有限公司 | A kind of body-sensing browsing method and device |
| CN109089147A (en) * | 2018-08-30 | 2018-12-25 | 宁波视睿迪光电有限公司 | Naked eye 3D video pushing method and device |
| CN109151497A (en) * | 2018-08-06 | 2019-01-04 | 广州虎牙信息科技有限公司 | A kind of even wheat live broadcasting method, device, electronic equipment and storage medium |
| CN109361913A (en) * | 2015-05-18 | 2019-02-19 | 韩国电子通信研究院 | For providing the method and apparatus of 3-D image for head-mounted display |
| US10390373B2 (en) | 2013-05-07 | 2019-08-20 | Hangzhou Zhileng Technology Co. Ltd. | Method, apparatus and system for establishing connection between devices |
| US10509946B2 (en) | 2013-05-07 | 2019-12-17 | Hangzhou Zhileng Technology Co. Ltd. | Method and device for matching signatures on the basis of motion signature information |
| US10591999B2 (en) | 2014-02-25 | 2020-03-17 | Zte Corporation | Hand gesture recognition method, device, system, and computer storage medium |
| CN111314739A (en) * | 2020-02-17 | 2020-06-19 | 聚好看科技股份有限公司 | Image processing method, server and display device |
| CN111355967A (en) * | 2020-03-11 | 2020-06-30 | 叠境数字科技（上海）有限公司 | Video live broadcast processing method, system, device and medium based on free viewpoint |
| CN111640187A (en) * | 2020-04-20 | 2020-09-08 | 中国科学院计算技术研究所 | Video splicing method and system based on interpolation transition |
| CN112565693A (en) * | 2020-11-30 | 2021-03-26 | 广东荣文科技集团有限公司 | Method, system and equipment for monitoring video on demand |
| CN114629880A (en) * | 2020-12-10 | 2022-06-14 | 西安诺瓦星云科技股份有限公司 | Streaming media video source management method and device and card-inserting type video splicing processing equipment |
| CN114760483A (en) * | 2022-04-20 | 2022-07-15 | 东方明珠新媒体股份有限公司 | Method, system and medium for playing and switching multi-view video |
| CN115361571A (en) * | 2022-08-04 | 2022-11-18 | 武汉依迅北斗时空技术股份有限公司 | Playing method and device of cloud storage video data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101014123A (en) * | 2007-02-05 | 2007-08-08 | 北京大学 | Method and system for rebuilding free viewpoint of multi-view video streaming |
| CN101035261A (en) * | 2007-04-11 | 2007-09-12 | 宁波大学 | Image signal processing method of the interactive multi-view video system |
| US20100197390A1 (en) * | 2009-01-30 | 2010-08-05 | Microsoft Corporation | Pose tracking pipeline |
| CN101977320A (en) * | 2010-10-29 | 2011-02-16 | 清华大学 | Video coding method in accordance with multi-view video standard |
-
2011
- 2011-07-29 CN CN201110214935A patent/CN102307309A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101014123A (en) * | 2007-02-05 | 2007-08-08 | 北京大学 | Method and system for rebuilding free viewpoint of multi-view video streaming |
| CN101035261A (en) * | 2007-04-11 | 2007-09-12 | 宁波大学 | Image signal processing method of the interactive multi-view video system |
| US20100197390A1 (en) * | 2009-01-30 | 2010-08-05 | Microsoft Corporation | Pose tracking pipeline |
| CN101977320A (en) * | 2010-10-29 | 2011-02-16 | 清华大学 | Video coding method in accordance with multi-view video standard |
Cited By (58)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708769A (en) * | 2012-05-18 | 2012-10-03 | 澜景图（北京）数字科技有限公司 | Interactive demonstrating and reporting system |
| CN103686270A (en) * | 2012-09-10 | 2014-03-26 | 联发科技股份有限公司 | Image viewing method based on user interaction input and related image viewing system |
| US9690458B2 (en) | 2012-09-10 | 2017-06-27 | Mediatek Inc. | Image viewing method for displaying portion of selected image based on user interaction input and related image viewing system and machine readable medium |
| CN103777748A (en) * | 2012-10-26 | 2014-05-07 | 华为技术有限公司 | Motion sensing input method and device |
| CN103051978A (en) * | 2012-12-16 | 2013-04-17 | 华南理工大学 | H264-based real-time mobile video service control method |
| CN103092349A (en) * | 2013-01-23 | 2013-05-08 | 宁凯 | Panoramic experience method based on Kinect somatosensory equipment |
| CN103220543B (en) * | 2013-04-25 | 2015-03-04 | 同济大学 | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect |
| CN103220543A (en) * | 2013-04-25 | 2013-07-24 | 同济大学 | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect |
| US10779337B2 (en) | 2013-05-07 | 2020-09-15 | Hangzhou Zhileng Technology Co. Ltd. | Method, apparatus and system for establishing connection between devices |
| US10509946B2 (en) | 2013-05-07 | 2019-12-17 | Hangzhou Zhileng Technology Co. Ltd. | Method and device for matching signatures on the basis of motion signature information |
| WO2014180291A1 (en) * | 2013-05-07 | 2014-11-13 | Li Dongge | Method and device for generating motion signature on the basis of motion signature information |
| US10390373B2 (en) | 2013-05-07 | 2019-08-20 | Hangzhou Zhileng Technology Co. Ltd. | Method, apparatus and system for establishing connection between devices |
| CN103279191A (en) * | 2013-06-18 | 2013-09-04 | 北京科技大学 | 3D (three dimensional) virtual interaction method and system based on gesture recognition technology |
| CN103279191B (en) * | 2013-06-18 | 2016-01-06 | 北京科技大学 | A kind of 3D virtual interacting method based on Gesture Recognition and system |
| CN104243961A (en) * | 2013-06-18 | 2014-12-24 | 财团法人资讯工业策进会 | Display system and method of multi-view image |
| CN104349197B (en) * | 2013-08-09 | 2019-07-26 | 联想(北京)有限公司 | A kind of data processing method and device |
| CN104349197A (en) * | 2013-08-09 | 2015-02-11 | 联想(北京)有限公司 | Data processing method and device |
| CN103646425A (en) * | 2013-11-20 | 2014-03-19 | 深圳先进技术研究院 | A method and a system for body feeling interaction |
| WO2015106501A1 (en) * | 2014-01-16 | 2015-07-23 | 苏州阔地网络科技有限公司 | Intelligent broadcasting instruction method and system for online synchronous classroom |
| US10591999B2 (en) | 2014-02-25 | 2020-03-17 | Zte Corporation | Hand gesture recognition method, device, system, and computer storage medium |
| CN104010225B (en) * | 2014-06-20 | 2016-02-10 | 合一网络技术(北京)有限公司 | The method and system of display panoramic video |
| CN104144349B (en) * | 2014-07-09 | 2017-08-29 | 中电科华云信息技术有限公司 | SPICE coding and decoding videos extended method and system based on H264 |
| CN104144349A (en) * | 2014-07-09 | 2014-11-12 | 中电科华云信息技术有限公司 | SPICE video coding and decoding expansion method and system based on H264 |
| CN104363439A (en) * | 2014-10-24 | 2015-02-18 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104602129B (en) * | 2015-01-27 | 2018-03-06 | 三星电子（中国）研发中心 | The player method and system of interactive multi-angle video |
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
| CN109361913A (en) * | 2015-05-18 | 2019-02-19 | 韩国电子通信研究院 | For providing the method and apparatus of 3-D image for head-mounted display |
| CN105704501A (en) * | 2016-02-06 | 2016-06-22 | 普宙飞行器科技（深圳）有限公司 | Unmanned plane panorama video-based virtual reality live broadcast system |
| CN108701294B (en) * | 2016-02-29 | 2021-05-25 | 微软技术许可有限责任公司 | Collaborative camera viewpoint control for interactive telepresence |
| CN108701294A (en) * | 2016-02-29 | 2018-10-23 | 微软技术许可有限责任公司 | The cooperation camera view control presented for interactive remote |
| CN107404602A (en) * | 2016-05-18 | 2017-11-28 | 广州市索广电子技术有限公司 | A kind of remote prompts method based on the braiding of video traffic channel data |
| CN107404602B (en) * | 2016-05-18 | 2020-01-24 | 广州市索广电子技术有限公司 | Remote prompting method based on video communication channel data weaving |
| CN106060518A (en) * | 2016-06-06 | 2016-10-26 | 武汉斗鱼网络科技有限公司 | Method and system for implementing 720-degree panoramic player with view angle switching function |
| CN106060518B (en) * | 2016-06-06 | 2017-12-08 | 武汉斗鱼网络科技有限公司 | Possesses the realization method and system of 720 degree of panorama players of view angle switch function |
| CN106210754A (en) * | 2016-07-07 | 2016-12-07 | 腾讯科技（深圳）有限公司 | A kind of control the method for net cast, relevant device and system |
| CN106231317A (en) * | 2016-09-29 | 2016-12-14 | 三星电子（中国）研发中心 | Video processing, coding/decoding method and device, VR terminal, audio/video player system |
| CN106375347A (en) * | 2016-11-18 | 2017-02-01 | 上海悦野健康科技有限公司 | Tourism live broadcast platform based on virtual reality |
| CN106851244A (en) * | 2017-01-10 | 2017-06-13 | 北京阿吉比科技有限公司 | The method and system of 3D panoramic videos are watched based on internet video live broadcasting platform |
| CN106954093B (en) * | 2017-03-15 | 2020-12-04 | 北京小米移动软件有限公司 | Panoramic video processing method, device and system |
| CN106954093A (en) * | 2017-03-15 | 2017-07-14 | 北京小米移动软件有限公司 | Panoramic video processing method, apparatus and system |
| CN107087145A (en) * | 2017-06-02 | 2017-08-22 | 深圳市本道科技有限公司 | Multi-channel video carries out the method and device that 360 degree of panoramic videos are shown |
| CN107396133B (en) * | 2017-07-20 | 2020-05-22 | 深圳市佳创视讯技术股份有限公司 | Free viewpoint video guide method and system |
| CN107396133A (en) * | 2017-07-20 | 2017-11-24 | 深圳市佳创视讯技术股份有限公司 | Free viewpoint video director method and system |
| CN108024071A (en) * | 2017-11-24 | 2018-05-11 | 腾讯数码（天津）有限公司 | Video content generation method, video content generating means and storage medium |
| CN108024071B (en) * | 2017-11-24 | 2022-03-08 | 腾讯数码（天津）有限公司 | Video content generation method, video content generation device, and storage medium |
| CN108874141A (en) * | 2018-06-25 | 2018-11-23 | 北京京东金融科技控股有限公司 | A kind of body-sensing browsing method and device |
| CN108874141B (en) * | 2018-06-25 | 2021-03-30 | 京东数字科技控股有限公司 | Somatosensory browsing method and device |
| CN109151497A (en) * | 2018-08-06 | 2019-01-04 | 广州虎牙信息科技有限公司 | A kind of even wheat live broadcasting method, device, electronic equipment and storage medium |
| CN109089147A (en) * | 2018-08-30 | 2018-12-25 | 宁波视睿迪光电有限公司 | Naked eye 3D video pushing method and device |
| CN111314739A (en) * | 2020-02-17 | 2020-06-19 | 聚好看科技股份有限公司 | Image processing method, server and display device |
| CN111355967A (en) * | 2020-03-11 | 2020-06-30 | 叠境数字科技（上海）有限公司 | Video live broadcast processing method, system, device and medium based on free viewpoint |
| CN111640187A (en) * | 2020-04-20 | 2020-09-08 | 中国科学院计算技术研究所 | Video splicing method and system based on interpolation transition |
| CN111640187B (en) * | 2020-04-20 | 2023-05-02 | 中国科学院计算技术研究所 | Video stitching method and system based on interpolation transition |
| CN112565693A (en) * | 2020-11-30 | 2021-03-26 | 广东荣文科技集团有限公司 | Method, system and equipment for monitoring video on demand |
| CN114629880A (en) * | 2020-12-10 | 2022-06-14 | 西安诺瓦星云科技股份有限公司 | Streaming media video source management method and device and card-inserting type video splicing processing equipment |
| CN114760483A (en) * | 2022-04-20 | 2022-07-15 | 东方明珠新媒体股份有限公司 | Method, system and medium for playing and switching multi-view video |
| CN114760483B (en) * | 2022-04-20 | 2023-12-19 | 东方明珠新媒体股份有限公司 | Multi-view video playing and switching method, system and medium |
| CN115361571A (en) * | 2022-08-04 | 2022-11-18 | 武汉依迅北斗时空技术股份有限公司 | Playing method and device of cloud storage video data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102307309A (en) | Somatosensory interactive broadcasting guide system and method based on free viewpoints | |
| US11924394B2 (en) | Methods and apparatus for receiving and/or using reduced resolution images | |
| US10341632B2 (en) | Spatial random access enabled video system with a three-dimensional viewing volume | |
| CN112738010B (en) | Data interaction method and system, interaction terminal and readable storage medium | |
| CN104602129B (en) | The player method and system of interactive multi-angle video | |
| US10650590B1 (en) | Method and system for fully immersive virtual reality | |
| CN100588250C (en) | Method and system for rebuilding free viewpoint of multi-view video streaming | |
| CN104219584A (en) | Reality augmenting based panoramic video interaction method and system | |
| CN112738534B (en) | Data processing method and system, server and storage medium | |
| CN102450011A (en) | Methods and apparatus for efficient streaming of free view point video | |
| KR102069930B1 (en) | Immersion communication client and server, and method for obtaining content view | |
| CN112738495B (en) | Virtual viewpoint image generation method, system, electronic device and storage medium | |
| CN111669518A (en) | Multi-angle free visual angle interaction method and device, medium, terminal and equipment | |
| CN111669561A (en) | Multi-angle free visual angle image data processing method and device, medium and equipment | |
| CN113963094A (en) | Depth map and video processing and reconstruction method, device, equipment and storage medium | |
| CN111669569A (en) | Video generation method and device, medium and terminal | |
| CN111669604A (en) | Acquisition equipment setting method and device, terminal, acquisition system and equipment | |
| CN112738009B (en) | Data synchronization method, device, synchronization system, medium and server | |
| CN111669570B (en) | Multi-angle free view video data processing method and device, medium and equipment | |
| Seo et al. | Immersive panorama TV service system | |
| CN112738646B (en) | Data processing method, device, system, readable storage medium and server | |
| CN117596373B (en) | Method for information display based on dynamic digital human image and electronic equipment | |
| CN112734821B (en) | Depth map generation method, computing node cluster and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120104 |
|
| WD01 | Invention patent application deemed withdrawn after publication |