CN112188302A - Data communication system, method and medium for VR system - Google Patents

Data communication system, method and medium for VR system Download PDF

Info

Publication number
CN112188302A
CN112188302A CN202011060080.1A CN202011060080A CN112188302A CN 112188302 A CN112188302 A CN 112188302A CN 202011060080 A CN202011060080 A CN 202011060080A CN 112188302 A CN112188302 A CN 112188302A
Authority
CN
China
Prior art keywords
data
control flow
host
video
top box
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011060080.1A
Other languages
Chinese (zh)
Inventor
周宸晏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Yingzan Communication Technology Co ltd
Original Assignee
Shanghai Yingzan Communication Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Yingzan Communication Technology Co ltd filed Critical Shanghai Yingzan Communication Technology Co ltd
Priority to CN202011060080.1A priority Critical patent/CN112188302A/en
Publication of CN112188302A publication Critical patent/CN112188302A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784Data processing by the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a data communication system, a method and a medium applied to a VR system.A video content acquired by multiple devices is the same coded content under the condition of movie playing, at the moment, a downlink data code stream is large and repeated, and the downlink data is distributed in a multicast mode, so that the load of a host or a set top box is reduced; the control flow between the VR equipment and the video host still adopts a unicast mode to transmit data, and the priority setting of a data packet is increased, so that the control flow can be normally received and processed. The invention adopts the data stream multicast mode to carry out downlink data transmission, thereby achieving the purposes of reducing data replication and reducing the load of a host/set top box, so that the common set top box can provide synchronous transmission of multiple VR videos and simultaneously serve a plurality of VR terminal devices.

Description

Data communication system, method and medium for VR system
Technical Field
The present invention relates to, and in particular, to a data communication system, method, and medium applied to a VR system. And more particularly, to the implementation of a data communication architecture for VR systems.
Background
With the great increase in network speed, high-bandwidth low-latency based applications gradually come into the view of users. As a typical application of a large-bandwidth scene, VR (Virtual Reality) technology is also gradually replacing conventional devices such as televisions to become a new video output device for home entertainment. Due to the immersive experience of the VR equipment, each user needs to have independent VR equipment, when the number of access equipment in the same scene is too many, due to the high bandwidth characteristic of VR, the burden of the household video host/video set top box is increased in multiples, so that the phenomena of frame loss, blocking and the like of the user side occur, and the user experience is influenced.
Since VR systems are currently in the early stages of popularity, a common household typically has only one device. In existing VR entertainment systems, the home video host/video set-top box typically provides only one VR data output. According to measurement and calculation, the conventional common host can provide 2-3 paths of high code stream VR audio and video decoding, processing and transmission; and because the common set-top box adopts an embedded chip, the processing capability is weaker than that of a host, and the common set-top box can only provide 1-2 paths of high code stream VR audio/video decoding, processing and transmission. With the rapid development of the VR technology, an audio/video format with a higher code rate appears, and a future family has 3 and 4 VR hosts for common entertainment and interaction, the existing host/set top box cannot bear data output of multiple VR audios/videos by using the original unicast technology, so that the use cost of a user is increased undoubtedly, a stronger host/set top box is required to support the new application scenes, and the popularization of the VR technology is adversely affected;
in the prior art, the data flow/control flow data packets use the same data channel, which may cause the downlink data flow/control flow to overlap, increase the packet loss probability, and increase the delay of the data packets. Under the existing system, repeated measurement and calculation are carried out according to experiments, operation is carried out while high-code-rate VR video playing, the possibility of packet loss or retransmission is increased by about 6% of control flow, and the data packet is delayed by 150ms on average. Due to the phenomenon, the processing delay of the host/set top box is prolonged, the illusion of operation failure is caused to the user, misoperation caused by the user operating again is easily caused, and the user experience is poor.
Patent document CN108271042B (application number: CN201810133524.6) discloses a video data transmission method based on a cable television network, a cloud VR system implementation method, and a cloud VR system, which includes: acquiring VR application picture data in a VR application running environment; converting the video code stream data into a radio frequency signal data stream; decoding the radio frequency signal data stream to obtain current VR picture data and displaying; collecting and transmitting user head motion information and user control information; sending the head movement information of the user and the data stream corresponding to the user control information to a cloud server through a bidirectional cable television network; demodulating the data stream and sending the data stream to a cloud server; and analyzing the operation instruction and generating new VR application picture data.
Disclosure of Invention
In view of the defects in the prior art, an object of the present invention is to provide a data communication system, method and medium for VR system.
As shown in fig. 1, according to the data communication system applied to the VR system provided by the present invention, in the case of playing a movie, video contents acquired by multiple devices are the same encoded content, at this time, a downlink data code stream is large and repeated, and the downlink data is distributed in a multicast manner, so that the load of a host or a set-top box is reduced;
the control flow between the VR equipment and the video host still adopts a unicast mode to transmit data, and the priority setting of a data packet is increased, so that the control flow can be normally received and processed.
Preferably, the method comprises the following steps:
the data processing module and the control flow input and output module;
the data processing module comprises: dividing the video host or set top box side and the VR equipment side;
the control flow input and output module: respectively recording request addresses and the number at a host end, and carrying out priority identification on the data packets; and establishing a kernel layer data priority queue, and preferentially sending a control flow message, wherein the control flow is a unicast data packet.
Preferably, the special address is in ipv4 format, the first segment is fixed as 239(EFH), the last segment is generated by hash coding the URL address requested by the data to generate 24bit data bits, and the 24bit data bits are filled
Preferably, the data processing module:
when a VR device side initiates a data request to a host through a control flow, a control flow module on the video host or a set top box side judges the current video request access number, if the same video request access number is larger than 1, the original downlink data flow repacks the data packet in a network layer in a multicast mode of a special address and sends the data packet out through a network;
and on the VR device side, the data processing module judges whether a request is made for the data stream according to the address, if so, the data stream is received, and if not, the data packet is discarded.
According to the data communication system applied to the VR system, under the condition of movie playing, video contents acquired by multiple devices are the same coded content, at the moment, the downstream data code stream is large and repeated, the downstream data is distributed in a multicast mode, and the load of a host or a set top box is reduced;
the control flow between the VR equipment and the video host still adopts a unicast mode to transmit data, and the priority setting of a data packet is increased, so that the control flow can be normally received and processed.
Preferably, the method comprises the following steps:
a data processing step and a control flow input and output step;
the data processing step comprises: when a VR device side initiates a data request to a host through a control flow, a control flow module on the video host or a set top box side judges the current video request access number, if the same video request access number is larger than 1, the original downlink data flow repacks the data packet in a network layer in a multicast mode of a special address and sends the data packet out through a network; and on the VR device side, the data processing module judges whether a request is made for the data stream according to the address, if so, the data stream is received, and if not, the data packet is discarded.
The control flow input and output step: respectively recording request addresses and the number at a host end, and carrying out priority identification on the data packets; and establishing a kernel layer data priority queue, and preferentially sending a control flow message, wherein the control flow is a unicast data packet.
Preferably, the special address is in ipv4 format, the first segment is fixed as 239(EFH), and the last segment is hash-coded by the URL address of the data request to generate 24-bit data bits and is padded.
According to the present invention, there is provided a computer-readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the steps of the data communication method applied to the VR system.
Compared with the prior art, the invention has the following beneficial effects:
(1) by adopting a data stream multicast mode to carry out downlink data transmission, the data replication is reduced, the load of a host/set top box is reduced, and an ordinary set top box can provide synchronous transmission of multiple VR videos and simultaneously serve multiple VR terminal devices.
(2) By adopting data stream/control stream separation and improving the priority of the control stream at a data packet network layer, the control stream data packet is preferentially sent/received, so that the time delay of a user for controlling equipment is shortened, the probability of packet loss of the data packet is reduced (according to laboratory test, the packet loss/retransmission probability is close to 0), and the use experience of the user is optimized.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is a block diagram of a system provided by the present invention.
Fig. 2 is a schematic diagram of a flow chart provided by the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that it would be obvious to those skilled in the art that various changes and modifications can be made without departing from the spirit of the invention. All falling within the scope of the present invention.
The present invention will be described more specifically with reference to examples.
Example (b):
in the multi-user scenario, the patent designs a single/multicast hybrid network transmission architecture. Under the condition of movie and television playing, video contents (movies such as a circular screen and a spherical screen, and 3D surrounding scenes) acquired by multiple devices are the same coded content, and at the moment, the downstream data code stream is large and repeated, so that the downstream data is distributed in a multicast mode (the multicast mode is a mode of performing mass distribution by utilizing the existing Ethernet multicast mode, namely the target address is a multicast address, namely the stream is simultaneously sent to the multiple devices), and the burden of a host/set top box can be greatly reduced; meanwhile, the control flow between the VR equipment and the video host still adopts a unicast mode to transmit data, and the priority setting of a data packet is increased, so that the control flow can be normally received and processed. As shown in fig. 2, is a flow chart diagram.
The technical scheme specifically comprises the following steps: the device comprises a data processing module and a control flow input and output module.
The data processing module is divided into a video host side and a VR device side. When a VR device side initiates a data request to a host through a control flow, a control flow module at a video host/set top box side judges the current video request access number, if the same video request access number is larger than 1, the original downlink data flow repacks the data packet in a network layer in a multicast mode of a special address and sends the data packet out through a network; and on the VR device side, the data processing module judges whether a request is made for the data stream according to the address, if so, the data stream is received, and if not, the data packet is discarded. The first segment of the special address (ipv4 format) is fixed as 239(EFH), and the last segment is generated by hash-coding the URL address requested by the data to generate 24-bit data bits, and is padded.
Under the action of the control flow input and output module, respectively recording request addresses and numbers at the host end, and carrying out priority identification on the data packets; when the module is started, a kernel layer data priority queue is established, and a control flow message is sent preferentially. The control flow is a unicast packet.
In the description of the present application, it is to be understood that the terms "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing the present application and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present application.
Those skilled in the art will appreciate that, in addition to implementing the systems, apparatus, and various modules thereof provided by the present invention in purely computer readable program code, the same procedures can be implemented entirely by logically programming method steps such that the systems, apparatus, and various modules thereof are provided in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Therefore, the system, the device and the modules thereof provided by the present invention can be considered as a hardware component, and the modules included in the system, the device and the modules thereof for implementing various programs can also be considered as structures in the hardware component; modules for performing various functions may also be considered to be both software programs for performing the methods and structures within hardware components.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.

Claims (8)

1. A data communication system applied to a VR system is characterized in that under the condition of movie playing, video contents acquired by multiple devices are the same coded content, at the moment, a downlink data code stream is large and repeated, and the downlink data is distributed in a multicast mode, so that the load of a host or a set top box is reduced;
the control flow between the VR equipment and the video host still adopts a unicast mode to transmit data, and the priority setting of a data packet is increased, so that the control flow can be normally received and processed.
2. The data communication system of claim 1, applied to a VR system, comprising:
the data processing module and the control flow input and output module;
the data processing module comprises: dividing the video host or set top box side and the VR equipment side;
the control flow input and output module: respectively recording request addresses and the number at a host end, and carrying out priority identification on the data packets; and establishing a kernel layer data priority queue, and preferentially sending a control flow message, wherein the control flow is a unicast data packet.
3. The data communication system of claim 2, wherein the specific address is in ipv4 format, the first segment is fixed as 239(EFH), and the last segment is generated by hash-coding the URL address requested by the data to generate 24-bit data bits and padded.
4. The data communication system of claim 2, wherein the data processing module is further configured to:
when a VR device side initiates a data request to a host through a control flow, a control flow module on the video host or a set top box side judges the current video request access number, if the same video request access number is larger than 1, the original downlink data flow repacks the data packet in a network layer in a multicast mode of a special address and sends the data packet out through a network;
and on the VR device side, the data processing module judges whether a request is made for the data stream according to the address, if so, the data stream is received, and if not, the data packet is discarded.
5. A data communication method applied to VR system is characterized in that under the condition of video playing, video contents acquired by multiple devices are the same coded content, at the moment, the downstream data code stream is large and repeated, and the downstream data is distributed in a multicast mode, so that the load of a host or a set top box is reduced;
the control flow between the VR equipment and the video host still adopts a unicast mode to transmit data, and the priority setting of a data packet is increased, so that the control flow can be normally received and processed.
6. The method of claim 5, further comprising:
a data processing step and a control flow input and output step;
the data processing step comprises: when a VR device side initiates a data request to a host through a control flow, a control flow module on the video host or a set top box side judges the current video request access number, if the same video request access number is larger than 1, the original downlink data flow repacks the data packet in a network layer in a multicast mode of a special address and sends the data packet out through a network; and on the VR device side, the data processing module judges whether a request is made for the data stream according to the address, if so, the data stream is received, and if not, the data packet is discarded.
The control flow input and output step: respectively recording request addresses and the number at a host end, and carrying out priority identification on the data packets; and establishing a kernel layer data priority queue, and preferentially sending a control flow message, wherein the control flow is a unicast data packet.
7. The method of claim 6, wherein the specific address is in ipv4 format, the first segment is fixed as 239(EFH), and the last segment is generated by hash-coding the URL address requested by the data to generate 24-bit data bits and is padded.
8. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the data communication method of any of claims 5 to 7 applied to a VR system.
CN202011060080.1A 2020-09-30 2020-09-30 Data communication system, method and medium for VR system Pending CN112188302A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011060080.1A CN112188302A (en) 2020-09-30 2020-09-30 Data communication system, method and medium for VR system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011060080.1A CN112188302A (en) 2020-09-30 2020-09-30 Data communication system, method and medium for VR system

Publications (1)

Publication Number Publication Date
CN112188302A true CN112188302A (en) 2021-01-05

Family

ID=73947131

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011060080.1A Pending CN112188302A (en) 2020-09-30 2020-09-30 Data communication system, method and medium for VR system

Country Status (1)

Country Link
CN (1) CN112188302A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100014519A1 (en) * 2007-10-15 2010-01-21 Media Patents, S.L. Methods for managing multicast traffic between sources sending data and hosts requesting data and network equipment used to implement the methods
US20180069760A1 (en) * 2016-09-06 2018-03-08 Smartiply, Inc. Fog Local Processing and Relaying for Mitigating Latency and Bandwidth Bottlenecks in AR/VR Streaming
CN207135230U (en) * 2017-07-19 2018-03-23 中国移动通信集团福建有限公司 A kind of high end STB for supporting the VR helmets
CN108307226A (en) * 2016-09-21 2018-07-20 中兴通讯股份有限公司 VR videos based on Web TV or game play system, set-top box
US20180350136A1 (en) * 2017-05-31 2018-12-06 TeMAVR, LLC Systems and associated methods for creating a viewing experience
WO2020166859A1 (en) * 2019-02-11 2020-08-20 Lg Electronics Inc. Method and apparatus for transmitting buffer status report by iab node in wireless communication system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100014519A1 (en) * 2007-10-15 2010-01-21 Media Patents, S.L. Methods for managing multicast traffic between sources sending data and hosts requesting data and network equipment used to implement the methods
US20180069760A1 (en) * 2016-09-06 2018-03-08 Smartiply, Inc. Fog Local Processing and Relaying for Mitigating Latency and Bandwidth Bottlenecks in AR/VR Streaming
CN108307226A (en) * 2016-09-21 2018-07-20 中兴通讯股份有限公司 VR videos based on Web TV or game play system, set-top box
US20180350136A1 (en) * 2017-05-31 2018-12-06 TeMAVR, LLC Systems and associated methods for creating a viewing experience
CN207135230U (en) * 2017-07-19 2018-03-23 中国移动通信集团福建有限公司 A kind of high end STB for supporting the VR helmets
WO2020166859A1 (en) * 2019-02-11 2020-08-20 Lg Electronics Inc. Method and apparatus for transmitting buffer status report by iab node in wireless communication system

Similar Documents

Publication Publication Date Title
CN102377823B (en) Method and system for realizing interactive sharing among multiple screens and multiple users by sliding screens
JP2020519094A (en) Video playback method, device, and system
CN109640029B (en) Method and device for displaying video stream on wall
CN108881815B (en) Video data transmission method and device
US20200145736A1 (en) Media data processing method and apparatus
CN110489042B (en) Method and system for simulating dragging based on video network
CN103248939A (en) Method and system for achieving synchronous display of multiple screens
CN112637661B (en) Video stream switching method and device, computer storage medium and electronic equipment
CN111866526B (en) Live broadcast service processing method and device
JP2013509768A (en) Digital audio / video channel changing method and corresponding apparatus
WO2018000743A1 (en) Cross-device group chatting method and electronic device
US20170171579A1 (en) Method and Device for Transcoding Live Video
CN108574816B (en) Video networking terminal and communication method and device based on video networking terminal
CN107547517B (en) Audio and video program recording method, network equipment and computer device
CN113132194A (en) Information transfer method, device, equipment, server and storage medium
WO2018121584A1 (en) Data stream transmission method, apparatus, related devices and storage medium
CN103685303A (en) Method and system for processing connection content delivery network
CN110392275B (en) Sharing method and device for manuscript demonstration and video networking soft terminal
CN111654659B (en) Conference control method and device
CN110519331B (en) Method and device for processing resources of video network
CN110502155B (en) Display method and device for shared data
CN114630101B (en) Display device, VR device and display control method of virtual reality application content
WO2022116822A1 (en) Data processing method and apparatus for immersive media, and computer-readable storage medium
CN112188302A (en) Data communication system, method and medium for VR system
CN111683228B (en) Data transmission method and device based on video networking, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210105