WO2017120756A1 - Système de traitement de données de vidéo vr - Google Patents

Système de traitement de données de vidéo vr Download PDF

Info

Publication number
WO2017120756A1
WO2017120756A1 PCT/CN2016/070649 CN2016070649W WO2017120756A1 WO 2017120756 A1 WO2017120756 A1 WO 2017120756A1 CN 2016070649 W CN2016070649 W CN 2016070649W WO 2017120756 A1 WO2017120756 A1 WO 2017120756A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
video
module
data frame
unit
Prior art date
Application number
PCT/CN2016/070649
Other languages
English (en)
Chinese (zh)
Inventor
李刚
龙寿伦
Original Assignee
深圳多哚新技术有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳多哚新技术有限责任公司 filed Critical 深圳多哚新技术有限责任公司
Priority to PCT/CN2016/070649 priority Critical patent/WO2017120756A1/fr
Publication of WO2017120756A1 publication Critical patent/WO2017120756A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers

Definitions

  • the present invention relates to the field of head-mounted display devices, and more particularly to a VR video data processing system.
  • VR Virtual Reality, VR for short
  • display technology is developing at a high speed, and various display devices appear; users are increasingly choosing display devices, so lighter and thinner VR glasses become users' pursuit. The goal; at the same time thinner and lighter VR glasses also pose new challenges to the technology.
  • the existing VR glasses Due to the large number of internal components, the existing VR glasses have a large amount of heat generated inside the VR display device, and the heat inside the VR display device directly affects the user's thermal experience, affecting the comfort of the VR glasses, and the data lines are too heavy. VR glasses are too thick and have a poor experience.
  • an object of the present invention is to provide a VR video data processing system, including: a video source subsystem and a VR subsystem;
  • the video source subsystem includes: a system processing chip, a video source conversion unit, and a video processing unit;
  • the system processing chip is configured to transmit system video data information to the video source conversion unit;
  • the video source conversion unit is configured to receive video data information transmitted by the system processing chip, convert the video data information into an RGB video data signal, and send the information to the video processing unit;
  • the video processing unit is configured to receive an RGB video data signal, and decompose the RGB video data signal into two parts of the data frame video signal displayed on the left eye display screen and the right eye display screen of the VR glasses, and the two parts of the data frame video signal Packaged and sent to the VR subsystem;
  • the VR subsystem includes: a VR data parsing unit and a VR display unit;
  • the VR data parsing unit is configured to receive a data frame video signal transmitted by the video processing unit, and parse the data frame video signal to obtain RGB video data, and transmit the RGB video data to the VR display unit;
  • the VR display unit is configured to display RGB video data sent by the VR data parsing unit.
  • the video processing unit comprises: a video input module, a video distribution module, and a number According to the frame packing module, the GTP sending module;
  • the video input module is configured to receive an RGB video data signal sent by the video source conversion unit;
  • the video distribution module is configured to decompose the RGB video data signals into two-part data frame video signals according to the left eye display unit and the right display unit display of the VR glasses, respectively;
  • the data frame packing module is configured to merge two parts of the data frame video signals into parallel data, and add check bytes at the end of the parallel data, respectively packaged and input to the GTP sending module;
  • the GTP sending module is configured to send the data frame packed by the data frame packing module to the VR subsystem.
  • the GTP sending module includes: a data sending module and a sending clock;
  • the data transmitting module is configured to send data in parallel under the driving of the sending clock, send bit 0 to bit 3 on the rising edge of the clock, and send bit 4 to bit 7 on the falling edge, and complete one byte of data transmission every clock cycle. .
  • the data frame packing module further includes: a CRC check generating module;
  • the CRC check generating module is configured to generate a check byte
  • the data frame sent by the GTP sending module includes: a data frame video signal and a check byte.
  • the GTP sending module further includes: a sending buffer module and a sending buffer control module;
  • the sending buffer module is configured to match a link port with a data bit width and a rate of a data frame video signal of the video processing unit;
  • the transmit buffer control module is configured to control the read and write of the transmit buffer FIFO, and set the minimum unit of data transmission to 128 bits according to the link port protocol.
  • the VR data parsing unit comprises: a GTP receiving module, a data frame unpacking module, and a VR video allocating module;
  • the GTP receiving module is configured to receive a data frame sent by the GTP sending module
  • the data frame unpacking module is configured to parse the received data frame into two parts of the data frame video signal, and obtain two parts of the RGB video data from the two parts of the data frame video signal, and send the data to the VR video distribution module;
  • the VR video distribution module is configured to receive two parts of RGB video data, and correspondingly allocate to the VR display unit for display.
  • the GTP receiving module includes: a data receiving module
  • the data receiving module is configured to receive data in parallel at the same frequency as the transmission clock.
  • the GTP receiving module further includes: a receiving CRC check module;
  • the receiving CRC check module is configured to check the check byte at the end of the parallel data. When the comparison result is the same, the currently received data is correct; otherwise, the data is incorrectly reported to the upper layer module.
  • the GTP receiving module further includes: a receiving buffer module and a receiving buffer control module;
  • the receiving buffer module is configured to match a link port with a data bit width and a rate of a data frame video signal of the video processing unit;
  • the receiving buffer control module is configured to control reading and writing of the receiving buffer FIFO, and according to the link port protocol, when the data passes the verification, the receiving link port receives the data.
  • the video source subsystem and the VR subsystem are connected by a differential line.
  • the present invention has the following advantages:
  • the video source subsystem comprises: a video source conversion unit and a video processing unit
  • the VR subsystem comprises a VR data parsing unit and a VR display unit, so as to move the hot work to the video source end, so that the VR glasses part only serves as a display device.
  • the processing work is as small as possible, which reduces the heating effect of the VR eyes.
  • the VR glasses end reduces the HDMI to RGB dedicated IC, can use a smaller FPGA data analysis unit, reducing the number of ICs on the glasses side, which is beneficial to make VR glasses thinner, reduce the weight of VR glasses, and reduce the VR glasses. Lines to improve user experience.
  • FIG. 1 is an overall schematic diagram of a VR video data processing system
  • FIG. 2 is a schematic diagram of a video processing unit
  • FIG. 3 is a schematic diagram of a VR data parsing unit.
  • the embodiment provides a VR video data processing system, as shown in FIG. 1, comprising: a video source subsystem 11, a VR subsystem 12;
  • the video source subsystem 11 includes: a system processing chip 1, a video source converting unit 2, and a video processing unit 3;
  • the system processing chip 1 is configured to transmit system video data information to a video source conversion unit;
  • the video source converting unit 2 is configured to receive the video data information transmitted by the system processing chip 1, convert the video data information into an RGB video data signal, and send it to the video processing unit 3;
  • the video processing unit 3 is configured to receive the RGB video data signal, and decompose the RGB video data signal into two parts of the data frame video signal displayed on the left eye display screen and the right eye display screen of the VR glasses, and respectively separate the two parts of the data frame video signal. Packed and sent to the VR subsystem 12;
  • the VR subsystem 12 includes: a VR data parsing unit 4, a VR display unit 5;
  • the VR data parsing unit 4 is configured to receive the data frame video signal transmitted by the video processing unit 3, and parse the data frame video signal to obtain RGB video data, and transmit the RGB video data to the VR display unit 5; the VR display unit 5 is configured to display the VR data parsing unit 4 to send RGB video data.
  • the VR display unit 5 includes: a left eye display screen and a right eye display screen.
  • the VR data parsing unit 4 receives the data frame video signal transmitted by the video processing unit 3, and parses the data frame video signal to obtain RGB video data, where the data frame video signal is parsed.
  • the two-part data frame video signals displayed on the left-eye display and the right-eye display of the VR glasses are obtained, so that the left-eye display and the right-eye display respectively display corresponding RGB video data.
  • the video source conversion unit converts HDMI to RGB signals.
  • the video processing unit 3 is an FPGA video processing.
  • the VR data analyzing unit 4 is an FPGA data analyzing unit.
  • the video source subsystem 11 includes a video source converting unit 2 and a video processing unit 3.
  • the VR subsystem 12 includes a VR data analyzing unit 4 and a VR display unit 5, so as to move the hot work to the video source.
  • the VR glasses part is only used as a display device, and the processing work is as small as possible, thereby reducing the heating effect of the VR eyes.
  • VR glasses end reduced HDMI to RGB dedicated IC can use a smaller FPGA data analysis unit, reducing the number of ICs on the glasses side, which is beneficial to make VR glasses lighter and lighter and reduce the weight of VR glasses.
  • the video processing unit 3 includes: a video input module 31, a video distribution module 32, a data frame packing module 33, and a GTP sending module 34;
  • the video input module 31 is configured to receive the RGB video data signal sent by the video source converting unit.
  • the video assigning module 32 is configured to decompose the RGB video data signal into two display units of the left eye display unit and the right display unit of the VR glasses. Part of the data frame video signal; the data frame packing module 33 is configured to combine the two parts of the data frame video signal into parallel data, and respectively packaged and input to the GTP sending module 34; the GTP sending module 34 is configured to generate a data frame by the data frame packing module. Sent to the VR subsystem 12.
  • the GTP sending module 34 includes: a data sending module 35, a sending clock 36;
  • the data transmitting module 35 is for transmitting data in parallel under the driving of the transmission clock, transmitting bits 0 to 3 on the rising edge of the clock, and transmitting bits 4 to 7 on the falling edge, and completing one byte of data transmission every clock cycle.
  • the data frame packing module further includes: a CRC check generating module 37;
  • the CRC check generation module 37 is configured to generate a check byte.
  • the data frame sent by the GTP sending module 34 includes: a data frame video signal and a check byte.
  • the GTP sending module 34 further includes: a sending buffer module 38, a sending buffer control module 39;
  • the transmit buffer module 38 is configured to match the link port with the data bit width and rate of the data frame video signal of the video processing unit; the transmit buffer control module 39 is configured to control the read and write of the transmit buffer FIFO, and is configured according to the link port protocol. , set the minimum unit of data transmission to 128bit.
  • the VR data parsing unit 4 includes: a GTP receiving module 41, a data frame unpacking module 46, and a VR video allocating module 47;
  • the GTP receiving module 41 is configured to receive a data frame sent by the GTP sending module 34.
  • the data frame unpacking module 46 is configured to parse the received data frame into two parts of the data frame video signal, and obtain two parts of the RGB video data from the two parts of the data frame video signal, and send the data to the VR video distribution module 47; the VR video distribution module 47 is used for receiving two parts of RGB video data, and correspondingly assigned to the VR display unit 5 for display.
  • the GTP receiving module 41 includes: a data receiving module 42; the data receiving module 42 is configured to pass Data is received in parallel at the same frequency as the transmit clock 36.
  • the GTP receiving module 41 further includes: a receiving CRC check module 43;
  • the receiving CRC check module 43 is configured to check the check byte at the end of the parallel data. When the comparison result is the same, the currently received data is correct; otherwise, the data is incorrectly reported to the upper layer module.
  • the GTP receiving module 41 further includes: a receiving buffer module 45, a receiving buffer control module 44;
  • the receiving buffer module 45 is configured to match the link port with the data bit width and rate of the data frame video signal of the video processing unit 3; the receive buffer control module 44 is configured to control the read buffer FIFO read and write, and according to the link port protocol When the data passes the check, the receiving link port receives the data.
  • the stability and accuracy of the data transmission between the video source subsystem and the VR subsystem are ensured, the external interference to the data transmission is reduced, the data throughput is improved, the data transmission amount is improved, and the video playback is smooth. And the video source subsystem and the VR subsystem can realize the communication connection through the differential line, making the VR glasses more convenient to use.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L'invention concerne un système de traitement de données de vidéo VR, comprenant : un sous-système de source de vidéo (11) et un sous-système VR (12). Une puce de traitement de système (1) transmet des informations de données de vidéo de système à une unité de conversion de source de vidéo (2); l'unité de conversion de source de vidéo (2) convertit les informations de données de vidéo en un signal de données de vidéo RVB, et envoie ce dernier à une unité de traitement de vidéo (3); l'unité de traitement de vidéo (3) décompose le signal de données de vidéo RVB en un signal de vidéo de trame de données à deux parties affiché sur un écran d'affichage d'œil gauche et un écran d'affichage d'œil droit de lunettes VR, intègre respectivement le signal de vidéo de trame de données à deux parties et envoie ce dernier au sous-système VR (12); et une unité d'analyse de données VR (4) reçoit le signal de vidéo de trame de données émis par l'unité de traitement de vidéo (3), analyse le signal de vidéo de trame de données de façon à obtenir des données de vidéo RVB, et émet ce dernier à destination d'une unité d'affichage VR (5). Au moyen de la présente invention, le travail impliquant une grande quantité d'émission de chaleur est transféré à une extrémité de source de vidéo, de telle sorte qu'une partie de lunettes VR sert uniquement de dispositif d'affichage, avec aussi peu de travail de traitement que possible, permettant ainsi de réduire l'effet chauffant de lunettes VR.
PCT/CN2016/070649 2016-01-12 2016-01-12 Système de traitement de données de vidéo vr WO2017120756A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/070649 WO2017120756A1 (fr) 2016-01-12 2016-01-12 Système de traitement de données de vidéo vr

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/070649 WO2017120756A1 (fr) 2016-01-12 2016-01-12 Système de traitement de données de vidéo vr

Publications (1)

Publication Number Publication Date
WO2017120756A1 true WO2017120756A1 (fr) 2017-07-20

Family

ID=59310532

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/070649 WO2017120756A1 (fr) 2016-01-12 2016-01-12 Système de traitement de données de vidéo vr

Country Status (1)

Country Link
WO (1) WO2017120756A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112055264A (zh) * 2019-06-06 2020-12-08 舜宇光学（浙江）研究院有限公司 一种视频数据拆分方法及其系统以及电子设备和计算系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140002622A1 (en) * 2012-07-02 2014-01-02 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
CN104306102A (zh) * 2014-10-10 2015-01-28 上海交通大学 针对视觉障碍患者的头戴式视觉辅助系统
CN104483753A (zh) * 2014-12-04 2015-04-01 上海交通大学 自配准透射式头戴显示设备
CN104660995A (zh) * 2015-02-11 2015-05-27 尼森科技（湖北）有限公司 一种救灾救援可视系统
CN105491369A (zh) * 2016-01-12 2016-04-13 深圳多哚新技术有限责任公司 一种vr视频数据处理系统
CN205356598U (zh) * 2016-01-12 2016-06-29 深圳多哚新技术有限责任公司 一种vr视频数据处理系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140002622A1 (en) * 2012-07-02 2014-01-02 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
CN104306102A (zh) * 2014-10-10 2015-01-28 上海交通大学 针对视觉障碍患者的头戴式视觉辅助系统
CN104483753A (zh) * 2014-12-04 2015-04-01 上海交通大学 自配准透射式头戴显示设备
CN104660995A (zh) * 2015-02-11 2015-05-27 尼森科技（湖北）有限公司 一种救灾救援可视系统
CN105491369A (zh) * 2016-01-12 2016-04-13 深圳多哚新技术有限责任公司 一种vr视频数据处理系统
CN205356598U (zh) * 2016-01-12 2016-06-29 深圳多哚新技术有限责任公司 一种vr视频数据处理系统

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112055264A (zh) * 2019-06-06 2020-12-08 舜宇光学（浙江）研究院有限公司 一种视频数据拆分方法及其系统以及电子设备和计算系统
CN112055264B (zh) * 2019-06-06 2022-11-01 舜宇光学（浙江）研究院有限公司 一种视频数据拆分方法及其系统以及电子设备和计算系统

Similar Documents

Publication Publication Date Title
CN105491369B (zh) 一种vr视频数据处理系统
US10564910B2 (en) Message passing framework for audio/video streaming in a topology of devices
KR102146867B1 (ko) 비디오 데이터와 함께 고속 데이터 전송을 제공하기 위한 방법 및 디바이스
US8397272B2 (en) Multi-stream digital display interface
US9594536B2 (en) Method and apparatus for electronic device communication
US10185621B2 (en) Method and apparatus for providing a display stream embedded with non-display data
WO2022134560A1 (fr) Procédés de transmission et de réception de données pour écran d'affichage et cartes d'envoi et réception d'écran d'affichage
WO2016202114A1 (fr) Procédé et dispositif de transmission de données et support d'informations
RU2006147230A (ru) Устройство и способ реализации интерфейса высокоскоростной передачи данных
JP3218074U (ja) マルチメディア信号伝送装置
CN107547882A (zh) 一种vr视频数据新处理系统
WO2015158156A1 (fr) Dispositif pour étendre une distance de transmission de bus série universel
CN104104893A (zh) 将混合信号同时通过单根光纤远程传输的设备及传输方法
WO2017120756A1 (fr) Système de traitement de données de vidéo vr
US8260994B2 (en) Interface for prototyping integrated systems
US8634090B2 (en) Data transfer apparatus, data transmitting and receiving apparatus, and image forming apparatus
CN205356598U (zh) 一种vr视频数据处理系统
WO2016000376A1 (fr) Procédé de traitement de signal et appareil de traitement de signal basés sur des interfaces pci-e
CN106791767A (zh) Vr视频处理系统
CN203368614U (zh) 将混合信号同时通过单根光纤远程传输的设备
CN112054875A (zh) 一种多通道数据传输方法及其系统以及电子设备和近眼显示设备
GB2519640A (en) Topology and bandwidth management for IO and inbound AV
US11422952B2 (en) Wireless input apparatus
CN210515372U (zh) 高速图像处理线路盒
Grunwald et al. Managing Multiple High-Speed Sensor Streams with ARINC 818-3

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16884319

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.11.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16884319

Country of ref document: EP

Kind code of ref document: A1