WO2021212356A1 - 定位数据处理方法、电子设备及存储介质 - Google Patents

定位数据处理方法、电子设备及存储介质 Download PDF

Info

Publication number
WO2021212356A1
WO2021212356A1 PCT/CN2020/086061 CN2020086061W WO2021212356A1 WO 2021212356 A1 WO2021212356 A1 WO 2021212356A1 CN 2020086061 W CN2020086061 W CN 2020086061W WO 2021212356 A1 WO2021212356 A1 WO 2021212356A1
Authority
WO
WIPO (PCT)
Prior art keywords
positioning data
data
frames
several frames
client
Prior art date
Application number
PCT/CN2020/086061
Other languages
English (en)
French (fr)
Inventor
毛冬
尹桑
Original Assignee
上海唯二网络科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海唯二网络科技有限公司 filed Critical 上海唯二网络科技有限公司
Priority to CN202080000608.8A priority Critical patent/CN111630829A/zh
Priority to PCT/CN2020/086061 priority patent/WO2021212356A1/zh
Publication of WO2021212356A1 publication Critical patent/WO2021212356A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04Protocols for data compression, e.g. ROHC

Definitions

  • the present disclosure relates to virtual reality technology, and in particular to a positioning data processing method of a virtual reality device, an electronic device, and a storage medium.
  • Virtual reality technology (Virtual Reality, VR) is a computer simulation system that can create and experience a virtual world. It uses a computer to generate a simulation environment to immerse users in the environment.
  • the embodiments of the present disclosure provide a positioning data processing solution for a virtual reality VR device, which can significantly reduce the amount of transmitted data.
  • One aspect of the present disclosure provides a method for processing positioning data of a virtual reality VR device, including:
  • the VR client obtains several frames of positioning data of at least one virtual reality device
  • the VR client compresses the several frames of positioning data
  • the VR client transmits at least part of the several frames of positioning data after the compression processing to an external device.
  • the compressing the several frames of positioning data includes:
  • the transmitting at least part of the plurality of frames of positioning data after the compression processing includes: sending at least part of the reference frame and the difference data.
  • the obtaining the difference data corresponding to each of at least some of the frames of positioning data includes:
  • the reference frame is the first frame, the last frame, or other frames between the first frame and the last frame in the several frames of positioning data.
  • the compressing the several frames of positioning data further includes:
  • De-sign processing is performed on the several frames of positioning data.
  • performing compression processing on the several frames of positioning data includes:
  • Lossless compression processing is performed on the several frames of positioning data.
  • the obtaining several frames of positioning data of at least one virtual reality device includes: obtaining several frames of positioning data of each of a plurality of virtual reality devices;
  • the compressing processing of the several frames of positioning data includes: compressing each of the several frames of positioning data of the plurality of virtual reality devices.
  • the several frames of positioning data are consecutive frames of positioning data, or several discontinuous frames of positioning data.
  • the method further includes: another VR client synchronizing the corresponding user's avatar in the constructed multi-user shared VR environment according to the data transmitted by the VR client to the external device.
  • an electronic device including:
  • the memory has executable code stored thereon, and when the executable code is executed by the processor, the processor is caused to execute the method as described above.
  • the electronic device is an all-in-one VR machine or a smart terminal device.
  • Another aspect of the present disclosure provides a non-transitory machine-readable storage medium having executable code stored thereon, and when the executable code is executed by a processor of an electronic device, the processor is caused to execute the above-mentioned method.
  • the amount of transmitted data can be reduced, the occupation of network resources can be reduced, and the impact on the VR system can be reduced when the network performance is poor, and the impact can be avoided. user experience.
  • the difference data is used to replace the complete data of each frame.
  • the VR data refresh rate is usually set to be higher, so the difference between adjacent frames is small, that is, the difference corresponding to each frame
  • the data is relatively small, which can significantly reduce the amount of data.
  • the difference data is further compressed by performing de-duplication processing on the difference data, preserving n-digit processing after the decimal point, de-decimal point processing, and de-sign processing to further reduce the data volume.
  • the amount of data obtained after compression using the scheme of this embodiment is at least less than one-third of the original data amount, and there is basically no loss of accuracy.
  • Fig. 1 shows an exemplary architecture of a virtual reality system according to an embodiment of the present disclosure
  • FIG. 2 is a schematic flowchart of an embodiment of a positioning data processing method of a virtual reality device of the present disclosure
  • FIG. 3 is a flowchart of another embodiment of a positioning data processing method of a virtual reality device of the present disclosure
  • Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
  • first, second, third, etc. may be used in this disclosure to describe various information, the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other.
  • first information may also be referred to as second information, and similarly, the second information may also be referred to as first information.
  • second information may also be referred to as first information.
  • features defined with “first” and “second” may explicitly or implicitly include one or more of these features.
  • “plurality” means two or more than two, unless otherwise specifically defined.
  • FIG. 1 shows an exemplary architecture of a virtual reality system according to an embodiment of the present disclosure.
  • the VR system shown in FIG. 1 includes a server 100 and multiple client systems 200, and the client system 200 includes a VR client 210 and a VR device 220.
  • the server 100 and the VR client 210 may be applied to the device in the form of software.
  • the server 100 may be deployed on an independent service device, or may be deployed on a cluster service device composed of multiple independent service devices.
  • the VR client 210 is deployed on a user terminal that supports VR technology.
  • the VR client 210 can be independent software, or can be used as a subsystem or component of a large-scale system.
  • the server 100 may provide a multi-user shared VR environment platform, and provide background services for each VR client 210.
  • the VR client 210 can construct a multi-user shared VR environment, and users of the VR client 210 have their own user stand-ins in the multi-user shared VR environment and enjoy an immersive VR experience.
  • the server 100 and the VR client 210 of each client system 200 are connected through a network.
  • the network can be a wired or wireless network such as the Internet, Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G, 5G, Bluetooth, Wi-Fi, etc. It can be understood that the VR client 210 of each client system 200 may also be connected point-to-point.
  • the VR device 220 includes, for example, a wearable VR device 220 that can be directly worn on the user's body (such as VR helmets, VR glasses and other head-mounted devices, and VR gloves, VR handles, VR bracelets, etc.), and can be integrated into the user's clothes A combination of one or more of the equipment with user space positioning, somatosensory tracking function, VR all-in-one machine and other equipment of the accessory.
  • a wearable VR device 220 that can be directly worn on the user's body (such as VR helmets, VR glasses and other head-mounted devices, and VR gloves, VR handles, VR bracelets, etc.), and can be integrated into the user's clothes
  • a wearable VR device 220 that can be directly worn on the user's body (such as VR helmets, VR glasses and other head-mounted devices, and VR gloves, VR handles, VR bracelets, etc.), and can be integrated into the user's clothes
  • a user terminal that supports VR technology can, for example, support a combination of one or more of the smart terminal devices (smartphones, tablet computers, notebook computers, desktop computers, in-vehicle terminals, etc.) that communicate with the VR device 220, the above-mentioned all-in-one VR devices, etc. .
  • the smart terminal devices smart terminal devices
  • the VR device 220 the above-mentioned all-in-one VR devices, etc.
  • the VR client 210 can obtain real-time positioning data from the corresponding VR device, and continuously synchronize the positioning data of the VR device with the system, so that the server and other VR clients can determine each of the same VR scenes.
  • the first user's VR client also called the first VR client
  • the second user's VR client also called the second VR client
  • the synchronization of the avatar of the first user will be described as an example.
  • FIG. 2 is a schematic flowchart of an embodiment of a method for processing positioning data of a virtual reality device of the present disclosure.
  • the method in this embodiment may include:
  • the first VR client obtains several frames of positioning data of at least one VR device of the first user.
  • the positioning data includes three-dimensional data, such as 6-degree-of-freedom pose data, that is, the freedom of movement along the directions of the three rectangular coordinate axes of x, y, and z and the freedom of rotation around these three coordinate axes. It is understandable that the positioning data may also only include part of the above 6-degree-of-freedom pose data.
  • the first user is configured with a multipoint VR device.
  • the first user's head is equipped with a VR all-in-one machine
  • the two hands are respectively equipped with a VR handle
  • the VR client is arranged in the VR all-in-one machine.
  • the first VR client can transmit several frames of positioning data of each of the three VR devices to the system at a preset synchronization frequency.
  • the synchronization frequency is set to 1 second
  • the VR data refresh rate is 60 frames. Every second, the first VR client synchronizes to the system every 1 second, that is, transmits to the system 60 frames of positioning data of each of the three VR devices within 1 second.
  • the synchronization frequency and the VR data refresh rate can be set according to actual needs.
  • the first user can also only be configured with a single VR device, and the first VR client will set the synchronization frequency at a preset synchronization frequency.
  • Several frames of positioning data of the VR device are transmitted to the system; or, in some embodiments, the first user may be configured with multiple VR devices, and the first VR client may configure the multiple VR devices according to preset synchronization rules.
  • Several frames of positioning data are not completely transmitted to the system at the same time.
  • the first VR client transmits positioning data to the system, either by transmitting the positioning data to the server, or by transmitting the positioning data to another target VR client (for example, the second VR client) End), or both to the server and to another target VR client.
  • another target VR client for example, the second VR client
  • the several frames of positioning data transmitted by the first VR client to the system may be consecutive frames of positioning data, or may also be several discontinuous frames of positioning data after frame sampling.
  • the first VR client performs compression processing on several frames of positioning data of at least one VR device.
  • the first VR client may perform lossy compression processing on the several frames of positioning data; alternatively, it may also perform lossless compression processing on the several frames of positioning data.
  • the first VR client may obtain partial data in several frames of positioning data after compression processing.
  • the number of frames of data obtained after compressing N frames of positioning data is less than N; or After a VR client performs compression processing, it can also obtain all data in several frames of positioning data, that is, the number of frames of data obtained after compressing N frames of positioning data is still equal to N.
  • the first VR client in the case of obtaining several frames of positioning data for each of multiple VR devices, can first perform a separate operation on several frames of positioning data for each VR device. Combine after compression processing; it is understandable that the compression processing for several frames of positioning data of each VR device can be the same processing or different processing.
  • the first VR client may first combine several frames of positioning data of each VR device before performing compression processing.
  • the first VR client transmits the compressed positioning data to the external device.
  • the external device may be a server device and/or a user terminal on which a second VR client is deployed.
  • the compressed positioning data transmitted by the first VR client to the external device may be the positioning data itself obtained after the compression processing, or it may be obtained after predetermined post-processing of the positioning data obtained after the compression processing. Positioning data.
  • the second VR client obtains decompressed data obtained based on the compressed positioning data.
  • the second VR client may receive the compressed positioning data from an external device (for example, the first VR client or server device), and decompress the received data corresponding to the compression processing. Obtain decompressed data after processing;
  • the second VR client directly receives data that has been decompressed from an external device (for example, a server).
  • an external device for example, a server
  • the second VR client may also receive compressed data from an external device after performing intermediate processing on the compressed positioning data sent by the first VR client, and then Decompress the received compressed data to obtain decompressed data.
  • the second VR client synchronizes the avatar of the first user in the constructed multi-user shared VR environment according to the obtained decompressed data.
  • the second VR client After obtaining the multi-frame positioning data of the VR device of the first user, the second VR client refreshes the pose and movement track of the avatar of the first user in the constructed multi-user shared VR environment.
  • the amount of transmitted data can be reduced, the occupation of network resources can be reduced, and the impact on the VR system can be reduced when the network performance is poor, and the user experience can be avoided .
  • the first VR client may first obtain all 60 frames of positioning data of the VR device and then perform compression processing, or it may obtain 60 frames of positioning data of the VR device multiple times, and obtain the data first after each acquisition. The data is compressed.
  • the first VR client is used to share the positioning data of the first user with the system, so that the second VR client can be used in the constructed multiple
  • the synchronization of the avatar of the first user is described as an example.
  • the first VR client processes N frames of positioning data of a VR device of the first user as an example for description.
  • the first VR client performs the following processing:
  • each frame of data is separated by a predetermined interval character (for example, a comma).
  • a predetermined interval character for example, a comma.
  • the above-mentioned adding a null value to the data to be synchronized S can be directly adding an interval at the end of the data to be synchronized S In this way, two consecutive interval symbols indicate that the data between the two is null. In this embodiment, it indicates that the positioning data of the i-th frame is exactly the same as the positioning data of the i-1th frame.
  • Processing the difference data Ei as data with n digits after the decimal point can be, for example, directly intercepting the data n+1 digits before the decimal point from the difference data Ei.
  • processing the difference data Ei as data with n digits after the decimal point may be rounding the n+1 digits after the decimal point of the difference data Ei, and then intercepting n+1 after the decimal point.
  • the data before the bit It can be understood that the present disclosure is not limited to this.
  • n is equal to 3, that is, data with 3 digits after the decimal point is retained, which usually can guarantee a sufficiently high data accuracy.
  • Processing the difference data Ei as data that does not include a decimal point can be obtained by, for example, multiplying the difference data Ei by 10 to the power of n. It can be understood that the present disclosure is not limited to this.
  • Processing the difference data Ei as data that does not include a positive/negative sign can be obtained by replacing the positive/negative signs of the difference data Ei with different identifiers, for example, the positive sign can be replaced by 1 and the negative sign can be replaced by 0. It can be understood that the present disclosure is not limited to this.
  • the second VR client decompresses the data S according to the decompression method corresponding to the compression method used by the first VR client to obtain decompressed data, and According to the obtained decompressed data, the avatar of the first user is synchronized in the constructed multi-user shared VR environment.
  • the difference data is used to replace the complete data of each frame.
  • the VR data refresh rate is usually set higher (the industry generally believes that the data refresh rate is not less than 60 frames per second to ensure a better display Effect), therefore, the difference between adjacent frames is small, that is, the difference data corresponding to each frame is relatively small, and the amount of data can be significantly reduced; and in this embodiment, the difference data is deduplicated (S35 ), n-digit processing after the decimal point (S36), de-decimal point processing (S37), and de-sign processing (S38). The difference data is further compressed, which can further reduce the amount of data. After testing, the amount of data obtained after compression using the scheme of this embodiment is at least less than one-third of the original data amount, and there is basically no loss of accuracy.
  • the symbols in the methods of the above embodiments do not constitute a restriction on the order.
  • the de-duplication processing, the processing of retaining the n digits after the decimal point, the processing of decimal points, and the processing of symbols can be used as needed in different embodiments. Choose or combine, or execute in a different order.
  • the first frame positioning data is used as the reference frame. It can be understood that in other embodiments, the reference frame may also be the last frame or other frames between the first frame and the last frame.
  • the difference data of each frame data may be obtained in other ways.
  • the difference data may be the difference data between the complete data of the corresponding frame and the reference frame, or, It is the difference data with other adjacent frames that are relatively close (for example, adjacent frames with an interval of 2, 3 frames).
  • Fig. 5 is a schematic structural diagram of an electronic device 500 according to an exemplary embodiment of the present disclosure.
  • the electronic device 500 includes a memory 510 and a processor 520.
  • the processor 520 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs), application specific integrated circuits (ASICs), on-site Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the memory 510 may include various types of storage units, such as a system memory, a read only memory (ROM), and a permanent storage device.
  • the ROM may store static data or instructions required by the processor 520 or other modules of the computer.
  • the permanent storage device may be a readable and writable storage device.
  • the permanent storage device may be a non-volatile storage device that does not lose stored instructions and data even after the computer is powered off.
  • the permanent storage device adopts a large-capacity storage device (such as a magnetic or optical disk, flash memory) as the permanent storage device.
  • the permanent storage device may be a removable storage device (for example, a floppy disk, an optical drive).
  • the system memory can be a readable and writable storage device or a volatile readable and writable storage device, such as dynamic random access memory.
  • the system memory can store some or all of the instructions and data needed by the processor at runtime.
  • the memory 510 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and magnetic disks and/or optical disks may also be used.
  • the memory 510 may include a removable storage device that can be read and/or written, such as a compact disc (CD), a read-only digital versatile disc (for example, DVD-ROM, dual-layer DVD-ROM), Read-only Blu-ray discs, ultra-density discs, flash memory cards (such as SD cards, min SD cards, Micro-SD cards, etc.), magnetic floppy disks, etc.
  • a removable storage device that can be read and/or written, such as a compact disc (CD), a read-only digital versatile disc (for example, DVD-ROM, dual-layer DVD-ROM), Read-only Blu-ray discs, ultra-density discs, flash memory cards (such as SD cards, min SD cards, Micro-SD cards, etc.), magnetic floppy disks, etc.
  • the computer-readable storage medium does not include carrier waves and instantaneous electronic signals transmitted wirelessly or wiredly.
  • the memory 510 stores executable code, and when the executable code is processed by the processor 520, the processor 520 can execute part or all of the above-mentioned methods.
  • the method according to the present disclosure can also be implemented as a computer program or computer program product, and the computer program or computer program product includes computer program code instructions for executing part or all of the steps in the above-mentioned method of the present disclosure.
  • the present disclosure can also be implemented as a non-transitory machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) on which executable code (or computer program, or computer instruction code) is stored ), when the executable code (or computer program, or computer instruction code) is executed by a processor of an electronic device (such as a computing device, a server, etc.), the processor is caused to execute each step of the above-mentioned method according to the present disclosure Part or all of.
  • a processor of an electronic device such as a computing device, a server, etc.
  • each block in the flowchart or block diagram may represent a module, program segment, or part of the code, and the module, program segment, or part of the code contains one or more functions for realizing the specified logical function.
  • Executable instructions may also occur in a different order than marked in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved.
  • each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本公开涉及虚拟现实VR设备的定位数据处理方法、电子设备及存储介质。所述方法包括:VR客户端获得至少一个虚拟现实设备的若干帧定位数据;所述VR客户端对所述若干帧定位数据进行压缩处理;所述VR客户端向外部设备传输经所述压缩处理后的所述若干帧定位数据中的至少部分。依据本公开的实施例,可以显著降低传输数据量。

Description

定位数据处理方法、电子设备及存储介质 技术领域
本公开涉及虚拟现实技术,尤其涉及虚拟现实设备的定位数据处理方法、电子设备及存储介质。
背景技术
虚拟现实技术(Virtual Reality,VR)是一种可以创建和体验虚拟世界的计算机仿真系统,它利用计算机生成一种模拟环境,使用户沉浸到该环境中。
随着虚拟现实技术的不断发展,在越来越多的应用中,多个用户通过网络共享一个虚拟现实环境。在有些应用中(例如游戏等),为给用户提供真实场景的浸入式体验,需要各个用户共享其实时定位数据。另一方面,虚拟现实应用中需要传输的数据量非常大。业界一直存在着如何保证数据及时传输和处理的需求,以满足用户对VR体验越来越高的要求。
技术问题
有鉴于此,本公开实施例提供一种虚拟现实VR设备的定位数据处理方案,可以显著降低传输数据量。
技术解决方案
本公开一方面提供一种虚拟现实VR设备的定位数据处理方法,包括:
VR客户端获得至少一个虚拟现实设备的若干帧定位数据;
所述VR客户端对所述若干帧定位数据进行压缩处理;
所述VR客户端向外部设备传输经所述压缩处理后的所述若干帧定位数据中的至少部分。
在一些实施例中,所述对所述若干帧定位数据进行压缩处理包括:
在所述若干帧定位数据中确定基准帧;
获得所述若干帧定位数据中的至少部分帧各自对应的差值数据。
在一些实施例中,所述传输经所述压缩处理后的所述若干帧定位数据中的至少部分包括:发送所述基准帧、及所述差值数据中的至少部分。
在一些实施例中,所述获得所述若干帧定位数据中的至少部分帧各自对应的差值数据包括:
获得所述若干帧定位数据中的至少部分帧各自与邻近帧之间的差值数据;或者,
获得所述若干帧定位数据中的至少部分帧各自与所述基准帧之间的差值数据。
在一些实施例中,所述基准帧为所述若干帧定位数据中的首帧、或末帧、或首帧与末帧之间的其他帧。
在一些实施例中,所述对所述若干帧定位数据进行压缩处理还包括:
对所述若干帧定位数据进行保留小数点处理,从而获得保留小数点后指定位数的定位数据;和/或,
对所述若干帧定位数据进行去小数点处理;和/或,
对所述若干帧定位数据进行去重处理;和/或,
对所述若干帧定位数据进行去符号处理。
在一些实施例中,对所述若干帧定位数据进行压缩处理包括:
对所述若干帧定位数据进行有损压缩处理;或者,
对所述若干帧定位数据进行无损压缩处理。
在一些实施例中,所述获得至少一个虚拟现实设备的若干帧定位数据包括:获得多个虚拟现实设备各自的若干帧定位数据;
对所述若干帧定位数据进行压缩处理包括:分别对所述多个虚拟现实设备各自的若干帧定位数据进行压缩处理。
在一些实施例中,所述若干帧定位数据为连续的若干帧定位数据,或者为不连续的若干帧定位数据。
在一些实施例中,还包括:另一VR客户端依据所述VR客户端向外部设备传输的数据,在构建的多用户共享VR环境中对相应用户的替身进行同步。
本公开另一方面提供一种电子设备,包括:
处理器;以及
存储器,其上存储有可执行代码,当所述可执行代码被所述处理器执行时,使所述处理器执行如上所述的方法。
在一些实施例中,所述电子设备为VR一体机或智能终端设备。
本公开再一方面提供一种非暂时性机器可读存储介质,其上存储有可执行代码,当所述可执行代码被电子设备的处理器执行时,使所述处理器执行如上所述的方法。
有益效果
本公开的一些实施例,通过对定位数据进行压缩处理后再进行传输,可以降低传输数据量,减少对网络资源的占用,并且,可以在网络性能不佳时降低对VR系统的影响,避免影响用户体验。
本公开的一些实施例,在首帧定位数据之后,用差值数据代替各帧的完整数据。由于在VR应用中,用户的运动速度和运动空间有限,并且,为了保证效果,VR数据刷新率通常设得较高,因此,相邻帧之间的差异较小,即每帧对应的差值数据比较小,可以显著降低数据量。
在另一些实施例中,通过对差值数据进行去重处理、保留小数点后n位处理、去小数点处理、去符号处理,对差值数据做了进一步压缩,可进一步降低数据量。经测试,采用本实施例方案进行压缩后获得的数据量至少少于原数据量的三分之一,且基本上没有精度丢失。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。
附图说明
通过结合附图对本公开示例性实施方式进行更详细的描述,本公开的上述以及其它目的、特征和优势将变得更加明显,其中,在本公开示例性实施方式中,相同的参考标号通常代表相同部件。
图1示出依据本公开实施例的虚拟现实系统的一种示例性架构;
图2是本公开的虚拟现实设备的定位数据处理方法一个实施例的流程示意图;
图3是本公开的虚拟现实设备的定位数据处理方法另一个实施例的流程图;
图4是本公开的压缩数据的数据结构示意图;
图5是根据本公开一个实施例的电子设备的结构示意图。
本发明的实施方式
下面将参照附图更详细地描述本公开的优选实施方式。虽然附图中显示了本公开的优选实施方式,然而应该理解,可以以各种形式实现本公开而不应被这里阐述的实施方式所限制。相反,提供这些实施方式是为了使本公开更加透彻和完整,并且能够将本公开的范围完整地传达给本领域的技术人员。
在本公开使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本公开。在本公开和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。
应当理解,尽管在本公开可能采用术语“第一”、“第二”、“第三”等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本公开范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本公开的描述中,“多个”的含义是两个或两个以上,除非另有明确具体的限定。
请参阅图1,图1示出依据本公开实施例的虚拟现实系统的一种示例性架构。在图1所示的VR系统中,包括服务端100和多个用户端系统200,用户端系统200包括VR客户端210和VR设备220。
服务端100和VR客户端210可以是以软件的形式应用于设备中。服务端100可以部署于一个独立的服务设备上,也可以部署在由多个独立的服务设备共同构成的集群服务设备上。VR客户端210部署于支持VR技术的用户终端上。VR客户端210可以为独立的软件,也可作为大型系统的子系统或组件。
服务端100可提供多用户共享VR环境平台,为各VR客户端210提供后台服务。VR客户端210可构建多用户共享VR环境,VR客户端210的用户在多用户共享VR环境中具有自己的用户替身,享受沉浸式的VR体 验。
服务端100和各用户端系统200的VR客户端210通过网络连接。网络可以是互联网、全球移动通讯系统(Global System of Mobile communication,GSM)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、4G、5G、蓝牙、Wi-Fi等有线或无线网络。可以理解的,各用户端系统200的VR客户端210也可点对点连接。
VR设备220例如包括可直接穿戴在用户身体上的可穿戴VR设备220(例如VR头盔、VR眼镜等头戴式设备,及VR手套、VR手柄、VR手环等)、可整合进用户的衣服、配件的具有用户空间定位、体感追踪功能的设备、VR一体机等设备中的一个或多个的组合。
支持VR技术的用户终端例如可以支持与VR设备220通信的智能终端设备(智能手机、平板电脑、笔记本电脑、台式电脑、车载终端等)、上述VR一体机等设备中的一个或多个的组合。
在图1所描述的系统中,VR客户端210可以从对应的VR设备实时获得定位数据,向系统不断同步VR设备的定位数据,使得服务端和其他VR客户端可以确定同一VR场景中的各用户在场景中的对应位置及运动轨迹。
下面结合图1,对本申请实施例提供的虚拟现实设备的定位数据处理方法的方案进行说明。其中,以第一用户的VR客户端(也称为第一VR客户端)向系统共享第一用户的定位数据,从而使得第二用户的VR客户端(也称为第二VR客户端)可以在所构建的多用户共享VR环境中对第一用户的替身进行同步为例进行说明。
图2是本公开的虚拟现实设备的定位数据处理方法一个实施例的流程示意图,本实施例的方法可以包括:
S21、第一VR客户端获得第一用户的至少一个VR设备的若干帧定位数据。
本公开的实施例中,定位数据包括三维数据,例如可以是6自由度位姿数据,即沿x、y、z三个直角坐标轴方向的移动自由度和绕这三个坐标轴的转动自由度,可以理解的,定位数据也可以只包括上述6自由度位姿数据中的部分。
在一个示例性实例中,第一用户配置有多点VR设备。例如,第一用户头部配置有VR一体机,两个手部分别配置有VR手柄,VR客户端配置在VR一体机中。第一VR客户端可以预设的同步频率将此三个VR设备各自的若干帧定位数据传输给系统,例如,在一个示例性实例中,设置同步频率为1秒,VR数据刷新率为60帧每秒,则第一VR客户端每隔1秒向系统进行一次同步,即向系统传输此三个VR设备各自在1秒内的60帧定位数据。可以理解的,在一些实施例中,同步频率和VR数据刷新率可按实际需求进行设置,另外,第一用户也可只配置有单个VR设备,第一VR客户端以预设的同步频率将该VR设备的若干帧定位数据传输给系统;或者,在一些实施例中,第一用户可配置有多个VR设备,第一VR客户端依据预设的同步规则,将多个VR设备各自的若干帧定位数据不完全同时地传输给系统。可以理解的,本公开中,第一VR客户端将定位数据传输给系统,可以是将定位数据传输给服务端,也可以是将定位数据传输给另外的目标VR客户端(例如第二VR客户端),或者既传输给服务端,也传输给另外的目标VR客户端。
另外,可以理解的,第一VR客户端传输给系统的若干帧定位数据可以是连续的若干帧定位数据,或者,也可以是抽帧后的不连续的若干帧定位 数据。
S22、第一VR客户端对至少一个VR设备的若干帧定位数据进行压缩处理。
本公开的实施例中,第一VR客户端可以是对该若干帧定位数据进行有损压缩处理;或者,也可以是对该若干帧定位数据进行无损压缩处理。
可以理解的,第一VR客户端进行压缩处理后得到的可以是若干帧定位数据中的部分数据,例如,对N帧定位数据进行压缩处理后所得到的数据的帧数小于N;或者,第一VR客户端进行压缩处理后得到的也可以是若干帧定位数据中的全部数据,即,对N帧定位数据进行压缩处理后所得到的数据的帧数仍等于N。
另外,可以理解的,在一种可能的实现方式中,在获得多个VR设备各自的若干帧定位数据的情况下,第一VR客户端可以先分别对每个VR设备的若干帧定位数据进行压缩处理后再进行组合;可以理解的,对各个VR设备的若干帧定位数据的压缩处理可以是采用相同的处理,也可以是采用不同的处理。
在另一种可能的实现方式中,在获得多个VR设备各自的若干帧定位数据的情况下,第一VR客户端可以先对各个VR设备的若干帧定位数据进行组合后再进行压缩处理。
S23、第一VR客户端向外部设备传输经压缩处理后的定位数据。
其中,外部设备可以是服务端设备和/或部署有第二VR客户端的用户终端。
可以理解的,第一VR客户端向外部设备传输的经压缩处理后的定位数据可以是压缩处理后获得的定位数据本身,也可以是对压缩处理后获得 的定位数据进行预定后处理后获得的定位数据。
S24、第二VR客户端获得基于所述压缩处理后的定位数据获得的解压缩数据。
其中,第二VR客户端可以是从外部设备(例如第一VR客户端或服务端设备)接收到所述压缩处理后的定位数据,并对所接收到的数据进行与压缩处理相应的解压缩处理后获得解压缩数据;
可以理解的,在另一种可能的实现方式中,第二VR客户端从外部设备(例如服务器)直接接收已经过解压缩处理的数据。
可以理解的,在另一种可能的实现方式中,第二VR客户端也可以是从外部设备接收对第一VR客户端发送的压缩处理后的定位数据进行了中间处理后的压缩数据,再对所接收到的压缩数据进行解压缩处理,从而获得解压缩数据。
S25、第二VR客户端依据所获得的解压缩数据,在构建的多用户共享VR环境中对第一用户的替身进行同步。
第二VR客户端获得第一用户的VR设备的多帧定位数据后,在所构建的多用户共享VR环境中对第一用户的替身的位姿和运动轨迹进行刷新。
本实施例中,通过对定位数据进行压缩处理后再进行传输,可以降低传输数据量,减少对网络资源的占用,并且,可以在网络性能不佳时降低对VR系统的影响,避免影响用户体验。
可以理解的,本公开实施例的标号并不构成对执行顺序的限定。例如,第一VR客户端可以是先获得VR设备的全部60帧定位数据后再执行压缩处理,也可以是分多次获得VR设备的60帧定位数据,并在每次获得数据后先对获得的数据进行压缩处理。
在本公开的虚拟现实设备的定位数据处理方法另一个实施例中,同样的,以第一VR客户端向系统共享第一用户的定位数据,从而使得第二VR客户端可以在所构建的多用户共享VR环境中对第一用户的替身进行同步为例进行说明。另外,为便于清楚说明和理解,本实施例中以第一VR客户端对第一用户的一个VR设备的N帧定位数据进行处理为例进行说明。
本实施例中,如图3所示,第一VR客户端进行如下处理:
S31、获得本次同步中VR设备的首帧定位数据,将该帧定位数据记录为待同步数据S,并记录帧数i=1。
S32、判断帧数i是否小于或等于N,若是,执行S33,若帧数i大于N,则执行S40。
S33、以i+1迭代i,获得VR设备的第i帧定位数据。
S34、获得第i帧定位数据相对于第i-1帧定位数据的差值数据Ei。
S35、判断差值数据Ei是否为零,若是,则在待同步数据S中增加一个空值,执行S32,否则,执行S36。
在一种实现方式中,各帧数据之间是以预定的间隔符(例如逗号)相隔离,上述在待同步数据S中增加一个空值数据可以是在待同步数据S的最后直接增加一个间隔符,这样,连续的两个间隔符即表示两者之间的数据为空值,在本实施例中,则表示第i帧定位数据与第i-1帧定位数据完全相同。
S36、将差值数据Ei处理为保留小数点后n位的数据,以处理后的数据迭代Ei。
将差值数据Ei处理为保留小数点后n位的数据例如可以是从差值数据Ei中直接截取小数点后n+1位之前的数据。在另一种可能的实现方式中, 将差值数据Ei处理为保留小数点后n位的数据可以是对差值数据Ei的小数点后第n+1位进行四舍五入处理,再截取小数点后n+1位之前的数据。可以理解的,本公开不限于此。
在一个示例中,n等于3,即保留小数点后3位的数据,这通常已能保证足够高的数据精度。
S37、将差值数据Ei处理为不包括小数点的数据,以处理后的数据迭代Ei。
将差值数据Ei处理为不包括小数点的数据例如可以是通过将差值数据Ei乘以10的n次方获得。可以理解的,本公开不限于此。
S38、将差值数据Ei处理为不包括正/负号的数据,以处理后的数据迭代Ei。
将差值数据Ei处理为不包括正/负号的数据例如可以是通过用不同标识分别代替差值数据Ei的正/负号获得,例如,可以以1代替正号,以0代替负号。可以理解的,本公开不限于此。
S39、以当前待同步数据与差值数据Ei,迭代待同步数据S,返回执行S32。
S40、向外部设备传输待同步数据S,完成第一VR客户端的本次同步。
帧数i大于N时,表示已完成对本次需同步的全部N帧定位数据的压缩,此时,如图4所示,待同步数据S中记录的是第一帧定位数据、以及后面每帧定数据相对于前一帧数据的差值数据的压缩后数据。
本实施例中,第二VR客户端收到待同步数据S后,按照与第一VR客户端所用的压缩方法对应的解压缩方法,对数据S进行解压缩处理,可获得解压缩数据,并依据所获得的解压缩数据,在构建的多用户共享VR 环境中对第一用户的替身进行同步。
本实施例中,在首帧定位数据之后,用差值数据代替各帧的完整数据。由于在VR应用中,用户的运动速度和运动空间有限,并且,为了保证效果,VR数据刷新率通常设得较高(业界通常认为数据刷新率不低于60帧每秒才能保证较好的显示效果),因此,相邻帧之间的差异较小,即每帧对应的差值数据比较小,可以显著降低数据量;并且,本实施例中,通过对差值数据进行去重处理(S35)、保留小数点后n位处理(S36)、去小数点处理(S37)、去符号处理(S38),对差值数据做了进一步压缩,可进一步降低数据量。经测试,采用本实施例方案进行压缩后获得的数据量至少少于原数据量的三分之一,且基本上没有精度丢失。
可以理解的,在本公开另一实现方式中,在S40中,也可采用其他方法对待同步数据S进行进一步压缩后再向外部传输,例如可以从数据S中抽掉部分帧的数据,即仅向外部设备传输待同步数据S中部分帧的数据。这尤其适用于网络状态不佳或目标VR客户端对应的用户终端性能较差的情况。
可以理解的,上述实施例方法中的符号并不构成对顺序的限定,例如,其中的去重处理、保留小数点后n位处理、去小数点处理、去符号处理,在不同实施例中可按需要选择或组合,或者以不同的顺序执行。
在上述实施例中,以首帧定位数据做为基准帧,可以理解的,在另一些实施例中,基准帧还可以是末帧、或首帧与末帧之间的其他帧。
可以理解的,在另一些实施例中,可以采用其他方式获得各帧数据的差值数据,例如,差值数据可以是相应帧的完整数据与基准帧之间的差值数据,或者,也可以是与其他相距较近的邻近帧(例如间隔2、3帧的邻近 帧)之间的差值数据。
图5是根据本公开一示例性实施例示出的一种电子设备500的结构示意图。
参见图5,电子设备500包括存储器510和处理器520。
处理器520可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
存储器510可以包括各种类型的存储单元,例如系统内存、只读存储器(ROM),和永久存储装置。其中,ROM可以存储处理器520或者计算机的其他模块需要的静态数据或者指令。永久存储装置可以是可读写的存储装置。永久存储装置可以是即使计算机断电后也不会失去存储的指令和数据的非易失性存储设备。在一些实施方式中,永久性存储装置采用大容量存储装置(例如磁或光盘、闪存)作为永久存储装置。另外一些实施方式中,永久性存储装置可以是可移除的存储设备(例如软盘、光驱)。系统内存可以是可读写存储设备或者易失性可读写存储设备,例如动态随机访问内存。系统内存可以存储一些或者所有处理器在运行时需要的指令和数据。此外,存储器510可以包括任意计算机可读存储媒介的组合,包括各种类型的半导体存储芯片(DRAM,SRAM,SDRAM,闪存,可编程只读存储器),磁盘和/或光盘也可以采用。在一些实施方式中,存储器510可以包括可读和/或写的可移除的存储设备,例如激光唱片(CD)、只读数字 多功能光盘(例如DVD-ROM,双层DVD-ROM)、只读蓝光光盘、超密度光盘、闪存卡(例如SD卡、min SD卡、Micro-SD卡等等)、磁性软盘等等。计算机可读存储媒介不包含载波和通过无线或有线传输的瞬间电子信号。
存储器510上存储有可执行代码,当可执行代码被处理器520处理时,可以使处理器520执行上文述及的方法中的部分或全部。
上文中已经参考附图详细描述了本公开的方案。在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详细描述的部分,可以参见其他实施例的相关描述。本领域技术人员也应该知悉,说明书中所涉及的动作和模块并不一定是本公开所必须的。另外,可以理解,本公开实施例方法中的步骤可以根据实际需要进行顺序调整、合并和删减,本公开实施例装置中的模块可以根据实际需要进行合并、划分和删减。
此外,根据本公开的方法还可以实现为一种计算机程序或计算机程序产品,该计算机程序或计算机程序产品包括用于执行本公开的上述方法中部分或全部步骤的计算机程序代码指令。
或者,本公开还可以实施为一种非暂时性机器可读存储介质(或计算机可读存储介质、或机器可读存储介质),其上存储有可执行代码(或计算机程序、或计算机指令代码),当所述可执行代码(或计算机程序、或计算机指令代码)被电子设备(如计算设备、服务器等)的处理器执行时,使所述处理器执行根据本公开的上述方法的各个步骤的部分或全部。
本领域技术人员还将明白的是,结合这里的公开所描述的各种示例性逻辑块、模块、电路和算法步骤可以被实现为电子硬件、计算机软件或两者的组合。
附图中的流程图和框图显示了根据本公开的多个实施例的系统和方法的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标记的功能也可以以不同于附图中所标记的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。
以上已经描述了本公开的各实施例,上述说明是示例性的,并非穷尽性的,并且也不限于所披露的各实施例。在不偏离所说明的各实施例的范围和精神的情况下,对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择,旨在最好地解释各实施例的原理、实际应用或对市场中的技术的改进,或者使本技术领域的其它普通技术人员能理解本文披露的各实施例。

Claims (15)

  1. 一种虚拟现实VR设备的定位数据处理方法,其特征在于,包括:
    VR客户端获得至少一个虚拟现实设备的若干帧定位数据;
    所述VR客户端对所述若干帧定位数据进行压缩处理;
    所述VR客户端向外部设备传输经所述压缩处理后的所述若干帧定位数据中的至少部分。
  2. 如权利要求1所述的方法,其特征在于,所述对所述若干帧定位数据进行压缩处理包括:
    在所述若干帧定位数据中确定基准帧;
    获得所述若干帧定位数据中的至少部分帧各自对应的差值数据。
  3. 如权利要求1所述的方法,其特征在于,所述传输经所述压缩处理后的所述若干帧定位数据中的至少部分包括:发送所述基准帧、及所述差值数据中的至少部分。
  4. 如权利要求2所述的方法,其特征在于,所述获得所述若干帧定位数据中的至少部分帧各自对应的差值数据包括:
    获得所述若干帧定位数据中的至少部分帧各自与邻近帧之间的差值数据;或者,
    获得所述若干帧定位数据中的至少部分帧各自与所述基准帧之间的差值数据。
  5. 如权利要求2所述的方法,其特征在于,所述基准帧为所述若干帧定位数据中的首帧、或末帧、或首帧与末帧之间的其他帧。
  6. 如权利要求2所述的方法,其特征在于,所述对所述若干帧定位数据进行压缩处理还包括:
    对所述若干帧定位数据进行保留小数点处理,从而获得保留小数点后指定位数的定位数据;和/或,
    对所述若干帧定位数据进行去小数点处理;和/或,
    对所述若干帧定位数据进行去重处理;和/或,
    对所述若干帧定位数据进行去符号处理。
  7. 如权利要求1所述的方法,其特征在于,对所述若干帧定位数据进行压缩处理包括:
    对所述若干帧定位数据进行有损压缩处理。
  8. 如权利要求1所述的方法,其特征在于,对所述若干帧定位数据进行压缩处理包括:
    对所述若干帧定位数据进行无损压缩处理。
  9. 如权利要求1至8任一项所述的方法,其特征在于,
    所述获得至少一个虚拟现实设备的若干帧定位数据包括:获得多个虚拟现实设备各自的若干帧定位数据;
    对所述若干帧定位数据进行压缩处理包括:分别对所述多个虚拟现实设备各自的若干帧定位数据进行压缩处理。
  10. 如权利要求1至8任一项所述的方法,其特征在于,所述若干帧定位数据为连续的若干帧定位数据。
  11. 如权利要求1至8任一项所述的方法,其特征在于,所述若干帧定位数据为不连续的若干帧定位数据。
  12. 如权利要求1至8任一项所述的方法,其特征在于,还包括:
    另一VR客户端依据所述VR客户端向外部设备传输的数据,在构建的多用户共享VR环境中对相应用户的替身进行同步。
  13. 一种电子设备,其特征在于,包括:
    处理器;以及
    存储器,其上存储有可执行代码,当所述可执行代码被所述处理器执行时,使所述处理器执行如权利要求1至11中任一项所述的方法。
  14. 如权利要求13所述的电子设备,其特征在于,所述电子设备为VR一体机或智能终端设备。
  15. 一种非暂时性机器可读存储介质,其上存储有可执行代码,当所述可执行代码被电子设备的处理器执行时,使所述处理器执行如权利要求1-11中任一项所述的方法。
PCT/CN2020/086061 2020-04-22 2020-04-22 定位数据处理方法、电子设备及存储介质 WO2021212356A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080000608.8A CN111630829A (zh) 2020-04-22 2020-04-22 定位数据处理方法、电子设备及存储介质
PCT/CN2020/086061 WO2021212356A1 (zh) 2020-04-22 2020-04-22 定位数据处理方法、电子设备及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/086061 WO2021212356A1 (zh) 2020-04-22 2020-04-22 定位数据处理方法、电子设备及存储介质

Publications (1)

Publication Number Publication Date
WO2021212356A1 true WO2021212356A1 (zh) 2021-10-28

Family

ID=72261115

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/086061 WO2021212356A1 (zh) 2020-04-22 2020-04-22 定位数据处理方法、电子设备及存储介质

Country Status (2)

Country Link
CN (1) CN111630829A (zh)
WO (1) WO2021212356A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106993181A (zh) * 2016-11-02 2017-07-28 大辅科技(北京)有限公司 多vr/ar设备协同系统及协同方法
CN109766006A (zh) * 2019-01-02 2019-05-17 京东方科技集团股份有限公司 虚拟现实场景的显示方法、装置及设备
CN110830521A (zh) * 2020-01-13 2020-02-21 南昌市小核桃科技有限公司 Vr多人同屏数据同步处理方法及装置
US20200098187A1 (en) * 2018-09-21 2020-03-26 New York University Shared Room Scale Virtual and Mixed Reality Storytelling for a Multi-Person Audience That May be Physically Co-Located

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105744281A (zh) * 2016-03-28 2016-07-06 飞依诺科技(苏州)有限公司 一种连续图像的处理方法及装置
CN107241563B (zh) * 2017-06-16 2020-01-07 深圳市玩视科技有限公司 视频传输的方法、智能移动终端及具有存储功能的装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106993181A (zh) * 2016-11-02 2017-07-28 大辅科技(北京)有限公司 多vr/ar设备协同系统及协同方法
US20200098187A1 (en) * 2018-09-21 2020-03-26 New York University Shared Room Scale Virtual and Mixed Reality Storytelling for a Multi-Person Audience That May be Physically Co-Located
CN109766006A (zh) * 2019-01-02 2019-05-17 京东方科技集团股份有限公司 虚拟现实场景的显示方法、装置及设备
CN110830521A (zh) * 2020-01-13 2020-02-21 南昌市小核桃科技有限公司 Vr多人同屏数据同步处理方法及装置

Also Published As

Publication number Publication date
CN111630829A (zh) 2020-09-04

Similar Documents

Publication Publication Date Title
TWI746878B (zh) 高頻寬記憶體系統以及邏輯裸片
US9480914B2 (en) Online gaming
TWI535277B (zh) 用於深度緩衝之方法、設備及系統
US20170192734A1 (en) Multi-interface unified displaying system and method based on virtual reality
WO2021159864A1 (zh) 一种传输视频音频数据的方法、云端服务器和系统
WO2021008627A1 (zh) 游戏角色渲染方法、装置、电子设备及计算机可读介质
US10554713B2 (en) Low latency application streaming using temporal frame transformation
CN112235604B (zh) 渲染方法及装置、计算机可读存储介质、电子设备
US9852107B2 (en) Techniques for scalable endpoint addressing for parallel applications
WO2021189670A1 (zh) 数据同步方法、数据同步系统及其装置、介质和系统
US9558718B2 (en) Streaming video data in the graphics domain
CN104012059A (zh) 协处理器之间的直接链路同步通信
US20140333662A1 (en) Multi-sampling anti-aliasing compression by use of unreachable bit combinations
KR20170047326A (ko) 폰패드
US11023825B2 (en) Platform as a service cloud server and machine learning data processing method thereof
US10171543B2 (en) Media streaming method and electronic device thereof
CN115359220A (zh) 虚拟世界的虚拟形象更新方法及装置
TW201902218A (zh) 經由多視圖壓縮/解壓縮減少記憶體頻寬的系統與方法
WO2021212356A1 (zh) 定位数据处理方法、电子设备及存储介质
US10044626B2 (en) Reliable out-of order end-to-end protocol with robust window state overflow management and a multi-node system using same
WO2021253346A1 (zh) 数据传输计算方法,装置及存储介质
CN112764877A (zh) 一种用于硬件加速设备与docker内进程通信的方法与系统
TWI295019B (en) Data transfer system and method
WO2020029181A1 (zh) 三维卷积神经网络计算装置及相关产品
WO2021237704A1 (zh) 数据同步方法及相关装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20932143

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20932143

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03.07.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20932143

Country of ref document: EP

Kind code of ref document: A1