WO2017129119A1 - 一种图像绘制的方法、用户设备、服务器及系统 - Google Patents

一种图像绘制的方法、用户设备、服务器及系统 Download PDF

Info

Publication number
WO2017129119A1
WO2017129119A1 PCT/CN2017/072539 CN2017072539W WO2017129119A1 WO 2017129119 A1 WO2017129119 A1 WO 2017129119A1 CN 2017072539 W CN2017072539 W CN 2017072539W WO 2017129119 A1 WO2017129119 A1 WO 2017129119A1
Authority
WO
WIPO (PCT)
Prior art keywords
instruction
image
resource
user equipment
server
Prior art date
Application number
PCT/CN2017/072539
Other languages
English (en)
French (fr)
Inventor
沈超
程东哲
韩祥
聂志明
李从兵
艾风
顾煜
王杨军
曹文升
叶劲峰
王伟光
陈国乐
周贺楠
庄志伟
杜幸阁
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技(深圳)有限公司 filed Critical 腾讯科技(深圳)有限公司
Publication of WO2017129119A1 publication Critical patent/WO2017129119A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication

Definitions

  • the present application relates to the field of cloud technologies, and in particular, to a method for image drawing, a user equipment, a server, and a system.
  • cloud delivery systems typically include a server and multiple user devices, the server can be a cluster server, and a variety of interactive applications can run in a cloud interaction system.
  • the server is usually responsible for image drawing. After the drawing is completed, the drawn image frame is sent to the user equipment, and the user equipment receives the drawn image frame. , directly decode the image frame, and then display the image frame.
  • Image rendering by the server has higher hardware requirements for the server, and with the improvement of the technology level, the user equipment usually has a better configuration, which undoubtedly increases the requirements of the server, and at the same time wastes the hardware resources of the user equipment. .
  • the embodiment of the present application provides a method for image rendering, which can be imaged by a user equipment, which not only reduces the hardware requirements of the server, but also improves the resource utilization efficiency of the user equipment.
  • the embodiments of the present application also provide corresponding user equipment, servers, and systems.
  • the first aspect of the present application provides a method for image rendering, the method is applied to a cloud interaction system, where the cloud interaction system includes a user equipment and a server, and the method includes:
  • the user equipment receives a drawing instruction and a drawing resource of an image frame sent by the server, where the drawing instruction is a drawing instruction that affects image drawing, and the drawing resource is the drawing image that affects the image Drawing resource corresponding to the drawing instruction;
  • the user equipment determines that the drawing resource includes a drawing resource required to execute the drawing instruction, executing each drawing instruction;
  • the user equipment performs image rendering by using the drawing resource required by each drawing instruction, and after performing all drawing instructions of the image frame, obtaining a drawing picture of the image frame.
  • the second aspect of the present application provides a method for image rendering, the method is applied to a cloud interaction system, where the cloud interaction system includes a user equipment and a server, and the method includes:
  • the server acquires all drawing instructions and drawing resources of the image frame
  • the server performs an instruction filtering on each drawing instruction to determine a drawing instruction that affects image drawing
  • the server sends, to the user equipment, the drawing instruction that affects image drawing and the drawing resource corresponding to the drawing instruction that affects image drawing, wherein the drawing resource corresponding to the drawing instruction that affects image drawing is And executing, by the user equipment, the drawing instruction that affects image drawing, and drawing a drawing picture of the image frame.
  • the third aspect of the present application provides a user equipment, where the user equipment is applied to a cloud interaction system, and the cloud interaction system further includes a server, where the user equipment includes:
  • a receiving unit configured to receive a drawing instruction and a drawing resource of an image frame sent by the server, where the drawing instruction is a drawing instruction that affects image drawing, and the drawing resource is corresponding to the drawing instruction that affects image drawing Drawing resources;
  • a processing unit configured to determine, when the drawing resource received by the receiving unit includes a drawing resource required to execute the drawing instruction, execute each drawing instruction;
  • a drawing unit configured to perform image drawing by using a drawing resource required by each drawing instruction executed by the processing unit, and after performing all drawing instructions of the image frame, obtain a drawing picture of the image frame.
  • a fourth aspect of the present application provides a server, where the server is applied to a cloud interaction system, where the cloud interaction system further includes a user equipment, where the server includes:
  • An obtaining unit configured to acquire all drawing instructions and drawing resources of the image frame
  • a determining unit configured to perform an instruction filtering on each drawing instruction acquired by the acquiring unit, and determine a drawing instruction that affects image drawing;
  • a sending unit configured to send, to the user equipment, the drawing instruction that is determined by the determining unit and affects image drawing, and the drawing resource corresponding to the drawing instruction that affects image drawing, where the image is affected
  • the drawing resource corresponding to the drawing instruction is used by the user equipment to execute the drawing instruction that affects image drawing, and draw a drawing picture of the image frame.
  • a fifth aspect of the present application provides a user equipment, where the user equipment is applied to a cloud interaction system, where the cloud interaction system further includes a server, where the user equipment includes:
  • the user equipment includes: a transceiver, a central processing unit, a graphics processor, and a memory, wherein the memory is configured to store a program that the central processing unit performs a control input method display;
  • the transceiver is configured to receive a drawing instruction and a drawing resource of an image frame sent by the server, where the drawing instruction is a drawing instruction that affects image drawing, and the drawing resource is corresponding to the drawing instruction that affects image drawing Drawing resources;
  • the central processor is configured to execute each drawing instruction when the drawing resource includes a drawing resource required to execute the drawing instruction;
  • the graphics processor is configured to perform image rendering by using the drawing resources required by each of the drawing instructions, and after performing all drawing instructions of the image frame, obtain a drawing picture of the image frame.
  • a sixth aspect of the present application provides a server, where the server is applied to a cloud interaction system, where the cloud interaction system further includes a user equipment, where the server includes: a transceiver, a processor, and a memory, where the memory is used to store the The processor executes a program that controls the display of the input method;
  • the processor is configured to acquire all drawing instructions and drawing resources of the image frame; perform instruction filtering on each drawing instruction to determine a drawing instruction that affects image drawing;
  • the transceiver is configured to send, to the user equipment, a drawing instruction that affects image drawing and a drawing resource corresponding to the drawing instruction that affects image drawing, where the drawing instruction that affects image drawing corresponds to
  • the drawing resource is used by the user equipment to execute the drawing instruction that affects image drawing, and the drawing picture of the image frame is drawn.
  • a seventh aspect of the present application provides a cloud interaction system, including a user equipment and a server.
  • the server is used to:
  • the user equipment is used to:
  • FIG. 1 is a schematic diagram of an embodiment of a cloud interactive system in an embodiment of the present application
  • FIG. 2 is a schematic diagram of an embodiment of a method for image drawing in an embodiment of the present application
  • FIG. 3 is a schematic diagram of another embodiment of a method for image drawing in an embodiment of the present application.
  • FIG. 4 is a schematic diagram of an embodiment of a user equipment in an embodiment of the present application.
  • FIG. 5 is a schematic diagram of another embodiment of a user equipment in an embodiment of the present application.
  • FIG. 6 is a schematic diagram of an embodiment of a server in an embodiment of the present application.
  • FIG. 7 is a schematic diagram of another embodiment of a server in an embodiment of the present application.
  • FIG. 8 is a schematic diagram of another embodiment of a server in an embodiment of the present application.
  • FIG. 9 is a schematic diagram of another embodiment of a user equipment in an embodiment of the present application.
  • FIG. 10 is a schematic diagram of another embodiment of a server in an embodiment of the present application.
  • the embodiment of the present application provides a method for image rendering, which can be imaged by a user equipment, which not only reduces the hardware requirements of the server, but also improves the resource utilization efficiency of the user equipment.
  • the embodiments of the present application also provide corresponding user equipment, servers, and systems. The details are described below separately.
  • FIG. 1 is a schematic diagram of an embodiment of a cloud interactive system according to an embodiment of the present application.
  • a cloud interactive system can be understood as a cloud game system, which generally includes a server and a user device. There may be multiple user devices, a server or a server cluster, and various interactive applications can be run in the cloud interaction system.
  • the user equipment can be a terminal device such as a personal computer (PC), a notebook, and a mobile phone.
  • the server can be a dedicated game server. Currently, the game screen is drawn by the server, and then transmitted to the user equipment one frame at a time, and displayed on the user equipment. However, in the embodiment of the present application, the server transmits the drawing instruction and the drawing resource of each frame to the user equipment, and the image is drawn by the user equipment. Each frame image becomes an image frame in the embodiment of the present application. This not only reduces the hardware requirements for the server, but also improves the resource utilization efficiency of the user equipment.
  • an embodiment of a method for image rendering provided by an embodiment of the present application includes:
  • the server acquires all drawing instructions and drawing resources of the image frame.
  • the server performs an instruction filtering on each drawing instruction to determine a drawing instruction that affects image drawing.
  • drawing instructions of an image frame some drawing instructions affect the drawing state and the drawing result, that is, it affects the drawing process, but some drawing instructions do not affect the drawing state and the drawing result, so that these drawing instructions do not affect the drawing process. It does not need to be sent to the user device, so you can filter out these drawing instructions that do not affect the drawing process.
  • the process of instruction filtering is to identify whether this drawing command will affect the drawing state and the final drawing result. For example, the function of obtaining the relevant state in D3D does not affect the drawing process, so the drawing instructions of these functions do not need to be transmitted to the user equipment.
  • the operation of this step is instruction filtering.
  • the server sends, to the user equipment, the drawing instruction that affects image drawing and the The drawing resource corresponding to the drawing instruction that affects the image drawing.
  • the drawing instruction that affects the image drawing is the drawing instruction remaining after filtering that affects the drawing state and the final drawing result.
  • the user equipment receives a drawing instruction that affects image drawing of the image frame sent by the server, and a drawing resource corresponding to the drawing instruction that affects image drawing, and determines that the drawing resource includes executing the drawing instruction.
  • Each drawing instruction is executed when the required resources are drawn.
  • the drawing instruction and the drawing resource may not arrive synchronously, so it is necessary to determine whether the drawing resource of the drawing instruction already exists before performing drawing, and if it already exists, the drawing instruction may be executed, and if it does not exist, the instruction execution may fail.
  • Each drawing instruction here refers to each drawing instruction in a drawing instruction that affects image drawing.
  • the image drawing method provided by the embodiment of the present application can perform image rendering by the user equipment, which reduces the hardware requirements of the server. At the same time, the resource utilization efficiency of the user equipment is improved.
  • FIG. 3 another embodiment of the method for image rendering provided by the embodiment of the present application includes:
  • the server acquires all drawing instructions of the image frame.
  • the server performs an instruction filtering on all the drawing instructions of the image frame, and determines whether each drawing instruction has an influence on the drawing. If there is any impact, step 203 is performed.
  • the server divides each drawing instruction into different instruction cache spaces according to the type of each drawing instruction in the drawing instruction that affects the image drawing, and divides the drawing resource corresponding to each drawing instruction into a resource cache. Area.
  • the types of drawing instructions can be different cache types, index types, and stream formats.
  • the drawing instruction in the embodiment of the present application may include two parts of the instruction identifier and the instruction data shown in FIG. 3, and the drawing resource is the drawing data in FIG.
  • All instruction flags are placed in a cache space to ensure strong ordering of drawing instructions.
  • the instruction cache space is set in the server, and each cache space stores one type of instruction, and the drawing instruction is filled into the corresponding cache space according to the instruction type.
  • each instruction cache space and resource cache space created will be filled with different amounts of data, and the next step is to compress each cache space, that is, execute steps. 204 and 205.
  • Instruction data each type is divided into a buffer space buffer separately.
  • the advantage of this is that the data of similar meaning has regularity, and then compression using a compression algorithm can obtain a high compression ratio, so that the total amount of data to be transmitted in one frame can be reduced. .
  • the instruction is divided according to the type of the drawing instruction, and the purpose is to reduce the amount of data transmitted by the network during the subsequent instruction transmission. If you do not need to reduce the amount of data transmitted by the network, you can also make a direct transmission without any distinction.
  • the server performs command data compression.
  • the server performs resource data compression.
  • the server sends the compressed instruction data and resource data through two channels.
  • the instruction data shown in Figure 3 is the data to be transmitted to the user equipment at the same time as the instruction identifier. It needs to be transmitted in a channel with the instruction identifier.
  • the instruction data usually includes vertex data, which is used to construct a virtual scene, and the instruction data cannot be sent to the program. Will crash.
  • Drawing resources means that the resource data mainly refers to the texture, which is used to map the scene. If the resource data is not sent, it will affect the drawing effect, but it will not cause the program to crash, so it can be transmitted through another channel. Of course, the resource data can also pass multiple The channel can reach the user equipment asynchronously.
  • the instruction data and the resource data are respectively transmitted to the user equipment through two channels.
  • the purpose of this is to ensure the instruction data transmission of the drawing instruction channel is preferentially guaranteed in the case of insufficient network bandwidth or network flow control, and the resource data can be slowly transmitted. Also, this part of the data is generally a picture, and the amount of data is large. After the two channels are divided, the resource data can be processed separately, and the amount of data to be transmitted is reduced.
  • the server starts to send the drawing instruction that affects image rendering and the influence to the user equipment when the image frame transmission time slot arrives or arrives.
  • the drawing resource corresponding to the drawing instruction of the image drawing when the transmission time slot of the image frame ends, transmitting the drawing instruction corresponding to the drawing instruction that affects the image drawing and the drawing instruction corresponding to the drawing instruction that affects the image drawing;
  • the drawing instruction of the image frame that affects image rendering and the drawing instruction that affects image rendering correspond to When the amount of data drawn by the resource exceeds the preset threshold.
  • the user equipment receives the instruction data through a channel.
  • the drawing instruction After receiving the instruction data, the drawing instruction is allocated to the instruction buffer storage. In particular, when it is determined that the rendering resource required by the rendering instruction is not stored in the resource buffer, the drawing instruction is allocated to the instruction buffer storage.
  • the user equipment receives resource data through another channel.
  • the drawing resource is allocated to the resource buffer storage.
  • the user equipment performs image rendering by using a drawing resource required by each of the drawing instructions.
  • the user equipment obtains the D3D drawing function command by parsing the instruction data. Because the two-channel or multi-channel transmission mode is adopted, there is a case where the instruction arrives but the resources required for the instruction execution have not yet fully arrived. Therefore, here we need to determine whether the user equipment has completely received the resources required for the drawing command currently being parsed. If not, temporarily abandon the execution of this drawing command and continue to store in the instruction data buffer; if so, It means that this drawing command can be executed.
  • the user equipment After performing all drawing instructions of the image frame, the user equipment obtains a drawing picture of the image frame.
  • the user equipment 30 provided by the embodiment of the present application is applied to a cloud interaction system, where the cloud interaction system further includes a server, where the user equipment includes:
  • the receiving unit 301 is configured to receive a drawing instruction and a drawing resource of the image frame sent by the server, where the drawing instruction is a drawing instruction that affects image drawing, and the drawing resource is corresponding to the drawing instruction that affects image drawing Drawing resources;
  • the processing unit 302 is configured to: when it is determined that the drawing resource received by the receiving unit 301 includes a drawing resource required to execute the drawing instruction, execute each drawing instruction;
  • the drawing unit 303 is configured to perform image drawing by using a drawing resource required by each drawing instruction executed by the processing unit 302, and after performing all drawing instructions of the image frame, obtain a drawing picture of the image frame.
  • the user equipment provided by the embodiment of the present application can perform image rendering by the user equipment, which not only reduces the hardware requirements of the server, but also reduces the hardware requirements of the server.
  • the resource utilization efficiency of the user equipment is improved.
  • the receiving unit 301 is configured to receive a drawing instruction and a drawing resource of an image frame by using at least two channels, where the drawing instruction and the drawing resource are received through different transmission channels.
  • the user equipment further includes Unit 304,
  • the control unit 304 is configured to allocate the drawing instruction received by the receiving unit 301 to an instruction buffer storage, and allocate the drawing resource to a resource buffer storage.
  • the instruction data transmission of the drawing instruction channel can be preferentially guaranteed in case of insufficient network bandwidth or network flow control.
  • the control unit 304 is configured to allocate the drawing instruction to the instruction buffer storage when determining that the drawing resource required by the drawing instruction is not stored in the resource buffer.
  • the server 40 provided by the embodiment of the present application is applied to a cloud interaction system, where the cloud interaction system further includes a user equipment, and the server includes:
  • the obtaining unit 401 is configured to acquire all drawing instructions and drawing resources of the image frame;
  • a determining unit 402 configured to perform an instruction filtering on each drawing instruction acquired by the acquiring unit 401, and determine a drawing instruction that affects image drawing;
  • a sending unit 403 configured to send, to the user equipment, the conference determined by the determining unit 402 And a drawing resource corresponding to the drawing instruction that affects image drawing, wherein the drawing resource corresponding to the drawing instruction that affects the image drawing is used by the user equipment to execute the image that affects the image
  • the drawn drawing instruction is drawn to obtain a drawing picture of the image frame.
  • the server provided by the embodiment of the present application can perform image rendering by the user equipment, which reduces the hardware requirements of the server and improves the hardware.
  • the resource utilization efficiency of the user equipment can perform image rendering by the user equipment, which reduces the hardware requirements of the server and improves the hardware.
  • the server further includes: a processing unit 404,
  • the processing unit 404 is configured to divide the drawing instructions into different instruction buffer spaces according to the type of each drawing instruction in the drawing instruction that affects the image drawing, and draw the corresponding drawing instructions. Resources are divided into resource caches.
  • the server further includes a compression unit 405.
  • the compressing unit 405 is configured to compress, respectively, the drawing instruction divided into the instruction cache space of the processing unit 404 and the drawing resource of the resource buffer area;
  • the sending unit 403 is configured to send, to the user equipment, a drawing instruction and a drawing resource compressed by the compression unit 405.
  • the sending unit 403 is configured to send, by using at least two channels, the drawing instruction that affects image drawing and the drawing resource corresponding to the drawing instruction that affects image drawing to the user equipment, where the meeting is sent A drawing instruction that affects image drawing occupies one channel.
  • the sending unit 403 is configured to start sending, to the user equipment, the drawing instruction that affects image rendering and the drawing instruction that affects image rendering when the image frame transmission time slot arrives or arrives.
  • a drawing resource at the end of the transmission time slot of the image frame, transmitting a drawing resource corresponding to the drawing instruction that affects image drawing and the drawing instruction corresponding to the drawing instruction that affects image drawing;
  • the drawing instruction of the image frame that affects image rendering and the drawing instruction that affects image rendering correspond to When the amount of data drawn by the resource exceeds the preset threshold.
  • FIG. 9 is a schematic structural diagram of a user equipment 30 according to an embodiment of the present application.
  • the user equipment 30 is applied to a cloud interaction system, where the cloud interaction system includes a user equipment and a server, and the user equipment 30 includes a central processing unit (CPU) 3101 and a graphics processing unit (GPU) 3102.
  • Transceiver 340, memory 350 and input/output (I/O) device 330, input/output (I/O) device 330 may be a keyboard or mouse, graphics processor 3102 for graphics rendering, and memory 350 may include read only
  • the memory and the random access memory provide operational instructions and data to the processor 310.
  • a portion of memory 350 may also include non-volatile random access memory (NVRAM).
  • NVRAM non-volatile random access memory
  • memory 350 stores elements, executable modules or data structures, or a subset thereof, or their extended set.
  • the operation instruction can be stored in an operating system
  • the transceiver 340 is configured to receive a drawing instruction and a drawing resource of an image frame sent by the server, where the drawing instruction is a drawing instruction that affects image drawing, and the drawing resource is a drawing instruction that affects image drawing Corresponding drawing resources;
  • the central processing unit 3101 is configured to: when determining that the drawing resource includes a drawing resource required to execute the drawing instruction, execute each drawing instruction;
  • the graphics processor 3102 is configured to perform image rendering by using the drawing resources required by each of the drawing instructions, and after performing all drawing instructions of the image frame, obtain a drawing picture of the image frame.
  • the user equipment provided by the embodiment of the present application can perform image rendering by the user equipment, which not only reduces the hardware requirements of the server, but also reduces the hardware requirements of the server.
  • the resource utilization efficiency of the user equipment is improved.
  • the central processing unit 3101 controls the operation of the user equipment 30.
  • the memory 350 may include read only memory and random access memory, and provides instructions and data to the central processing unit 3101.
  • a portion of memory 350 may also include non-volatile random access memory (NVRAM).
  • NVRAM non-volatile random access memory
  • the various components of user equipment 30 are coupled together by a bus system 320, wherein bus system 320 includes a data bus.
  • bus system 320 can also include a power bus, a control bus, and a status signal bus.
  • various buses are labeled as bus system 320 in the figure.
  • Processor 310 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 310 or an instruction in a form of software.
  • the processor 310 described above may be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or discrete hardware. Component.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA off-the-shelf programmable gate array
  • the methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in the memory 350, and the processor 310 reads the information in the memory 350 and performs the steps of the above method in combination with its hardware.
  • the transceiver 340 is configured to receive a drawing instruction and a drawing resource of the image frame by using at least two channels, where the drawing instruction and the drawing resource are received through different transmission channels.
  • the central processing unit 3101 is further configured to allocate the drawing instruction to the instruction buffer storage, and allocate the drawing resource to the resource buffer storage.
  • the central processing unit 3101 is further configured to allocate the drawing instruction to the instruction buffer storage when determining that the rendering resource required by the drawing instruction is not stored in the resource buffer.
  • the input/output device 330 is also for displaying the second interactive application interface.
  • the above user equipment 30 can be understood by referring to the related description in the parts of FIG. 1 to FIG. 5, and no further description is made herein.
  • FIG. 10 is a schematic structural diagram of a server 40 according to an embodiment of the present application.
  • the server 40 is applied to a cloud interaction system, which includes a user equipment and a server, the server 40 includes a processor 410, a memory 450, and a transceiver 430, and the memory 450 may include a read only memory and a random access memory. Operating instructions and data are provided to processor 410. A portion of the memory 450 may also include non-volatile random access memory (NVRAM).
  • NVRAM non-volatile random access memory
  • the memory 450 stores the following elements, executable modules or data structures, or a subset thereof, or their extended set:
  • the operation instruction can be stored in the operating system
  • the processor 410 is configured to acquire all drawing instructions and drawing resources of an image frame; perform instruction filtering on each drawing instruction to determine a drawing instruction that affects image drawing;
  • the transceiver 430 is configured to send, to the user equipment, a drawing instruction that affects image drawing and a drawing resource corresponding to the drawing instruction that affects image drawing, where the drawing instruction that affects image drawing is Corresponding rendering resources are used by the user equipment to execute the drawing instruction that affects image drawing, and draw a drawing picture of the image frame.
  • the server provided by the embodiment of the present application can perform image rendering by the user equipment, which reduces the hardware requirements of the server and improves the hardware.
  • the resource utilization efficiency of the user equipment can perform image rendering by the user equipment, which reduces the hardware requirements of the server and improves the hardware.
  • the processor 410 controls the operation of the server 40, which may also be referred to as a CPU (Central Processing Unit).
  • Memory 450 can include read only memory and random access memory and provides instructions and data to processor 410. A portion of the memory 450 may also include non-volatile random access memory (NVRAM).
  • the specific components of the server 40 are coupled together by a bus system 420 in a specific application.
  • the bus system 420 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 420 in the figure.
  • Processor 410 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 410 or an instruction in a form of software.
  • the processor 410 described above may be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or discrete hardware. Component.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA off-the-shelf programmable gate array
  • the methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly implemented as a hardware decoding processor, or by using a hard processor in the decoding processor.
  • the combination of the piece and the software module is completed.
  • the software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in the memory 450, and the processor 410 reads the information in the memory 450 and completes the steps of the above method in combination with its hardware.
  • the processor 410 is further configured to divide the drawing instructions into different instruction buffer spaces according to the type of each drawing instruction in the drawing instruction that affects the image drawing, and corresponding to the drawing instructions.
  • the drawing resources are divided into resource buffers.
  • the transceiver 430 is configured to send compressed drawing instructions and drawing resources to the user equipment.
  • the transceiver 430 is configured to send, by using at least two channels, the drawing instruction that affects image rendering and the drawing resource corresponding to the drawing instruction that affects image rendering to the user equipment, where A drawing instruction that affects image drawing occupies one channel.
  • the transceiver 430 is configured to start sending, to the user equipment, the drawing instruction that affects image rendering and the drawing instruction that affects image rendering when the image frame transmission time slot arrives or arrives.
  • Corresponding rendering resource at the end of the transmission time slot of the image frame, sending the drawing instruction corresponding to the drawing instruction that affects the image drawing and the drawing instruction corresponding to the drawing instruction that affects the image drawing;
  • the drawing instruction of the image frame that affects image rendering and the drawing instruction that affects image rendering correspond to When the amount of data drawn by the resource exceeds the preset threshold.
  • the above server 40 can be understood by referring to the related description in the parts of FIG. 1 to FIG. 3, and no further description is made herein.
  • the cloud interaction system provided by the embodiment of the present application can be understood by referring to the related description in the parts of FIG. 1 to FIG. 3, and the details are not described herein.
  • the program may be stored in a computer readable storage medium, and the storage medium may include: ROM, RAM, disk or CD.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请公开了一种图像绘制的方法,所述方法应用于云交互系统,所述云交互系统包括用户设备和服务器,所述服务器获取图像帧的所有绘制指令和绘制资源;对每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令;向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,用户设备确定所述会影响图像绘制的绘制资源中包含执行所述会影响图像绘制的绘制指令所需的绘制资源时,执行每条绘制指令,利用绘制资源进行图像绘制,得到所述图像帧的绘制画面。本申请实施例提供的图像绘制的方法,可以由用户设备进行图像绘制,既降低了对服务器的硬件要求,同时提高了用户设备的资源利用效率。

Description

一种图像绘制的方法、用户设备、服务器及系统
本申请要求于2016年1月29日提交中国专利局、申请号为201610064034.6、发明名称为“一种图像绘制的方法、用户设备、服务器及系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及云技术领域,具体涉及一种图像绘制的方法、用户设备、服务器及系统。
背景技术
随着近年来网络带宽的高速发展,云计算技术的日趋成熟催生了云交互系统。现有的云交系统通常包括服务器和多个用户设备,服务器可以是集群服务器,多种交互式应用都可以运行在云交互系统中。在云交互系统中有关图像绘制方面的应用,现有技术中通常都是由服务器负责图像绘制,绘制完成后,将绘制好的图像帧发送给用户设备,用户设备接收到绘制好的图像帧后,直接解码图像帧,然后显示图像画面。
由服务器进行图像绘制,对服务器的硬件要求较高,而随着科技水平的提高,用户设备通常都具有较好的配置,这样无疑增加了对服务器的要求,而且同时浪费了用户设备的硬件资源。
发明内容
本申请实施例提供一种图像绘制的方法,可以由用户设备进行图像绘制,既降低了对服务器的硬件要求,同时提高了用户设备的资源利用效率。本申请实施例还提供了相应的用户设备、服务器和系统。
本申请第一方面提供一种图像绘制的方法,所述方法应用于云交互系统,所述云交互系统包括用户设备和服务器,所述方法包括:
所述用户设备接收所述服务器发送的图像帧的绘制指令和绘制资源,所述绘制指令为会影响图像绘制的绘制指令,所述绘制资源为所述会影响图像绘制 的绘制指令所对应的绘制资源;
所述用户设备确定所述绘制资源中包含执行所述绘制指令所需的绘制资源时,执行每条绘制指令;
所述用户设备利用所述每条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
本申请第二方面提供一种图像绘制的方法,所述方法应用于云交互系统,所述云交互系统包括用户设备和服务器,所述方法包括:
所述服务器获取图像帧的所有绘制指令和绘制资源;
所述服务器对每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令;
所述服务器向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,所述会影响图像绘制的绘制指令所对应的绘制资源用于所述用户设备执行所述会影响图像绘制的绘制指令,绘制得到所述图像帧的绘制画面。
本申请第三方面提供一种用户设备,所述用户设备应用于云交互系统,所述云交互系统还包括服务器,所述用户设备包括:
接收单元,用于接收所述服务器发送的图像帧的绘制指令和绘制资源,所述绘制指令为会影响图像绘制的绘制指令,所述绘制资源为所述会影响图像绘制的绘制指令所对应的绘制资源;
处理单元,用于确定所述接收单元接收的所述绘制资源中包含执行所述绘制指令所需的绘制资源时,执行每条绘制指令;
绘制单元,用于利用所述处理单元执行的每条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
本申请第四方面提供一种服务器,所述服务器应用于云交互系统,所述云交互系统还包括用户设备,所述服务器包括:
获取单元,用于获取图像帧的所有绘制指令和绘制资源;
确定单元,用于对所述获取单元获取的每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令;
发送单元,用于向所述用户设备发送所述确定单元确定的所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,所述会影响图像绘制的绘制指令所对应的绘制资源用于所述用户设备执行所述会影响图像绘制的绘制指令,绘制得到所述图像帧的绘制画面。
本申请第五方面提供一种用户设备,所述用户设备应用于云交互系统,所述云交互系统还包括服务器,所述用户设备包括:
所述用户设备包括:收发器、中央处理器、图形处理器和存储器,所述存储器用于存储所述中央处理器执行控制输入法显示的程序;
所述收发器用于接收所述服务器发送的图像帧的绘制指令和绘制资源,所述绘制指令为会影响图像绘制的绘制指令,所述绘制资源为所述会影响图像绘制的绘制指令所对应的绘制资源;
所述中央处理器用于确定所述绘制资源中包含执行所述绘制指令所需的绘制资源时,执行每条绘制指令;
所述图形处理器用于利用所述每条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
本申请第六方面提供一种服务器,所述服务器应用于云交互系统,所述云交互系统还包括用户设备,所述服务器包括:收发器、处理器和存储器,所述存储器用于存储所述处理器执行控制输入法显示的程序;
所述处理器用于获取图像帧的所有绘制指令和绘制资源;对每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令;
所述收发器用于向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,所述会影响图像绘制的绘制指令所对应的绘制资源用于所述用户设备执行所述会影响图像绘制的绘制指令,绘制得到所述图像帧的绘制画面。
本申请第七方面提供一种云交互系统,包括用户设备和服务器,
所述服务器用于:
获取图像帧的所有绘制指令和绘制资源,对每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令,向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,所述会 影响图像绘制的绘制指令所对应的绘制资源用于所述用户设备执行所述会影响图像绘制的绘制指令,绘制得到所述图像帧的绘制画面;
所述用户设备用于:
接收所述服务器发送的所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源;确定所述所对应的绘制资源中包含执行所述会影响图像绘制的绘制指令所需的绘制资源时,执行所述会影响图像绘制的绘制指令中各条绘制指令;利用所述各条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本申请实施例中云交互式系统的一实施例示意图;
图2是本申请实施例中图像绘制的方法的一实施例示意图;
图3是本申请实施例中图像绘制的方法的另一实施例示意图;
图4是本申请实施例中用户设备的一实施例示意图;
图5是本申请实施例中用户设备的另一实施例示意图;
图6是本申请实施例中服务器的一实施例示意图;
图7是本申请实施例中服务器的另一实施例示意图;
图8是本申请实施例中服务器的另一实施例示意图;
图9是本申请实施例中用户设备的另一实施例示意图;
图10是本申请实施例中服务器的另一实施例示意图。
具体实施方式
本申请实施例提供一种图像绘制的方法,可以由用户设备进行图像绘制,既降低了对服务器的硬件要求,同时提高了用户设备的资源利用效率。本申请实施例还提供了相应的用户设备、服务器和系统。以下分别进行详细说明。
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清 楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
图1为本申请实施例中云交互式系统的一实施例示意图。
参阅图1,云交互式系统可以理解为是云游戏系统,通常包括服务器和用户设备,用户设备可以有多个,服务器也可以是服务器集群,多种交互式应用都可以运行在云交互系统中。用户设备可以是个人电脑(Personal Computer,PC)、笔记本和手机等终端设备。服务器可以是专用的游戏服务器,目前游戏的画面都是由服务器完成绘制,然后一帧一帧的传输给用户设备,在用户设备上显示。但本申请实施例中,服务器要将每帧图像的绘制指令和绘制资源传输给用户设备,由用户设备来完成图像绘制,每帧图像在本申请实施例中成为图像帧。这样既降低了对服务器的硬件要求,同时提高了用户设备的资源利用效率。
结合图1所示的云交互式系统,下面参阅图2所示的图像绘制的方法的示意图,对本申请实施例提供的图像绘制的过程进行说明。
参阅图2,本申请实施例提供的图像绘制的方法的一实施例包括:
101、服务器获取图像帧的所有绘制指令和绘制资源。
每一图像帧有很多条绘制指令,通常有1000-100000个左右,绘制指令统计上虽然有大量的重复,但是不同的组合会得到不同的效果。
102、服务器对每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令。
图像帧的所有绘制指令中,有些绘制指令会影响绘制状态和绘制结果,也就是说会影响绘制流程,但有些绘制指令不会影响绘制状态和绘制结果,这样,这些不影响绘制流程的绘制指令就不需要发送给用户设备,所以可以通过指令过滤,过滤掉这些不影响绘制流程的绘制指令。
指令过滤的过程就是:识别这一条绘制命令是否会影响绘制状态和最终的绘制结果,比如D3D中获取相关状态的函数是不会影响绘制流程的,因此这些函数的绘制指令不需要传输给用户设备,这一步的操作就是指令过滤。
103、服务器向所述用户设备发送所述会影响图像绘制的绘制指令和所述 会影响图像绘制的绘制指令所对应的绘制资源。
会影响图像绘制的绘制指令就是过滤后剩余的会影响绘制状态和最终的绘制结果的绘制指令。
104、用户设备接收到所述服务器发送的图像帧的会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,确定所述绘制资源中包含执行所述绘制指令所需的绘制资源时,执行每条绘制指令。
绘制指令和绘制资源可能没有同步到达,所以在执行绘制之前要先确定该绘制指令的绘制资源是否已存在,如果已存在,则可以执行绘制指令,若未存在,则可能会导致指令执行失败。
105、利用所述每条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
此处的每条绘制指令指的是会影响图像绘制的绘制指令中的每条绘制指令。
与现有技术中对服务器的硬件要求较高,而且浪费用户设备的硬件资源相比,本申请实施例提供的图像绘制的方法,可以由用户设备进行图像绘制,既降低了对服务器的硬件要求,同时提高了用户设备的资源利用效率。
为了便于对本申请实施例中图像绘制的方法进行更详细的理解,下面参阅图3进一步说明本申请实施例提供的图像绘制的方法。
参阅图3,本申请实施例提供的图像绘制的方法的另一实施例包括:
201、服务器获取图像帧的所有绘制指令。
202、服务器对该图像帧的所有绘制指令进行指令过滤,判断每条绘制指令是否对绘制有影响,若有影响,则执行步骤203。
203、服务器根据所述会影响图像绘制的绘制指令中各绘制指令的类型,将所述各绘制指令划分到不同的指令缓存空间,并将所述各绘制指令所对应的绘制资源划分到资源缓存区。
绘制指令的类型可以是不同的缓存类型、索引类型和流格式等。
本申请实施例中的绘制指令可以包括图3所示的指令标识和指令数据两部分,绘制资源为图3中的绘制数据。
所有的指令标识放在一个缓存空间可以保证绘制指令的强顺序性。
对于绘制指令,服务器中设置了指令缓存空间,每个缓存空间存储一种类型的指令,根据指令类型把绘制指令填充到对应的缓存空间中。同时我们还需要获得绘制指令所涉及的绘制资源,对于这些绘制资源,存在一个单独的资源缓存区。
对于每一条绘制指令都做了上面的步骤后,创建的各个指令缓存空间和资源缓存空间都会相应的被填充不同数量的数据,接下来的一步是对每个缓存空间做压缩,也就是执行步骤204和205。
指令数据,每种类型单独划分到一个缓存空间buffer,这样做的好处是相似含义的数据具有规律性,然后使用压缩算法压缩可以得到高压缩比,这样一帧总共要传输的数据总量可以减少。
本申请实施例中按照绘制指令的类型进行指令划分,目的是为了让后续指令传输过程中减少网络传输的数据量。如果不用减少网络传输的数据量,也可以不用做任何区分,直接传输就可以。
204、服务器进行指令数据压缩。
205、服务器进行资源数据压缩。
206和207、服务器通过双通道发送压缩后的指令数据和资源数据。
图3所示的指令数据是要与指令标识同时传递到用户设备的数据,需要与指令标识放在一个通道中传输,指令数据通常包括顶点数据,用来构建虚拟场景,指令数据发送不到程序会崩溃。绘制资源也就是资源数据主要指纹理,用来给场景贴图,资源数据发送不到会影响绘制效果,但不会导致程序崩溃,所以可以通过另外一条通道传输,当然,资源数据还可以通过多个通道异步到达用户设备即可。
本申请实施例中,指令数据和资源数据通过两个通道分别传输给用户设备。这么做的目的就是在网络带宽不够或者网络流量控制的情况下,可以优先保障绘制指令通道的指令数据传输,资源数据可以慢慢发送。还有这部分数据一般都是图片,数据量很大,双通道划分了以后可以单独对资源数据作处理,减少需要传输的数据量。
对于发送数据的时间点:所述服务器在所述图像帧传输时隙到来时或到来之前,开始向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响 图像绘制的绘制指令所对应的绘制资源,在所述图像帧的传输时隙结束时,发送完成所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源;
其中,所述图像帧传输时隙到来之前为在所述图像帧的传输时隙还未到来,但所述图像帧的会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源的数据量超过预置阈值时。
也就是说在每一帧结束的时候一定会把这一帧所涉及到的所有绘制命令和资源都发送。另外,还可以设定,当各个缓存空间数据量达到一定程度的时候,可以提前发送掉这一帧的数据内容,一帧的数据内容可以分多次发送完成。
208、用户设备通过一条通道接收指令数据。
接收指令数据后,将所述绘制指令分配到指令缓冲区存储。尤其是在确定所述资源缓冲区中未存储有所述绘制指令所需的绘制资源时,将所述绘制指令分配到指令缓冲区存储。
209、用户设备通过另一条通道接收资源数据。
接收资源数据后,将所述绘制资源分配到资源缓冲区存储。
210、所述用户设备利用所述每条绘制指令所需的绘制资源进行图像绘制。
用户设备通过解析指令数据获得D3D绘制函数命令,因为采用双通道或多通道的传输方式,因此会存在指令到达但是指令执行所需资源还没有完全到达的情况。因此在这里我们需要去判断一下用户设备是否已经完整的接收到了当前正在解析执行的绘制命令所需的资源,如果没有,暂时放弃执行这条绘制命令,继续存放在指令数据缓冲区;如果有,则表示可以执行这条绘制命令。
211、所述用户设备在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
最终在执行完一帧传输过来的所有绘制命令后,即表示绘制完成。
参阅图4,本申请实施例提供的用户设备30应用于云交互系统,所述云交互系统还包括服务器,所述用户设备包括:
接收单元301,用于接收所述服务器发送的图像帧的绘制指令和绘制资源,所述绘制指令为会影响图像绘制的绘制指令,所述绘制资源为所述会影响图像绘制的绘制指令所对应的绘制资源;
处理单元302,用于确定所述接收单元301接收的所述绘制资源中包含执行所述绘制指令所需的绘制资源时,执行每条绘制指令;
绘制单元303,用于利用所述处理单元302执行的每条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
与现有技术中对服务器的硬件要求较高,而且浪费用户设备的硬件资源相比,本申请实施例提供的用户设备,可以由用户设备进行图像绘制,既降低了对服务器的硬件要求,同时提高了用户设备的资源利用效率。
可选地,在上述图4对应的实施例的基础上,本申请实施例提供的用户设备的第一个可选实施例中,
所述接收单元301,用于通过至少两条通道接收图像帧的绘制指令和绘制资源,所述绘制指令与所述绘制资源通过不同的传输通道接收。
可选地,在上述用户设备对应的第一个可选实施例的基础上,参阅图5,本申请实施例提供的用户设备的第二个可选实施例中,所述用户设备还包括控制单元304,
所述控制单元304,用于将所述接收单元301接收的所述绘制指令分配到指令缓冲区存储,将所述绘制资源分配到资源缓冲区存储。
通过双通道传输可以在网络带宽不够或者网络流量控制的情况下,可以优先保障绘制指令通道的指令数据传输。
在上述图5对应的实施例的基础上,本申请实施例提供的用户设备的第二个可选实施例中,
所述控制单元304,用于确定所述资源缓冲区中未存储有所述绘制指令所需的绘制资源时,将所述绘制指令分配到指令缓冲区存储。
参阅图6,本申请实施例提供的服务器40应用于云交互系统,所述云交互系统还包括用户设备,所述服务器包括:
获取单元401,用于获取图像帧的所有绘制指令和绘制资源;
确定单元402,用于对所述获取单元401获取的每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令;
发送单元403,用于向所述用户设备发送所述确定单元402确定的所述会影 响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,所述会影响图像绘制的绘制指令所对应的绘制资源用于所述用户设备执行所述会影响图像绘制的绘制指令,绘制得到所述图像帧的绘制画面。
与现有技术中对服务器的硬件要求较高,而且浪费用户设备的硬件资源相比,本申请实施例提供的服务器,可以由用户设备进行图像绘制,既降低了对服务器的硬件要求,同时提高了用户设备的资源利用效率。
可选地,在上述图6对应的实施例的基础上,参阅图7,本申请实施例提供的服务器的第一个可选实施例中,所述服务器还包括:处理单元404,
所述处理单元404,用于根据所述会影响图像绘制的绘制指令中各绘制指令的类型,将所述各绘制指令划分到不同的指令缓存空间,并将所述各绘制指令所对应的绘制资源划分到资源缓存区。
可选地,在上述图7对应的实施例的基础上,参阅图8,本申请实施例提供的服务器的第二个可选实施例中,所述服务器还包括压缩单元405,
所述压缩单元405,用于对所述处理单元404划分到所述每个指令缓存空间中的绘制指令和所述资源缓存区的绘制资源分别进行压缩;
所述发送单元403,用于向所述用户设备发送所述压缩单元405压缩的绘制指令和绘制资源。
可选地,在上述图6至图8对应的任一实施例的基础上,本申请实施例提供的服务器的第三个可选实施例中,
所述发送单元403,用于通过至少两条通道向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,发送所述会影响图像绘制的绘制指令占用一条通道。
可选地,在上述图6至图8对应的任一实施例的基础上,本申请实施例提供的服务器的第四个可选实施例中,
所述发送单元403,用于在所述图像帧传输时隙到来时或到来之前,开始向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,在所述图像帧的传输时隙结束时,发送完成所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源;
其中,所述图像帧传输时隙到来之前为在所述图像帧的传输时隙还未到来,但所述图像帧的会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源的数据量超过预置阈值时。
图9是本申请实施例提供的用户设备30的结构示意图。所述用户设备30应用于云交互系统,所云交互系统包括用户设备和服务器,所述用户设备30包括中央处理器(Central Processing Unit,CPU)3101和图形处理器(Graphic Processing Unit,GPU)3102、收发器340、存储器350和输入/输出(I/O)设备330,输入/输出(I/O)设备330可以是键盘或鼠标,图形处理器3102用于图形渲染,存储器350可以包括只读存储器和随机存取存储器,并向处理器310提供操作指令和数据。存储器350的一部分还可以包括非易失性随机存取存储器(NVRAM)。
在一些实施方式中,存储器350存储了如下的元素,可执行模块或者数据结构,或者他们的子集,或者他们的扩展集。
在本申请实施例中,通过调用存储器350存储的操作指令(该操作指令可存储在操作系统中),
所述收发器340用于接收所述服务器发送的图像帧的绘制指令和绘制资源,所述绘制指令为会影响图像绘制的绘制指令,所述绘制资源为所述会影响图像绘制的绘制指令所对应的绘制资源;
所述中央处理器3101用于确定所述绘制资源中包含执行所述绘制指令所需的绘制资源时,执行每条绘制指令;
所述图形处理器3102用于利用所述每条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
与现有技术中对服务器的硬件要求较高,而且浪费用户设备的硬件资源相比,本申请实施例提供的用户设备,可以由用户设备进行图像绘制,既降低了对服务器的硬件要求,同时提高了用户设备的资源利用效率。
中央处理器3101控制用户设备30的操作。存储器350可以包括只读存储器和随机存取存储器,并向中央处理器3101提供指令和数据。存储器350的一部分还可以包括非易失性随机存取存储器(NVRAM)。具体的应用中用户设备30的各个组件通过总线系统320耦合在一起,其中总线系统320除包括数据总线 之外,还可以包括电源总线、控制总线和状态信号总线等。但是为了清楚说明起见,在图中将各种总线都标为总线系统320。
上述本申请实施例揭示的方法可以应用于处理器310中,或者由处理器310实现。处理器310可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器310中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器310可以是通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器350,处理器310读取存储器350中的信息,结合其硬件完成上述方法的步骤。
可选地,收发器340用于通过至少两条通道接收图像帧的绘制指令和绘制资源,所述绘制指令与所述绘制资源通过不同的传输通道接收.
可选地,中央处理器3101还用于将所述绘制指令分配到指令缓冲区存储,将所述绘制资源分配到资源缓冲区存储。
可选地,中央处理器3101还用于确定所述资源缓冲区中未存储有所述绘制指令所需的绘制资源时,将所述绘制指令分配到指令缓冲区存储。
输入/输出设备330还用于显示所述第二交互式应用界面。
以上的用户设备30可以参阅图1至图5部分的相关描述进行理解,本处不做过多赘述。
图10是本申请实施例提供的服务器40的结构示意图。所述服务器40应用于云交互系统,所述云交互系统包括用户设备和服务器,所述服务器40包括处理器410、存储器450和收发器430,存储器450可以包括只读存储器和随机存取存储器,并向处理器410提供操作指令和数据。存储器450的一部分还可以包括非易失性随机存取存储器(NVRAM)。
在一些实施方式中,存储器450存储了如下的元素,可执行模块或者数据结构,或者他们的子集,或者他们的扩展集:
在本申请实施例中,通过调用存储器450存储的操作指令(该操作指令可存储在操作系统中),
所述处理器410用于获取图像帧的所有绘制指令和绘制资源;对每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令;
所述收发器430用于向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,所述会影响图像绘制的绘制指令所对应的绘制资源用于所述用户设备执行所述会影响图像绘制的绘制指令,绘制得到所述图像帧的绘制画面。
与现有技术中对服务器的硬件要求较高,而且浪费用户设备的硬件资源相比,本申请实施例提供的服务器,可以由用户设备进行图像绘制,既降低了对服务器的硬件要求,同时提高了用户设备的资源利用效率。
处理器410控制服务器40的操作,处理器410还可以称为CPU(Central Processing Unit,中央处理单元)。存储器450可以包括只读存储器和随机存取存储器,并向处理器410提供指令和数据。存储器450的一部分还可以包括非易失性随机存取存储器(NVRAM)。具体的应用中服务器40的各个组件通过总线系统420耦合在一起,其中总线系统420除包括数据总线之外,还可以包括电源总线、控制总线和状态信号总线等。但是为了清楚说明起见,在图中将各种总线都标为总线系统420。
上述本申请实施例揭示的方法可以应用于处理器410中,或者由处理器410实现。处理器410可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器410中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器410可以是通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬 件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器450,处理器410读取存储器450中的信息,结合其硬件完成上述方法的步骤。
可选地,处理器410还用于根据所述会影响图像绘制的绘制指令中各绘制指令的类型,将所述各绘制指令划分到不同的指令缓存空间,并将所述各绘制指令所对应的绘制资源划分到资源缓存区。
可选地,对每个指令缓存空间中的绘制指令和所述资源缓存区的绘制资源分别进行压缩;
收发器430用于向所述用户设备发送压缩的绘制指令和绘制资源。
可选地,收发器430用于通过至少两条通道向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,发送所述会影响图像绘制的绘制指令占用一条通道。
可选地,收发器430用于在所述图像帧传输时隙到来时或到来之前,开始向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,在所述图像帧的传输时隙结束时,发送完成所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源;
其中,所述图像帧传输时隙到来之前为在所述图像帧的传输时隙还未到来,但所述图像帧的会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源的数据量超过预置阈值时。
以上的服务器40可以参阅图1至图3部分的相关描述进行理解,本处不做过多赘述。
本申请实施例提供的云交互系统可以参阅图1至图3部分的相关描述进行理解,本处不做过多赘述。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:ROM、RAM、磁盘或光盘等。
以上对本申请实施例所提供的图像绘制的方法、用户设备、服务器以及系统进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。

Claims (19)

  1. 一种图像绘制的方法,其特征在于,所述方法应用于云交互系统,所述云交互系统包括用户设备和服务器,所述方法包括:
    所述用户设备接收所述服务器发送的图像帧的绘制指令和绘制资源,所述绘制指令为会影响图像绘制的绘制指令,所述绘制资源为所述会影响图像绘制的绘制指令所对应的绘制资源;
    所述用户设备确定所述绘制资源中包含执行所述绘制指令所需的绘制资源时,执行每条绘制指令;以及
    所述用户设备利用所述每条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
  2. 根据权利要求1所述的方法,其特征在于,所述用户设备接收图像帧的绘制指令和绘制资源,包括:
    所述用户设备通过至少两条通道接收图像帧的绘制指令和绘制资源,所述绘制指令与所述绘制资源通过不同的传输通道接收。
  3. 根据权利要求1或2或所述的方法,其特征在于,所述方法还包括:
    所述用户设备将所述绘制指令分配到指令缓冲区存储,将所述绘制资源分配到资源缓冲区存储。
  4. 根据权利要求3所述的方法,其特征在于,所述用户设备将所述绘制指令分配到指令缓冲区存储,包括:
    所述用户设备确定所述资源缓冲区中未存储有所述绘制指令所需的绘制资源时,将所述绘制指令分配到指令缓冲区存储。
  5. 一种图像绘制的方法,其特征在于,所述方法应用于云交互系统,所述云交互系统包括用户设备和服务器,所述方法包括:
    所述服务器获取图像帧的所有绘制指令和绘制资源;
    所述服务器对每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令;以及
    所述服务器向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,所述会影响图像绘制的绘制指令所对应的绘制资源用于所述用户设备执行所述会影响图像绘制的绘 制指令,绘制得到所述图像帧的绘制画面。
  6. 根据权利要求5所述的方法,其特征在于,所述服务器对每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令之后,所述方法还包括:
    所述服务器根据所述会影响图像绘制的绘制指令中各绘制指令的类型,将所述各绘制指令划分到不同的指令缓存空间,并将所述各绘制指令所对应的绘制资源划分到资源缓存区。
  7. 根据权利要求6所述的方法,其特征在于,所述方法还包括:
    所述服务器对每个指令缓存空间中的绘制指令和所述资源缓存区的绘制资源分别进行压缩;
    所述服务器向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,包括:
    所述服务器向所述用户设备发送压缩的绘制指令和绘制资源。
  8. 根据权利要求5-7任一所述的方法,其特征在于,所述服务器向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,包括:
    所述服务器通过至少两条通道向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,发送所述会影响图像绘制的绘制指令占用一条通道。
  9. 根据权利要求5-7任一所述的方法,其特征在于,所述服务器向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,包括:
    所述服务器在所述图像帧传输时隙到来时或到来之前,开始向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,在所述图像帧的传输时隙结束时,发送完成所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源;
    其中,所述图像帧传输时隙到来之前为在所述图像帧的传输时隙还未到来,但所述图像帧的会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源的数据量超过预置阈值时。
  10. 一种用户设备,其特征在于,所述用户设备应用于云交互系统,所述 云交互系统还包括服务器,所述用户设备包括:
    接收单元,用于接收所述服务器发送的图像帧的绘制指令和绘制资源,所述绘制指令为会影响图像绘制的绘制指令,所述绘制资源为所述会影响图像绘制的绘制指令所对应的绘制资源;
    处理单元,用于确定所述接收单元接收的所述绘制资源中包含执行所述绘制指令所需的绘制资源时,执行每条绘制指令;以及
    绘制单元,用于利用所述处理单元执行的每条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
  11. 根据权利要求10所述的用户设备,其特征在于,
    所述接收单元,用于通过至少两条通道接收图像帧的绘制指令和绘制资源,所述绘制指令与所述绘制资源通过不同的传输通道接收。
  12. 根据权利要求10或11所述的用户设备,其特征在于,所述用户设备还包括控制单元,
    所述控制单元,用于将所述接收单元接收的所述绘制指令分配到指令缓冲区存储,将所述绘制资源分配到资源缓冲区存储。
  13. 根据权利要求12所述的用户设备,其特征在于,
    所述控制单元,用于确定所述资源缓冲区中未存储有所述绘制指令所需的绘制资源时,将所述绘制指令分配到指令缓冲区存储。
  14. 一种服务器,其特征在于,所述服务器应用于云交互系统,所述云交互系统还包括用户设备,所述服务器包括:
    获取单元,用于获取图像帧的所有绘制指令和绘制资源;
    确定单元,用于对所述获取单元获取的每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令;以及
    发送单元,用于向所述用户设备发送所述确定单元确定的所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,所述会影响图像绘制的绘制指令所对应的绘制资源用于所述用户设备执行所述会影响图像绘制的绘制指令,绘制得到所述图像帧的绘制画面。
  15. 根据权利要求14所述的服务器,其特征在于,所述服务器还包括:处 理单元,
    所述处理单元,用于根据所述会影响图像绘制的绘制指令中各绘制指令的类型,将所述各绘制指令划分到不同的指令缓存空间,并将所述各绘制指令所对应的绘制资源划分到资源缓存区。
  16. 根据权利要求15所述的服务器,其特征在于,所述服务器还包括压缩单元,
    所述压缩单元,用于对所述处理单元划分到所述每个指令缓存空间中的绘制指令和所述资源缓存区的绘制资源分别进行压缩;
    所述发送单元,用于向所述用户设备发送所述压缩单元压缩的绘制指令和绘制资源。
  17. 根据权利要求14-16任一所述的服务器,其特征在于,
    所述发送单元,用于通过至少两条通道向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,发送所述会影响图像绘制的绘制指令占用一条通道。
  18. 根据权利要求14-16任一所述的服务器,其特征在于,
    所述发送单元,用于在所述图像帧传输时隙到来时或到来之前,开始向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,在所述图像帧的传输时隙结束时,发送完成所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源;
    其中,所述图像帧传输时隙到来之前为在所述图像帧的传输时隙还未到来,但所述图像帧的会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源的数据量超过预置阈值时。
  19. 一种云交互系统,其特征在于,包括用户设备和服务器,
    所述服务器用于:
    获取图像帧的所有绘制指令和绘制资源,对每条绘制指令进行指令过滤,确定会影响图像绘制的绘制指令,向所述用户设备发送所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源,其中,所述会影响图像绘制的绘制指令所对应的绘制资源用于所述用户设备执行所述会影 响图像绘制的绘制指令,绘制得到所述图像帧的绘制画面;
    所述用户设备用于:
    接收所述服务器发送的所述会影响图像绘制的绘制指令和所述会影响图像绘制的绘制指令所对应的绘制资源;确定所述所对应的绘制资源中包含执行所述会影响图像绘制的绘制指令所需的绘制资源时,执行所述会影响图像绘制的绘制指令中各条绘制指令;利用所述各条绘制指令所需的绘制资源进行图像绘制,在执行完所述图像帧的所有绘制指令后,得到所述图像帧的绘制画面。
PCT/CN2017/072539 2016-01-29 2017-01-25 一种图像绘制的方法、用户设备、服务器及系统 WO2017129119A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610064034.6A CN105677282B (zh) 2016-01-29 2016-01-29 一种图像绘制的方法、用户设备、服务器及系统
CN201610064034.6 2016-01-29

Publications (1)

Publication Number Publication Date
WO2017129119A1 true WO2017129119A1 (zh) 2017-08-03

Family

ID=56304334

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/072539 WO2017129119A1 (zh) 2016-01-29 2017-01-25 一种图像绘制的方法、用户设备、服务器及系统

Country Status (2)

Country Link
CN (1) CN105677282B (zh)
WO (1) WO2017129119A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113096054A (zh) * 2020-01-09 2021-07-09 北京小米移动软件有限公司 图像帧合成方法、装置及存储介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677282B (zh) * 2016-01-29 2019-04-26 腾讯科技(深圳)有限公司 一种图像绘制的方法、用户设备、服务器及系统
CN106446590A (zh) * 2016-11-23 2017-02-22 武汉联影医疗科技有限公司 一种公告通知的生成方法和系统
CN108711179B (zh) * 2018-05-21 2022-07-19 杭州多技教育科技有限公司 绘图还原方法和系统
CN108769715B (zh) * 2018-05-22 2022-05-13 深圳市腾讯网络信息技术有限公司 图形指令数据的处理方法及装置
CN112383591B (zh) * 2020-10-27 2024-02-23 西安万像电子科技有限公司 图像管理方法、设备及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103294439A (zh) * 2013-06-28 2013-09-11 华为技术有限公司 一种图像更新方法、系统及装置
CN104144212A (zh) * 2014-07-16 2014-11-12 福建星网锐捷网络有限公司 一种虚拟桌面图像传输方法、装置及系统
CN104469385A (zh) * 2014-12-11 2015-03-25 北京星网锐捷网络技术有限公司 基于虚拟化技术的图形显示方法及装置
CN105096373A (zh) * 2015-06-30 2015-11-25 华为技术有限公司 一种媒体内容渲染的方法、用户设备及系统
CN105224390A (zh) * 2015-09-22 2016-01-06 宁夏大学 一种虚拟桌面压缩的方法
CN105677282A (zh) * 2016-01-29 2016-06-15 腾讯科技(深圳)有限公司 一种图像绘制的方法、用户设备、服务器及系统

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8429269B2 (en) * 2009-12-09 2013-04-23 Sony Computer Entertainment Inc. Server-side rendering
US20110161410A1 (en) * 2009-12-31 2011-06-30 Centrifuge Systems, Inc. Massive-scale interactive visualization of data spaces
CN102487402B (zh) * 2010-12-03 2014-03-19 腾讯科技(深圳)有限公司 由服务器端实现网页渲染的方法、设备和系统
CN102916994A (zh) * 2011-08-02 2013-02-06 华为技术有限公司 一种页面浏览方法、服务器和终端

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103294439A (zh) * 2013-06-28 2013-09-11 华为技术有限公司 一种图像更新方法、系统及装置
CN104144212A (zh) * 2014-07-16 2014-11-12 福建星网锐捷网络有限公司 一种虚拟桌面图像传输方法、装置及系统
CN104469385A (zh) * 2014-12-11 2015-03-25 北京星网锐捷网络技术有限公司 基于虚拟化技术的图形显示方法及装置
CN105096373A (zh) * 2015-06-30 2015-11-25 华为技术有限公司 一种媒体内容渲染的方法、用户设备及系统
CN105224390A (zh) * 2015-09-22 2016-01-06 宁夏大学 一种虚拟桌面压缩的方法
CN105677282A (zh) * 2016-01-29 2016-06-15 腾讯科技(深圳)有限公司 一种图像绘制的方法、用户设备、服务器及系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113096054A (zh) * 2020-01-09 2021-07-09 北京小米移动软件有限公司 图像帧合成方法、装置及存储介质

Also Published As

Publication number Publication date
CN105677282A (zh) 2016-06-15
CN105677282B (zh) 2019-04-26

Similar Documents

Publication Publication Date Title
WO2017129119A1 (zh) 一种图像绘制的方法、用户设备、服务器及系统
CN111240837B (zh) 资源配置方法、装置、终端及存储介质
US9720740B2 (en) Resource management in MapReduce architecture and architectural system
US10241799B2 (en) Out-of-order command execution with sliding windows to maintain completion statuses
US20160198208A1 (en) Desktop-cloud-based media control method and device
CN109542614B (zh) 资源配置方法、装置、终端及存储介质
CN114501062B (zh) 视频渲染协同方法、装置、设备及存储介质
WO2021146930A1 (zh) 显示处理方法、显示处理装置、电子设备及存储介质
US11132766B2 (en) Image processing method and device using multiple layers of an operating system
CN111026493B (zh) 界面渲染的处理方法和装置
US20210316213A1 (en) Apparatus and method for providing streaming video by application program
EP3779690A1 (en) Processor core scheduling method and apparatus, terminal, and storage medium
CN109587561B (zh) 视频处理方法、装置、电子设备及存储介质
CN113473226B (zh) 提高视频渲染效率的方法、装置、计算机设备及存储介质
WO2023142715A1 (zh) 视频编码方法、实时通信方法、装置、设备及存储介质
WO2020107992A1 (zh) 视频处理方法、装置、电子设备及存储介质
CN112165572A (zh) 图像处理方法、装置、终端及存储介质
WO2023083213A1 (zh) 一种数据解码方法、装置、电子设备及可读存储介质
CN111767433A (zh) 数据处理方法、装置、存储介质以及终端
CN105727556A (zh) 一种图像绘制的方法、相关设备及系统
KR102231875B1 (ko) 응용 프로그램의 스트리밍 영상 제공 장치 및 방법
CN114205359A (zh) 视频渲染协同方法、装置及设备
CN114125367A (zh) 用于处理视频会议画面的显示的方法、装置和相关产品
CN114327790A (zh) 基于Linux系统Android容器的渲染方法
WO2023142714A1 (zh) 视频处理协同方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17743734

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17743734

Country of ref document: EP

Kind code of ref document: A1