CN114972594B - Data processing method, device, equipment and medium for meta universe - Google Patents

Data processing method, device, equipment and medium for meta universe Download PDF

Info

Publication number
CN114972594B
CN114972594B CN202210443914.XA CN202210443914A CN114972594B CN 114972594 B CN114972594 B CN 114972594B CN 202210443914 A CN202210443914 A CN 202210443914A CN 114972594 B CN114972594 B CN 114972594B
Authority
CN
China
Prior art keywords
rendering
target area
cloud
target
user side
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210443914.XA
Other languages
Chinese (zh)
Other versions
CN114972594A (en
Inventor
陈相礼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202210443914.XA priority Critical patent/CN114972594B/en
Publication of CN114972594A publication Critical patent/CN114972594A/en
Application granted granted Critical
Publication of CN114972594B publication Critical patent/CN114972594B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/005General purpose rendering architectures
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/66Methods for processing data by generating or executing the game program for rendering three dimensional images
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The disclosure provides a data processing method, device, equipment and medium for metauniverse, relates to the technical field of computers, in particular to the technical fields of cloud computing, internet of things, enhanced/virtual reality and computer vision, and is applicable to metauniverse scenes. The specific implementation scheme is as follows: responding to control operation of a virtual space, and determining a target area corresponding to an operation position of the virtual space; determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area; the rendering device is cloud device and/or user terminal; and rendering the target area through the cloud device and/or the user side. The method and the device can effectively render the user operation area in the running process of the virtual space product.

Description

Data processing method, device, equipment and medium for meta universe
Technical Field
The disclosure relates to the technical field of computers, in particular to the technical fields of cloud computing, internet of things, enhanced/virtual reality and computer vision, and is applicable to metauniverse scenes.
Background
With the development of ACG (Animation, comics, games, animation, cartoon, game) internet of things, an entertainment product (such as a metauniverse product or a game product including a movable interface) including a virtual space is gradually rising. In the running process of the entertainment product, the space region operated by the user needs to be rendered based on the creation resources of the virtual space frequently, so that how to efficiently complete the rendering of the space region is important.
Disclosure of Invention
The present disclosure provides a data processing method, apparatus, device, and medium for meta-universe.
According to an aspect of the present disclosure, there is provided a data processing method including:
responding to control operation of a virtual space, and determining a target area corresponding to an operation position of the virtual space;
determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area; the rendering device is cloud device and/or user terminal;
and rendering the target area through the cloud device and/or the user side.
According to another aspect of the present disclosure, there is provided an electronic device including:
At least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data processing method of any one of the embodiments of the present disclosure.
According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the data processing method of any of the embodiments of the present disclosure.
According to another aspect of the present disclosure, there is provided a data processing system comprising: the cloud terminal comprises a user terminal and cloud terminal equipment;
the user side is used for executing the data processing method of any embodiment of the disclosure;
the cloud end device is connected with the user end and is used for providing rendering service of the target area for the user end under the condition that the rendering device of the target area comprises the cloud end device.
According to the scheme, the user operation area can be efficiently rendered in the running process of the virtual space product.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
FIG. 1 is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure;
FIG. 2A is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure;
FIG. 2B is a schematic diagram of a rendering process for a target region provided in accordance with an embodiment of the present disclosure;
FIG. 3A is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure;
3B-3C are schematic illustrations of a rendering process for another target region provided in accordance with an embodiment of the present disclosure;
FIG. 4 is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure;
FIG. 5 is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a data processing system provided in accordance with an embodiment of the present disclosure;
FIG. 7 is a schematic diagram of a data processing apparatus provided according to an embodiment of the present disclosure;
fig. 8 is a block diagram of an electronic device for implementing a data processing method of an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
FIG. 1 is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure; the embodiment of the disclosure is suitable for the situation that the user side renders the operation area (namely the target area) of the virtual space based on the control operation of the user in the virtual space. The method is particularly suitable for the situation that the operation area in the world space is rendered based on the control operation of the user in the world space of the metauniverse and the like in the running process of entertainment products such as the metauniverse. The method may be performed by a data processing device, which may be implemented in software and/or hardware. And in particular, may be integrated in a client having virtual space rendering requirements. As shown in fig. 1, the data processing method provided in this embodiment may include:
s101, responding to control operation of the virtual space, and determining a target area corresponding to the operation position of the virtual space.
The virtual space may be a virtual activity space simulating a real world provided for a user by an entertainment product such as a meta-universe or a game including a movable interface. For example, for a metauniverse product, its virtual space may be a virtual world that maps with the real world and that can interact with the user. For games that include a movable interface, the virtual space may be a virtual world in which a virtual object (e.g., a virtual character operated by a user) in the game is located during movement of the game interface. The control operation of the virtual space may be an operation triggered in the virtual space by a user in using an entertainment product containing the virtual space. It should be noted that, the control operation of the virtual space may be triggered by an external device (such as a mouse, a keyboard, or a handle), or may be triggered by clicking or sliding, or may be triggered by voice or gestures. This is not limited. For example, an operation of controlling the virtual space or the movement of a virtual object in the virtual space triggered by clicking a certain position of the virtual space may be mentioned. The operation position of the virtual space may be a trigger position in the virtual space when the user triggers a control operation of the virtual space. For example, if the control operation of the user in the virtual space is triggered by the click operation, the click position of the user in the virtual space is taken as the operation position of the virtual space.
Typically, the range of virtual space contained in an entertainment product is large, e.g., the virtual space of a metauniverse product is mapped to the real world, and its corresponding spatial range must be very large. Therefore, in order to ensure the smoothness of use of entertainment products, when the user side displays the virtual space to the user, the user side does not render all the virtual spaces, and usually only the part of the virtual space to be displayed to the user or the newly added part of the virtual space to be displayed compared with the currently displayed space is rendered. The target area in this embodiment may be the portion of the virtual space that needs to be displayed to the user, or the portion of the virtual space to be displayed that is newly added compared to the currently displayed space. Optionally, in this embodiment, the entire virtual space may be divided into a plurality of sub-areas according to a certain rule in advance, and the sub-area where the operation position of the virtual space is located is taken as the target area.
Optionally, in this embodiment, in response to a control operation of a user in a virtual space, the user side maps a touch position of the control operation in an actual space to the virtual space to obtain an operation position in the virtual space, and then uses an area corresponding to the operation position in the virtual space as the target area. Specifically, one implementation manner of determining the operation position in the target area corresponding to the virtual space is as follows: and determining the virtual space region under the operation position visual angle as a target region, or comparing the virtual space region under the operation position visual angle with the space region under the position visual angle before operation, and determining the newly added space region as the target region. Another implementation is: based on a division result of the virtual space in advance, judging a subarea where the operation position of the virtual space is located, and taking the subarea as a target area.
Alternatively, the user side may also interact with a backend server (e.g. a virtual space server) to determine a target area corresponding to the operation position of the virtual space, for example, control operation triggered by the user is forwarded to the backend server, and the backend server determines, according to the trigger position of the user, the target area corresponding to the operation position of the virtual space and feeds back the target area to the user side.
S102, determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area.
Wherein the target resource is an environment creation resource required when rendering the target area. The rendering device is a device that performs rendering of a target area based on a target resource. The alternative rendering device in this embodiment includes two types of cloud devices and a client. The cloud device may be an external server device that provides a cloud rendering service. The user terminal is the user terminal of the entertainment product containing the virtual space, namely, the user terminal acted by the control operation of the virtual space. Alternatively, the rendering device of the target area determined in this embodiment may include only: the cloud device may also only include a user terminal, and may also include the cloud device and the user terminal at the same time.
Optionally, in this embodiment, the local space resources corresponding to a part of the virtual area may be stored in the local space of the user side due to some reasons, such as updating and upgrading of entertainment products or limitation of local memory of the user side, but the stored space resources may not be comprehensive and accurate enough, for example, only the resources of the high-frequency space area may be stored, and also the stored space resource versions of some virtual areas may be outdated. Therefore, after determining the target area to be rendered, the user side of the embodiment can firstly judge whether the target resources required for rendering the target area are locally stored, and if all the target resources required for rendering the target area are locally stored, the rendering device of the target area is determined to be the user side, namely the local device of the user side; if the target resources needed for rendering the target area are not stored locally, determining rendering equipment of the target area as cloud equipment; if part of the target resources needed for rendering the target area are locally stored, determining rendering equipment of the target area corresponding to the part of the locally stored target resources as a user side, and determining rendering equipment of the target area corresponding to the part of the locally non-stored target resources as cloud equipment.
Optionally, the specific manner of determining whether the target resource needed for rendering the target area is locally stored in this embodiment may be: a target resource list is maintained locally, and the mapping relation between the version identification of the local storage target resource and the area identification of the target area is recorded in the target resource list. At this time, whether the version identifier of the target resource associated with the region identifier is stored or not may be searched in the mapping relationship based on the region identifier of the target region, if not, it is indicated that the target resource corresponding to the target region is not stored locally, if so, it is further determined whether the target resource is out of date based on the version identifier of the target resource, if so, it is indicated that the target resource corresponding to the target region is not stored locally, and if not, it is indicated that the target resource corresponding to the target region is stored locally.
And S103, rendering the target area through the cloud device and/or the user side.
Optionally, if the rendering device of the target area determined in S102 is a cloud device, at this time, the client may request the cloud device to remotely assist itself to complete rendering of the target area. Specifically, the client may send a cloud rendering request carrying a target area identifier to the cloud device, so that the cloud device obtains a target resource corresponding to the target area identifier based on the target area identifier, invokes a rendering parameter corresponding to the target area, renders the target area based on the target resource, and feeds back a rendering result (i.e., a virtual space image corresponding to the rendered target area) to the client.
If the rendering device of the target area determined in S102 is the user terminal, rendering of the target area needs to be completed locally at the user terminal, and at this time, the user terminal may obtain a target resource corresponding to the target area from the locally stored space resource, and then call the rendering parameter corresponding to the target area, and render the target area based on the target resource.
If the rendering device of the target area determined in S102 is the cloud device and the user side, the user side may render the portion of the target area (i.e., the first target area) based on the locally stored portion of the target resource and based on the rendering parameter corresponding to the target area, and at the same time, for the portion of the target resource that is not locally stored, request the cloud device to render the portion of the target area (i.e., the second target area), and obtain the rendering result of the cloud device on the second target area.
Optionally, in this embodiment, no matter the cloud device or the user side, when rendering the target area, two-dimensional (2D) rendering logic may be adopted, or three-dimensional (3D) rendering logic may be adopted, specifically, which rendering logic may be adopted according to actual display forms of the Virtual space on different types of user sides, for example, for a Virtual Reality (VR) type user side, the corresponding rendering logic may be 3D rendering logic, and for a client (i.e., mobile side) or a personal computer (Personal Computer, PC) side, the corresponding rendering logic may be 2D rendering logic. The local user side can determine specific rendering logic to render according to the form of displaying the virtual space, or the determined rendering logic is carried in a cloud rendering request and sent to the cloud device.
Optionally, after obtaining a rendering result of the target area, that is, a virtual space image corresponding to the rendered target area, the user side device displays the virtual space image to a user through a user side display screen, so that the user triggers a next control operation based on the displayed virtual space image.
According to the scheme of the embodiment of the disclosure, the user side responds to the control operation of the virtual space, determines the target area corresponding to the operation position of the virtual space, further determines rendering equipment for the target area according to the local storage condition of target resources of the target area, and renders the target area through the rendering equipment. According to the scheme, the user side can flexibly select the rendering equipment of the target area according to the situation that the target resource corresponding to the target area to be rendered is stored locally, and the user operation area is efficiently rendered in the running process of the virtual space product in a seamless switching mode of local rendering and cloud rendering. In addition, compared with the rendering operation of the target area by the fixed user side, when the user side does not need to render the area, the rendering process is paused to perform the resource downloading operation, namely the rendering operation of the user side cannot be interrupted by the resource updating process, so that the continuity of the virtual space effect displayed by the user side is ensured, and the user experience is greatly improved.
Optionally, in this solution, the determining, by the user side, a target area corresponding to an operation position of the virtual space includes: sending a target area query request carrying login account information to a world server, so that the world server queries the operation position of the virtual space according to the login account information, and determines a target area according to the operation position and the area division result of the virtual space; and acquiring a target area fed back by the world server. The world server may be a server used by a background of the user end for taking charge of a service related to the virtual space, for example, the world server may manage an operation position of each user end in the virtual space, and may record a region division result of the virtual space. The area division result of the virtual space may be configured by an operator of the entertainment product at the front end of the world server, or may be configured by a special configuration management server and then pushed to the world server, which is not limited.
Specifically, the user side responds to the control operation of the virtual space, generates a target area query request according to the current login account information, and sends the target area query request to the world server, and the world server can query the operation position of the login account in the virtual space after the control operation is executed based on the login account information, then determines the subarea where the operation position is located according to the area division result of the virtual space, takes the subarea as a target area and feeds the target area back to the user side. According to the embodiment, the user side acquires the target area through interaction with the world server, for the local part of the user side, special target area determining logic is not required to be configured, and the area dividing result of the whole virtual space is maintained, so that the occupation of the local memory of the user side is greatly reduced, the running power consumption of the user side is reduced, and the target area determining logic and the area dividing result of the whole virtual space are configured in the special world server, so that the maintenance of the target area determining logic and the area dividing result is facilitated, and the maintenance cost is reduced.
FIG. 2A is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure; fig. 2B is a schematic diagram of a rendering process of a target area according to an embodiment of the present disclosure. Based on the foregoing embodiments, the embodiments of the present disclosure further explain in detail how to render a target area through a cloud device, as shown in fig. 2A-2B, a data processing method provided in this embodiment may include:
s201, in response to control operation of the virtual space, determining a target area corresponding to an operation position of the virtual space.
S202, determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area.
The rendering device is cloud device and/or user terminal.
S203, if the rendering device comprises a cloud device, determining an interaction mode with the cloud device according to the type of the user side.
The type of the ue in this embodiment may depend on the operating system of the terminal device to which the ue belongs or the product of the ue, and may include, but is not limited to: client, PC and VR. For example, if the operating system of the terminal device to which the user side belongs is a microsoft (Window) operating system or an apple computer (macOS) operating system, the type of the user side may be a PC side, if the operating system of the terminal device to which the user side belongs is an apple mobile (iOS) operating system or an Android (Android) operating system, the type of the user side may be a client side, and if the product to which the user side belongs is a virtual reality product, such as an iQiyiVR product, the type of the user side may be a VR side.
Optionally, in this embodiment, the interaction modes of the different types of clients and the cloud device are different, and specifically, for the PC-side type clients, the interaction modes of the PC-side type clients and the cloud device are interaction modes such as mouse movement and keyboard key pressing; for a client-side type user side, the interaction mode of the client-side type user side and the cloud-side equipment is interaction modes such as clicking and sliding through a touch screen; for the VR end type user end, interaction modes with the cloud end device are interaction modes such as a handle, gestures, voice, a head display gyroscope and the like.
S204, controlling the cloud device to render the target area based on the interaction mode.
Optionally, the interaction modes are different, and the rendering logic of the corresponding target area, the version of the target resource required for rendering the target area and the communication mode with the cloud device are different correspondingly. Therefore, in this embodiment, the user side may interact with the cloud device in different ways according to different interaction ways of the cloud device, so as to control the cloud device to render the target area.
Specifically, if the interaction mode is an interaction mode corresponding to the client or the PC, the rendering logic of the target area is a 2D rendering logic at this time, and if the interaction mode is an interaction mode corresponding to the VR, the rendering logic of the area at this time is a 3D rendering logic. The user side can generate a cloud rendering request according to rendering logic corresponding to the interaction mode, version information of the user side, version information of an operating system of terminal equipment where the user side is located and identification information of a target area, the cloud rendering request is sent to the cloud equipment through the corresponding interaction mode of the user side, the cloud equipment determines a version of target resources required for rendering the target area according to the version information of the user side and the version information of the operating system of the terminal equipment where the user side is located, further obtains the target resources corresponding to the version from the cloud according to the identification of the target area, then determines corresponding rendering parameters according to the rendering logic given in the cloud rendering request, further renders the target area according to the target resources and the rendering parameters, and feeds a rendering result back to the user side through the corresponding interaction mode of the user side.
And S205, if the rendering equipment comprises a user terminal, rendering the target area through the user terminal.
Illustratively, as shown in FIG. 2B, assuming that the virtual space is a 4×4 grid space, each grid corresponds to one sub-divided region in the virtual space. S1 and S2 represent virtual space regions where the cloud device can support rendering (i.e., the cloud device can support rendering all virtual space regions), where S1 represents virtual space where the cloud device renders based on the 3D rendering logic and S2 represents virtual space where the cloud device renders based on the 2D rendering logic. S3 represents a virtual space that may need to be rendered locally at the client. If the user side responds to the control operation of the virtual space, it is determined that the target areas corresponding to the operation position of the virtual space are the area 1 and the area 2 in the S3, and the target resource corresponding to the area 1 is not stored locally at the user side, and the target resource corresponding to the area 2 is stored locally at the user side, at this time, the user side may render the area 2 locally based on the locally stored target resource corresponding to the area 2, and add the rendering result to the position corresponding to the area 2. For the region 1, the user side needs to interact with the cloud side device based on the interaction mode of the user side and the cloud side device, so that the cloud side device selects 2D or 3D rendering logic to render the region 1 in the cloud side based on the interaction mode, and the rendering result is fed back to the user side in a mode of controlling video streaming. For example, if the client is the VR end, the cloud device selects the 3D rendering logic to render the region 1, that is, selects the rendering result corresponding to the region 11 in S1 and feeds back the rendering result to the client. If the user terminal is a PC terminal or a client terminal, the cloud terminal equipment selects 2D rendering logic to render the region 1, namely, a rendering result corresponding to the region 21 in the S2 is selected and fed back to the user terminal; the user side adds the control video stream corresponding to the region 21 or the region 11 fed back by the cloud device to the region 1 in S3, so as to complete rendering of the region 1.
According to the scheme, the user side responds to control operation of the virtual space, a target area corresponding to the operation position of the virtual space is determined, rendering equipment is further determined for the target area according to the local storage condition of target resources of the target area, when the rendering equipment is user side equipment, an interaction mode with cloud side equipment is required to be determined according to the type of the user side, and then the cloud side equipment is controlled to render the target area based on the interaction mode. According to the cloud terminal display method and device, different interaction modes are adopted for controlling the cloud terminal device to render the target area aiming at different types of user terminals, for example, communication modes corresponding to the different interaction modes and rendering effects are different, so that the target area rendered by the cloud terminal device is adapted to different user terminals, and the accuracy, diversity and flexibility of the display effect of the user terminals are improved.
FIG. 3A is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure; fig. 3B-3C are schematic diagrams of a rendering process of another target area provided in accordance with an embodiment of the present disclosure. Based on the foregoing embodiments, the embodiments of the present disclosure further explain in detail how to render a target area through a cloud device, as shown in fig. 3A-3C, a data processing method provided in this embodiment may include:
S301, in response to control operation of the virtual space, determining a target area corresponding to an operation position of the virtual space.
S302, determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area.
The rendering device is cloud device and/or user terminal.
S303, if the rendering device comprises a cloud device, the target resource in the cloud device is downloaded to the local while the target region is rendered through the cloud device.
Optionally, in this embodiment, when the rendering device is only a cloud device, or the rendering device includes a cloud device and a user side, the user side may render, through a cloud rendering service of the cloud device, the target area, and meanwhile, through a resource downloading service of the cloud device, a target resource required for rendering the target area is downloaded locally to the user side, and at this time, a spatial resource of a virtual space locally stored by the user side includes a target resource corresponding to the target area. Optionally, in this embodiment, spatial resources of the virtual space may be deployed on a Content Delivery Network (CDN) of the cloud device through a resource service.
It should be noted that, in this embodiment, the target resource corresponding to the target area is already downloaded to the local area while the target area is rendered by the cloud device, so when the determined target area is the same as the determined target area by the user end in response to the control operation of the virtual space, the rendering device of the target area becomes local to the user end, that is, when the user end needs to render the target area, the user end does not need to interact with the cloud device any more, and the local rendering is directly performed. As shown in fig. 3B and 3C, the user side interacts with the cloud device, performs cloud rendering on the region 1 in S3 through a cloud rendering service of the cloud device, and feeds back a cloud rendering result (i.e., the region 11 in S1 or the region S21 in S2) to the user side through a control video stream mode, and meanwhile, the user side further transmits a target resource Z1 required by the rendering region 1 to the user side through a resource downloading service of the cloud device, so that the user side stores the target resource Z1 in a local space resource, and if the user side needs to render the region 1 in S3 later, the rendering of the region 1 can be completed locally through the locally stored target resource Z1.
In addition, it should be further noted that, on the basis of the embodiment, the original installation package of the user side only needs to include the basic data of the operation of the user side, and any space resource corresponding to the virtual space is not needed, so that the volume of the original installation package of the user side is greatly reduced. And further, the success rate of downloading at the user end is improved, and the user end is convenient to propagate and distribute.
According to the scheme of the embodiment of the disclosure, the user side responds to control operation of the virtual space, a target area corresponding to the operation position of the virtual space is determined, rendering equipment is determined for the target area according to the local storage condition of target resources of the target area, and if the rendering equipment comprises cloud equipment, the target area is rendered through the cloud equipment and the target resources are downloaded to the local area. The method and the device complete the downloading of the target resource when the cloud device renders the target area, and can realize the downloading of the target resource under the condition that a user does not feel, so that the whole process of using the user terminal by the user is not interrupted by the process of rendering and resource downloading, the running continuity of the user terminal is greatly improved, in addition, the interaction with the cloud device is not needed when the target area is rendered again, the interaction cost is reduced, and the rendering efficiency is improved.
Optionally, on the basis of the above scheme, the scheme further includes: and deleting the outdated resources in the locally stored space resources in response to the local resource cleaning event. The local resource cleaning event may be an event for cleaning a space resource locally stored in the user terminal, and the local resource cleaning event may be initiated at regular intervals (for example, a week); or the initiation is performed once when the occupied memory of the user terminal is larger than the memory threshold value; or may be initiated once in response to a triggering operation (such as clicking a space cleaning button) by the user on the user side. The expired resources may be resources determined from all of the locally stored spatial resources by a rule-based elimination (LRU) algorithm that need to be temporarily purged from the local. In particular, the expired resource may be at least one of a non-latest version of a space resource, a duplicate storage resource, and a space resource that is used less frequently. The space resource with lower use frequency can be used space resource in a period of time (such as in a week); but also spatial resources, etc. whose frequency is below the frequency threshold are used. According to the scheme, a space resource elimination mechanism is locally introduced at the user terminal, and the expired resources in the local storage space resources are periodically cleared, so that the occupation of the user terminal to the local storage resources of the terminal equipment is further reduced.
FIG. 4 is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure; based on the foregoing embodiments, the embodiments of the present disclosure further explain in detail how to download a target resource in a cloud device to a local area, as shown in fig. 4, where the data processing method provided in this embodiment may include:
s401, in response to control operation of the virtual space, determining a target area corresponding to an operation position of the virtual space.
S402, determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area.
The rendering device is cloud device and/or user terminal.
S403, if the rendering device comprises a cloud device, determining whether a thermal condition is met currently according to a preset reference item while rendering the target area through the cloud device.
The preset reference item may be a basis for measuring whether to download the target resource locally. The preset reference item may include: at least one item of a user end version, an operating system version of a terminal to which the user end belongs, a target area identifier and a rendering channel. The thermal precondition is a correlation rule for judging whether or not to download the target resource locally, and specifically, may be a correlation rule set based on whether or not the content information of the preset reference item satisfies the update condition. The thermal conditions in this embodiment may be set by the operation and maintenance personnel corresponding to the product at the user end according to the development requirement of the product. The thermal more condition can be configured as a fixed condition in the user side in the research and development stage of the user side, and can be sent to the user side through a background server of the user side after being updated according to the product development requirement. This embodiment is not limited.
Optionally, in this embodiment, when the user terminal needs to download the target resource, it may first determine whether the current thermal condition is satisfied based on the preset reference item. Specifically, there are many ways to determine whether the thermal condition is satisfied at present according to the preset reference item, and this embodiment is not limited. One implementation is: whether the content information of the preset reference item meets the thermal condition is judged, for example, whether the version number of the user side belongs to an optional version of the allowable downloading target resource is judged. If the number of the preset reference items is multiple, it may be determined that the thermal condition is currently satisfied when the content information of all the reference items satisfies the thermal condition, or may be determined that the thermal condition is currently satisfied when the content information of at least one reference item satisfies the thermal condition, or the like. Another implementation is: judging whether the preset reference item is complete or not, for example, judging whether the target area identifier is contained or not, if yes, determining that the thermal more condition is met currently. Another implementation is: the two modes are combined, and meanwhile, the content information of the preset reference item and the integrity of the contained item are judged.
Specifically, in this embodiment, if it is determined that the thermal condition is currently met according to the preset reference item, the following operation of downloading the target resource in the cloud device to the local is executed while the target area is being rendered by the cloud device, and if it is determined that the thermal condition is not currently met, the operation of downloading the target resource is not executed while the target area is being rendered by the cloud device.
S404, if yes, downloading the target resource in the cloud device to the local.
According to the scheme of the embodiment of the disclosure, a user side responds to control operation of a virtual space, a target area corresponding to the operation position of the virtual space is determined, rendering equipment is determined for the target area according to the local storage condition of target resources of the target area, if the rendering equipment comprises cloud equipment, the cloud equipment is used for rendering the target area, meanwhile, whether the thermal condition is met currently is determined based on a preset reference item, and if the thermal condition is met, the target resources are downloaded to the local. According to the scheme, whether the user side needs to download the target resources is judged by introducing the preset reference item, and all the target resources are downloaded in a non-blind mode, so that the situation that the downloaded target resources are not suitable for local rendering of the user side or the downloaded target resources are inaccurate due to the fact that the preset reference item does not meet the downloading condition is avoided. The availability of the locally stored space resources is improved.
Optionally, on the basis of the present embodiment, if the number of preset reference items is at least two, determining whether the thermal more condition is currently satisfied according to the preset reference items includes: determining the priority of the preset reference item according to the content information of the preset reference item; and determining whether the thermal more condition is met currently according to the content information and the priority of the preset reference item. The content information of the preset reference item may be at least two items of a specific version number of the user terminal, a specific version number of an operating system of a terminal to which the user terminal belongs, target area identification information and rendering channel information.
Specifically, the process of determining the priority of the preset reference item according to the content information of the preset reference item may be: the initial priority ranking of the at least two preset reference items can be performed according to a default priority rule, then whether the preset reference items need to be adjusted or not is judged according to each preset reference item after the initial ranking, and if so, the priority of the preset reference items is adjusted to obtain the final priority of the at least two preset reference items. For example, if the client version is not the latest version, its priority is shifted backward (e.g., shifted backward by one bit); if the operating system version of the terminal to which the user terminal belongs is not the latest version, the priority of the terminal is moved backwards (for example, moved backwards by one bit); if the target area identifier is not legal identifier, the priority of the target area identifier is moved backwards (for example, moved backwards by one bit); if the rendering channel is not a regular channel, its priority is moved backward (e.g., one bit backward).
One possible way to determine whether the thermal more condition is currently satisfied according to the content information and the priority of the preset reference item is to determine whether the thermal more condition is currently satisfied according to the content information of the preset reference item with the highest priority, and if so, determine that the thermal more condition is currently satisfied. Another implementation way is to set a weight value for each priority, set a first value for the judgment result satisfying the thermal more condition, and set a second value for the judgment result not satisfying the thermal more condition; judging whether the thermal more condition is met at one time according to the content information of each preset reference item, calculating a weighted result according to the numerical value and the weight value corresponding to the judging result, if the weighted result is larger than a judging threshold value, indicating that the thermal more condition is met currently, otherwise, indicating that the thermal more condition is not met currently. When the preset reference items are multiple, the priority of each preset reference item is determined according to the specific content of the reference item, whether the thermal condition is met or not is further determined, and the flexibility and the accuracy of judging whether the thermal condition is met or not are further improved.
Preferentially, the thermal conditions in this embodiment may be flexibly changed according to the operation policy of the product corresponding to the user side, and the manner in which the user side updates the thermal conditions stored locally may be: based on a heartbeat mechanism, acquiring the latest version number of the thermal more condition; the thermal conditions of the local store are updated according to the latest version number. Specifically, in this embodiment, the user side may interact with its background server (e.g. a management server for configuring thermal preconditions) through a heartbeat mechanism, periodically obtain the latest version number of the thermal precondition from the background server, compare the latest version number with the locally stored version number of the thermal precondition, obtain the latest version of the thermal precondition from the background server when the locally stored thermal precondition is not the latest version, and replace the original thermal precondition of the local storage with the latest version of the thermal precondition. The scheme is based on the version of the heartbeat mechanism for regularly monitoring the thermal more condition to update the thermal more condition stored locally, so that the validity and the accuracy of the thermal more condition stored locally are ensured, and the accuracy of the downloaded target resource is further ensured.
FIG. 5 is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure; based on the foregoing embodiments of the present disclosure, further explaining how to determine a rendering device of a target area according to a local storage condition of a target resource corresponding to the target area when the cloud device includes at least two selectable edge devices, as shown in fig. 5, a data processing method provided in this embodiment may include:
S501, in response to control operation of the virtual space, determining a target area corresponding to an operation position of the virtual space.
S502, judging whether target resources corresponding to the target area are locally stored, if so, executing S503, and if not, executing S504.
S503, if the target resources corresponding to the target area are locally stored, determining the rendering equipment of the target area as a user side.
And S504, if the target resources corresponding to the target area are not stored locally, determining target edge equipment from at least two selectable edge equipment according to the target area, and taking the target edge equipment as rendering equipment of the target area.
The optional edge device in this embodiment may be deployed on edge computing nodes at different positions in the virtual space, and may be an electronic device capable of providing area rendering and resource downloading services.
Optionally, one implementation manner of this embodiment is: according to the position of the target area, selecting the selectable edge device closest to the target area from a plurality of selectable edge devices as the target edge device, namely, the selectable edge device is used as the rendering device of the target area. Another implementation is: selecting at least two alternative edge devices which are closer to the target area from a plurality of alternative edge devices according to the position of the target area; and selecting the candidate edge device with the least task amount as the target edge device according to the current task amount of the candidate edge device, namely, the candidate edge device with the least task amount is used as the rendering device of the target area.
And S505, rendering the target area through the user side and/or the target edge equipment.
Optionally, if the rendering device of the target area includes the target edge device, the target resource in the target edge device needs to be downloaded to the local client while the target area is rendered by the target edge device.
According to the scheme of the embodiment of the disclosure, a user side responds to control operation of a virtual space, a target area corresponding to the operation position of the virtual space is determined, if target resources corresponding to the target area are not stored locally, the target edge equipment is determined from at least two selectable edge equipment according to the position of the target area, and the target resources in the target edge equipment are downloaded locally while the target area is rendered through cloud equipment. According to the cloud computing method and device, functions of the cloud device are dispersed into a plurality of selectable edge devices, so that on one hand, the computing pressure of the total cloud device is reduced, on the other hand, the user side downloads target resources from the edge device closest to the user side, the transmission cost of edge computing is reduced, and the transmission efficiency is improved.
Fig. 6 is a schematic diagram of a data processing system according to an embodiment of the present disclosure. As shown in fig. 6, the data processing system 6 of the present embodiment includes a user terminal 61 and a cloud device 62;
The user side 61 is used for the data processing method described in any of the above embodiments; the cloud device 62 is connected to the client 61, and is configured to provide a rendering service of the target area for the client 61 when the rendering device of the target area includes the cloud device 62. The rendering service may be a service that renders the target area based on the target resource and related rendering parameters.
Further, the cloud device 62 in the data processing system 6 is further configured to: while providing the rendering service of the target area for the user terminal 61, a download service of the target resource is provided for the user terminal 61. The download service of the target resource may be a service to which the target resource is transferred in response to a request of the user terminal 61.
Further, the cloud device 62 in the data processing system 6 includes at least two optional edge devices.
Further, the data processing system 6 further includes: the virtual space server 63 is connected to the client 61, and the virtual space server 63 is configured to provide the client 61 with a service for determining the target area. The service of inquiring the operation position of the virtual space according to the login account information and determining the target area according to the operation position and the area division result of the virtual space can be provided.
Further, the data processing system 6 further includes: a management server 64 connected to the client 61 for providing a thermal update service to the client 61. The management server 64 is further connected to the cloud device 62, and is configured to push spatial resources of the rendered virtual space for the cloud device 62; the management server 64 is also connected to the virtual space server 63 for pushing the region division result of the virtual space for the virtual space server 63.
The specific operating principle of the data processing system shown in fig. 6 is described in detail below:
the configuration of the relevant parameters by the operation staff of the product corresponding to the user terminal 61 may be performed through the front-end interface of the management server 64, for example, and may include, but not limited to: configuring space resources of different versions and different space areas, and packaging the configured space resources; configuring updating rules of a thermal mechanism and corresponding version numbers thereof; the virtual space may be divided into regions, for example, regular division may be performed, or irregular division may be performed.
The management server 64 responds to the front-end configuration to push the newly configured space resource to the cloud device 62, specifically to the optional edge device of the region to which the space resource belongs, and pushes the region division result of the virtual space to the virtual space server 63.
In the running process, the user side 61 responds to the control operation of the virtual space, a target area query request carrying login account information is sent to the world server, the world server queries the operation position of the virtual space according to the login account information, determines a target area according to the operation position and the locally recorded area division result of the virtual space, feeds back the target area to the user side 61, judges whether target resources corresponding to the target area are locally stored after the user side 61 obtains the target area, if yes, renders the target area locally, if not, determines target edge equipment from at least two selectable edge equipment in the cloud equipment 62, and uses the target edge equipment as rendering equipment of the target area, renders the target area through cloud rendering service in the target edge equipment, meanwhile, the user side 61 also determines whether a thermal condition is met currently according to a preset reference item, and if yes, downloads the target resources to the local through resource downloading service in the target edge equipment. After the user terminal 61 finishes rendering the target area, the rendering result is displayed to the user through the display screen.
Alternatively, the client 61 may communicate with the management server 64 based on the heartbeat mechanism timing, obtain the latest version number of the thermal precondition, and update the locally stored thermal precondition according to the latest version number.
Optionally, the user terminal 61 may also delete the expired resources in the locally stored space resources in response to the local resource cleaning event.
It should be noted that, the original installation package of the user terminal in the system may only need to include the basic data of the operation of the user terminal, and no space resource corresponding to the virtual space is needed, so that the volume of the original installation package of the user terminal is greatly reduced. And further, the success rate of downloading at the user end is improved, and the user end is convenient to propagate and distribute.
The system of the embodiment can support the user side to flexibly select the rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area to be rendered, and the user operation area is efficiently rendered in the running process of the virtual space product in a seamless switching mode of local rendering and cloud rendering. In addition, when the user side does not need to render in the area, the rendering process is suspended to perform the resource downloading operation, namely the rendering operation of the user side is not interrupted by the resource updating process, so that the continuity of the virtual space effect displayed by the user side is ensured, and the user experience is greatly improved.
Fig. 7 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present disclosure, where the embodiment of the present disclosure is applicable to a case where a user side renders an operation area (i.e., a target area) of a virtual space based on a control operation of a user in the virtual space. The method is particularly suitable for the situation that the operation area in the world space is rendered based on the control operation of the user in the world space of the metauniverse and the like in the running process of entertainment products such as the metauniverse. The device can be configured in a user terminal with virtual space rendering requirement, and is realized by adopting software and/or hardware, and the device can realize the data processing method of any embodiment of the disclosure. As shown in fig. 7, the data processing apparatus 700 includes:
a target area determining module 701, configured to determine a target area corresponding to an operation position of a virtual space in response to a control operation of the virtual space;
a rendering device determining module 702, configured to determine a rendering device of the target area according to a local storage condition of a target resource corresponding to the target area; the rendering device is cloud device and/or user terminal;
and the region rendering module 703 is configured to render, through the cloud device and/or the client, the target region.
According to the scheme of the embodiment of the disclosure, the user side responds to the control operation of the virtual space, determines the target area corresponding to the operation position of the virtual space, further determines rendering equipment for the target area according to the local storage condition of target resources of the target area, and renders the target area through the rendering equipment. According to the scheme, the user side can flexibly select the rendering equipment of the target area according to the situation that the target resource corresponding to the target area to be rendered is stored locally, and the user operation area is efficiently rendered in the running process of the virtual space product in a seamless switching mode of local rendering and cloud rendering. In addition, compared with the rendering operation of the target area by the fixed user side, when the user side does not need to render the area, the rendering process is paused to perform the resource downloading operation, namely the rendering operation of the user side cannot be interrupted by the resource updating process, so that the continuity of the virtual space effect displayed by the user side is ensured, and the user experience is greatly improved.
Further, if the rendering device includes a cloud device, the region rendering module 703 is specifically configured to:
according to the type of the user side, determining an interaction mode with the cloud device;
And controlling the cloud device to render the target area based on the interaction mode.
Further, the data processing apparatus 700 further includes:
the resource downloading module is used for downloading the target resource in the cloud device to the local in the process that the region rendering module renders the target region through the cloud device.
Further, the resource downloading module includes:
the heat condition judging unit is used for determining whether the heat condition is met currently according to a preset reference item; wherein, the preset reference items comprise: at least one item of a user end version, an operating system version of a terminal to which the user end belongs, a target area identifier and a rendering channel;
and the resource downloading unit is used for downloading the target resource in the cloud equipment to the local in the process that the region rendering module renders the target region through the cloud equipment if the target resource is satisfied.
Further, if the number of the preset reference items is at least two, the thermal more condition determining unit is specifically configured to:
determining the priority of the preset reference item according to the content information of the preset reference item;
And determining whether the thermal more condition is met currently according to the content information and the priority of the preset reference item.
Further, the data processing apparatus 700 further includes:
a thermal conditioning configuration module for: based on a heartbeat mechanism, acquiring the latest version number of the thermal more condition; and updating the thermal more condition of the local storage according to the latest version number.
Further, the cloud device comprises at least two selectable edge devices; the rendering device determining module 701 is specifically configured to:
and if the target resource corresponding to the target area is not stored locally, determining target edge equipment from the at least two selectable edge equipment according to the target area, and taking the target edge equipment as rendering equipment of the target area.
Further, the target area determining module 701 is specifically configured to:
sending a target area query request carrying login account information to a world server, so that the world server queries an operation position of a virtual space according to the login account information, and determines a target area according to the operation position and an area division result of the virtual space;
and acquiring the target area fed back by the world server.
Further, the data processing apparatus 700 further includes:
and the local resource cleaning module is used for responding to the local resource cleaning event and deleting the outdated resources in the locally stored space resources.
The product can execute the method provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of executing the method.
In the technical scheme of the disclosure, the related user end performs the data related to the regional rendering, such as the control operation, the operation position, the target region, the target resource, the user end version, the operating system version of the terminal to which the user end belongs, the target region identification, the rendering channel and the like, and the storage, the application and the like all conform to the regulations of related laws and regulations, and do not violate the conventions of the public order.
According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.
Fig. 8 illustrates a schematic block diagram of an example electronic device 800 that may be used to implement embodiments of the present disclosure. It should be noted that the electronic device may be a terminal device where the user terminal of the embodiment is located. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile apparatuses, such as personal digital assistants, cellular telephones, smartphones, wearable devices, and other similar computing apparatuses. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 8, the electronic device 800 includes a computing unit 801 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 802 or a computer program loaded from a storage unit 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the electronic device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804.
Various components in electronic device 800 are connected to I/O interface 805, including: an input unit 806 such as a keyboard, mouse, etc.; an output unit 807 such as various types of displays, speakers, and the like; a storage unit 808, such as a magnetic disk, optical disk, etc.; and a communication unit 809, such as a network card, modem, wireless communication transceiver, or the like. The communication unit 809 allows the electronic device 800 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.
The computing unit 801 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 801 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs the respective methods and processes described above, such as a data processing method. For example, in some embodiments, the data processing method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 808. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 800 via the ROM 802 and/or the communication unit 809. When a computer program is loaded into RAM 803 and executed by computing unit 801, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the data processing method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above can be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome. The server may also be a server of a distributed system or a server that incorporates a blockchain.
Artificial intelligence is the discipline of studying the process of making a computer mimic certain mental processes and intelligent behaviors (e.g., learning, reasoning, thinking, planning, etc.) of a person, both hardware-level and software-level techniques. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, and the like; the artificial intelligent software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, a machine learning/deep learning technology, a big data processing technology, a knowledge graph technology and the like.
Cloud computing (cloud computing) refers to a technical system that a shared physical or virtual resource pool which is elastically extensible is accessed through a network, resources can comprise servers, operating systems, networks, software, applications, storage devices and the like, and resources can be deployed and managed in an on-demand and self-service mode. Through cloud computing technology, high-efficiency and powerful data processing capability can be provided for technical application such as artificial intelligence and blockchain, and model training.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel, sequentially, or in a different order, provided that the desired results of the disclosed aspects are achieved, and are not limited herein.
The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims (15)

1. A data processing method, comprising:
responding to control operation of a virtual space, and determining a target area corresponding to an operation position of the virtual space;
determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area; the rendering device is cloud device; the cloud device comprises at least two selectable edge devices;
the determining the rendering device of the target area according to the local storage condition of the target resource corresponding to the target area includes:
if the target resource corresponding to the target area is not stored locally, determining target edge equipment from the at least two selectable edge equipment according to the target area, and taking the target edge equipment as rendering equipment of the target area;
Rendering the target area through the cloud device;
the rendering, by the cloud device, the target area includes:
according to the type of the user side, determining an interaction mode with the cloud device; the types of the user side include: the system comprises a client, a PC (personal computer) terminal and a VR (virtual reality) terminal; the client comprises: the mobile terminal comprises an apple mobile terminal and an android mobile terminal; based on the interaction mode, controlling the cloud device to render the target area comprises the following steps:
if the interaction mode is the interaction mode corresponding to the client or the PC end, the rendering logic of the target area is 2D rendering logic, and if the interaction mode is the interaction mode corresponding to the VR end, the rendering logic of the target area is 3D rendering logic; the user side generates a cloud rendering request according to rendering logic corresponding to the interaction mode, user side version information, operating system version information of terminal equipment where the user side is located and identification information of the target area, and sends the cloud rendering request to the cloud equipment through the corresponding interaction mode of the user side; the cloud device determines the version of a target resource required for rendering the target area according to the version information of the user side and the version information of an operating system of the terminal device where the user side is located, further obtains the target resource corresponding to the version from the cloud according to the identification of the target area, then determines corresponding rendering parameters according to rendering logic given in a cloud rendering request, further renders the target area according to the target resource and the rendering parameters, and feeds back a rendering result to the user side in an interactive mode corresponding to the user side;
Wherein, in the process of rendering the target area through the cloud device, the method further comprises:
downloading the target resource in the cloud device to a local area includes:
determining whether a thermal more condition is met currently according to a preset reference item; wherein, the preset reference items comprise: at least one item of a user end version, an operating system version of a terminal to which the user end belongs, a target area identifier and a rendering channel;
if yes, downloading the target resource in the cloud device to a local place;
if the number of the preset reference items is at least two, determining whether the current thermal condition is satisfied according to the preset reference items includes:
determining the priority of the preset reference item according to the content information of the preset reference item;
and determining whether the thermal more condition is met currently according to the content information and the priority of the preset reference item.
2. The method of claim 1, further comprising:
based on a heartbeat mechanism, acquiring the latest version number of the thermal more condition;
and updating the thermal more condition of the local storage according to the latest version number.
3. The method of claim 1, wherein the determining a target area corresponding to an operation position of the virtual space comprises:
Sending a target area query request carrying login account information to a world server, so that the world server queries an operation position of a virtual space according to the login account information, and determines a target area according to the operation position and an area division result of the virtual space;
and acquiring the target area fed back by the world server.
4. A method according to any one of claims 1-3, further comprising:
and deleting the outdated resources in the locally stored space resources in response to the local resource cleaning event.
5. A data processing apparatus comprising:
the target area determining module is used for responding to the control operation of the virtual space and determining a target area corresponding to the operation position of the virtual space;
the rendering equipment determining module is used for determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area; the rendering device is cloud device; the cloud device comprises at least two selectable edge devices;
the rendering device determining module is specifically configured to:
if the target resource corresponding to the target area is not stored locally, determining target edge equipment from the at least two selectable edge equipment according to the target area, and taking the target edge equipment as rendering equipment of the target area;
The region rendering module is used for rendering the target region through the cloud device;
the region rendering module is specifically configured to:
according to the type of the user side, determining an interaction mode with the cloud device; the types of the user side include: the system comprises a client, a PC (personal computer) terminal and a VR (virtual reality) terminal; the client comprises: the mobile terminal comprises an apple mobile terminal and an android mobile terminal;
based on the interaction mode, the cloud device is controlled to render the target area;
the region rendering module is further specifically configured to:
if the interaction mode is the interaction mode corresponding to the client or the PC end, the rendering logic of the target area is 2D rendering logic, and if the interaction mode is the interaction mode corresponding to the VR end, the rendering logic of the target area is 3D rendering logic; the user side generates a cloud rendering request according to rendering logic corresponding to the interaction mode, user side version information, operating system version information of terminal equipment where the user side is located and identification information of the target area, and sends the cloud rendering request to the cloud equipment through the corresponding interaction mode of the user side; the cloud device determines the version of a target resource required for rendering the target area according to the version information of the user side and the version information of an operating system of the terminal device where the user side is located, further obtains the target resource corresponding to the version from the cloud according to the identification of the target area, then determines corresponding rendering parameters according to rendering logic given in a cloud rendering request, further renders the target area according to the target resource and the rendering parameters, and feeds back a rendering result to the user side in an interactive mode corresponding to the user side;
The resource downloading module is used for downloading the target resource in the cloud equipment to the local in the process of rendering the target area through the cloud equipment by the area rendering module;
wherein, the resource downloading module comprises:
the heat condition judging unit is used for determining whether the heat condition is met currently according to a preset reference item; the preset reference item comprises at least one item of a user end version, an operating system version of a terminal to which the user end belongs, a target area identifier and a rendering channel;
the resource downloading unit is used for downloading the target resource in the cloud equipment to the local in the process that the region rendering module renders the target region through the cloud equipment if the target resource is satisfied;
if the number of the preset reference items is at least two, the thermal more condition judging unit is specifically configured to:
determining the priority of the preset reference item according to the content information of the preset reference item;
and determining whether the thermal more condition is met currently according to the content information and the priority of the preset reference item.
6. The apparatus of claim 5, further comprising:
a thermal conditioning configuration module for: based on a heartbeat mechanism, acquiring the latest version number of the thermal more condition; and updating the thermal more condition of the local storage according to the latest version number.
7. The apparatus of claim 5, wherein the target area determination module is specifically configured to:
sending a target area query request carrying login account information to a world server, so that the world server queries an operation position of a virtual space according to the login account information, and determines a target area according to the operation position and an area division result of the virtual space;
and acquiring the target area fed back by the world server.
8. The apparatus of any of claims 5-7, further comprising:
and the local resource cleaning module is used for responding to the local resource cleaning event and deleting the outdated resources in the locally stored space resources.
9. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data processing method of any one of claims 1-4.
10. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the data processing method according to any one of claims 1-4.
11. A data processing system, comprising: the cloud terminal comprises a user terminal and cloud terminal equipment;
wherein the client is configured to perform the data processing method of any one of claims 1 to 4;
the cloud end device is connected with the user end and is used for providing rendering service of the target area for the user end under the condition that the rendering device of the target area comprises the cloud end device.
12. The system of claim 11, wherein the cloud device is further to: and providing a target resource downloading service for the user side while providing a rendering service of the target area for the user side.
13. The system of claim 11 or 12, wherein the cloud device comprises: at least two optional edge devices.
14. The system of any of claims 11-12, further comprising:
a virtual space server connected with the user terminal,
the virtual space server is used for providing a determining service of a target area for the user side.
15. The system of claim 14, further comprising:
the management server is connected with the user side and is used for providing a thermal more condition updating service for the user side;
the management server is also connected with the cloud device and is used for pushing and rendering space resources of the virtual space for the cloud device;
The management server is also connected with the virtual space server and is used for pushing the regional division result of the virtual space for the virtual space server.
CN202210443914.XA 2022-04-25 2022-04-25 Data processing method, device, equipment and medium for meta universe Active CN114972594B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210443914.XA CN114972594B (en) 2022-04-25 2022-04-25 Data processing method, device, equipment and medium for meta universe

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210443914.XA CN114972594B (en) 2022-04-25 2022-04-25 Data processing method, device, equipment and medium for meta universe

Publications (2)

Publication Number Publication Date
CN114972594A CN114972594A (en) 2022-08-30
CN114972594B true CN114972594B (en) 2023-08-29

Family

ID=82979696

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210443914.XA Active CN114972594B (en) 2022-04-25 2022-04-25 Data processing method, device, equipment and medium for meta universe

Country Status (1)

Country Link
CN (1) CN114972594B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116150540B (en) * 2023-04-19 2023-07-28 山东捷瑞数字科技股份有限公司 System and method for realizing one-key switching of exhibition item content based on meta universe and cloud platform
CN116758201B (en) * 2023-08-16 2024-01-12 淘宝(中国)软件有限公司 Rendering processing method, device and system of three-dimensional scene and computer storage medium
CN117319226B (en) * 2023-11-29 2024-02-23 中南大学 Meta universe-based data processing method and device, electronic equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110941342A (en) * 2019-12-04 2020-03-31 中国联合网络通信集团有限公司 Data processing method, VR terminal and server
CN112791399A (en) * 2021-02-08 2021-05-14 腾讯科技(深圳)有限公司 Method, device, system, medium and electronic equipment for displaying cloud game picture

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111135558B (en) * 2019-12-26 2023-08-22 网易(杭州)网络有限公司 Game synchronization method, game client, computer storage medium and electronic device
CN112891936A (en) * 2021-02-10 2021-06-04 广州虎牙科技有限公司 Virtual object rendering method and device, mobile terminal and storage medium
CN113468456B (en) * 2021-07-12 2022-04-22 工银科技有限公司 Webpage rendering method and device, electronic equipment and computer-readable storage medium
CN114225386A (en) * 2021-11-15 2022-03-25 腾讯科技(深圳)有限公司 Scene picture coding method and device, electronic equipment and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110941342A (en) * 2019-12-04 2020-03-31 中国联合网络通信集团有限公司 Data processing method, VR terminal and server
CN112791399A (en) * 2021-02-08 2021-05-14 腾讯科技(深圳)有限公司 Method, device, system, medium and electronic equipment for displaying cloud game picture

Also Published As

Publication number Publication date
CN114972594A (en) 2022-08-30

Similar Documents

Publication Publication Date Title
CN114972594B (en) Data processing method, device, equipment and medium for meta universe
CN113259433B (en) Method, device and system for optimizing user interface data cache for future actions
CN106846040A (en) Virtual present display methods and system in a kind of direct broadcasting room
WO2013043716A2 (en) Remote process execution management
US20130073601A1 (en) Remote process execution management
WO2022048329A1 (en) Menu display method and apparatus
US20230036515A1 (en) Control method for game accounts, apparatus, medium, and electronic device
CN110992112A (en) Method and device for processing advertisement information
CN112843680A (en) Picture display method and device, terminal equipment and storage medium
CN111782229B (en) Method and device for starting small program and electronic equipment
CN113452535A (en) Upgrading method, information processing method and device and electronic equipment
WO2022016981A1 (en) Image processing methods and apparatus, storage medium, and electronic device
CN113656533A (en) Tree control processing method and device and electronic equipment
CN113419865A (en) Cloud resource processing method, related device and computer program product
JP2017056038A (en) Program for determining resource distribution for rendering by predicting player's intention, electronic device, system, and method
CN106933449B (en) Icon processing method and device
CN111035919A (en) Operation mode determination method, device, equipment and storage medium
CN111510376B (en) Image processing method and device and electronic equipment
CN114669052A (en) Game control method, device, equipment and storage medium
CN112346512A (en) Time synchronization method and device
CN113436604A (en) Method and device for broadcasting content, electronic equipment and storage medium
CN115334321B (en) Method and device for acquiring access heat of video stream, electronic equipment and medium
CN116271830B (en) Behavior control method, device, equipment and storage medium for virtual game object
CN118045338A (en) Game operation control method, game operation control device, electronic equipment and computer storage medium
CN113961792B (en) Resource recommendation system, method, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant