CN114972594A - Data processing method, device, equipment and medium for meta universe - Google Patents

Data processing method, device, equipment and medium for meta universe Download PDF

Info

Publication number
CN114972594A
CN114972594A CN202210443914.XA CN202210443914A CN114972594A CN 114972594 A CN114972594 A CN 114972594A CN 202210443914 A CN202210443914 A CN 202210443914A CN 114972594 A CN114972594 A CN 114972594A
Authority
CN
China
Prior art keywords
target area
rendering
target
cloud
virtual space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210443914.XA
Other languages
Chinese (zh)
Other versions
CN114972594B (en
Inventor
陈相礼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202210443914.XA priority Critical patent/CN114972594B/en
Publication of CN114972594A publication Critical patent/CN114972594A/en
Application granted granted Critical
Publication of CN114972594B publication Critical patent/CN114972594B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/005General purpose rendering architectures
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/66Methods for processing data by generating or executing the game program for rendering three dimensional images
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present disclosure provides a data processing method, apparatus, device, and medium for a metasma, which relate to the technical field of computers, and in particular, to the technical field of cloud computing, internet of things, augmented/virtual reality, and computer vision, and may be applicable to metasma scenes. The specific implementation scheme is as follows: responding to the control operation of the virtual space, and determining a target area corresponding to the operation position of the virtual space; determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area; the rendering device is cloud equipment and/or a user side; and rendering the target area through the cloud equipment and/or the user end. The method can realize the efficient rendering of the user operation area in the running process of the virtual space product.

Description

Data processing method, device, equipment and medium for meta universe
Technical Field
The present disclosure relates to the field of computer technology, and in particular to the field of cloud computing, internet of things, augmented/virtual reality, and computer vision technologies, applicable to metastic scenes.
Background
With the development of the technologies of the internet of things of ACG (Animation, communications, Games, Animation, cartoon, game), an entertainment product (such as a meta space product or a game product including a movable interface) including a virtual space is gradually emerging. In the operation process of the entertainment product, the space region operated by a user needs to be rendered frequently based on the creation resource of the virtual space, so how to efficiently finish rendering the space region is very important.
Disclosure of Invention
The present disclosure provides a data processing method, apparatus, device, and medium for a metasma.
According to an aspect of the present disclosure, there is provided a data processing method including:
responding to the control operation of the virtual space, and determining a target area corresponding to the operation position of the virtual space;
determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area; the rendering device is cloud equipment and/or a user side;
and rendering the target area through the cloud equipment and/or the user end.
According to another aspect of the present disclosure, there is provided an electronic device including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data processing method of any of the embodiments of the present disclosure.
According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the data processing method of any one of the embodiments of the present disclosure.
According to another aspect of the present disclosure, there is provided a data processing system comprising: a user side and a cloud device;
the user side is used for executing the data processing method of any embodiment of the disclosure;
the cloud device is connected with the user side and used for providing rendering service of the target area for the user side under the condition that the rendering device of the target area comprises the cloud device.
According to the scheme of the embodiment of the disclosure, the user operation area can be efficiently rendered in the running process of the virtual space product.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
fig. 1 is a flow chart of a data processing method provided according to an embodiment of the present disclosure;
fig. 2A is a flow chart of a data processing method provided according to an embodiment of the present disclosure;
fig. 2B is a schematic diagram of a rendering process of a target area according to an embodiment of the present disclosure;
FIG. 3A is a flow chart of a data processing method provided according to an embodiment of the present disclosure;
3B-3C are schematic diagrams of another rendering process of a target area provided according to an embodiment of the disclosure;
FIG. 4 is a flow chart of a data processing method provided in accordance with an embodiment of the present disclosure;
FIG. 5 is a flow chart of a data processing method provided according to an embodiment of the present disclosure;
FIG. 6 is a block diagram of a data processing system provided in accordance with an embodiment of the present disclosure;
FIG. 7 is a schematic structural diagram of a data processing apparatus provided in accordance with an embodiment of the present disclosure;
fig. 8 is a block diagram of an electronic device for implementing a data processing method of an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a flow chart of a data processing method provided according to an embodiment of the present disclosure; the embodiment of the disclosure is suitable for the situation that the user side renders the operation area (namely the target area) of the virtual space based on the control operation of the user in the virtual space. The method is particularly suitable for rendering the operation area in the world space based on the control operation of the user in the world space of the meta universe in the operation process of entertainment products such as the meta universe. The method may be performed by a data processing apparatus, which may be implemented in software and/or hardware. The method can be particularly integrated in a user side with virtual space rendering requirements. As shown in fig. 1, the data processing method provided in this embodiment may include:
and S101, responding to the control operation of the virtual space, and determining a target area corresponding to the operation position of the virtual space.
The virtual space can be a virtual activity space simulating a real world provided for a user by entertainment products such as a metasma or a game including a movable interface. For example, for a metastic product, its virtual space may be a virtual world that maps with the real world and that can interact with the user. For a game that includes a movable interface, the virtual space may be a virtual world in which a virtual object (e.g., a user-operated virtual character) in the game is located during movement of the game interface. The control operation of the virtual space may be an operation that is triggered in the virtual space by a user during use of an entertainment product that includes the virtual space. It should be noted that the control operation of the virtual space may be triggered by an external device (such as a mouse, a keyboard, a handle, or the like), may be triggered by clicking or sliding, and may also be triggered by voice, gesture, or the like. This is not limitative. For example, the operation of controlling the movement of a virtual space or a virtual object in a virtual space may be triggered by clicking a certain position of the virtual space. The operation position of the virtual space may be a trigger position in the virtual space when the user triggers a control operation of the virtual space. For example, if a control operation of the user in the virtual space is triggered by a click operation, the click position of the user in the virtual space is set as the operation position in the virtual space.
Typically, the range of virtual spaces contained in entertainment products is large, for example, the virtual space of a meta space product is mapped to the real world, and the corresponding spatial range must be very large. Therefore, in order to ensure the fluency of the use of entertainment products, the user end does not render all the virtual spaces when showing the virtual spaces to the user, and generally only renders the part of the virtual space to be shown to the user, or the newly added part of the virtual space to be shown compared with the currently shown space. The target area of this embodiment may be the portion of the virtual space that needs to be presented to the user, or a newly added portion of the virtual space to be presented compared to the currently presented space. Optionally, in this embodiment, the entire virtual space may be divided into a plurality of sub-regions according to a certain rule in advance, and the sub-region where the operation position of the virtual space is located is used as the target region.
Optionally, in this embodiment, in response to a control operation of a user in a virtual space, the user side first maps a touch position of the control operation in an actual space to the virtual space to obtain an operation position in the virtual space, and then takes an area of the operation position corresponding to the virtual space as a target area. Specifically, one implementation manner of determining the target area corresponding to the operation position in the virtual space is as follows: and determining the virtual space area under the operating position view angle as a target area, or comparing the virtual space area under the operating position view angle with the space area under the position view angle before operation, and determining a newly-added space area as the target area. Another way to implement this is: and judging a sub-region where the operation position of the virtual space is located based on the division result of the virtual space in advance, and taking the sub-region as a target region.
Optionally, the user side may also interact with a backend server (e.g., a virtual space server) of the user side to determine a target area corresponding to the operation position of the virtual space, for example, control operation triggered by the user is forwarded to the backend server, and the backend server determines the target area corresponding to the operation position of the virtual space according to the trigger position of the user and feeds the target area back to the user side.
S102, according to the storage condition of the target resource corresponding to the target area in the local area, the rendering device of the target area is determined.
Wherein the target resource is an environment creation resource required when rendering the target area. The rendering apparatus is an apparatus that performs rendering of a target region based on a target resource. The rendering device available for the embodiment includes a cloud device and a user side. The cloud device may be an external server device providing cloud rendering services. The user side is the user side of the entertainment product containing the virtual space, namely the user side acted by the control operation of the virtual space. Optionally, the rendering device of the target area determined by this embodiment may only include: the cloud device may also only include the user side, and may also include both the cloud device and the user side.
Optionally, in this embodiment, due to some reasons, such as update and upgrade of entertainment products or limitation of a local memory of the user terminal, the user terminal may locally store the spatial resources corresponding to part of the virtual areas, but the stored spatial resources are not comprehensive and accurate enough, for example, only the resources in the high-frequency spatial area may be stored, and versions of the stored spatial resources in some virtual areas may be expired. Therefore, after determining the target area to be rendered, the user terminal of this embodiment may first determine whether the target resource required for rendering the target area is stored locally, and if all the target resources required for rendering the target area are stored locally, determine the rendering device of the target area as the user terminal, that is, the local device of the user terminal; if the target resource required for rendering the target area is not stored locally, determining that rendering equipment of the target area is cloud equipment; if a part of target resources required for rendering the target area are locally stored, determining that rendering equipment of the target area corresponding to the locally stored part of target resources is a user side, and determining that rendering equipment of the target area corresponding to the locally non-stored part of target resources is cloud equipment.
Optionally, the specific way of determining whether the target resource required for rendering the target area is locally stored in this embodiment may be: and locally maintaining a target resource list, wherein the list records the mapping relation between the version identification of the locally stored target resource and the area identification of the target area. At this time, whether to store the version identifier of the target resource associated with the area identifier may be first searched in the mapping relationship based on the area identifier of the target area, if not, it is determined that the target resource corresponding to the target area is not locally stored, if so, it is further determined whether the target resource is expired based on the version identifier of the target resource, if so, it is determined that the target resource corresponding to the target area is not locally stored, and if not, it is determined that the target resource corresponding to the target area is locally stored.
And S103, rendering the target area through the cloud equipment and/or the user end.
Optionally, if the rendering device of the target area determined in S102 is a cloud device, at this time, the user terminal may request the cloud device to remotely assist itself in completing the rendering of the target area. Specifically, the user side may send a cloud rendering request carrying a target area identifier to the cloud device, so that the cloud device obtains a target resource corresponding to the target area identifier based on the target area identifier, calls a rendering parameter corresponding to the target area, renders the target area based on the target resource, and feeds back a rendering result (i.e., a virtual space image corresponding to the rendered target area) to the user side.
If the rendering device of the target area determined in S102 is the user side, rendering of the target area needs to be completed locally at the user side, and at this time, the user side may obtain the target resource corresponding to the target area from the locally stored spatial resource, and then call the rendering parameter corresponding to the target area, and render the target area based on the target resource.
If the rendering devices of the target area determined in S102 are the cloud device and the client, the client may render the part of the target area (i.e., the first target area) based on the part of the target resources stored locally and based on the rendering parameters corresponding to the target area, and meanwhile, request the cloud device to render the part of the target area (i.e., the second target area) for the part of the target resources not stored locally, and obtain a rendering result of the cloud device on the second target area.
Optionally, in this embodiment, no matter the cloud device or the user side, when the target area is rendered, a two-dimensional (2-Dimension, 2D) rendering logic may be adopted, a three-dimensional (3-Dimension, 3D) rendering logic may also be adopted, which kind of rendering logic is specifically adopted, and may be determined according to an actual display form of the Virtual space at different types of user sides, for example, for a Virtual Reality (VR) type user side, the corresponding rendering logic may be a 3D rendering logic, and for a client side (i.e., a Mobile side) or a Personal Computer (PC) side, the corresponding rendering logic may be a 2D rendering logic. The client locally can determine a specific rendering logic for rendering according to the form of the virtual space displayed by the client, or the determined rendering logic is carried in the cloud rendering request and is sent to the cloud equipment.
Optionally, after obtaining the rendering result of the target area, that is, the rendered virtual space image corresponding to the target area, the user end device displays the virtual space image to the user through the user end display screen, so that the user triggers the next control operation based on the displayed virtual space image.
According to the scheme of the embodiment, the user side responds to the control operation of the virtual space, determines the target area corresponding to the operation position of the virtual space, further determines the rendering equipment for the target area according to the local storage condition of the target resource of the target area, and renders the target area through the rendering equipment. According to the scheme, the user side can flexibly select the rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area to be rendered, and the user operation area is efficiently rendered in the operation process of the virtual space product in a mode of seamless switching between local rendering and cloud rendering. In addition, compared with the method that the user side performs the rendering operation of the target area, the user side does not need to pause the rendering process to perform the resource downloading operation first when the area is rendered, namely the rendering operation of the user side is not interrupted by the resource updating process, the continuity of the virtual space effect displayed by the user side is ensured, and the user experience is greatly improved.
Optionally, in this scheme, the determining, by the user side, a target area corresponding to the operation position of the virtual space includes: sending a target area query request carrying login account information to a world server so that the world server queries an operation position of a virtual space according to the login account information, and determining a target area according to the operation position and an area division result of the virtual space; and acquiring a target area fed back by the world server. The world server may be a server in which a user background is responsible for services related to the virtual space, for example, the world server may manage an operation position of each user in the virtual space, and may record a result of dividing the area of the virtual space. The result of the regional division of the virtual space may be configured by the operator of the entertainment product at the front end of the world server, or may be configured by a special configuration management server and then pushed to the world server, which is not limited.
Specifically, the user side responds to the control operation of the virtual space, generates a target area query request according to the current login account information, and sends the target area query request to the world server, and the world server can query the operation position of the login account in the virtual space after executing the control operation based on the login account information, then determines the sub-area where the operation position is located according to the area division result of the virtual space, and feeds the sub-area back to the user side as the target area. The user side acquires the target area through interaction with the world server, and for the local user side, the user side does not need to be configured with special target area determining logic and maintain the area dividing result of the whole virtual space, so that the occupation of the local memory of the user side is greatly reduced, the operation power consumption of the user side is reduced, the target area determining logic and the area dividing result of the whole virtual space are configured in the special world server, the target area determining logic and the area dividing result are more conveniently maintained, and the maintenance cost is reduced.
Fig. 2A is a flow chart of a data processing method provided according to an embodiment of the present disclosure; fig. 2B is a schematic diagram of a rendering process of a target area according to an embodiment of the present disclosure. On the basis of the above embodiments, the embodiment of the present disclosure further explains in detail how to render the target area through the cloud device, and as shown in fig. 2A-2B, the data processing method provided in this embodiment may include:
s201, responding to the control operation of the virtual space, and determining a target area corresponding to the operation position of the virtual space.
S202, according to the storage condition of the target resource corresponding to the target area in the local area, the rendering device of the target area is determined.
The rendering device is cloud device and/or a user side.
And S203, if the rendering device comprises a cloud device, determining an interaction mode with the cloud device according to the type of the user side.
The type of the user end of this embodiment may be determined according to the operating system of the terminal device to which the user end belongs or the product of the user end, and may include but is not limited to: client, PC end and VR end. For example, if the operating system of the terminal device to which the user terminal belongs is a microsoft (Window) operating system or an apple computer side (macOS) operating system, the type of the user terminal may be a PC side, if the operating system of the terminal device to which the user terminal belongs is an apple mobile side (iOS) operating system or an Android (Android) operating system, the type of the user terminal may be a client side, and if the product to which the user terminal belongs is a virtual reality product, such as an arcade virtual reality product (iQiyiVR), the type of the user terminal may be a VR side.
Optionally, in this embodiment, different types of clients have different interaction modes with the cloud device, and specifically, for a PC type client, the interaction mode with the cloud device is interaction through mouse movement, keyboard keys, and the like; for a client of the client type, the interaction mode with the cloud device is interaction through touch screen clicking, sliding and the like; for a VR end type user side, the interaction mode of the VR end type user side and cloud equipment is interaction modes such as a handle, a gesture, voice and a head display gyroscope.
And S204, based on the interaction mode, controlling the cloud equipment to render the target area.
Optionally, the interaction modes are different, and the rendering logic of the corresponding target area, the version of the target resource required for rendering the target area, and the communication mode with the cloud device are different accordingly. Therefore, in this embodiment, the user side can interact with the cloud device in different ways according to different interaction ways of the cloud device, so as to control the cloud device to render the target area.
Specifically, if the interaction mode is an interaction mode corresponding to the client or the PC, the rendering logic of the target area is 2D rendering logic, and if the interaction mode is an interaction mode corresponding to the VR, the rendering logic of the target area is 3D rendering logic. The user side can generate a cloud end rendering request according to rendering logic corresponding to the interaction mode, version information of the user side, version information of an operating system of terminal equipment where the user side is located and identification information of a target area, the cloud end rendering request is sent to the cloud end equipment through the interaction mode corresponding to the user side, the cloud end equipment determines the version of target resources required by the rendering target area according to the version information of the user side and the version information of the operating system of the terminal equipment where the user side is located, then the target resources corresponding to the version are obtained from the cloud end according to the identification of the target area, then corresponding rendering parameters are determined according to the rendering logic given in the cloud end rendering request, the target area is rendered according to the target resources and the rendering parameters, and a rendering result is fed back to the user side through the interaction mode corresponding to the user side.
And S205, if the rendering device comprises a user terminal, rendering the target area through the user terminal.
For example, as shown in fig. 2B, the virtual space is assumed to be a 4 × 4 grid space, and each grid corresponds to one sub-divided region in the virtual space. S1 and S2 represent virtual space regions that the cloud device can support rendering (i.e., the cloud device can support rendering all the virtual space regions), where S1 represents a virtual space that the cloud device renders based on 3D rendering logic, and S2 represents a virtual space that the cloud device renders based on 2D rendering logic. S3 represents a virtual space that the user end may need to render locally. If the user side responds to the control operation of the virtual space, it is determined that the target areas corresponding to the operation positions of the virtual space are the area 1 and the area 2 in S3, and the target resource corresponding to the area 1 is not stored locally at the user side, and the target resource corresponding to the area 2 is stored locally at the user side, at this time, the user side may render the area 2 locally based on the target resource corresponding to the locally stored area 2, and add the rendering result to the position corresponding to the area 2. For the area 1, the user side needs to interact with the cloud device based on an interaction mode of the user side and the cloud device, so that the cloud device selects 2D or 3D rendering logic to perform cloud rendering on the area 1 based on the interaction mode, and a rendering result is fed back to the user side in a mode of controlling video streams. For example, if the user side is the VR side, the cloud device selects the 3D rendering logic to render the area 1, that is, selects the rendering result corresponding to the area 11 in S1 to feed back to the user side. If the user side is a PC side or a client side, the cloud device selects a 2D rendering logic to render the area 1, that is, selects the rendering result corresponding to the area 21 in S2 to feed back to the user side; the user side adds the control video stream corresponding to the area 21 or the area 11 fed back by the cloud device to the area 1 in S3, and the rendering of the area 1 is completed.
According to the scheme of the embodiment, the user side responds to the control operation of the virtual space, determines the target area corresponding to the operation position of the virtual space, and then determines the rendering equipment for the target area according to the local storage condition of the target resource of the target area, when the rendering equipment is the user side equipment, the interaction mode with the cloud side equipment needs to be determined according to the type of the user side, and then based on the interaction mode, the cloud side equipment is controlled to render the target area. According to the scheme, different interaction modes are adopted for different types of user sides to control the cloud equipment to render the target area, for example, the communication modes and rendering effects corresponding to the different interaction modes are different, so that the user sides with different target area adaptation rendered by the cloud equipment are enabled to be used, and the accuracy, diversity and flexibility of the user side display effect are improved.
FIG. 3A is a flow chart of a data processing method provided according to an embodiment of the present disclosure; 3B-3C are schematic diagrams of another rendering process of a target area provided according to an embodiment of the disclosure. On the basis of the above embodiments, the embodiment of the present disclosure further explains in detail how to render the target area through the cloud device, and as shown in fig. 3A to 3C, the data processing method provided in this embodiment may include:
and S301, responding to the control operation of the virtual space, and determining a target area corresponding to the operation position of the virtual space.
S302, according to the storage situation of the target resource corresponding to the target area in the local area, the rendering device of the target area is determined.
The rendering device is cloud device and/or a user side.
And S303, if the rendering device comprises a cloud device, downloading the target resource in the cloud device to the local while rendering the target area through the cloud device.
Optionally, in this embodiment, when the rendering device is only a cloud device, or the rendering device includes a cloud device and a user side, the user side may render the target area through a cloud rendering service of the cloud device, and meanwhile, the user side that downloads the target resource required by the rendering target area is local through a resource downloading service of the cloud device, and at this time, the space resource of the virtual space locally stored in the user side includes the target resource corresponding to the target area. Optionally, in this embodiment, the space resource of the virtual space may be deployed on a Content Delivery Network (CDN) of the cloud device through a resource service.
It should be noted that, in this embodiment, when the target area is rendered by the cloud device, the target resource corresponding to the target area is downloaded to the local, so that when the user terminal subsequently responds to the control operation of the virtual space, and the determined target area is the same as this time, the rendering device of the target area becomes the local of the user terminal, that is, when the user terminal subsequently needs to render the target area, the user terminal does not need to interact with the cloud device, and the target area is directly rendered by the local rendering. For example, as shown in fig. 3B and 3C, the user interacts with the cloud device, performs cloud rendering on the region 1 in S3 through a cloud rendering service of the cloud device, and feeds back a cloud rendering result (i.e., the region 11 in S1 or the region S21 in S2) to the user in a manner of controlling video stream, and at the same time, the user also transmits the target resource Z1 required for rendering the region 1 to the user through a resource downloading service of the cloud device, so that the user stores the target resource Z1 in a local space resource, and if the user subsequently needs to render the region 1 in S3, the user can locally complete rendering of the region 1 through the locally stored target resource Z1.
In addition, it should be further noted that, on the basis of the scheme of this embodiment, the original installation package of the user end only needs to include the basic data operated by the user end, and does not need to include any space resource corresponding to the virtual space, so that the volume of the original installation package of the user end is greatly reduced. Thereby improving the downloading success rate of the user terminal and facilitating the transmission and distribution.
According to the scheme of the embodiment, the user side responds to the control operation of the virtual space, determines the target area corresponding to the operation position of the virtual space, determines the rendering equipment for the target area according to the local storage condition of the target resource of the target area, and downloads the target resource to the local place while rendering the target area through the cloud equipment if the rendering equipment comprises the cloud equipment. According to the scheme, the target resource is downloaded when the target area is rendered by the cloud equipment, and the target resource can be downloaded under the condition that a user does not sense the target area, so that the whole process that the user uses the user side cannot be interrupted by the process of rendering and resource downloading, the running continuity of the user side is greatly improved, in addition, interaction with the cloud equipment is not needed when the target area is rendered subsequently, the interaction cost is reduced, and the rendering efficiency is improved.
Optionally, on the basis of the above scheme, the scheme further includes: and in response to the local resource cleaning event, deleting the expired resource in the locally stored space resources. The local resource cleaning event may be an event for cleaning a space resource locally stored at the user end, and the local resource cleaning event may be initiated periodically (for example, once a week); or initiating once when the memory occupied by the user side is larger than the memory threshold value; or the user can respond to a triggering operation (such as clicking a space cleaning key) on the user terminal to initiate once, and the like. The expired resource may be a resource that needs to be temporarily removed from the local storage as determined by a rule eviction (LRU) algorithm from the total space resources stored locally. Specifically, the expired resource may be at least one of a space resource of a non-latest version, a duplicate storage resource, and a space resource with a low frequency of use. The space resource with lower usage frequency may be a space resource used for a period of time (e.g., a week); but also spatial resources with frequencies below a frequency threshold, etc. According to the scheme, a spatial resource elimination mechanism is locally introduced to the user side, expired resources in the local storage spatial resources are periodically eliminated, and the occupation of the local storage resources of the terminal equipment at the user side is further reduced.
FIG. 4 is a flow chart of a data processing method provided according to an embodiment of the present disclosure; on the basis of the above embodiments, the embodiment of the present disclosure further explains in detail how to download the target resource in the cloud device to the local, as shown in fig. 4, the data processing method provided in this embodiment may include:
s401, responding to the control operation of the virtual space, and determining a target area corresponding to the operation position of the virtual space.
S402, according to the storage condition of the target resource corresponding to the target area in the local area, determining the rendering equipment of the target area.
The rendering device is cloud device and/or a user side.
And S403, if the rendering device comprises a cloud device, determining whether the current thermal update condition is met according to a preset reference item while rendering the target area through the cloud device.
The preset reference item may be a basis for measuring whether to download the target resource locally. The preset reference item may include: at least one item of the user side version, the operating system version of the terminal to which the user side belongs, the target area identification and the rendering channel. The hot update condition is a relevant rule for determining whether to download the target resource locally, and specifically, may be a relevant rule set based on whether the content information of the preset reference item satisfies the update condition. The thermal upgrading condition in this embodiment may be set by the operation and maintenance staff of the product corresponding to the user side according to the development requirement of the product. The thermal update condition may be a fixed condition configured in the user side research and development stage, or may be updated according to the product development requirement and then issued to the user side through the background server of the user side. This embodiment is not limited to this.
Optionally, in this embodiment, when the user needs to download the target resource, it may be determined whether the hot update condition is currently met based on the preset reference item. Specifically, there are many ways to determine whether the thermal upgrade condition is currently satisfied according to the preset reference item, and this embodiment is not limited thereto. One way that can be achieved is: and judging whether the content information of the preset reference item meets a hot update condition, for example, judging whether the version number of the user side belongs to an optional version of the target resource allowed to be downloaded. If the number of the preset reference items is multiple, it may be determined that the hot update condition is currently satisfied when the content information of all the reference items satisfies the hot update condition, or it may be determined that the hot update condition is currently satisfied when the content information of at least one reference item satisfies the hot update condition. Another way to implement this is: and judging whether the preset reference item contains complete items, for example, judging whether the preset reference item contains a target area identifier, and if so, determining that the thermal update condition is currently met. Another way to implement this is: and combining the two modes, and simultaneously judging the integrity of the content information and the contained item of the preset reference item.
Specifically, in this embodiment, if it is determined that the hot update condition is currently satisfied according to the preset reference item, the following operation of downloading the target resource in the cloud device to the local is performed in S404 while rendering the target area through the cloud device, and if it is determined that the hot update condition is currently not satisfied, the operation of downloading the target resource is not performed while rendering the target area through the cloud device.
And S404, if yes, downloading the target resource in the cloud equipment to the local.
According to the scheme of the embodiment, the user side responds to the control operation of the virtual space, determines the target area corresponding to the operation position of the virtual space, determines the rendering equipment for the target area according to the storage condition of target resources of the target area in the local area, determines whether the current thermal update condition is met or not based on the preset reference item when the rendering equipment comprises the cloud equipment, and downloads the target resources to the local area if the current thermal update condition is met. According to the scheme, whether the user side needs to download the target resource is judged by introducing the preset reference item instead of downloading all the target resources blindly, so that the situation that the downloaded target resource is not suitable for local rendering of the user side or the downloaded target resource is inaccurate and the like due to the fact that the preset reference item does not meet the downloading condition is avoided. The availability of the space resources of the local storage is improved.
Optionally, on the basis of this embodiment, if the number of the preset reference items is at least two, determining whether the thermal upgrade condition is currently met according to the preset reference items, including: determining the priority of the preset reference item according to the content information of the preset reference item; and determining whether the hot update condition is met currently according to the content information and the priority of the preset reference item. The content information of the preset reference item may be at least two items of a specific version number of the user side, a specific version number of an operating system of the terminal to which the user side belongs, target area identification information, and rendering channel information.
Specifically, according to the content information of the preset reference item, the process of determining the priority of the preset reference item may be: the method includes the steps that at least two preset reference items are subjected to initial priority ranking according to a default priority rule, then whether the preset reference items need to be adjusted or not is judged according to each preliminarily ranked preset reference item, if yes, the priorities of the preset reference items are adjusted, and the final priorities of the at least two preset reference items are obtained. For example, if the user side version is not the latest version, the priority is shifted backward (e.g., by one bit); if the operating system version of the terminal to which the user side belongs is not the latest version, moving the priority of the terminal backwards (for example, moving the priority backwards by one bit); if the target area identifier is not a legal identifier, the priority of the target area identifier is moved backwards (for example, moved backwards by one bit); if the rendering channel is not a regular channel, its priority is shifted backward (e.g., by one bit).
One implementation way of determining whether the hot upgrade condition is currently met or not according to the content information and the priority of the preset reference item is to determine whether the hot upgrade condition is currently met or not according to the content information of the preset reference item with the highest priority, and if so, determine that the hot upgrade condition is currently met. Another way to realize this is to set a weight value for each priority, and set a first value for the judgment result that meets the thermal upgrade condition, and set a second value for the judgment result that does not meet the thermal upgrade condition; judging whether the heat upgrade condition is met once according to the content information of each preset reference item, calculating a weighting result according to a numerical value and a weighted value corresponding to the judgment result, if the weighting result is larger than a judgment threshold, indicating that the heat upgrade condition is met currently, and otherwise, indicating that the heat upgrade condition is not met currently. According to the scheme, when the preset reference items are multiple, the priority of each preset reference item is determined according to the specific content of the reference item, and then whether the heat upgrade condition is met or not is determined, so that the flexibility and accuracy of judging whether the heat upgrade condition is met or not are further improved.
Preferentially, the thermal upgrade condition of this embodiment can be flexibly changed according to the operation policy of the product corresponding to the user side, and at this time, the manner of updating the local stored thermal upgrade condition by the user side may be: acquiring the latest version number of the hot update condition based on a heartbeat mechanism; the locally stored hot update condition is updated according to the latest version number. Specifically, in this embodiment, the user side may interact with a background server (e.g., a management server configured with a thermal upgrade condition) thereof through a heartbeat mechanism, regularly obtain a latest version number of the thermal upgrade condition from the background server, compare the latest version number with a version number of the local storage thermal upgrade condition, obtain the thermal upgrade condition of the latest version from the background server when the local storage thermal upgrade condition is not the latest version, and replace the original thermal upgrade condition stored locally with the thermal upgrade condition of the latest version. The scheme regularly monitors the version of the hot upgrade condition based on the heartbeat mechanism to update the locally stored hot upgrade condition, so that the effectiveness and the accuracy of the locally stored hot upgrade condition are ensured, and the accuracy of downloading target resources is further ensured.
FIG. 5 is a flow chart of a data processing method provided according to an embodiment of the present disclosure; on the basis of the foregoing embodiment, the embodiment of the present disclosure further explains in detail how, when the cloud device includes at least two optional edge devices, a rendering device that determines a target area according to a local storage condition of a target resource corresponding to the target area, where as shown in fig. 5, the data processing method provided in this embodiment may include:
s501, responding to the control operation of the virtual space, and determining a target area corresponding to the operation position of the virtual space.
S502, judging whether the target resource corresponding to the target area is stored locally, if so, executing S503, otherwise, executing S504.
And S503, if the target resource corresponding to the target area is locally stored, determining the rendering device of the target area as the user side.
S504, if the target resource corresponding to the target area is not stored locally, determining the target edge device from the at least two optional edge devices according to the target area, and using the target edge device as the rendering device of the target area.
The optional edge device of this embodiment may be deployed on edge computing nodes at different positions in a virtual space, and may be an electronic device capable of providing region rendering and resource downloading services.
Optionally, an implementation manner of this embodiment is: and according to the position of the target area, selecting the optional edge device closest to the target area from the plurality of optional edge devices as the target edge device, namely the optional edge device is taken as the rendering device of the target area. Another way to implement this is: selecting at least two alternative edge devices which are closer to the target area from a plurality of alternative edge devices according to the position of the target area; and selecting the candidate edge device with the least task amount as a target edge device according to the current task amount of the candidate edge device, namely, the candidate edge device is used as the rendering device of the target area.
And S505, rendering the target area through the user side and/or the target edge device.
Optionally, if the rendering device of the target area includes the target edge device, the target resource in the target edge device needs to be downloaded to the local user side while the target area is rendered by the target edge device.
According to the scheme of the embodiment, the user side responds to the control operation of the virtual space, determines the target area corresponding to the operation position of the virtual space, if the target resource corresponding to the target area is not stored locally, determines the target edge equipment from at least two optional edge equipment according to the position of the target area, and downloads the target resource in the target edge equipment to the local while rendering the target area through the cloud equipment. According to the scheme, the functions of the cloud equipment are dispersed into the plurality of optional edge equipment, on one hand, the calculation pressure of the total cloud equipment is reduced, on the other hand, the user side downloads the target resource from the edge equipment nearest to the user side, the transmission cost of edge calculation is reduced, and the transmission efficiency is improved.
Fig. 6 is a schematic structural diagram of a data processing system according to an embodiment of the present disclosure. As shown in fig. 6, the data processing system 6 of the present embodiment includes a user terminal 61 and a cloud device 62;
the user terminal 61 is used in the data processing method according to any of the above embodiments; the cloud device 62 is connected to the client 61, and is configured to provide a rendering service of the target area for the client 61 when the rendering device of the target area includes the cloud device 62. The rendering service may be a service for rendering the target area based on the target resource and the related rendering parameter.
Further, the cloud device 62 in the data processing system 6 is further configured to: the client 61 is provided with a download service of the target resource while the rendering service of the target area is provided for the client 61. The download service of the target resource may be a service to which the target resource is transmitted in response to a request of the user terminal 61.
Further, cloud device 62 in data processing system 6 includes at least two optional edge devices.
Further, the data processing system 6 further includes: the virtual space server 63 is connected to the user terminal 61, and the virtual space server 63 is configured to provide the user terminal 61 with a service for determining a target area. Namely, the service of inquiring the operation position of the virtual space according to the login account information and determining the target area according to the operation position and the area division result of the virtual space can be provided.
Further, the data processing system 6 further includes: and a management server 64 connected to the user terminal 61 for providing a thermal upgrade service to the user terminal 61. The management server 64 is further connected to the cloud device 62, and is configured to push space resources of the rendered virtual space for the cloud device 62; the management server 64 is also connected to the virtual space server 63 for pushing the area division result of the virtual space to the virtual space server 63.
The specific operating principle of the data processing system shown in fig. 6 is explained in detail below:
the operation and maintenance personnel of the product corresponding to the user terminal 61 may configure the relevant parameters through the front-end interface of the management server 64, which may include, but is not limited to: configuring space resources of different versions and different space areas, and packaging the configured space resources; configuring an updating rule of a hot updating mechanism and a version number corresponding to the updating rule; the virtual space may be divided into regions, for example, regularly divided or irregularly divided.
The management server 64 will respond to the configuration of the front end, push the newly configured space resource to the cloud device 62, specifically, push the newly configured space resource to the optional edge device of the area to which the space resource belongs, and push the area division result of the virtual space to the virtual space server 63.
In the operation process of the user terminal 61, in response to the control operation of the virtual space, sending a target area query request carrying login account information to the world server 63, querying the operation position of the virtual space by the world server 63 according to the login account information, determining a target area according to the operation position and the locally recorded area division result of the virtual space, feeding the target area back to the user terminal 61, judging whether a target resource corresponding to the target area is locally stored after the user terminal 61 acquires the target area, rendering the target area locally if the target resource is locally stored, determining a target edge device from at least two optional edge devices in the cloud device 62 if the target area is not locally stored, using the target edge device as a rendering device of the target area, rendering the target area through a cloud rendering service in the target edge device, and meanwhile, according to a preset reference item, and determining whether the hot update condition is met currently, and if so, downloading the target resource to the local through a resource downloading service in the target edge equipment. After finishing rendering the target area, the user terminal 61 displays the rendering result to the user through the display screen.
Optionally, the user terminal 61 may communicate with the management server 64 at regular time based on the heartbeat mechanism, obtain the latest version number of the thermal upgrade condition, and update the locally stored thermal upgrade condition according to the latest version number.
Optionally, the user end 61 may also delete an expired resource from the locally stored spatial resources in response to a local resource cleaning event.
It should be noted that the original installation package of the user side in the system may only need to include the basic data operated by the user side, and does not need to include any space resource corresponding to the virtual space, thereby greatly reducing the volume of the original installation package of the user side. Thereby improving the downloading success rate of the user terminal and facilitating the transmission and distribution.
The system of the embodiment can support a user side to flexibly select rendering equipment of a target area according to the local storage condition of target resources corresponding to the target area to be rendered, and the user operation area can be efficiently rendered in the operation process of a virtual space product in a mode of seamless switching between local rendering and cloud rendering. In addition, the user side does not need to suspend the rendering process to perform resource downloading operation first when rendering is performed in the region, namely the rendering operation of the user side is not interrupted by the resource updating process, so that the continuity of virtual space effect display of the user side is ensured, and the user experience is greatly improved.
Fig. 7 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present disclosure, which is suitable for a case where a user side renders an operation area (i.e., a target area) of a virtual space based on a control operation of a user in the virtual space. The method is particularly suitable for rendering the operation area in the world space based on the control operation of the user in the world space of the meta universe in the operation process of entertainment products such as the meta universe. The device can be configured in a user side with virtual space rendering requirements, and is realized by software and/or hardware, and the device can realize the data processing method of any embodiment of the disclosure. As shown in fig. 7, the data processing apparatus 700 includes:
a target area determining module 701, configured to determine, in response to a control operation of a virtual space, a target area corresponding to an operation position of the virtual space;
a rendering device determining module 702, configured to determine, according to a local storage condition of a target resource corresponding to the target area, a rendering device of the target area; the rendering device is cloud equipment and/or a user side;
the region rendering module 703 is configured to render the target region through the cloud device and/or the user side.
According to the scheme of the embodiment, the user side responds to the control operation of the virtual space, determines the target area corresponding to the operation position of the virtual space, further determines the rendering equipment for the target area according to the local storage condition of the target resource of the target area, and renders the target area through the rendering equipment. According to the scheme, the user side can flexibly select the rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area to be rendered, and the user operation area is efficiently rendered in the operation process of the virtual space product in a mode of seamless switching between local rendering and cloud rendering. In addition, compared with the method that the user side performs the rendering operation of the target area, the user side does not need to pause the rendering process to perform the resource downloading operation first when the area is rendered, namely the rendering operation of the user side is not interrupted by the resource updating process, the continuity of the virtual space effect displayed by the user side is ensured, and the user experience is greatly improved.
Further, if the rendering device includes a cloud device, the region rendering module 703 is specifically configured to:
determining an interaction mode with the cloud equipment according to the type of the user side;
and controlling the cloud equipment to render the target area based on the interaction mode.
Further, the data processing apparatus 700 further includes:
and the resource downloading module is used for downloading the target resource in the cloud equipment to the local in the process that the area rendering module renders the target area through the cloud equipment.
Further, the resource downloading module includes:
the heat upgrade condition judging unit is used for determining whether the heat upgrade condition is met currently or not according to a preset reference item; wherein the preset reference item comprises: at least one item of a user side version, an operating system version of a terminal to which the user side belongs, a target area identifier and a rendering channel;
and if so, downloading the target resource in the cloud equipment to the local in the process of rendering the target area by the area rendering module through the cloud equipment.
Further, if the number of the preset reference items is at least two, the thermal update condition determining unit is specifically configured to:
determining the priority of the preset reference item according to the content information of the preset reference item;
and determining whether the hot update condition is met currently or not according to the content information and the priority of the preset reference item.
Further, the data processing apparatus 700 further includes:
a thermal override configuration module to: acquiring the latest version number of the hot update condition based on a heartbeat mechanism; and updating the hot update condition of the local storage according to the latest version number.
Further, the cloud device comprises at least two optional edge devices; the rendering device determining module 701 is specifically configured to:
if the target resource corresponding to the target area is not stored locally, determining target edge equipment from the at least two optional edge equipment according to the target area, and using the target edge equipment as rendering equipment of the target area.
Further, the target area determining module 701 is specifically configured to:
sending a target region query request carrying login account information to a world server so that the world server queries an operation position of a virtual space according to the login account information and determines a target region according to the operation position and a region division result of the virtual space;
and acquiring the target area fed back by the world server.
Further, the data processing apparatus 700 further includes:
and the local resource cleaning module is used for responding to the local resource cleaning event and deleting the expired resource in the locally stored space resource.
The product can execute the method provided by any embodiment of the disclosure, and has corresponding functional modules and beneficial effects of the execution method.
In the technical scheme of the present disclosure, the related user side executes the data related to the region rendering, such as the acquisition, storage, and application of the control operation, the operation position, the target region, the target resource, the user side version, the operating system version of the terminal to which the user side belongs, the target region identifier, the rendering channel, and the like of the virtual space, which all conform to the regulations of the related laws and regulations and do not violate the customs of the public order.
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
FIG. 8 illustrates a schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure. It should be noted that the electronic device may be a terminal device where the user end of the embodiment is located. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 8, the apparatus 800 includes a computing unit 801 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)802 or a computer program loaded from a storage unit 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The calculation unit 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.
A number of components in the device 800 are connected to the I/O interface 805, including: an input unit 806, such as a keyboard, a mouse, or the like; an output unit 807 such as various types of displays, speakers, and the like; a storage unit 808, such as a magnetic disk, optical disk, or the like; and a communication unit 809 such as a network card, modem, wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
Computing unit 801 may be a variety of general and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and the like. The calculation unit 801 executes the respective methods and processes described above, such as the data processing method. For example, in some embodiments, the data processing method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 808. In some embodiments, part or all of the computer program can be loaded and/or installed onto device 800 via ROM 802 and/or communications unit 809. When loaded into RAM 803 and executed by the computing unit 801, a computer program may perform one or more steps of the data processing method described above. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the data processing method in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), blockchain networks, and the internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome. The server may also be a server of a distributed system, or a server incorporating a blockchain.
Artificial intelligence is the subject of research that makes computers simulate some human mental processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), both at the hardware level and at the software level. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, and the like; the artificial intelligence software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, a machine learning/deep learning technology, a big data processing technology, a knowledge map technology and the like.
Cloud computing (cloud computing) refers to a technology system that accesses a flexibly extensible shared physical or virtual resource pool through a network, where resources may include servers, operating systems, networks, software, applications, storage devices, and the like, and may be deployed and managed in a self-service manner as needed. Through the cloud computing technology, high-efficiency and strong data processing capacity can be provided for technical application and model training of artificial intelligence, block chains and the like.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims (26)

1. A method of data processing, comprising:
responding to the control operation of the virtual space, and determining a target area corresponding to the operation position of the virtual space;
determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area; the rendering device is cloud equipment and/or a user side;
and rendering the target area through the cloud equipment and/or the user end.
2. The method of claim 1, wherein the rendering of the target area by the cloud device comprises:
determining an interaction mode with the cloud equipment according to the type of the user side;
and controlling the cloud equipment to render the target area based on the interaction mode.
3. The method of claim 1, wherein during the rendering of the target area by the cloud device, further comprising:
and downloading the target resource in the cloud equipment to the local.
4. The method of claim 3, wherein the downloading the target resource in the cloud device locally comprises:
determining whether a heat update condition is met currently or not according to a preset reference item; wherein the preset reference item comprises: at least one item of a user side version, an operating system version of a terminal to which the user side belongs, a target area identifier and a rendering channel;
and if so, downloading the target resource in the cloud equipment to the local.
5. The method of claim 4, wherein if the number of the preset reference items is at least two, determining whether a thermal update condition is currently satisfied according to the preset reference items comprises:
determining the priority of the preset reference item according to the content information of the preset reference item;
and determining whether the hot update condition is met currently or not according to the content information and the priority of the preset reference item.
6. The method of claim 4 or 5, further comprising:
acquiring the latest version number of the hot update condition based on a heartbeat mechanism;
and updating the hot update condition of the local storage according to the latest version number.
7. The method of claim 1, wherein the cloud device comprises at least two optional edge devices;
the determining, according to a local storage condition of a target resource corresponding to the target area, a rendering device of the target area includes:
if the target resource corresponding to the target area is not stored locally, determining target edge equipment from the at least two optional edge equipment according to the target area, and using the target edge equipment as rendering equipment of the target area.
8. The method of claim 1, wherein the determining a target region corresponding to the operating location of the virtual space comprises:
sending a target region query request carrying login account information to a world server so that the world server queries an operation position of a virtual space according to the login account information and determines a target region according to the operation position and a region division result of the virtual space;
and acquiring the target area fed back by the world server.
9. The method according to any one of claims 1-8, further comprising:
and in response to the local resource clearing event, deleting the expired resource in the locally stored space resource.
10. A data processing apparatus comprising:
the target area determining module is used for responding to the control operation of the virtual space and determining a target area corresponding to the operation position of the virtual space;
the rendering equipment determining module is used for determining rendering equipment of the target area according to the local storage condition of the target resource corresponding to the target area; the rendering equipment is cloud equipment and/or a user side;
and the region rendering module is used for rendering the target region through the cloud equipment and/or the user side.
11. The apparatus of claim 10, wherein if the rendering device comprises a cloud device, the region rendering module is specifically configured to:
determining an interaction mode with the cloud equipment according to the type of the user side;
and controlling the cloud equipment to render the target area based on the interaction mode.
12. The apparatus of claim 10, wherein the apparatus further comprises:
and the resource downloading module is used for downloading the target resource in the cloud equipment to the local in the process that the area rendering module renders the target area through the cloud equipment.
13. The apparatus of claim 12, wherein the resource download module comprises:
the heat upgrade condition judging unit is used for determining whether the heat upgrade condition is met currently or not according to a preset reference item; the preset reference item comprises at least one item of a user side version, an operating system version of a terminal to which the user side belongs, a target area identifier and a rendering channel;
and if the target area is satisfied, the resource downloading unit is used for downloading the target resource in the cloud equipment to the local in the process that the area rendering module renders the target area through the cloud equipment.
14. The apparatus of claim 13, wherein if the number of the preset reference entries is at least two, the thermal update condition determining unit is specifically configured to:
determining the priority of the preset reference item according to the content information of the preset reference item;
and determining whether the hot update condition is met currently or not according to the content information and the priority of the preset reference item.
15. The apparatus of claim 13 or 14, further comprising:
a thermal override configuration module to: acquiring the latest version number of the hot update condition based on a heartbeat mechanism; and updating the hot update condition of the local storage according to the latest version number.
16. The apparatus of claim 10, wherein the cloud device comprises at least two selectable edge devices;
the rendering device determination module is specifically configured to:
if the target resource corresponding to the target area is not stored locally, determining target edge equipment from the at least two optional edge equipment according to the target area, and using the target edge equipment as rendering equipment of the target area.
17. The apparatus according to claim 10, wherein the target region determining module is specifically configured to:
sending a target area query request carrying login account information to a world server so that the world server queries an operation position of a virtual space according to the login account information, and determining a target area according to the operation position and an area division result of the virtual space;
and acquiring the target area fed back by the world server.
18. The apparatus of any of claims 10-17, further comprising:
and the local resource clearing module is used for responding to the local resource clearing event and deleting the overdue resource in the locally stored space resource.
19. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data processing method of any one of claims 1-9.
20. A non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the data processing method according to any one of claims 1 to 9.
21. A computer program product comprising a computer program which, when executed by a processor, implements a data processing method according to any one of claims 1-9.
22. A data processing system, comprising: a user side and a cloud device;
wherein, the user terminal is used for executing the data processing method of any one of claims 1 to 9;
the cloud device is connected with the user side and used for providing rendering service of the target area for the user side under the condition that the rendering device of the target area comprises the cloud device.
23. The system of claim 22, wherein the cloud device is further configured to: and providing a target resource downloading service for the user side while providing the rendering service of the target area for the user side.
24. The system of claim 22 or 23, wherein the cloud device comprises: at least two optional edge devices.
25. The system of any of claims 22-24, further comprising:
a virtual space server connected to the user side,
the virtual space server is used for providing the determining service of the target area for the user side.
26. The system of claim 25, further comprising:
the management server is connected with the user side and used for providing a heat updating service for the user side;
the management server is further connected with the cloud end equipment and used for pushing space resources for rendering the virtual space for the cloud end equipment;
the management server is also connected with the virtual space server and used for pushing the area division result of the virtual space for the virtual space server.
CN202210443914.XA 2022-04-25 2022-04-25 Data processing method, device, equipment and medium for meta universe Active CN114972594B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210443914.XA CN114972594B (en) 2022-04-25 2022-04-25 Data processing method, device, equipment and medium for meta universe

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210443914.XA CN114972594B (en) 2022-04-25 2022-04-25 Data processing method, device, equipment and medium for meta universe

Publications (2)

Publication Number Publication Date
CN114972594A true CN114972594A (en) 2022-08-30
CN114972594B CN114972594B (en) 2023-08-29

Family

ID=82979696

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210443914.XA Active CN114972594B (en) 2022-04-25 2022-04-25 Data processing method, device, equipment and medium for meta universe

Country Status (1)

Country Link
CN (1) CN114972594B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116150540A (en) * 2023-04-19 2023-05-23 山东捷瑞数字科技股份有限公司 System and method for realizing one-key switching of exhibition item content based on meta universe and cloud platform
CN116758201A (en) * 2023-08-16 2023-09-15 淘宝(中国)软件有限公司 Rendering processing method, device and system of three-dimensional scene and computer storage medium
CN117319226A (en) * 2023-11-29 2023-12-29 中南大学 Meta universe-based data processing method and device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110941342A (en) * 2019-12-04 2020-03-31 中国联合网络通信集团有限公司 Data processing method, VR terminal and server
CN111135558A (en) * 2019-12-26 2020-05-12 网易(杭州)网络有限公司 Game synchronization method, game client, computer storage medium and electronic device
CN112791399A (en) * 2021-02-08 2021-05-14 腾讯科技(深圳)有限公司 Method, device, system, medium and electronic equipment for displaying cloud game picture
CN112891936A (en) * 2021-02-10 2021-06-04 广州虎牙科技有限公司 Virtual object rendering method and device, mobile terminal and storage medium
CN113468456A (en) * 2021-07-12 2021-10-01 工银科技有限公司 Webpage rendering method and device, electronic equipment and computer-readable storage medium
CN114225386A (en) * 2021-11-15 2022-03-25 腾讯科技(深圳)有限公司 Scene picture coding method and device, electronic equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110941342A (en) * 2019-12-04 2020-03-31 中国联合网络通信集团有限公司 Data processing method, VR terminal and server
CN111135558A (en) * 2019-12-26 2020-05-12 网易(杭州)网络有限公司 Game synchronization method, game client, computer storage medium and electronic device
CN112791399A (en) * 2021-02-08 2021-05-14 腾讯科技(深圳)有限公司 Method, device, system, medium and electronic equipment for displaying cloud game picture
CN112891936A (en) * 2021-02-10 2021-06-04 广州虎牙科技有限公司 Virtual object rendering method and device, mobile terminal and storage medium
CN113468456A (en) * 2021-07-12 2021-10-01 工银科技有限公司 Webpage rendering method and device, electronic equipment and computer-readable storage medium
CN114225386A (en) * 2021-11-15 2022-03-25 腾讯科技(深圳)有限公司 Scene picture coding method and device, electronic equipment and storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116150540A (en) * 2023-04-19 2023-05-23 山东捷瑞数字科技股份有限公司 System and method for realizing one-key switching of exhibition item content based on meta universe and cloud platform
CN116758201A (en) * 2023-08-16 2023-09-15 淘宝(中国)软件有限公司 Rendering processing method, device and system of three-dimensional scene and computer storage medium
CN116758201B (en) * 2023-08-16 2024-01-12 淘宝(中国)软件有限公司 Rendering processing method, device and system of three-dimensional scene and computer storage medium
CN117319226A (en) * 2023-11-29 2023-12-29 中南大学 Meta universe-based data processing method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN114972594B (en) 2023-08-29

Similar Documents

Publication Publication Date Title
KR102180995B1 (en) User interface data caching optimization for future actions
CN114972594A (en) Data processing method, device, equipment and medium for meta universe
US8856739B2 (en) Method of updating list of software-as-a-service and system for the same
CN111143039B (en) Scheduling method and device of virtual machine and computer storage medium
US20210157743A1 (en) Multi-state midtier dynamic cache replacement
CN114675965B (en) Federal learning method, apparatus, device and medium
CN110992112A (en) Method and device for processing advertisement information
CN111083058A (en) Content distribution network service current limiting method and electronic equipment
CN115617463B (en) Target creating system and method based on virtualization platform
CN104580375A (en) Method and equipment for determining UI style information of target application
CN108290071B (en) Media, apparatus, system, and method for determining resource allocation for performing rendering with prediction of player's intention
CN111135558A (en) Game synchronization method, game client, computer storage medium and electronic device
CN114330249A (en) Information editing method, device, equipment and storage medium
CN112671892B (en) Data transmission method, device, electronic equipment and medium
CN113419865A (en) Cloud resource processing method, related device and computer program product
CN113536755A (en) Method, device, electronic equipment, storage medium and product for generating poster
CN115543423A (en) Method, device and equipment for generating benchmarks and storage medium
CN113448668B (en) Method and device for skipping popup window and electronic equipment
CN114564268A (en) Equipment management method and device, electronic equipment and storage medium
CN114443197A (en) Interface processing method and device, electronic equipment and storage medium
CN114095564A (en) Data processing method and device, equipment and medium
CN113360689A (en) Image retrieval system, method, related device and computer program product
CN112346512A (en) Time synchronization method and device
CN114860405B (en) Parameter updating method and device of multitask model and storage medium
CN114296609A (en) Interface processing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant