CN115826809A - Cross-end meta universe interaction system, method and storage medium - Google Patents

Cross-end meta universe interaction system, method and storage medium Download PDF

Info

Publication number
CN115826809A
CN115826809A CN202211642981.0A CN202211642981A CN115826809A CN 115826809 A CN115826809 A CN 115826809A CN 202211642981 A CN202211642981 A CN 202211642981A CN 115826809 A CN115826809 A CN 115826809A
Authority
CN
China
Prior art keywords
equipment
data
interaction
cross
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211642981.0A
Other languages
Chinese (zh)
Inventor
李浥尘
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dustsea Interactive Technology Suzhou Co ltd
Original Assignee
Dustsea Interactive Technology Suzhou Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dustsea Interactive Technology Suzhou Co ltd filed Critical Dustsea Interactive Technology Suzhou Co ltd
Priority to CN202211642981.0A priority Critical patent/CN115826809A/en
Publication of CN115826809A publication Critical patent/CN115826809A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the application discloses a cross-end meta-universe interaction system, a method and a storage medium, wherein the cross-end meta-universe interaction system comprises: the interaction layer comprises an interaction interface switching module and an interaction mode switching module, and is respectively used for switching corresponding interaction interfaces and interaction modes based on the acquired information of the user access equipment and the operating system of the equipment end; the application layer comprises an application program function mode switching module and a cross-platform deployment module, and is respectively used for switching corresponding application program functions and realizing translation of corresponding device platform native codes based on the acquired user access device and operating system information of the device end; the access layer is used for realizing sharing of the same API interface, parameterized transmission and verification by the equipment end and ensuring consistency of cross-platform data; the server layer deploys the servers in a server cluster mode to realize the intercommunication between the equipment ends and the servers; and the data layer is used for realizing data consistency between the equipment ends.

Description

Cross-end meta universe interaction system, method and storage medium
Technical Field
The application relates to the technical field of meta universe, in particular to a cross-end meta universe interaction system, a cross-end meta universe interaction method and a storage medium.
Background
The metasma is an online virtual world which is constructed based on the traditional internet by using a digital technology, is mapped in parallel with the real world or exceeds the real world, can interact with the real world and realizes data interconnection. As a powerful candidate for next generation internet technologies, the meta universe has shown great value in the fields of virtual activities, social interaction, office collaboration, e-commerce, marketing, and the like. With the further expansion of the use scenes, users put forward stronger demands for accessing the meta universe from different devices. For example, in the field of metastic brand marketing, consumers want to access from different entries such as brand official APP, online small programs, HTML5 marketing pages, offline digital large screens, experience metastic content, interact with others, acquire brand and product information, create content, and brand parties want to build metastic space covering multi-channel entries quickly and at low cost. This presents a challenge to the cross-terminal properties of the metasequoiy.
Currently, the mainstream cross-end implementation methods are as follows:
1. by taking advantage of the mode that the traditional game industry transplants game content to each equipment platform, the meta universe application program is customized for each equipment end, and interaction and content are manufactured. The implementation mode needs to be a single metasma content, is specially developed for each equipment terminal, is high in cost and long in period, and greatly improves metasma manufacturing threshold. And the users accessed from the equipment ends are isolated from each other, and can not interact in the same virtual world.
2. By taking a mode of a traditional webpage game as a reference, the meta-universe content is rendered through a browser end, and the content is distributed through the browser application of each equipment end for a user to access. The scheme can realize rapid multi-end distribution of primary metascom content production, but has the fatal defects that the metascom picture content quality is greatly reduced due to the limitation of browser rendering performance, and the problem that the picture precision is insufficient and the requirement cannot be met in use scenes such as a computer end, an offline digital large screen and the like is caused. At the same time. When complex pictures such as multiple people, large scenes and the like are rendered or ultra-clear contents are output, the scheme has the conditions of serious equipment heating, frame dropping, delay, deadlocking and the like, and the experience is seriously influenced.
Therefore, it is desirable to provide a low-cost and fast underlying meta-universe architecture and solution that can meet the cross-end requirement and ensure the content quality.
Disclosure of Invention
An object of the embodiments of the present application is to provide a cross-end metaspace interaction system, method and storage medium, so as to solve the problems that a cross-end implementation manner of the metaspace in the prior art is high in cost, long in period and incapable of guaranteeing content quality.
To achieve the above object, an embodiment of the present application provides a cross-end meta-universe interaction system, including: the interaction layer comprises an interaction interface switching module and an interaction mode switching module, and is respectively used for switching corresponding interaction interfaces and interaction modes based on the acquired information of the user access equipment and the operating system of the equipment end;
the application layer comprises an application program function mode switching module and a cross-platform deployment module, and is respectively used for switching corresponding application program functions and realizing translation of corresponding device platform native codes based on the acquired user access device and operating system information of the device end;
the access layer is used for realizing that the equipment ends share the same API interface, parameterization transmission and verification and ensuring the consistency of cross-platform data;
the server layer deploys servers in a server cluster mode to realize intercommunication among the equipment ends and the servers;
and the data layer is used for realizing data consistency between the equipment ends.
Optionally, the user access device includes a computer terminal, a mobile phone terminal, a VR device, an offline large screen and/or a projection device;
the operating system comprises a Microsoft operating system, an apple operating system and/or an android operating system;
the interactive interface comprises a 2D computer-side interactive interface, a 2D mobile phone-side interactive interface, a cloud rendering interactive interface and/or a 3D VR interactive interface;
the interactive interface switching module is further configured to:
and selecting corresponding input equipment and file import and output paths based on different default settings of the user access equipment.
Optionally, the interaction manner includes:
the method comprises the steps of displaying and interacting with a menu form through 2D screen mouse keys, displaying and interacting with the menu form through 2D screen virtual touch keys, displaying through a 3D space suspension 2D menu, interacting with a rocker control mode through ray detection and/or interacting through shortcut keys.
Optionally, the switching module of the application function mode performs switching of the application function mode through macro definition, including:
when the macro is defined as an immersive projection space macro, the application function modes include a default switching of the character camera to a first view mode, a hiding of the 3D character model and an additional opening of a multi-camera matrix;
when the macro is defined as an IOS or Android macro, the application function mode comprises third party payment and social media sharing;
when the macro is defined as a cloud rendering macro, the application program function mode comprises the step of opening a data channel and allowing data transmission between a front-end browser page and an application end and a server end.
Optionally, the method for implementing translation of native code of the corresponding device platform comprises:
translating the codes of the universal contents of the equipment terminals into a universal intermediate language through the cross-platform deployment module;
and translating the universal intermediate language into platform native codes of the equipment terminal based on the acquired user access equipment and operating system information of the equipment terminal.
Optionally, the network connection mode of the access stratum includes a short connection and a long connection, and when the short connection is used, after the data request and the data are returned, the connection is interrupted after the task is finished;
when the long connection is used, data in the long connection is compressed and transmitted in a binary mode of protobuf.
Optionally, the server layer includes:
the data server is used for providing a universal data interface for the equipment terminal;
the multi-person interactive server is used for realizing the state synchronization of the user virtual image in the meta universe and outputting the corresponding user virtual image to different equipment terminals;
the chat server is used for synchronizing social contact and chat information of the users;
and the central server is used for maintaining the requests and communication of the equipment terminals to the server and realizing the synchronization and intercommunication of the requests of the equipment terminals.
Optionally, the server layer implements intercommunication between the device ends through a custom message queue and a remote procedure call, and implements intercommunication between the device ends and the server through a Config configuration mode;
and the data side realizes the data consistency of the equipment side through cache and Mysql data unification.
In order to achieve the above object, the present application further provides a cross-terminal meta universe interaction method, including the steps of:
acquiring user access equipment and operating system information of an equipment end, and switching a corresponding interactive interface and an interactive mode based on the user access equipment and operating system information;
selecting different macro definitions to switch to corresponding application program functions based on the acquired user access equipment and operating system information, and translating the codes of the general contents of each equipment terminal into corresponding equipment platform native codes through translation of a general intermediate language;
an access layer is arranged, different equipment ends share the same API interface, parameterized transmission and verification are realized, and the consistency of cross-platform data is ensured;
using Config configuration to realize the calling of the equipment end to the service, and using a user-defined message queue and remote procedure calling to realize the message intercommunication between the equipment ends;
and realizing data consistency between the equipment ends by using cache and Mysql data unification.
To achieve the above object, the present application also provides a computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a machine, implements the steps of the method as described above.
The embodiment of the application has the following advantages:
the embodiment of the application provides a cross-end meta universe interaction system, which comprises: the interaction layer comprises an interaction interface switching module and an interaction mode switching module, and is respectively used for switching corresponding interaction interfaces and interaction modes based on the acquired information of the user access equipment and the operating system of the equipment end; the application layer comprises an application program function mode switching module and a cross-platform deployment module, and is respectively used for switching corresponding application program functions and realizing translation of corresponding device platform native codes based on the acquired user access device and operating system information of the device end; the access layer is used for realizing that the equipment ends share the same API interface, parameterization transmission and verification and ensuring the consistency of cross-platform data; the server layer deploys servers in a server cluster mode to realize intercommunication among the equipment ends and the servers; and the data layer is used for realizing data consistency between the equipment ends.
Through the system, cross-equipment end and cross-channel entrance deployment in the metasequoia is realized, a bottom layer frame is constructed, and cross-end data intercommunication is realized, so that a metasequoia content producer can rapidly deploy the metasequoia content produced by the metasequoia content producer to each equipment end and channel through the system without repeated development and worrying about the reduction of the presentation effect. The user can access through the channels, and the unified and standardized interactive experience in the same unitary universe scene is realized with the full-platform user accessed through different channels. The system greatly reduces the time and economic cost of the meta-universe producer for landing the meta-universe activities and scenes, and one-time production covers users of all mainstream equipment ends. Meanwhile, the system helps the user to quickly access and experience the meta-universe interactive content together with other users of the full platform through different devices in most mainstream use scenes.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It should be apparent that the drawings in the following description are merely exemplary, and that other embodiments can be derived from the drawings provided by those of ordinary skill in the art without inventive effort.
Fig. 1 is a schematic structural diagram of a cross-end meta-universe interaction system according to an embodiment of the present application;
fig. 2 is a flowchart of a cross-end meta-universe interaction method according to an embodiment of the present application.
Detailed Description
The present disclosure is not intended to be limited to the particular embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
In addition, the technical features mentioned in the different embodiments of the present application described below may be combined with each other as long as they do not conflict with each other.
An embodiment of the present application provides a cross-end metastic-universe interactive system, and referring to fig. 1, fig. 1 is a schematic structural diagram of a cross-end metastic-universe interactive system provided in an embodiment of the present application, it should be understood that the system may further include additional blocks that are not shown and/or may omit the blocks that are shown, and the scope of the present application is not limited in this respect.
An embodiment of the present application provides a cross-end metaspace interactive system, which is a metaspace development architecture for implementing cross-end data intercommunication such as Windows/Mac/IOS/Android/browser/VR platform/offline large screen/immersive projection space, and is specifically divided into the following components:
and the interaction layer comprises an interaction interface switching module and an interaction mode switching module, and is respectively used for switching the corresponding interaction interface and interaction mode based on the acquired user access equipment and operating system information of the equipment terminal.
Specifically, the interactive interface switching module is used for intelligent switching of UI interactive interfaces and input/output logics: and judging the running environment of the metachrosis application program by acquiring information of user access equipment and an operating system, and switching a corresponding interactive interface.
In some embodiments, the user access device comprises a computer terminal, a mobile phone terminal, a VR device, an offline large screen and/or a projection device;
the operating system comprises a Microsoft operating system, an apple operating system and/or an android operating system;
the interactive interface comprises a 2D computer-side interactive interface, a 2D mobile phone-side interactive interface, a cloud rendering interactive interface and/or a 3D VR interactive interface;
the interactive interface switching module is further configured to:
and selecting corresponding input equipment and file import and output paths based on different default settings of the user access equipment.
Specifically, (i) if the user accesses the system through Windows and Mac, the system is switched to a 2D computer-side interactive interface, the keyboard and the mouse are default input devices, and the system file browser is a file import and export path.
(ii) If the user accesses the system through the IOS and the Android system, the system is switched to a 2D mobile phone end interactive interface, touch control, virtual keys and a virtual keyboard are defaulted as input modes, and mobile phone end files and photo albums are file import and export ways.
(iii) And if the user accesses the browser through the link, switching to a cloud rendering interactive interface, judging for the computer end or the mobile phone end according to the browser running environment in the same input mode as the Android condition, and pulling up the corresponding file import and output path through a front-end browser page instead of the application.
(iv) If the user accesses through the VR equipment, the 3D VR interactive interface is switched, the VR head display, the handle and the tracker are defaulted to be in an input mode, through body feeling, rays and handle entity key operation, the VR equipment file browser is a file import and output path.
(v) And if the user accesses the large screen or the immersive projection space under the line, hiding the 2D interactive interface. The default keyboard, mouse, microsoft Xbox or Sony PlayStation handle are input mode, the computer side file browser is the file import and export path.
The interactive mode switching module is used for intelligently switching interactive experience and interactive modes: and aiming at drawing a lottery, voting, commodity browsing, mini games, 3D virtual AI customer service and the like, detecting an access equipment terminal and automatically matching a corresponding interaction mode.
In some embodiments, the interaction means comprises:
the method comprises the steps of displaying and interacting with a menu form through a 2D screen mouse key, displaying and interacting with the menu form through a 2D screen virtual touch key, displaying through a 3D space suspension 2D menu, interacting with a rocker control mode through ray detection and/or interacting through a shortcut key.
Specifically, (i) if the user accesses through Windows or Mac system, the 2D screen mouse button and menu form that can be operated through keyboard and mouse are used for presentation and interaction.
(ii) And if the user accesses the system through an IOS, an Android system or a browser link, displaying and interacting in a menu form by using a 2D screen virtual touch key.
(iii) If the user passes through VR equipment access, then use 3D space suspension 2D menu to demonstrate, carry out the interaction through ray detection and rocker control mode.
(iv) If the user accesses the large screen or the immersive projection space through the line, interaction is carried out through a shortcut key under the condition that a menu and a UI are not called through a keyboard, a mouse, microsoft Xbox or Sony PlayStation handle keys.
And the application layer comprises an application program function mode switching module and a cross-platform deployment module, and is respectively used for switching corresponding application program functions and realizing translation of corresponding device platform native codes based on the acquired user access device and operating system information of the device end.
In some embodiments, the application function mode switching module performs switching of the application function mode by macro definition, including:
when the macro is defined as an immersive projection space macro, the application function modes include a default switching of the character camera to a first view mode, a hiding of the 3D character model and an additional opening of a multi-camera matrix;
when the macro is defined as an IOS or Android macro, the application function mode comprises third party payment and social media sharing;
when the macro is defined as a cloud rendering macro, the application program function mode comprises the step of opening a data channel and allowing data transmission between a front-end browser page and an application end and a server end.
Specifically, the application function mode switching module switches the application function mode by macro definition: assume that macro definitions Define1 and Define2 exist within the product, with different business logic codes, either for different customers or different platforms, respectively. Before package publishing, the macro is set to Define1 through an editor tool, so that when the package is compiled, the code of Define2 can be directly discarded and not compiled.
(i) If the immersive projection space macro is used, the character camera is switched to a first view angle mode in a default mode, the 3D character model is hidden, the multi-camera matrix is additionally started, the 6-channel camera output perpendicular to each other by 90 degrees is supported, the 360-degree cube mapping output is supported, a panoramic image is formed, and the correction frame can be displayed to assist in projection space field calibration.
(ii) If the IOS macro or the Android macro is used, the application program switches related functions such as third-party payment and social media sharing to the corresponding system solution.
(iii) If the cloud macro is used, the application program opens a data channel and allows data transmission between the front-end browser page and the application end and the server end.
(iv) Such as customizing different application home page layouts for different customers based on macros.
In some embodiments, a method of enabling translation of corresponding device platform native code comprises:
translating the codes of the universal contents of the equipment terminals into a universal intermediate language through the cross-platform deployment module;
and translating the universal intermediate language into platform native codes of the equipment side based on the acquired user access equipment and operating system information of the equipment side.
Specifically, the cross-platform deployment module implements cross-platform deployment through an intermediate language: based on the support of the Unity engine to CIL (common intermediate language), the common application content and logic of each end, such as C # Code, JSON configuration file, and the like, are translated into CIL language, and then converted into Native Code of each equipment platform. For the IOS platform, the code is converted into C + + code. And then, configuring the native code items of each platform, accessing or adjusting the non-universal components and the SDK, and finally exporting the applications of different equipment ends.
And the access layer is used for realizing the sharing of the same API interface, parameterization transmission and verification by the equipment end and ensuring the consistency of cross-platform data.
In some embodiments, the network connection mode of the access layer includes a short connection and a long connection, and when the short connection is used, after the data request and the data are returned, the connection is interrupted after the task is finished;
when the long connection is used, data in the long connection is compressed and transmitted in a binary mode of protobuf.
Specifically, the access layer realizes that different equipment ends share the same API interface, parameterizes transmission and verification, and ensures cross-platform data consistency. The network connection mode in the application comprises a short connection Http and a long connection Socket. The use of the short connection effectively saves the resource occupation of the server, and after the data request and the data return, the connection is interrupted after the task is finished. For example: the data object to be transmitted is serialized into a Json character string and transmitted to a back-end server, the server takes the deserialized Json in an agreed format as a data structure, after a series of logic processing, the newly generated data is re-serialized into the Json and transmitted to a client, and the client deserializes the object in the same way for use.
The unification of the data field type and the field name ensures the consistency among different platforms and devices. The use of long connection ensures real-time pushing performance of data, and the server can directly issue the data to the designated client. Data in the Socket is compressed and transmitted in a protobuf binary mode, so that the size of the packet body is saved, and the cost of network bandwidth and flow is saved. And distinguishing the use strategies of the long and short connections according to specific requirements.
And the server layer is used for deploying servers in a server cluster mode to realize the intercommunication among the equipment ends and between the equipment ends and the servers.
In some embodiments, the server layer comprises:
the data server is used for providing a universal data interface for the equipment terminal;
the multi-person interactive server is used for realizing the state synchronization of the user virtual image in the meta universe and outputting the corresponding user virtual image to different equipment terminals;
the chat server is used for synchronizing social contact and chat information of the users;
and the central server is used for maintaining the requests and communication of the equipment terminals to the server and realizing the synchronization and intercommunication of the requests of the equipment terminals.
Specifically, the server cluster mode is not affected by different quantities of the synchronization parameters of the specific equipment terminals, so that unified standardization is realized:
(i) For example, the data server realizes a universal data interface of each equipment end, processes related requests, such as user information, login registration, file storage, shop building, payment service, data statistics, user social contact, activity lottery, work audit, virtual activity (such as exhibition/exhibition hall) information, short message notification, configuration management, video decoding, role images, character arrangement and the like.
(ii) Like many people interactive server: and additionally building a meta universe multi-person interactive server for synchronizing the states of the user virtual images in the meta universe. And carrying out parameterization on overall transformation (position, rotation and scaling) related to the virtual image 3D model controller, transformation of each joint, animation machine information and the like, and carrying out independent transmission and synchronization. According to different output information of different equipment, for example, a mobile phone, a computer, an offline large screen and an immersive projection space end only synchronously carry out integral transformation and animation machine information, a VR equipment end additionally synchronizes the information of each joint of a model, and data verification and synchronization are carried out through a metachrosis multi-person interaction server.
(iii) The chat server: and additionally building a chat server for the social contact of the user and the synchronization of the chat information. And chat information and management of the user are independently processed.
(iv) The central server: the method is used for maintaining requests and communication of multiple terminals such as Windows/Mac/IOS/browser/VR platform/offline large screen/and the like to the server, and realizing the synchronization of the requests of the terminals and the intercommunication of the whole platform.
In some embodiments, the server layer implements the interworking between the device terminals by a custom message queue and a remote procedure call, and implements the interworking between the device terminals and the server by a Config configuration mode.
Specifically, the intercommunication between the multiple ends and the server layer is realized through a Config configuration mode:
for example, a user can call services by different terminals through a Windows/Mac/IOS/browser/VR platform/offline large screen/and other requests of multiple terminals to a service terminal in a Config configuration mode, so that the intercommunication between the multiple terminals and the services is realized, and a cross-platform strategy is realized.
The problem of service information non-intercommunication of different ends is solved through a custom message queue + RPC (remote procedure call):
for example, through multi-terminal operation such as Windows/Mac/IOS/browser/VR platform/offline large screen/and the like, since the default message formats of all the terminals are different and message intercommunication cannot be realized, unified message formats and bottom layer calling between the terminals are realized through the user-defined message queue + RPC, and the problem of message intercommunication failure of different terminals is solved.
And the data layer is used for realizing data consistency between the equipment ends.
In some embodiments, the data side realizes data consistency of the device side by cache and Mysql data unification.
Specifically, multi-end data consistency is realized by cache + Mysql data unification:
for example, when a user operates through multiple terminals such as Windows/Mac/IOS/browser/VR platform/offline large screen/and the like, unified storage and management of data of different equipment terminals are realized in a mode of caching and Mysql, independent databases or data tables do not need to be configured for the different equipment terminals, and the efficiency and resource problems caused by multiple data sources are solved.
Through the system, cross-equipment end and cross-channel entrance deployment in the metasphere is realized, a bottom layer framework is constructed, cross-end data intercommunication is realized, a metasphere content producer can rapidly deploy metasphere content produced by the metasphere content producer to each equipment end and channel through the system, repeated development is not needed, and the situation that the presentation effect is reduced is not needed to be worried about. The user can access through the channels, and the unified and standardized interactive experience in the same monadic universe scene is realized with the full-platform user accessed through different channels. The system greatly reduces the time and economic cost of the meta-universe producer for landing the meta-universe activities and scenes, and one-time production covers users of all mainstream equipment ends. Meanwhile, the system helps the user to quickly access and experience the meta-universe interactive content together with other users of the full platform through different devices in most mainstream use scenes.
An embodiment of the present application provides a cross-end metastasizing interaction method, and referring to fig. 2, fig. 2 is a flowchart of a cross-end metastasizing interaction method provided in an embodiment of the present application, and it should be understood that the method may further include additional blocks that are not shown and/or may omit the blocks shown, and the scope of the present application is not limited in this respect.
In step 101, user access device and operating system information of a device end are obtained, and a corresponding interactive interface and an interactive mode are switched based on the user access device and operating system information.
At step 102, based on the obtained user access device and operating system information, selecting different macro definitions to switch to corresponding application program functions, and translating the codes of the general content of each device end into corresponding device platform native codes through translation of a general intermediate language.
In step 103, an access layer is set, so that different device ends share the same API interface, parameterized transmission and verification, and consistency of cross-platform data is ensured.
At step 104, using Config configuration to implement the service invocation by the device side, and using custom message queue and remote procedure invocation to implement the message intercommunication between the device sides.
At step 105, data consistency between the device sides is achieved using caching and Mysql data unification.
For a specific implementation method, reference is made to the foregoing system embodiment, which is not described herein again.
The present application may be methods, apparatus, systems, and/or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for carrying out various aspects of the present application.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as a punch card or an in-groove protruding structure with instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present application may be assembler instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry can execute computer-readable program instructions to implement aspects of the present application by utilizing state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).
Various aspects of the present application are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
It is noted that, unless expressly stated otherwise, all the features disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose. Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic series of equivalent or similar features. Where used, further, preferably, still further and more preferably is a brief introduction to the description of the other embodiment based on the foregoing embodiment, the combination of the contents of the further, preferably, still further or more preferably back strap with the foregoing embodiment being a complete construction of the other embodiment. Several further, preferred, still further or more preferred arrangements of the belt after the same embodiment may be combined in any combination to form a further embodiment.
Although the present application has been described in detail with respect to the general description and the specific examples, it will be apparent to those skilled in the art that certain changes and modifications may be made based on the present application. Accordingly, such modifications and improvements are intended to be within the scope of this invention as claimed.

Claims (10)

1. A cross-terminal meta-universe interaction system, comprising:
the interaction layer comprises an interaction interface switching module and an interaction mode switching module, and is respectively used for switching corresponding interaction interfaces and interaction modes based on the acquired information of the user access equipment and the operating system of the equipment end;
the application layer comprises an application program function mode switching module and a cross-platform deployment module, and is respectively used for switching corresponding application program functions and realizing translation of corresponding device platform native codes based on the acquired user access device and operating system information of the device end;
the access layer is used for realizing that the equipment ends share the same API interface, parameterization transmission and verification and ensuring the consistency of cross-platform data;
the server layer deploys servers in a server cluster mode to realize intercommunication among the equipment ends and the servers;
and the data layer is used for realizing data consistency between the equipment ends.
2. The cross-terminal meta universe interaction system of claim 1,
the user access equipment comprises a computer end, a mobile phone end, VR equipment, an offline large screen and/or projection equipment;
the operating system comprises a Microsoft operating system, an apple operating system and/or an android operating system;
the interactive interface comprises a 2D computer-side interactive interface, a 2D mobile phone-side interactive interface, a cloud rendering interactive interface and/or a 3D VR interactive interface;
the interactive interface switching module is further configured to:
and selecting corresponding input equipment and file import and output paths based on different default settings of the user access equipment.
3. The cross-terminal metastability-based interaction system according to claim 1, wherein said means for interacting comprises:
the method comprises the steps of displaying and interacting with a menu form through 2D screen mouse keys, displaying and interacting with the menu form through 2D screen virtual touch keys, displaying through a 3D space suspension 2D menu, interacting with a rocker control mode through ray detection and/or interacting through shortcut keys.
4. The cross-terminal meta-universe interaction system of claim 1,
the application program function mode switching module switches the application program function mode through macro definition, and the method comprises the following steps:
when the macro is defined as an immersive projection space macro, the application function modes include a default switching of the character camera to a first view mode, a hiding of the 3D character model and an additional opening of a multi-camera matrix;
when the macro is defined as an IOS or Android macro, the application function mode comprises third party payment and social media sharing;
when the macro is defined as a cloud rendering macro, the application program function mode comprises the step of opening a data channel and allowing data transmission between a front-end browser page and an application end and a server end.
5. The cross-terminal metauniverse interaction system of claim 1, wherein the method of effecting translation of the corresponding device platform native code comprises:
translating the codes of the universal contents of each equipment terminal into a universal intermediate language through the cross-platform deployment module;
and translating the universal intermediate language into platform native codes of the equipment terminal based on the acquired user access equipment and operating system information of the equipment terminal.
6. The cross-terminal meta-universe interaction system of claim 1,
the network connection mode of the access layer comprises short connection and long connection, and when the short connection is used, after the data request and the data are returned, the connection is interrupted after the task is finished;
when the long connection is used, data in the long connection is compressed and transmitted in a binary mode of protobuf.
7. The cross-terminal meta-universe interaction system of claim 1, wherein the server layer comprises:
the data server is used for providing a universal data interface for the equipment terminal;
the multi-person interactive server is used for realizing the state synchronization of the user virtual image in the meta universe and outputting the corresponding user virtual image to different equipment terminals;
the chat server is used for synchronizing social contact and chat information of the users;
and the central server is used for maintaining the requests and communication of the equipment terminals to the server and realizing the synchronization and intercommunication of the requests of the equipment terminals.
8. The cross-terminal meta-universe interaction system of claim 1,
the server layer realizes the intercommunication between the equipment ends through self-defined message queues and remote process calls, and realizes the intercommunication between the equipment ends and the server through a Config configuration mode;
and the data side realizes the data consistency of the equipment side through cache and Mysql data unification.
9. A cross-end meta-universe interaction method is characterized by comprising the following steps:
acquiring user access equipment and operating system information of an equipment end, and switching a corresponding interactive interface and an interactive mode based on the user access equipment and operating system information;
selecting different macro definitions to switch to corresponding application program functions based on the acquired user access equipment and operating system information, and translating the codes of the general contents of each equipment terminal into corresponding equipment platform native codes through translation of a general intermediate language;
an access layer is arranged, different equipment ends share the same API interface, parameterized transmission and verification are realized, and the consistency of cross-platform data is ensured;
using Config configuration to realize the calling of the equipment end to the service, and using a user-defined message queue and remote procedure calling to realize the message intercommunication between the equipment ends;
and realizing data consistency between the equipment ends by using cache and Mysql data unification.
10. A computer storage medium on which a computer program is stored, the computer program, when executed by a machine, implementing the steps of the method of claim 9.
CN202211642981.0A 2022-12-20 2022-12-20 Cross-end meta universe interaction system, method and storage medium Pending CN115826809A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211642981.0A CN115826809A (en) 2022-12-20 2022-12-20 Cross-end meta universe interaction system, method and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211642981.0A CN115826809A (en) 2022-12-20 2022-12-20 Cross-end meta universe interaction system, method and storage medium

Publications (1)

Publication Number Publication Date
CN115826809A true CN115826809A (en) 2023-03-21

Family

ID=85517088

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211642981.0A Pending CN115826809A (en) 2022-12-20 2022-12-20 Cross-end meta universe interaction system, method and storage medium

Country Status (1)

Country Link
CN (1) CN115826809A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117808562A (en) * 2024-02-29 2024-04-02 南京特沃斯高科技有限公司 Network marketing method and platform based on metaspace

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117808562A (en) * 2024-02-29 2024-04-02 南京特沃斯高科技有限公司 Network marketing method and platform based on metaspace
CN117808562B (en) * 2024-02-29 2024-05-10 南京特沃斯高科技有限公司 Network marketing method and platform based on metaspace

Similar Documents

Publication Publication Date Title
TWI776066B (en) Picture generating method, device, terminal, server and storage medium
CN111596985B (en) Interface display method, device, terminal and medium in multimedia conference scene
US20170302709A1 (en) Virtual meeting participant response indication method and system
CA3068920A1 (en) Virtual meeting participant response indication method and system
US20230291980A1 (en) Method and apparatus for video generation and displaying, device, and medium
US20180295158A1 (en) Displaying group expressions for teleconference sessions
CN111741367B (en) Video interaction method and device, electronic equipment and computer readable storage medium
CN108846886A (en) A kind of generation method, client, terminal and the storage medium of AR expression
US9924136B1 (en) Coordinated display transitions of people and content
CN103677970A (en) System and method for achieving combination display of terminal local desktop and far-end virtual desktop
JP2024504053A (en) Two-dimensional code display method, apparatus, device and medium
WO2023227031A1 (en) Methods for giving and displaying gift in livestreaming room, and related device
CN115826809A (en) Cross-end meta universe interaction system, method and storage medium
KR20190104821A (en) Server, device and method for providing avatar communication
CN113778593B (en) Cloud desktop control method and device, electronic equipment, storage medium and program product
CN113645476B (en) Picture processing method and device, electronic equipment and storage medium
CN112533053B (en) Live broadcast interaction method and device, electronic equipment and storage medium
CN113411660B (en) Video data processing method and device and electronic equipment
US20230370686A1 (en) Information display method and apparatus, and device and medium
CN113535292A (en) Interface information control method and device, electronic equipment and storage medium
US11711408B2 (en) Content appearance conversion for remote application sharing
CN110855539B (en) Device discovery method, device and storage medium
US11995787B2 (en) Systems and methods for the interactive rendering of a virtual environment on a user device with limited computational capacity
US20230409801A1 (en) Document content presenting method and apparatus, and electronic device
WO2023142756A1 (en) Live broadcast interaction method, device, and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination