CN115080030A - Browser diagram and UE4 three-dimensional scene interactive linkage method, medium and device based on webrtc - Google Patents
Browser diagram and UE4 three-dimensional scene interactive linkage method, medium and device based on webrtc Download PDFInfo
- Publication number
- CN115080030A CN115080030A CN202210659150.8A CN202210659150A CN115080030A CN 115080030 A CN115080030 A CN 115080030A CN 202210659150 A CN202210659150 A CN 202210659150A CN 115080030 A CN115080030 A CN 115080030A
- Authority
- CN
- China
- Prior art keywords
- event
- browser
- dimensional scene
- interaction
- webrtc
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/36—Software reuse
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
- G06F9/4488—Object-oriented
- G06F9/449—Object-oriented method invocation or resolution
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a browser diagram and UE4 three-dimensional scene interactive linkage method, medium and device based on webrtc, wherein the method comprises the following steps: realizing an event scheduling center at a browser end according to a publishing and subscribing mode; the event scheduling center has the functions of event publishing, event registering, event scheduling and event list inquiring, so that event publishing and registering can be carried out on the js-exposed interface of the browser end, and event publishing and registering can be carried out on the webrtc interface exposed by the UE 4; and an event dispatching center is utilized to carry out interactive linkage of the browser diagram and the three-dimensional scene of the UE 4. According to the method, all browser chart components and the UE4 three-dimensional scene are managed by adopting a publish-subscribe mode, so that events of the browser chart components and the UE4 three-dimensional scene are decoupled, other event logics cannot be influenced when the events are added or deleted, and the problem existing in the method for realizing interactive linkage of the browser and the UE4 three-dimensional scene in the prior art can be solved.
Description
Technical Field
The invention relates to the technical field of software and information, in particular to a browser diagram and UE4 three-dimensional scene interactive linkage method, medium and device based on webrtc.
Background
As shown in fig. 1, a method for interactive linkage between a browser diagram and a three-dimensional scene of UE4, which is implemented in the prior art, includes the following steps:
firstly, respectively developing control interfaces at a browser end and a UE4 three-dimensional scene end;
secondly, developing and calling codes of a UE4 interface at a browser end;
thirdly, developing and calling codes of browser diagram components at a three-dimensional scene end of the UE 4;
fourthly, operating the three-dimensional scene and the browser of the UE 4;
fifthly, an event controlling the three-dimensional scene of the UE4 is triggered in the chart component of the browser, or an event controlling the chart component of the browser is triggered in the three-dimensional scene of the UE 4.
When the browser chart component and the UE4 have too many three-dimensional scenes or the complexity of the interactive logic is high, a large amount of customized development is needed. Or when the interaction logic changes, the browser and the UE4 need to change code on both sides of the three-dimensional scene. And the browser cannot sense the interface state of the three-dimensional scene end of the UE4, which is not beneficial to the management of the interface.
Disclosure of Invention
The invention aims to provide a browser diagram and UE4 three-dimensional scene interactive linkage method, medium and device based on webrtc, so as to solve the problems of the browser diagram and UE4 three-dimensional scene interactive linkage method in the prior art.
The invention provides a browser diagram and UE4 three-dimensional scene interactive linkage method based on webrtc, which comprises the following steps:
realizing an event scheduling center at a browser end according to a publishing and subscribing mode; the event scheduling center has the functions of event publishing, event registering, event scheduling and event list inquiring, so that event publishing and registering can be carried out on the js-exposed interface of the browser end, and event publishing and registering can be carried out on the webrtc interface exposed by the UE 4;
and an event dispatching center is utilized to carry out interactive linkage of the browser diagram and the three-dimensional scene of the UE 4.
Further, the method for interactive linkage of the browser diagram and the three-dimensional scene of the UE4 by using the event dispatching center comprises the following steps:
editing an event;
and (5) executing the event.
In some embodiments, the event editing step comprises:
firstly, when a browser configures a diagram component response event, registering the diagram component response event to an event dispatching center;
secondly, when the UE4 renderer configures the three-dimensional scene response event, registering the three-dimensional scene response event to an event scheduling center;
thirdly, when the browser configures the graph component for interaction, subscribing a three-dimensional scene response event or a graph component response event corresponding to the event scheduling center;
fourthly, the UE4 renderer subscribes to a chart component response event or a three-dimensional scene response event corresponding to the event scheduling center when configuring the three-dimensional scene interaction.
In some embodiments, the event running step comprises:
firstly, a browser initializes and starts a UE4 renderer, and the browser establishes a webrtc connection with a UE4 renderer;
step two, the browser traverses all the chart components for configuration, and registers the configured chart components to an event dispatching center in response to events;
thirdly, loading scene configuration by the UE4 renderer, and registering the configured three-dimensional scene response event to an event scheduling center;
step four, triggering an event:
when the browser triggers a chart interaction event, the interaction between the browser and a three-dimensional scene of the UE4 or a local event of the browser is realized by using an event scheduling center;
when the UE4 renderer triggers the three-dimensional scene interaction event, the event scheduling center is used for realizing the interaction between the UE4 three-dimensional scene and the browser or the UE4 three-dimensional scene local event.
Further, the method for realizing the interaction between the browser and the three-dimensional scene of the UE4 or the local event of the browser by using the event scheduling center in the fourth step includes:
when the browser triggers the chart interaction event, automatically issuing the event name and the corresponding data to an event scheduling center;
the event scheduling center pushes the event name and corresponding data to the chart component or three-dimensional scene that subscribes to the event in the browser and UE 4;
the chart component or the three-dimensional scene receives the event name and the corresponding data, and then executes the corresponding event, so that the interaction between the browser and the three-dimensional scene or the local event of the browser of the UE4 is realized.
Further, the method for realizing the interaction between the three-dimensional scene of the UE4 and the local event of the three-dimensional scene of the browser or the UE4 by using the event scheduling center in the fourth step includes:
when a UE4 renderer triggers a three-dimensional scene interaction event, automatically issuing an event name and corresponding data to an event scheduling center;
the event scheduling center pushes the event name and corresponding data to the chart component or three-dimensional scene that subscribes to the event in the browser and UE 4;
the chart component or the three-dimensional scene receives the event name and the corresponding data, and then executes the corresponding event, so that the interaction between the three-dimensional scene of the UE4 and the local event of the three-dimensional scene of the browser or the UE4 is realized.
The invention also provides a computer terminal storage medium which stores computer terminal executable instructions, wherein the computer terminal executable instructions are used for executing the browser chart and UE4 three-dimensional scene interactive linkage method based on webrtc.
The present invention also provides a computing device comprising:
at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform the above-mentioned webrtc-based browser diagram and UE4 three-dimensional scene interaction linkage method.
In summary, due to the adoption of the technical scheme, the invention has the beneficial effects that:
according to the method, all browser chart components and the UE4 three-dimensional scene are managed by adopting a publish-subscribe mode, so that events of the browser chart components and the UE4 three-dimensional scene are decoupled, other event logics cannot be influenced when the events are added or deleted, and the problem existing in the method for realizing interactive linkage of the browser and the UE4 three-dimensional scene in the prior art can be solved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention, and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a flowchart of a method for interactive linkage between a browser diagram and a three-dimensional scene of UE4, which is implemented in the prior art.
Fig. 2 is a flowchart of a method for realizing interaction and linkage between a browser diagram and a three-dimensional scene of UE4 based on webrtc in the embodiment of the present invention.
Fig. 3 is a flowchart of event editing in a method for realizing interaction and linkage between a browser diagram and a UE4 based on webrtc according to an embodiment of the present invention.
Fig. 4 is a flowchart of event operation in the browser diagram and UE4 three-dimensional scene interaction linkage method implemented based on webrtc in the embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The abbreviations and key terms to which the present invention relates are defined as follows:
webrtc: the abbreviation of Web instant messaging (english: Web Real-Time Communication) is an API that supports Web browsers for Real-Time voice conversations or video conversations.
Browser chart: the visualized chart of the browser end realized by js and css comprises graphical charts or characters such as tables, pie charts, line charts, radar charts, column charts and the like.
Three-dimensional scene: the three-dimensional simulation scene manufactured by the UE4 rendering engine and art tools is used.
Cloud rendering: the (cloudrender) mode is similar to the conventional cloud computing mode, namely, the 3D program is placed in a remote server for rendering, the user terminal clicks a 'cloud rendering' button through Web software or directly in the local 3D program and accesses to the access resource through the high-speed internet, the instruction is sent out from the user terminal, the server executes a corresponding rendering task according to the instruction, and a rendering result picture is transmitted back to the user terminal for displaying.
Examples
As shown in fig. 2, the present embodiment provides a method for interactive linkage between a browser diagram and a three-dimensional scene of UE4 based on webrtc, including:
realizing an event scheduling center at a browser end according to a publishing and subscribing mode; the event scheduling center has the functions of event publishing, event registering, event scheduling and event list inquiring, so that event publishing and registering can be carried out on the js-exposed interface of the browser end, and event publishing and registering can be carried out on the webrtc interface exposed by the UE 4;
and an event dispatching center is utilized to carry out interactive linkage of the browser diagram and the three-dimensional scene of the UE 4. The method for interactive linkage of the browser diagram and the three-dimensional scene of the UE4 by using the event dispatching center comprises the following steps:
editing an event;
and (5) executing the event.
As shown in fig. 3, the event editing step includes:
firstly, when a browser configures a chart component response event, registering the chart component response event to an event dispatching center;
secondly, when the UE4 renderer configures the three-dimensional scene response event, registering the three-dimensional scene response event to an event scheduling center;
thirdly, when the browser configures the graph component for interaction, subscribing a three-dimensional scene response event or a graph component response event corresponding to the event scheduling center;
fourthly, the UE4 renderer subscribes to a chart component response event or a three-dimensional scene response event corresponding to the event scheduling center when configuring the three-dimensional scene interaction.
As shown in fig. 4, the event running step includes:
firstly, a browser initializes and starts a UE4 renderer, and the browser establishes a webrtc connection with a UE4 renderer;
step two, the browser traverses all the chart components for configuration, and registers the configured chart components to an event dispatching center in response to events;
thirdly, loading scene configuration by a UE4 renderer, and registering a configured three-dimensional scene response event to an event scheduling center;
step four, triggering an event:
(1) when the browser triggers a chart interaction event, the interaction between the browser and a three-dimensional scene of the UE4 or a local event of the browser is realized by using an event scheduling center; specifically, the method comprises the following steps:
when the browser triggers the chart interaction event, automatically issuing the event name and the corresponding data to an event scheduling center;
the event scheduling center pushes the event name and corresponding data to the chart component or three-dimensional scene subscribing to the event in the browser and UE4 renderer;
the chart component or the three-dimensional scene receives the event name and the corresponding data, and then executes the corresponding event, so that the interaction between the browser and the three-dimensional scene or the local event of the browser of the UE4 is realized.
(2) When a UE4 renderer triggers a three-dimensional scene interaction event, an event scheduling center is used for realizing interaction between a UE4 three-dimensional scene and a browser or a local event of the UE4 three-dimensional scene; specifically, the method comprises the following steps:
when a UE4 renderer triggers a three-dimensional scene interaction event, automatically issuing an event name and corresponding data to an event scheduling center;
the event scheduling center pushes the event name and corresponding data to a chart component or three-dimensional scene that subscribes to the event in the browser and UE 4;
the chart component or the three-dimensional scene receives the event name and the corresponding data, and then executes the corresponding event, so that the interaction between the three-dimensional scene of the UE4 and the local event of the three-dimensional scene of the browser or the UE4 is realized.
Therefore, the method adopts the publish-subscribe mode to manage all browser chart components and the UE4 three-dimensional scene, so that the events of the browser chart components and the UE4 three-dimensional scene are decoupled, other event logics cannot be influenced when the events are added or deleted, and the problem of the interactive linkage method of the browser and the UE4 three-dimensional scene in the prior art can be solved.
Furthermore, in some embodiments, a computer terminal storage medium is provided, which stores computer terminal executable instructions for executing the webrtc-based browser diagram and UE4 three-dimensional scene interaction linkage method as described in the previous embodiments. Examples of the computer storage medium include a magnetic storage medium (e.g., a floppy disk, a hard disk, etc.), an optical recording medium (e.g., a CD-ROM, a DVD, etc.), or a memory such as a memory card, a ROM, a RAM, or the like. The computer storage media may also be distributed over a network-connected computer system, such as an application store.
Furthermore, a computing device is presented in some embodiments, comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the webrtc-based browser diagram and UE4 three-dimensional scene interaction linkage method as described in the previous embodiments. Examples of computing devices include PCs, tablets, smart phones, or PDAs, among others.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. A browser diagram and UE4 three-dimensional scene interactive linkage method based on webrtc is characterized by comprising the following steps:
realizing an event scheduling center at a browser end according to a publishing and subscribing mode; the event scheduling center has the functions of event publishing, event registering, event scheduling and event list inquiring, so that event publishing and registering can be carried out on the js-exposed interface of the browser end, and event publishing and registering can be carried out on the webrtc interface exposed by the UE 4;
and an event dispatching center is utilized to carry out interactive linkage of the browser diagram and the three-dimensional scene of the UE 4.
2. The method for interactive linkage of browser charts and three-dimensional scenes of UE4 based on webrtc implementation of claim 1, wherein the method for interactive linkage of browser charts and three-dimensional scenes of UE4 by using an event dispatching center comprises:
editing an event;
and (5) executing the event.
3. The method for interaction and linkage of browser diagrams and UE4 three-dimensional scenes based on webrtc implementation of claim 2, wherein the step of event editing comprises:
firstly, when a browser configures a diagram component response event, registering the diagram component response event to an event dispatching center;
secondly, when the UE4 renderer configures the three-dimensional scene response event, registering the three-dimensional scene response event to an event scheduling center;
thirdly, when the browser configures the graph component for interaction, subscribing a three-dimensional scene response event or a graph component response event corresponding to the event scheduling center;
fourthly, the UE4 renderer subscribes to a chart component response event or a three-dimensional scene response event corresponding to the event scheduling center when configuring the three-dimensional scene interaction.
4. The method for interaction linkage of browser diagrams and UE4 three-dimensional scenes based on webrtc implementation of claim 2, wherein the step of event execution comprises:
firstly, a browser initializes and starts a UE4 renderer, and the browser establishes a webrtc connection with a UE4 renderer;
step two, the browser traverses all the chart components for configuration, and registers the configured chart components to an event dispatching center in response to events;
thirdly, loading scene configuration by the UE4 renderer, and registering the configured three-dimensional scene response event to an event scheduling center;
step four, triggering an event:
when the browser triggers a chart interaction event, the interaction between the browser and a three-dimensional scene of the UE4 or a local event of the browser is realized by using an event scheduling center;
when the UE4 renderer triggers the three-dimensional scene interaction event, the event scheduling center is used for realizing the interaction between the UE4 three-dimensional scene and the browser or the UE4 three-dimensional scene local event.
5. The method for realizing interaction linkage between browser graphs and three-dimensional scenes of UE4 based on webrtc of claim 4, wherein the method for realizing interaction between the browser and the three-dimensional scenes of UE4 or local events of the browser by using the event scheduling center in the fourth step comprises:
when the browser triggers the chart interaction event, automatically issuing the event name and the corresponding data to an event scheduling center;
the event scheduling center pushes the event name and corresponding data to the chart component or three-dimensional scene that subscribes to the event in the browser and UE 4;
the chart component or the three-dimensional scene receives the event name and the corresponding data, and then executes the corresponding event, so that the interaction between the browser and the three-dimensional scene or the local event of the browser of the UE4 is realized.
6. The method for interaction linkage of browser graphs and UE4 three-dimensional scenes based on webrtc implementation of claim 4, wherein the method for implementing interaction between the UE4 three-dimensional scene and the browser or UE4 three-dimensional scene local event by using the event scheduling center in the fourth step comprises:
when a UE4 renderer triggers a three-dimensional scene interaction event, automatically issuing an event name and corresponding data to an event scheduling center;
the event scheduling center pushes the event name and corresponding data to the chart component or three-dimensional scene that subscribes to the event in the browser and UE 4;
the chart component or the three-dimensional scene receives the event name and the corresponding data, and then executes the corresponding event, so that the interaction between the three-dimensional scene of the UE4 and the local event of the three-dimensional scene of the browser or the UE4 is realized.
7. A computer terminal storage medium storing computer terminal-executable instructions for performing the webrtc-based browser diagram and UE4 three-dimensional scene interaction linkage method according to any one of claims 1-6.
8. A computing device, comprising:
at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the webrtc-based browser graphic interaction linkage method of any one of claims 1-6 with the three-dimensional scene of the UE 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210659150.8A CN115080030A (en) | 2022-06-13 | 2022-06-13 | Browser diagram and UE4 three-dimensional scene interactive linkage method, medium and device based on webrtc |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210659150.8A CN115080030A (en) | 2022-06-13 | 2022-06-13 | Browser diagram and UE4 three-dimensional scene interactive linkage method, medium and device based on webrtc |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115080030A true CN115080030A (en) | 2022-09-20 |
Family
ID=83250410
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210659150.8A Pending CN115080030A (en) | 2022-06-13 | 2022-06-13 | Browser diagram and UE4 three-dimensional scene interactive linkage method, medium and device based on webrtc |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115080030A (en) |
-
2022
- 2022-06-13 CN CN202210659150.8A patent/CN115080030A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101615122B (en) | Method and system for providing information related to elements of a user interface by an access system | |
| US10135938B2 (en) | Publish-subscribe system | |
| US11481948B2 (en) | Method, device and storage medium for generating animation group by synthesizing animation layers based on tree structure relation between behavior information and sub-behavior information | |
| US20070033518A1 (en) | Computer-implemented method, system, and program product for hiding columns in an electronic table | |
| US20170185609A1 (en) | Universal adaptor for rapid development of web-based data visualizations | |
| US20090193363A1 (en) | Representing Multiple Computing Resources Within A Predefined Region Of A Graphical User Interface For Displaying A Single Icon | |
| US20170212657A1 (en) | User interface rendering performance | |
| CN111324252B (en) | Display control method and device in live broadcast platform, storage medium and electronic equipment | |
| CN112714329B (en) | Display control method and device for live broadcasting room, storage medium and electronic equipment | |
| CN114064024A (en) | Method, apparatus, device, storage medium, and program product for developing micro-application | |
| WO2023103430A1 (en) | Data visualization display method and apparatus, medium and electronic device | |
| CN110083467B (en) | Method and device for processing applet message and computer storage medium | |
| CN112835582A (en) | Container engine-based rendering method, device, equipment and storage medium | |
| CN117389647A (en) | Plug-in generation method, application development method, device, equipment and medium | |
| CN116974676A (en) | Page content sending method, device and equipment | |
| CN115080030A (en) | Browser diagram and UE4 three-dimensional scene interactive linkage method, medium and device based on webrtc | |
| CN112698826B (en) | Low code page creation system, method and equipment | |
| CN114371838A (en) | Method, device and equipment for rendering small program canvas and storage medium | |
| CN112698882A (en) | Page component loading method and device | |
| JP7464651B2 (en) | Terminal operation method and terminal | |
| CN115712428A (en) | Medical image browsing method, device, equipment and storage medium | |
| CN115552362A (en) | Interface display method and device, computer readable storage medium and electronic equipment | |
| CN112306324A (en) | Information processing method, apparatus, device and medium | |
| CN117692891A (en) | Resource subscription device, method, electronic equipment and storage medium | |
| CN115390812A (en) | Service information processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |