CN114143529A

CN114143529A - Visual interaction method and device based on three-dimensional virtual scene and electronic equipment

Info

Publication number: CN114143529A
Application number: CN202111483576.4A
Authority: CN
Inventors: 郑腾飞; 卢纯义; 骆宗义; 余忠东; 吕默影; 徐琛; 郭嘉; 叶徐静; 汤伟华; 滕家扬; 王淅蓉; 周毅; 刘晓谦; 蒋一傲; 黄毅之; 何晓冬
Original assignee: State Grid Zhejiang Electric Power Co Ltd Lanxi Power Supply Co; Jinhua Power Supply Co of State Grid Zhejiang Electric Power Co Ltd
Current assignee: State Grid Zhejiang Electric Power Co Ltd Lanxi Power Supply Co; Jinhua Power Supply Co of State Grid Zhejiang Electric Power Co Ltd
Priority date: 2021-12-07
Filing date: 2021-12-07
Publication date: 2022-03-04

Abstract

The invention discloses a visual interaction method and device based on a three-dimensional virtual scene and electronic equipment. The method comprises the following steps: acquiring two-dimensional data of a target scene; establishing a three-dimensional model of the target scene through a scene bounding box; segmenting the three-dimensional model of the target scene to generate a plurality of sub-models; establishing an information transmission path among the plurality of submodels; and displaying the two-dimensional data in the three-dimensional model of the target scene through the information transmission path. The visual interaction method and device based on the three-dimensional virtual scene and the electronic equipment can realize a series of inspection and operation and maintenance work such as inspection of equipment inside a cabinet, inspection of server wiring, troubleshooting of air conditioners and the like through the three-dimensional virtual scene, and improve the operation and maintenance capacity of a dispatching machine room.

Description

Visual interaction method and device based on three-dimensional virtual scene and electronic equipment

Technical Field

The disclosure relates to the field of computer information processing, in particular to a visual interaction method and device based on a three-dimensional virtual scene and electronic equipment.

Background

The power grid is an organic whole, the total amount of production, transmission and use of alternating current electric energy in the power grid changes at any time, but the balance must be kept at any moment, and a machine room needs to be scheduled for regulation and control. Along with the setting of distribution network is complicated day by day, the burden of computer lab also is bigger and bigger, and the computer lab operation and maintenance among the prior art is difficult to keep up with the development of electric wire netting.

For example, in an existing machine room, for example, in an invention patent "an integrated operation and maintenance management system information processing method of a power grid dispatching automation system" with patent application number 201610951279.0 in the prior art, a power grid operation and maintenance management system is disclosed, which optimizes event information into fault information by collecting the event information of the system, and finally processes the fault information to combine personnel, technology and flow. The system can perform centralized management on the power grid dispatching automation system, monitor and count the operation condition of the automation system, realize the accumulation of the database, convert the traditional experience type of maintenance, transformation and planning of the automation system and equipment into scientific analysis type management, and further effectively improve the management level. However, the operation and maintenance software system in practical application still adopts the traditional WEB-side two-dimensional interface switching browsing mode to display real-time data, alarm and query historical information, and adopts the C #. NET + Web-Socket + Ajax technology. Such a two-dimensional management interface cannot comprehensively display multi-dimensional information of an operation and maintenance object under a uniform interface

Therefore, a new visualization interaction method, device and electronic device based on a three-dimensional virtual scene are needed.

Disclosure of Invention

In view of this, the present disclosure provides a visual interaction method and apparatus based on a three-dimensional virtual scene, and an electronic device, which can implement a series of inspection and operation and maintenance work, such as inspection of internal devices of a cabinet, inspection of a server connection, and inspection of an air conditioner and the like, through the three-dimensional virtual scene, thereby improving operation and maintenance capabilities of a scheduling machine room.

Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or in part will be obvious from the description, or may be learned by practice of the disclosure.

According to an aspect of the present disclosure, a visualization interaction method based on a three-dimensional virtual scene is provided, the method including: acquiring two-dimensional data of a target scene; establishing a three-dimensional model of the target scene through a scene bounding box; segmenting the three-dimensional model of the target scene to generate a plurality of sub-models; establishing an information transmission path among the plurality of submodels; displaying the two-dimensional data in a three-dimensional model of the target scene through the information transmission path;

the segmenting the three-dimensional model of the target scene to generate a plurality of sub-models comprises:

and establishing a cost function and generating a plurality of sub models by segmenting the three-dimensional model of the target scene through the cost function.

In an exemplary embodiment of the present disclosure, further comprising: displaying warning information in the three-dimensional model of the target scene when the two-dimensional data does not satisfy a threshold condition.

In an exemplary embodiment of the present disclosure, building a three-dimensional model of the target scene through a scene bounding box includes: and establishing a three-dimensional model of the target scene through an AABB type scene bounding box.

In an exemplary embodiment of the present disclosure, the cost function includes:

C(V)＝Ct+Pl*C(Vl)+Pr*C(Vr)

wherein, c (Vl) is a space division cost of the first submodel Vl surrounded by the bounding box, c (Vr) is a space division cost of the second submodel Vr surrounded by the bounding box, Ct is a traversal cost of the target scene, and Pl and Pr are conditional probabilities that the ray reaches the first submodel Vl and the second submodel Vr when the ray hits the target scene.

In an exemplary embodiment of the present disclosure, establishing an information transmission path between the plurality of submodels includes: an information transmission path between the plurality of submodels is established through Unity 3D.

According to an aspect of the present disclosure, a visual scheduling apparatus is provided, the apparatus including: the two-dimensional data module is used for acquiring two-dimensional data of a target scene; the bounding box module is used for establishing a three-dimensional model of the target scene through a scene bounding box; the segmentation module is used for segmenting the three-dimensional model of the target scene to generate a plurality of sub-models; the path module is used for establishing an information transmission path among the plurality of submodels; and the display module is used for displaying the two-dimensional data in the three-dimensional model of the target scene through the information transmission path.

In an exemplary embodiment of the present disclosure, further comprising: and the warning module is used for displaying warning information in the three-dimensional model of the target scene when the two-dimensional data does not meet the threshold condition.

According to an aspect of the present disclosure, an electronic device is provided, the electronic device including: one or more processors; storage means for storing one or more programs; when executed by one or more processors, cause the one or more processors to implement a method as above.

According to the visual interaction method and device based on the three-dimensional virtual scene and the electronic equipment, by means of expanding two-dimensional data in the server in each original target scene into the three-dimensional scene, inspection of equipment inside the cabinet, checking of wiring of the server, troubleshooting of an air conditioner and the like and a series of inspection and operation and maintenance work can be achieved through the three-dimensional virtual scene, and operation and maintenance capacity of a dispatching machine room is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The above and other objects, features and advantages of the present disclosure will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings. The drawings described below are merely some embodiments of the present disclosure, and other drawings may be derived from those drawings by those of ordinary skill in the art without inventive effort.

Fig. 1 is a system block diagram illustrating a visualization interaction method, device and electronic device based on a three-dimensional virtual scene according to an exemplary embodiment.

FIG. 2 is a flow diagram illustrating a method for visualization interaction based on a three-dimensional virtual scene in accordance with an exemplary embodiment.

FIG. 3 is a flow diagram illustrating a method for visualization interaction based on a three-dimensional virtual scene in accordance with an exemplary embodiment.

Fig. 4 is a schematic diagram illustrating a visualization interaction method based on a three-dimensional virtual scene according to another exemplary embodiment.

Fig. 5 is a block diagram illustrating a visual scheduling apparatus in accordance with an exemplary embodiment.

Fig. 6 is a block diagram illustrating a visual scheduling apparatus in accordance with another exemplary embodiment.

FIG. 7 is a block diagram illustrating an electronic device in accordance with an example embodiment.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus, a repetitive description thereof will be omitted.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known methods, devices, implementations, or operations have not been shown or described in detail to avoid obscuring aspects of the disclosure.

The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.

The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.

It will be understood that, although the terms first, second, third, etc. may be used herein to describe various components, these components should not be limited by these terms. These terms are used to distinguish one element from another. Thus, a first component discussed below may be termed a second component without departing from the teachings of the disclosed concept. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

It is to be understood by those skilled in the art that the drawings are merely schematic representations of exemplary embodiments, and that the blocks or processes shown in the drawings are not necessarily required to practice the present disclosure and are, therefore, not intended to limit the scope of the present disclosure.

In the automatic dispatching machine room of the power distribution network, a plurality of large screens are arranged, information of all aspects in the power distribution network is displayed in real time, specific work content of power dispatching is based on data information fed back by various information acquisition equipment or information provided by monitoring personnel, and the development conditions of all production works are comprehensively considered by combining with actual operation parameters of the power distribution network, such as voltage, current, frequency, load and the like.

In view of the difficulties in the prior art, the present disclosure provides a visual interaction method, device and electronic device based on a three-dimensional virtual scene, which can comprehensively display multi-dimensional information of an operation and maintenance object, such as a spatial position, an operation state, an asset attribute, an operation and maintenance history, alarm information, a link relationship and the like, on an existing two-dimensional management interface under a unified three-dimensional interface; the routing inspection route of a field operation and maintenance engineer can be simulated, and an operation and maintenance report is generated; the position of the operation and maintenance object equipment in the data center space can be accurately positioned; the link relation between the upstream and the downstream of the equipment can be shown to help engineers quickly grasp the association relation between the equipment and the equipment.

As shown in fig. 1, the system architecture 100 may include

terminal devices

101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the

terminal devices

101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The user may use the

terminal devices

101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The

terminal devices

101, 102, 103 may have installed thereon various communication client applications, such as a data monitoring application, a web browser application, a search-type application, an instant messaging tool, and the like.

The

terminal devices

101, 102, 103 may be various electronic devices having a data transmission function and supporting information interaction, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.

The server 105 may be a server that provides various services, such as a background management server that provides support for real-time information displayed by the

terminal devices

101, 102, 103. The server 105 may perform processing such as analysis on the real-time information and feed back the processing result (instrument state information, alarm information) to the user.

The server 105 may for example acquire two-dimensional data from the target scene transmitted by the

terminal devices

101, 102, 103; server 105 may build a three-dimensional model of the target scene, for example, through a scene bounding box; server 105 may generate a plurality of sub-models, for example, by segmenting a three-dimensional model of the target scene; the server 105 may, for example, establish an information transmission path between the plurality of submodels; the server 105 may, for example, display the two-dimensional data in a three-dimensional model of the target scene over the information transmission path.

Server 105 may also display warning information in the three-dimensional model of the target scene, for example, when the two-dimensional data does not satisfy a threshold condition.

The server 105 may be a solid server, or may be composed of a plurality of servers, for example, it should be noted that the visualization interaction method based on the three-dimensional virtual scene provided by the embodiment of the present disclosure may be executed by the server 105, and accordingly, the visualization scheduling apparatus may be disposed in the server 105.

According to the three-dimensional virtual scene-based visual interaction method, the three-dimensional visual operation and maintenance scene is established, interactivity and interactivity are given to the scene, the three-dimensional virtual scene-based visual interaction method for dispatching the operation and maintenance of the automatic machine room is provided, and the operation and maintenance capacity of the dispatching machine room is improved.

FIG. 2 is a flow diagram illustrating a method for visualization interaction based on a three-dimensional virtual scene in accordance with an exemplary embodiment. The visualization interaction method based on the three-dimensional virtual scene at least comprises the steps S202 to S210.

As shown in fig. 2, in S202, two-dimensional data of a target scene is acquired. The target scenario may be, for example, an automated dispatch room of a power distribution network. The power dispatching is an effective management means which is adopted for ensuring safe and stable operation of a power grid, reliable external power supply and orderly operation of various power production works.

In the automatic dispatching machine room of the power distribution network, a plurality of large screens are arranged, information of all aspects in the power distribution network is displayed in real time, specific work content of power dispatching is data information fed back by various information acquisition equipment or information provided by monitoring personnel, the development conditions of all production works are comprehensively considered by combining actual operation parameters of the power distribution network, such as voltage, current, frequency, load and the like, the safe and economic operation states of the power distribution network are judged, operation instructions are issued through a telephone or an automatic system, and field operators or an automatic control system are instructed to adjust, such as adjustment of the output of a generator, adjustment of load distribution, switching of capacitors, reactors and the like, so that the continuous safe and stable operation of the power distribution network is ensured. In the embodiment of the present application, the above load information of voltage, current, and the like is referred to as two-dimensional information.

In S204, a three-dimensional model of the target scene is built through the scene bounding box. The method comprises the following steps: and establishing a three-dimensional model of the target scene through an AABB type scene bounding box.

Bounding box is an algorithm for solving the optimal bounding space of a discrete point set, and the basic idea is to approximately replace complex geometric objects with a slightly larger and characteristically simple geometry (called bounding box).

Common bounding box algorithms are AABB bounding boxes, bounding balls, directional bounding boxes OBB, and fixed directional convex hull FDH. The collision detection problem has wide application in the fields of virtual reality, computer aided design and manufacture, games, robots and the like, and even becomes a key technology. And the bounding box algorithm is one of the important methods for performing the preliminary detection of collision interference.

AABB (AABB, axisal bindoutbox) is the earliest bounding box applied. It is defined as the smallest hexahedron containing the object with the sides parallel to the coordinate axes. So describing an AABB, only six scalars are needed. The AABB has the advantages of simple structure, small storage space, poor compactness, large redundant space especially for irregular geometric bodies, and incapability of correspondingly rotating an object when the object rotates. The processing object is rigid and convex, and is not suitable for complex virtual environment conditions involving soft body deformation.

In S206, a three-dimensional model of the target scene is segmented to generate a plurality of sub-models. Wherein segmenting the three-dimensional model of the target scene to generate a plurality of sub-models comprises: establishing a cost function; and generating a plurality of sub models by segmenting the three-dimensional model of the target scene through the cost function.

Wherein the cost function comprises:

C(V)＝Ct+Pl*C(Vl)+Pr*C(Vr)

The detailed steps for generating a plurality of sub-models with respect to the three-dimensional model for segmenting the target scene will be described in detail in the embodiment corresponding to fig. 3.

In S208, an information transmission path between the plurality of submodels is established. The method comprises the following steps: an information transmission path between the plurality of submodels is established through Unity 3D.

Among them, Unity3D is a comprehensive development tool that is capable of creating multiple platforms of types of interactive content such as three-dimensional video games, building visualizations, real-time three-dimensional animations, etc. And generating a graphical development environment for interaction through the data. Information transmission paths among the submodels can be established through the interface communication related programs in the Unity 3D.

In S210, the two-dimensional data is displayed in the three-dimensional model of the target scene through the information transmission path. And displaying the two-dimensional data in the three-dimensional model of the target scene through interface communication established by the Unity 3D.

In one embodiment, different interactive forms of virtual hands, sound effects, animation embedding and graphic menus can be added through interface communication. The actual operator can select any one that is most suitable for the operator. Therefore, the device is suitable for operators with different use habits to operate, and the energy spent in training the use method is reduced.

In one embodiment, the operation and maintenance data is visually analyzed and displayed in a scene, and the method comprises the following steps: the system comprises power environment information data, data center layout position information data, equipment asset information data and inspection information data. These data are updated instantaneously during operation.

According to the three-dimensional virtual scene-based visual interaction method disclosed by the invention, the obtained three-dimensional scene display is essentially a three-dimensional visual display of the operation and maintenance state of the data center and the big data generated by information operation and maintenance, so that the authenticity and real-time performance of the three-dimensional scene are greatly improved, and the staff can conveniently master the conditions of equipment deployment, cable connection, power environment and the like of a dispatching machine room.

It should be clearly understood that this disclosure describes how to make and use particular examples, but the principles of this disclosure are not limited to any details of these examples. Rather, these principles can be applied to many other embodiments based on the teachings of the present disclosure.

In one embodiment, a warning message is displayed in the three-dimensional model of the target scene when the two-dimensional data does not satisfy a threshold condition. And displaying the two-dimensional data in the three-dimensional model of the target scene, judging before displaying, and warning the area represented by the two-dimensional data in the three-dimensional model when the two-dimensional data does not meet the threshold condition corresponding to the device.

For example, when the current representing a certain server in the two-dimensional data is lower than a threshold value, the server is highlighted in the three-dimensional model of the target scene, and a flash or sound alarm and the like can be provided.

FIG. 3 is a flow diagram illustrating a method for visualization interaction based on a three-dimensional virtual scene in accordance with an exemplary embodiment. The flow shown in fig. 3 is a detailed description of S206 "segmenting the three-dimensional model of the target scene to generate a plurality of sub-models" in the flow shown in fig. 2,

as shown in fig. 3, in S302, the probability of the submodel is determined. Fig. 4 is a schematic diagram illustrating a visualization interaction method based on a three-dimensional virtual scene according to another exemplary embodiment. As shown in fig. 4:

the current scene is surrounded by an AABB type, i.e. a rotatable, parallel bounding box of scene, the bounding box of scene is denoted V, which can be represented by a quadruple { O, Lx, Ly, Lz }, where O is the bounding box center, the coordinates are (Ox, Oy, Oz), and Lx, Ly, Lz are the axial lengths of the X, Y, Z axes of the bounding box, respectively.

A plane perpendicular to the Z-axis divides the scene bounding box into two parts, a left sub-bounding box Vl and a right sub-bounding box Vr, where x is the distance from the dividing plane to the left end point of the dividing axis. Since the light rays in the scene are randomly and uniformly distributed straight lines, the conditional probabilities Pl, Pr of the hits Vl and Vr are proportional to the surface areas SA (Vl) and SA (Vr) of Vl and Vr in the case that the light rays hit the current scene, then

Pl＝SA(V1)/SA(V)＝(LxLy+LxX+LyX)/(LxLy+LxLz+LyLz)；

Pr＝SA(Vr)/SA(V)＝((LxLy+Lx(Lz-X)+Ly(Lz-X)/(LxLy+LxLz+LyLz)。

In S304, a cost function is established. Assuming that the traversal cost of the scene is Ct, and the intersection calculation cost of the straight line and the triangle in the scene is Ci, the spatial segmentation cost c (V) of the scene enclosed by the enclosure box V can be expressed as:

C(V)＝Ct+Pl*C(Vl)+Pr*C(Vr)。

where c (Vl) is the space partitioning cost of the left sub-scene surrounded by the bounding box Vl, and c (Vr) is the space partitioning cost of the right sub-scene surrounded by the bounding box Vr.

In S306, an optimal scene separation is determined by a cost function. After the recursive expression is developed, the space segmentation cost of the scene can be calculated as follows:

C(V)＝∑n∈SA(Vn)/SA(V)*Ct+∑l∈SA(Vl)/SA(V)*Ci。

and obtaining the scene space segmentation with the minimum value in the formula as the optimal scene space segmentation. However, the direct solution of the formula generates a spatial segmentation result without the premise of ensuring the integrity of geometric objects in the scene, and the situation that the scene has many primitives and the primitives are irregularly distributed is basically impossible to complete.

Therefore, in most cases, the solution process needs to be simplified by using a local greedy algorithm, the spatial segmentation cost of Vl and Vr is replaced by the product of the number of triangles contained in Vl and Vr and the intersection calculation cost of a single triangle, and the scene spatial segmentation cost can be expressed as

C(X，Y)＝Csi*((2Lm+2Ln)/(LmLn+LmLp+LnLp)*XY-(LmN+LnN)/(LmLn+LmLp+LnLp)*X-(LmLp+LnLp)/(LmLn+LmLp+LnLp*Y))+Ct

The method is a scene space segmentation cost function, wherein x is the distance from a segmentation plane to a left end point of a segmentation axis, y is the number of triangles contained in a left sub bounding box Vl, n is the number of triangles in a scene, lp is the axial length of the segmentation axis, lm and ln are the axial lengths of the other two axes respectively, Ct is all traversal costs of the scene, and Csi is the intersection test cost of a straight line and a single triangle.

In S308, a plurality of sub models are obtained by performing scene segmentation on the three-dimensional model.

Therefore, the three-dimensional model is subjected to scene separation to obtain a plurality of sub-models, and the operation and maintenance work is realized through interface communication after the three-dimensional scene model with the interface communication of Unity3D is reconstructed.

According to the three-dimensional virtual scene-based visual interaction method, the authenticity and the real-time performance of the three-dimensional scene are greatly improved, the staff can conveniently master the conditions of data center equipment deployment, cable connection, power environment and the like, the operation and maintenance work of the data center is adjusted according to the conditions, and the scientization of the operation and maintenance work of the data center is facilitated.

Providing for data center scene interaction: the interactive system has the advantages that various interactive forms such as virtual hands, sound effects, animation embedding, graphic menus and the like are achieved, the use of the interface of a user is facilitated, the menus of the system are fully displayed through the two-dimensional graphic menu form, and the use of the user is facilitated. In the implementation effect, a user can indirectly complete part of the operation and maintenance work of the data center through interaction without entering the data center to operate as before. The inspection of the equipment inside the cabinet, the checking of the wiring of the server, the troubleshooting of an air conditioner and the like can be realized, and a series of inspection and operation and maintenance work can be realized.

According to the visualization interaction method based on the three-dimensional virtual scene, the following effects can be brought:

1. obtaining a three-dimensional model consistent with an actual scene through 3D modeling, and providing a simulated display platform for a user;

2. the power equipment, environment, security, network equipment and asset systems in the data center can be integrated to realize equipment monitoring visualization;

3. the visual angle is dynamically switched through a mouse and a keyboard, the operations such as rotation, forward and backward movement, pitching, amplifying, zooming and the like are carried out, and all the operations of a user are instantly presented by clicking a real object of equipment;

4. the property, state information, operation and maintenance information and the like of the assets can be displayed and can be edited on line;

5. the user can randomly designate a patrol route, set a patrol period and dynamically display the equipment state of a patrol area;

6. the platform provides two reminding modes of an alarm event list and an alarm mark under a visual interface, and the alarm can be automatically positioned to alarm equipment after alarming;

7. and capacity management, namely analyzing and displaying the capacity of the load bearing of the cabinet, the space of the cabinet and the power consumption of the cabinet.

The functions enrich the three-dimensional scene and improve the convenience of operation.

Those skilled in the art will appreciate that all or part of the steps implementing the above embodiments are implemented as computer programs executed by a CPU. When executed by the CPU, performs the functions defined by the above-described methods provided by the present disclosure. The program may be stored in a computer readable storage medium, which may be a read-only memory, a magnetic or optical disk, or the like.

Furthermore, it should be noted that the above-mentioned figures are only schematic illustrations of the processes involved in the methods according to exemplary embodiments of the present disclosure, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.

The following are embodiments of the disclosed apparatus that may be used to perform embodiments of the disclosed methods. For details not disclosed in the embodiments of the apparatus of the present disclosure, refer to the embodiments of the method of the present disclosure.

Fig. 5 is a block diagram illustrating a visual scheduling apparatus in accordance with an exemplary embodiment. The visual scheduling device comprises: a two-dimensional data module 502, a bounding box module 504, a segmentation module 506, a path module 508, and a display module 510.

The two-dimensional data module 502 is configured to obtain two-dimensional data of a target scene; the target scenario may be, for example, an automated dispatch room of a power distribution network. Load information of voltage, current, etc., is referred to as two-dimensional information.

The bounding box module 504 is used to build a three-dimensional model of the target scene through a scene bounding box. The method comprises the following steps: and establishing a three-dimensional model of the target scene through an AABB type scene bounding box. Bounding box is an algorithm for solving the optimal bounding space of a discrete point set, and the basic idea is to approximately replace complex geometric objects with a slightly larger and characteristically simple geometry (called bounding box).

The segmentation module 506 is configured to segment the three-dimensional model of the target scene to generate a plurality of sub-models; wherein segmenting the three-dimensional model of the target scene to generate a plurality of sub-models comprises: establishing a cost function; and generating a plurality of sub models by segmenting the three-dimensional model of the target scene through the cost function.

Wherein the cost function comprises:

C(V)＝Ct+Pl*C(Vl)+Pr*C(Vr)；

The path module 508 is configured to establish an information transmission path between the plurality of submodels; an information transmission path between the plurality of submodels is established through Unity 3D.

The display module 510 is configured to display the two-dimensional data in the three-dimensional model of the target scene through the information transmission path. And displaying the two-dimensional data in the three-dimensional model of the target scene through interface communication established by the Unity 3D.

Fig. 6 is a block diagram illustrating a visual scheduling apparatus in accordance with another exemplary embodiment. The visual scheduling device further comprises: an alert module 602.

The warning module 602 is configured to display warning information in the three-dimensional model of the target scene when the two-dimensional data does not satisfy a threshold condition.

An electronic device 200 according to this embodiment of the present disclosure is described below with reference to fig. 7. The electronic device 200 shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 7, the electronic device 200 is embodied in the form of a general purpose computing device. The components of the electronic device 200 may include, but are not limited to: at least one processing unit 210, at least one memory unit 220, a bus 230 connecting different system components (including the memory unit 220 and the processing unit 210), a display unit 240, and the like.

Wherein the storage unit stores program code executable by the processing unit 210 to cause the processing unit 210 to perform the steps according to various exemplary embodiments of the present disclosure described in the above-mentioned electronic prescription flow processing method section of the present specification. For example, the processing unit 210 may perform the steps shown in fig. 2 and 3.

The memory unit 220 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)2201 and/or a cache memory unit 2202, and may further include a read only memory unit (ROM) 2203.

The storage unit 220 may also include a program/utility 2204 having a set (at least one) of program modules 2205, such program modules 2205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.

Bus 230 may be one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

The electronic device 200 may also communicate with one or more external devices 300 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 200, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 200 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 250. Also, the electronic device 200 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 260. The network adapter 260 may communicate with other modules of the electronic device 200 via the bus 230. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, or a network device, etc.) to execute the above method according to the embodiments of the present disclosure.

Claims

1. A visualization interaction method based on a three-dimensional virtual scene is characterized by comprising the following steps:

acquiring two-dimensional data of a target scene;

establishing a three-dimensional model of the target scene through a scene bounding box;

segmenting the three-dimensional model of the target scene to generate a plurality of sub-models;

establishing an information transmission path among the plurality of submodels; and

displaying the two-dimensional data in a three-dimensional model of the target scene through the information transmission path;

2. The visual interaction method based on three-dimensional virtual scene as claimed in claim 1, wherein said cost function is: c (v) ═ Ct + Pl + c (vl) + Pr + c (vr)

3. The visual interaction method based on three-dimensional virtual scene as claimed in claim 1, further comprising:

displaying warning information in the three-dimensional model of the target scene when the two-dimensional data does not satisfy a threshold condition.

4. The visual interaction method based on three-dimensional virtual scene as claimed in claim 1, wherein the building of the three-dimensional model of the target scene through the scene bounding box comprises:

and establishing a three-dimensional model of the target scene through an AABB type scene bounding box.

5. The visual interaction method based on three-dimensional virtual scene as claimed in claim 1, wherein establishing the information transmission path between the plurality of submodels comprises:

an information transmission path between the plurality of submodels is established through Unity 3D.

6. Visual scheduling device, its characterized in that includes:

the two-dimensional data module is used for acquiring two-dimensional data of a target scene;

a bounding box module for building a three-dimensional model of the target scene by a scene bounding box

The segmentation module is used for segmenting the three-dimensional model of the target scene to generate a plurality of sub-models;

the path module is used for establishing an information transmission path among the plurality of submodels; and

and the display module is used for displaying the two-dimensional data in the three-dimensional model of the target scene through the information transmission path.

7. The visualization scheduling apparatus of claim 6, further comprising:

and the warning module is used for displaying warning information in the three-dimensional model of the target scene when the two-dimensional data does not meet the threshold condition.

8. An electronic device, comprising:

one or more processors;

storage means for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-5.