CN115795126A

CN115795126A - Visualization method based on Internet of things and related equipment

Info

Publication number: CN115795126A
Application number: CN202111058033.8A
Authority: CN
Inventors: 程志
Original assignee: Huawei Cloud Computing Technologies Co Ltd
Current assignee: Huawei Cloud Computing Technologies Co Ltd
Priority date: 2021-09-09
Filing date: 2021-09-09
Publication date: 2023-03-14

Abstract

The embodiment of the application discloses a visualization method based on the Internet of things and related equipment, and relates to the field of the Internet of things. The method specifically comprises the following steps: the method comprises the steps of establishing a digital twin model and a visualization model, wherein the digital twin model comprises a first model attribute, the visualization model comprises a second model attribute, associating the first model attribute with an Internet of things object, generating a mapping relation between the first model attribute and the second model attribute, associating the first model attribute to the second model attribute based on the mapping relation, enabling the second model attribute to change in real time based on the state of the Internet of things object, and enabling the visualization model to be used for driving a visualization engine to display the Internet of things object based on the second model attribute, so that the visualization model and the Internet of things object are decoupled through the digital twin model, the change of the Internet of things object has no influence on the visualization model, the source and the obtaining mode of data of each device do not need to be considered, and the processing of the visualization model is simplified.

Description

Visualization method based on Internet of things and related equipment

Technical Field

The embodiment of the application relates to the field of the Internet of things, in particular to a visualization method based on the Internet of things and related equipment.

Background

In the internet of things, objects in the physical world are often required to be visualized in the digital world, and the visualization of the internet of things is beneficial to monitoring and operating the physical world by managers, engineers and the like, and is a friendly man-machine interaction mode.

For the visualization of objects in the internet of things, not only the visualization of the surfaces of the objects but also the visualization of internal mechanisms of the objects, such as the temperature, humidity and the like from buildings, floors, rooms to rooms, and rooms are often required, and the content of detailed displays in the physical interior can be dynamically kept consistent with the physical world, such as the on-off state of a lamp in each room, the brightness change, the temperature change and the like. In order to associate the visual model of the object with the attribute of the equipment model, the value can be transmitted to the corresponding parameter of the visual model after the value of the equipment attribute is obtained, so that the visual and actual equipment state linkage dynamic effect is achieved.

However, the above method requires the visualization model to associate data of each device, and the visualization model needs to consider the source and the acquisition mode of the data of each device, so that the operation of the visualization model is complex, and furthermore, after the device of the object is changed, the configuration of the visualization model is changed in a linkage manner. For example, if a room has a temperature sensor, and the sensor device is damaged, and is replaced by another temperature sensor, the change of the unique identifier of the device may cause the visualization model to bind a new device again, further resulting in complex operation of the visualization model.

Disclosure of Invention

The embodiment of the application provides a visualization method based on the Internet of things, which is used for simplifying the processing of a visualization model. The embodiment of the application also provides a corresponding visualization device, a computer readable storage medium, a chip system, a computer program product and the like based on the Internet of things.

The application provides a visualization method based on the internet of things in a first aspect, and the visualization method comprises the following steps: establishing a digital twin model, wherein the digital twin model comprises a first model attribute; associating the first model attribute with the Internet of things object, so that the first model attribute changes in real time based on the state of the Internet of things object; establishing a visualization model, wherein the visualization model comprises a second model attribute; generating a mapping relation between the first model attribute and the second model attribute; and associating the first model attribute to the second model attribute based on the mapping relation, so that the second model attribute changes in real time based on the state of the Internet of things object, and the visualization model is used for driving the visualization engine to display the Internet of things object based on the second model attribute.

The digital twin model in the present application is a digital model of a physical object, i.e. an object of the internet of things, which can evolve in real time by receiving data from the physical object, thereby remaining consistent with the physical object throughout its life cycle.

The visualization model in the application can be visual in the digital world through driving the visualization engine to the object of the physical world, namely the object of the internet of things, so that the object of the internet of things can be displayed, monitoring and operation of the physical world by managers, engineers and the like are facilitated, and the method is a friendly man-machine interaction mode.

In this first aspect, a digital twin model is established, wherein the digital twin model includes a first model attribute; associating the first model attribute with the Internet of things object, so that the first model attribute changes in real time based on the state of the Internet of things object; establishing a visualization model, wherein the visualization model comprises second model attributes; generating a mapping relation between the first model attribute and the second model attribute; the first model attribute is associated to the second model attribute based on the mapping relation, so that the second model attribute changes in real time based on the state of the Internet of things object, the visualization model is used for driving the visualization engine to display the Internet of things object based on the second model attribute, the visualization model and the Internet of things object are decoupled through the digital twin model, the change of the Internet of things object has no influence on the visualization model, the source and the obtaining mode of data of each device do not need to be considered, and the processing of the visualization model is simplified.

In a possible implementation manner of the first aspect, the first model attributes correspond to the second model attributes one to one.

In the possible implementation manner, for a complex object of the internet of things, such as a building, a large machine or a road network, a large number of hundreds of sensor devices are often associated, if the direct visualization model is bound with the device model, the operation configuration is complex, many-to-many mapping relations exist, and when the first model attribute of the digital twin model corresponds to the second model attribute of the visualization model, the mapping relations of the visualization model can be simplified into one-to-one, so that the processing of the visualization model is further simplified.

In a possible implementation manner of the first aspect, the method further includes: receiving a query instruction input by a user, wherein the query instruction comprises first attribute information; and displaying second attribute information in the second model attribute in the Internet of things object, wherein the second attribute information corresponds to the first attribute information.

In the possible implementation mode, the user can directly input the query command and then display the information corresponding to the query command, so that the user experience is improved.

In a possible implementation manner of the first aspect, the method further includes: receiving a control instruction input by a user, wherein the control instruction comprises third attribute information; acquiring an Internet of things object corresponding to the third attribute information; and controlling the Internet of things object corresponding to the third attribute information based on the control instruction.

In the possible implementation mode, the user can directly input the control command and then control the corresponding object of the internet of things based on the control command, so that the user experience is improved.

In a possible implementation manner of the first aspect, the first model attribute includes fourth attribute information, and the fourth attribute information is calculated for the digital twin model.

In this possible implementation, some attributes cannot be directly provided through the attributes of the internet of things object, such as whether a road is congested or not, the average room temperature, and the like. If the visualization model is to be displayed, computing power needs to be provided, and often the background of the visualization model does not have a large amount of computing power and computing methods, so that the visualization model can be calculated through a digital twin model, and the first model attribute also comprises attribute information calculated by the digital twin model, so that the visualization model can display attributes which cannot be directly provided through an object of the internet of things.

In a possible implementation manner of the first aspect, the visualization model is a three-dimensional dynamic model, and the visualization engine is a three-dimensional dynamic engine.

In the possible implementation mode, the visualization model and the visualization engine are realized based on three-dimensional dynamic, and the realizability of the scheme is improved.

In a possible implementation manner of the first aspect, the internet of things object includes an internet of things device and an object composed of the internet of things device.

In the possible implementation mode, when the digital twin model and the visual model are modeled, the modeling can be performed on the Internet of things equipment, and the modeling can also be performed on the object formed by the Internet of things equipment, so that a more comprehensive physical network object can be displayed, and the user experience is further improved.

In a second aspect of the present application, an internet of things based visualization apparatus is provided, configured to perform the method of the first aspect or any possible implementation manner of the first aspect. In particular, the internet of things based visualization apparatus comprises means or units for performing the method of the first aspect or any possible implementation manner of the first aspect, such as: the device comprises a first establishing unit, a first association unit, a second establishing unit, a generating unit, a second association unit, a first receiving unit, a display unit, a second receiving unit, an obtaining unit and a control unit.

A third aspect of the present application provides a computer device comprising a processor, a communication interface and a memory for storing program code, the processor being configured to invoke the program code in the memory to cause the controller to perform the first aspect or the method of any possible implementation of the first aspect.

A fourth aspect of the present application provides a computer-readable storage medium storing one or more computer-executable instructions that, when executed by a processor, cause the processor to perform a method according to the first aspect or any one of the possible implementations of the first aspect.

A fifth aspect of the present application provides a computer program product storing one or more computer executable instructions that, when executed by a processor, cause the processor to perform a method as set forth in the first aspect or any one of the possible implementations of the first aspect.

A sixth aspect of the present application provides a chip system, which includes at least one processor and an interface, where the interface is configured to receive data and/or signals, and the at least one processor is configured to support a computer device to implement the functions recited in the first aspect or any one of the possible implementation manners of the first aspect. In one possible design, the system-on-chip may further include a memory, the memory storing program instructions and data necessary for the computer device. The chip system may be constituted by a chip, or may include a chip and other discrete devices.

In the embodiment of the application, a digital twinning model is established, wherein the digital twinning model comprises a first model attribute; associating the first model attribute with the Internet of things object, so that the first model attribute changes in real time based on the state of the Internet of things object; establishing a visualization model, wherein the visualization model comprises second model attributes; generating a mapping relation between the first model attribute and the second model attribute; the first model attribute is associated to the second model attribute based on the mapping relation, so that the second model attribute changes in real time based on the state of the Internet of things object, the visualization model is used for driving the visualization engine to display the Internet of things object based on the second model attribute, the visualization model and the Internet of things object are decoupled through the digital twin model, the change of the Internet of things object has no influence on the visualization model, the source and the obtaining mode of data of each device do not need to be considered, and the processing of the visualization model is simplified.

Drawings

FIG. 1 is a visual architecture diagram of the Internet of things;

fig. 2 is a schematic diagram of an embodiment of a visualization method based on the internet of things according to an embodiment of the present application;

FIG. 3 is a diagram illustrating a digital twinning model according to an embodiment of the present disclosure;

FIG. 4 is another schematic diagram of a digital twinning model provided in an embodiment of the present application;

FIG. 5 is a schematic view of a visualization model provided in an embodiment of the present application;

FIG. 6 is another schematic view of a visualization model provided in an embodiment of the present application;

fig. 7 is a schematic diagram of a mapping relationship between a first model attribute and a second model attribute provided in the embodiment of the present application;

fig. 8 is an architecture diagram of a visualization of the internet of things provided in the embodiment of the present application;

fig. 9 is a schematic diagram of another embodiment of a visualization method based on the internet of things according to an embodiment of the present application;

fig. 10 is a schematic diagram of another embodiment of a visualization method based on the internet of things according to an embodiment of the present application;

fig. 11 is a schematic view of an embodiment of an internet of things-based visualization apparatus provided in an embodiment of the present application;

fig. 12 is a schematic diagram of an embodiment of a computer device according to an embodiment of the present application.

Detailed Description

Embodiments of the present application will now be described with reference to the accompanying drawings, and it is to be understood that the described embodiments are merely illustrative of some, but not all, embodiments of the present application. As can be known to those skilled in the art, with the development of technology and the emergence of new scenarios, the technical solution provided in the embodiments of the present application is also applicable to similar technical problems.

The terms "first," "second," and the like in the description and in the claims of the present application and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The embodiment of the application provides a visualization method based on the Internet of things and related equipment, which are used for simplifying the processing of a visualization model. The embodiment of the application also provides a corresponding visualization device, a computer readable storage medium, a chip system, a computer program product and the like based on the Internet of things. The following are detailed below.

The Internet of Things (IOT) refers to the technology and devices that collect any object or process that needs monitoring, connection, and interaction in real time, collect various information needed by sound, light, heat, electricity, mechanics, chemistry, biology, location, etc. through various possible network accesses, so as to realize ubiquitous connection between objects and people, and realize intelligent sensing, identification, and management of objects and processes. The internet of things is an information bearer based on the internet, a traditional telecommunication network and the like, and all common physical objects which can be independently addressed form an interconnected network.

Illustratively, the thing in the internet of things is a garden, a building is arranged in the garden, a floor is arranged in the building, and a room is arranged in the floor. For remote visual checking of a park, a visual model is used when a worker needs to check the state of a certain house or the state of a certain room. "thing" can also be the mill in the thing networking, has the production line in the mill so, has equipment in producing the line, has multiple part in the equipment. When the remote visual observation of a factory is carried out, a worker needs to check the state of a strip production line or the internal state of a certain production device, and a visual model is used.

The digital twin model is a digital model of a physical object, i.e., an object of the internet of things, which can evolve in real time by receiving data from the physical object so as to be consistent with the physical object throughout its life cycle.

The visualization model can visualize objects in the physical world, namely objects in the internet of things, in the digital world by driving the visualization engine, namely the objects in the internet of things display the objects in the internet of things, so that management personnel, engineers and the like can monitor and operate the physical world, the visualization model is a friendly man-machine interaction mode, and the visualization model can specifically drive the visualization engine to display in two dimensions or three dimensions.

As shown in fig. 1, when the internet of things object is visually displayed, a visual model may be established through a computer device or other device with a computing function, a corresponding device model is established based on the internet of things object, and after the device model of the internet of things object is associated to the visual model, the visual model may drive a visualization engine to display the internet of things object in a display module.

The visualization method based on the internet of things provided by the embodiment of the present application is described below with reference to the concept and application scenario of the internet of things, as shown in fig. 2, an embodiment of the visualization method based on the internet of things provided by the embodiment of the present application includes:

201. and establishing a digital twin model.

When the internet of things object needs to be visually displayed, a digital twin model needs to be established, the established digital twin model comprises a plurality of first model attributes, and each first model attribute is used for representing one internet of things object.

Referring to fig. 3, for example, if a house needs to be visually displayed, the internet of things object includes the house itself, floors, rooms and lamps, the house includes a first floor and a second floor, the first floor includes a first room, the second floor includes a second room, and the first room includes lamps.

Referring to fig. 4, the first model attribute specifically includes an Identity (ID) of an object of the internet of things, a relationship, an attribute, an event, and a command. Illustratively, the digital twin model includes the Internet of things object ID, that is, the Thing ID, the first model attributes of T001, T002, and T003, respectively, for T001 there are relationships R001 and ROO2, there are attributes P001 and P002, etc., there are events E001 and E002 waiting, there are commands C001 and C002, etc., for T002 there is relationship R-1, that is, meaning T002 is contained in T001, there is attribute P001, etc., there is event E001, etc., there is command C001, etc., for T003 there is relationship R-2, that is, meaning T003 is contained in T001, there is attribute P001, etc., there is event E001, etc., there is command C001, etc.

More specifically, the TOO1 may be used to represent a house in an object of internet of things, the TOO2 and the T003 may be used to represent a floor one and a floor two in the house respectively, where the attributes may be a height P001 of the house T001, a position P002 of the house T001, a height P001 of the floor one T002, a height P001 of the floor two T003, and the like, the event may be an exterior E001 of the house T001, a color E002 of the house T001, a pattern E001 of the floor one T002, a pattern E001 of the floor two T003, and the like, the command may be to turn on C001 by controlling all the lights of the house T001, turn on C001 by controlling all the lights of the floor one T002, turn on C001 by controlling all the lights of the floor two T003, and the like.

It should be noted that the event and the command are unknown after the modeling is completed, the event occurs only after the first model attribute is associated with the object of the internet of things, and the command occurs only when the visualization model is displayed.

202. And associating the first model attribute with the Internet of things object, so that the first model attribute changes in real time based on the state of the Internet of things object.

Before the first model attribute is associated with the internet of things object, an equipment model needs to be established for the internet of things object, wherein the internet of things object comprises internet of things equipment and an object composed of the internet of things equipment, a sensor is arranged on the internet of things equipment, for example, the internet of things equipment is a sweeping robot, a position sensor is arranged on the sweeping robot, the position sensor can periodically report parameters, for example, longitude, latitude, altitude, speed and direction, the equipment model can define the data format of the position sensor on the sweeping robot, the established equipment model can be directly associated with the first model attribute, for example, the internet of things equipment comprises the sweeping robot and a lamp, the object composed of the internet of things equipment comprises a house, a floor I and a floor II, the sweeping robot is arranged on the floor I, and the lamp is arranged on the floor II, association of the relation can be completed based on the data format, the corresponding attribute can directly associate sensor information on the physical network equipment with the attribute in the first model attribute, and the attribute of the equipment composed of the internet of things equipment can be input by a user in advance.

After the association is completed, the values of the attributes such as P001 and P002 are not known any more, but are based on the values after the association of the device model, that is, the first model attribute changes in real time based on the state of the object of the internet of things, and at this time, the corresponding event can be obtained based on the value of the current attribute.

In addition, the first model attribute comprises fourth attribute information, wherein the fourth attribute information is obtained by calculation for the digital twin model. That is, there is fourth attribute information in the attribute of the first model, for example, the attribute of the sweeping robot T004 includes pressure P003, but the parameter reported in the sensor of the sweeping robot does not include pressure, the digital twin model can provide calculation capability, and the pressure is calculated according to the existing attribute parameter to obtain attribute pressure P003, that is, the fourth attribute information.

203. And establishing a visual model.

The established visualization model comprises a plurality of second model attributes, and each second model attribute is used for representing an object of the internet of things. In addition, the first model attributes correspond to the second model attributes one to one, and the visual model is a three-dimensional dynamic model.

Referring to fig. 3 and 5, the internet of things object includes a house itself, floors, rooms and lamps, the house includes a first floor and a second floor, the first floor includes a first room, the second floor includes a second room, and the first room includes lamps.

Referring to fig. 4 and 6, the second model attribute specifically includes an internet of things object ID, a display attribute, a real-time display event, and a control command, and referring to fig. 5, where a relationship of the visualization model is embodied in the visualization model modeling, that is, when there is a relationship between internet of things objects, the relationship can be embodied in the built visualization model, an attribute of the first model attribute corresponds to the display attribute of the second model attribute, an event of the first model attribute corresponds to the real-time display event of the second model attribute, and a command of the first model attribute corresponds to the control command of the second model attribute.

Illustratively, the digital twin model comprises first model attributes of which the object IDs of the internet of things are 3D-001, 3D-002 and 3D-003 respectively, for 3D-001, display attributes 3D-P001 and 3D-P002 exist, real-time display events 3D-E001 and 3D-E002 exist, and control commands 3D-C001 and 3D-C002 exist, and other objects of the internet of things are similar, and the description of the embodiment of the application is omitted.

204. And generating a mapping relation between the first model attribute and the second model attribute.

Referring to fig. 7, after the digital twin model and the visualization model are built, a mapping relationship between the first model attribute and the second model attribute may be generated, so that the first model attribute corresponds to the second model attribute one to one. Specifically, the visualization model is a 3D model.

205. And associating the first model attribute to the second model attribute based on the mapping relation, so that the second model attribute changes in real time based on the state of the object of the internet of things.

After associating the first model attribute to the second model attribute based on the mapping relationship, the values of the second model attribute in the visualization model are associated, for example, the values of 3D-P001 and 3D-P002, etc. are no longer unknown, but are associated by the values in the first model attribute, i.e., the second model attribute is changed in real time based on the state of the object of the internet of things.

After the association is completed, the visualization model can be used for driving the visualization engine to display the internet of things object based on the second model attribute, wherein the visualization engine is a three-dimensional dynamic engine, and therefore three-dimensional dynamic display of the physical network object can be completed. When the attribute of the digital twin model is changed or an event is generated, the display attribute of the visualization model and the change of the real-time display event are informed in real time, and the internet of things object displayed by the visualization engine is changed in a linkage manner.

For example, referring to fig. 8, when a type a arm of a real device of an object of the internet of things needs to be visually displayed, a digital twin model is established, where a hand, a wrist, a first arm, a second arm, and a base of the arm need to be displayed, the digital twin model includes 6 first model attributes, and an object ID of the internet of things is the arm, the hand, the wrist, the first arm, the second arm, and the base, respectively, the hand is provided with a sensor for monitoring a vacuum value and a pressure, the wrist is provided with a sensor for monitoring a direction and a speed, the first arm is provided with a sensor for monitoring a direction, a speed, and an angle, the second arm is not provided with a sensor, the base is provided with a sensor for monitoring a direction and a rotation speed, and in the established digital twin model, the hand includes an attribute vacuum value and a pressure, the wrist includes an attribute direction and a speed, the first arm includes an attribute direction, an angle, and a speed, and the base includes an attribute direction and a rotation speed. After the digital twin model is established, the numerical values recorded by the sensors in the object of the internet of things can be associated to the attributes of the first model attributes in the digital twin model, such as the sensor 1, the sensor 2, the sensor 3 and the sensor 4, based on the equipment model. And then establishing a visual model, wherein the visual model comprises a second model attribute, generating a mapping relation between the first model attribute and the second model attribute, using the mapping relation in a visual model and a digital twin model mapping module, relating the first model attribute to the second model attribute based on the mapping relation, driving a visual engine to display the object of the internet of things based on the second model attribute by the visual model, namely, displaying the mechanical arm as a dynamic three-dimensional display of a virtual 3D display model, wherein the mechanical arm is consistent with a physical entity of the mechanical arm, and in addition, displaying the attributes in the various first model attributes on the mechanical arm displayed by the visual engine, and further displaying the value corresponding to the attributes after clicking by a user. When the mechanical arm changes, the digital twin model changes correspondingly, and an updating notice is sent to the visual model and the digital twin model mapping module, so that the visual model and the digital twin model mapping module update the data of the visual model in the virtual 3D display module.

For complex objects of the internet of things, such as buildings, large machines and road networks, a large number of hundreds of sensor devices have properties, so that the binding operation configuration of the visualization model and the device model is complex, and the linkage change of the configuration of the visualization model can be caused after the devices of the objects of the internet of things are changed. For example, if one room has one temperature sensor, the sensor device is damaged and is replaced by another temperature sensor, the unique internet of things object ID of the device changes, which causes the visual model to bind new devices again, and after the visual model is decoupled from the internet of things object through the digital twin model, the operation of the visual model becomes simple, and in addition, the digital twin model can provide the computing power which the visual model does not have, so that the attributes which cannot be directly provided through the attributes of the internet of things object, such as whether a road is congested and the average temperature of the room, can be computed. By introducing the digital twin model, the data of the physical world can be conveniently bound by the visual model. Because the digital twin model is used for modeling the physical world, the visual model and the digital twin level can be in one-to-one correspondence, the visualization of different levels of details when the visual model is zoomed is supported, the visualization is performed from the outside of the object of the internet of things to the inside module of the object of the internet of things, and the 2D/3D visual model and the equipment model of the object of the internet of things are decoupled. The change of the object of the Internet of things has small influence on the visualization model.

After the visual display of the object of the internet of things is completed, a query command and a control command can be input into the object of the internet of things, namely, the virtual 3D display module sends a data query or data modification command to the visual model and the digital twin model mapping module, and the visual model and the digital twin model mapping module respectively send a query operation and a modification operation to the digital twin model, so as to query or control the object of the internet of things, which is described below.

1. The user specifies to query a specific internet of things object:

referring to fig. 9, after steps 201 to 205 are performed, the following steps may be further performed:

901. and receiving a query instruction input by a user.

902. And displaying second attribute information in the second model attribute in the Internet of things object.

After the visualization model drives the visualization engine to display the internet of things object based on the second model attribute, the internet of things object is displayed in the display module, and the user can also input a query instruction in the display module, wherein the query instruction comprises first attribute information, and the first attribute information can be any attribute in the digital twin model, can also be any display attribute in the visualization model, and can also be an unknown attribute.

After the first attribute information is acquired, second attribute information corresponding to the first attribute information can be found in the second model attribute, and the second attribute information in the second model attribute is displayed in the object of the internet of things.

For example, when the visualization engine displays the mechanical arm, the user may query the non-displayed content, input a query instruction, where the query instruction may include the speed of the first arm and the speed of the second arm, i.e., the first attribute information, and then display the speed of the first arm in the second model attribute in the mechanical arm, but the speed of the second arm is unknown, and the digital twin model may calculate the estimated speed of the second arm according to the attribute of the first arm and the attribute of the base, and then associate the estimated speed of the second arm with the second model attribute, and finally display the estimated speed of the second arm in the mechanical arm.

2. The user specifies to control a particular internet of things object:

referring to fig. 10, after steps 201 to 205 are performed, the following steps may be further performed:

1001. and receiving a control instruction input by a user.

1002. And acquiring the Internet of things object corresponding to the third attribute information.

1003. And controlling the Internet of things object corresponding to the third attribute information based on the control instruction.

After the visualization model drives the visualization engine to display the internet of things object based on the second model attribute, the internet of things object is displayed in the display module, and a user can also input a control instruction in the display module, wherein the control instruction comprises third attribute information, and the third attribute information can be any command in the digital twin model or any control command in the visualization model.

After the third attribute information is obtained, the internet of things object corresponding to the third attribute information can be found in the first model attribute or the second model attribute, and then the internet of things object corresponding to the third attribute information can be controlled based on the control instruction, wherein a networked controller needs to be arranged in the internet of things object to realize control, and corresponding events can be generated after control and correspond to the events in the first model attribute and the real-time display events in the second model attribute.

For example, when the visualization engine displays the mechanical arm, a user may input a control instruction, where the control instruction may include controlling rotation of the first arm, that is, third attribute information, that is, a command in the first model attribute and a control command in the second model attribute, at this time, it may be obtained that the object of the internet of things corresponding to the third attribute information is the first arm, and then the mechanical arm is controlled based on the control instruction, specifically, rotation of the mechanical arm is controlled, at this time, the user completes operation of the virtual three-dimensional module displayed by the visualization engine, so as to control the first arm of the real device, and after the control is completed, a corresponding event may be generated, at this time, an event that the first arm rotates may be displayed when the mechanical arm is displayed, and at this time, the user side may view that the first arm in the virtual mechanical arm rotates, and an operation conforming to the control command is completed.

As shown in fig. 11, an embodiment of an internet of things-based visualization apparatus 1100 provided in an embodiment of the present application includes:

a first establishing unit 1101 for establishing a digital twin model, the digital twin model comprising first model attributes; the first setup unit 1101 may perform step 201 in the above-described method embodiment.

A first associating unit 1102, configured to associate the first model attribute with the internet of things object, so that the first model attribute changes in real time based on a state of the internet of things object; the first associating unit 1102 may perform step 202 in the above-described method embodiment.

A second establishing unit 1103, configured to establish a visualization model, where the visualization model includes a second model attribute; the second establishing unit 1103 may perform step 203 in the above-described method embodiment.

A generating unit 1104, configured to generate a mapping relationship between the first model attribute and the second model attribute; the generating unit 1104 may perform step 204 in the above-described method embodiments.

A second associating unit 1105, configured to associate the first model attribute to a second model attribute based on the mapping relationship, so that the second model attribute changes in real time based on a state of the internet of things object, where the visualization model is configured to drive a visualization engine to display the internet of things object based on the second model attribute; the second associating unit 1105 may perform step 205 in the above-described method embodiment.

In the embodiment of the present application, the first establishing unit 1101 establishes a digital twin model, where the digital twin model includes a first model attribute; the first association unit 1102 associates the first model attribute with the internet of things object, so that the first model attribute changes in real time based on the state of the internet of things object; the second establishing unit 1103 establishes a visualization model, wherein the visualization model includes a second model attribute; the generation unit 1104 generates a mapping relationship of the first model attribute and the second model attribute; the second associating unit 1105 associates the first model attribute with the second model attribute based on the mapping relationship, so that the second model attribute changes in real time based on the state of the internet of things object, and the visualization model is used for driving the visualization engine to display the internet of things object based on the second model attribute, so that the visualization model and the internet of things object are decoupled through the digital twin model, so that the change of the internet of things object has no influence on the visualization model, the source and the obtaining mode of data of each device do not need to be considered, and the processing of the visualization model is simplified.

Optionally, the first model attribute corresponds to the second model attribute one to one.

Optionally, the visualization apparatus of the internet of things further includes: a first receiving unit 1106, configured to receive a query instruction input by a user, where the query instruction includes first attribute information; the displaying unit 1107 is configured to display second attribute information in the second model attribute in the internet of things object, where the second attribute information corresponds to the first attribute information.

Optionally, the visualization apparatus of the internet of things further includes: a second receiving unit 1108, configured to receive a control instruction input by a user, where the control instruction includes third attribute information; an obtaining unit 1109, configured to obtain an internet of things object corresponding to the third attribute information; the control unit 1110 is configured to control the internet of things object corresponding to the third attribute information based on the control instruction.

Optionally, the first model attribute includes fourth attribute information, and the fourth attribute information is calculated for the digital twin model.

Optionally, the visualization model is a three-dimensional dynamic model, and the visualization engine is a three-dimensional dynamic engine.

Optionally, the internet of things object includes an internet of things device and an object composed of the internet of things device.

Fig. 12 is a schematic diagram of a possible logical structure of a computer device 1200 according to an embodiment of the present application. The computer device 1200 includes: a processor 1201, a communication interface 1202, a storage system 1203, and a bus 1204. The processor 1201, the communication interface 1202, and the storage system 1203 are connected to each other by a bus 1204. In an embodiment of the present application, the processor 1201 is configured to control and manage actions of the computer device 1200, for example, the processor 1201 is configured to execute the method for visualization based on the internet of things described in the foregoing embodiment. The communication interface 1202 is used to support communication for the computer device 1200. A storage system 1203 for storing program codes and data of the computer device 1200.

The processor 1201 may be, for example, a central processing unit, a general purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor 1201 may also be a combination of computing functions, e.g., a combination comprising one or more microprocessors, a digital signal processor and a microprocessor, or the like. The bus 1204 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 12, but this is not intended to represent only one bus or type of bus.

In another embodiment of the present application, a computer-readable storage medium is further provided, in which computer-executable instructions are stored, and when the at least one processor of the device executes the computer-executable instructions, the device executes the method for visualization based on the internet of things described in the foregoing embodiment.

In another embodiment of the present application, there is also provided a computer program product comprising computer executable instructions stored in a computer readable storage medium; the at least one processor of the device may read the computer-executable instructions from the computer-readable storage medium, and the execution of the computer-executable instructions by the at least one processor causes the device to perform the internet of things-based visualization method described in the above embodiments.

In another embodiment of the present application, a chip system is further provided, where the chip system includes at least one processor and an interface, the interface is configured to receive data and/or signals, and the at least one processor is configured to support implementation of the internet of things based visualization method described in the foregoing embodiment. In one possible design, the system-on-chip may further include a memory, storage, for storing necessary program instructions and data for the computer device. The chip system may be constituted by a chip, or may include a chip and other discrete devices.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and the like.

Claims

1. A visualization method based on the Internet of things is characterized by comprising the following steps:

establishing a digital twin model, the digital twin model comprising a first model attribute;

associating the first model attribute with an Internet of things object, so that the first model attribute changes in real time based on the state of the Internet of things object;

establishing a visualization model, wherein the visualization model comprises a second model attribute;

generating a mapping relation between the first model attribute and the second model attribute;

associating the first model attribute to the second model attribute based on the mapping relationship such that the second model attribute changes in real-time based on a state of the internet of things object, the visualization model to drive a visualization engine to display the internet of things object based on the second model attribute.

2. The method of claim 1, wherein the first model attributes correspond one-to-one with the second model attributes.

3. The method according to claim 1 or 2, characterized in that the method further comprises:

receiving a query instruction input by a user, wherein the query instruction comprises first attribute information;

and displaying second attribute information in the second model attribute in the internet of things object, wherein the second attribute information corresponds to the first attribute information.

4. The method according to claim 1 or 2, characterized in that the method further comprises:

receiving a control instruction input by a user, wherein the control instruction comprises third attribute information;

acquiring an Internet of things object corresponding to the third attribute information;

and controlling the Internet of things object corresponding to the third attribute information based on the control instruction.

5. The method of claim 1 or 2, wherein the first model attribute comprises fourth attribute information calculated for the digital twin model.

6. The method of claim 1 or 2, wherein the visualization model is a three-dimensional dynamic model and the visualization engine is a three-dimensional dynamic engine.

7. The method of claim 1 or 2, wherein the internet of things objects comprise internet of things devices and objects composed of the internet of things devices.

8. A visualization device based on the Internet of things is characterized by comprising:

a first establishing unit for establishing a digital twin model, the digital twin model comprising a first model property;

the first association unit is used for associating the first model attribute with the Internet of things object, so that the first model attribute changes in real time based on the state of the Internet of things object;

a second establishing unit, configured to establish a visualization model, where the visualization model includes a second model attribute;

the generating unit is used for generating a mapping relation between the first model attribute and the second model attribute;

a second associating unit, configured to associate the first model attribute to the second model attribute based on the mapping relationship, so that the second model attribute changes in real time based on a state of the internet of things object, where the visualization model is configured to drive a visualization engine to display the internet of things object based on the second model attribute.

9. The apparatus of claim 8, wherein the first model attributes correspond one-to-one with the second model attributes.

10. The apparatus of claim 8 or 9, further comprising:

the first receiving unit is used for receiving a query instruction input by a user, and the query instruction comprises first attribute information;

and the display unit is used for displaying second attribute information in the second model attribute in the internet of things object, wherein the second attribute information corresponds to the first attribute information.

11. The apparatus of claim 8 or 9, further comprising:

the second receiving unit is used for receiving a control instruction input by a user, and the control instruction comprises third attribute information;

an obtaining unit, configured to obtain an internet of things object corresponding to the third attribute information;

and the control unit is used for controlling the Internet of things object corresponding to the third attribute information based on the control instruction.

12. The apparatus of claim 8 or 9, wherein the first model attribute comprises fourth attribute information calculated for the digital twin model.

13. The apparatus of claim 8 or 9, wherein the visualization model is a three-dimensional dynamic model and the visualization engine is a three-dimensional dynamic engine.

14. The apparatus of claim 8 or 9, wherein the internet of things objects comprise internet of things devices and objects composed of the internet of things devices.

15. A computer device, comprising: a processor, a communication interface, and a memory for storing program code, the processor for invoking the program code in the memory to cause the controller to perform the method of any of claims 1-7.

16. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-7.

17. A chip system, comprising at least one processor and an interface for receiving data and/or signals, the at least one processor being configured to perform the method according to any of claims 1-7.

18. A computer program product having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method according to any of claims 1-7.