CN115529201A - Method, system, device, server and storage medium for generating family environment panorama based on digital twinning - Google Patents
Method, system, device, server and storage medium for generating family environment panorama based on digital twinning Download PDFInfo
- Publication number
- CN115529201A CN115529201A CN202210607901.1A CN202210607901A CN115529201A CN 115529201 A CN115529201 A CN 115529201A CN 202210607901 A CN202210607901 A CN 202210607901A CN 115529201 A CN115529201 A CN 115529201A
- Authority
- CN
- China
- Prior art keywords
- bound
- equipment
- preset area
- preset
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000010586 diagram Methods 0.000 claims description 23
- 238000004891 communication Methods 0.000 claims description 13
- 230000003993 interaction Effects 0.000 abstract description 7
- 238000010408 sweeping Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/35—Categorising the entire scene, e.g. birthday party or wedding scene
- G06V20/36—Indoor scenes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W8/00—Network data management
- H04W8/005—Discovery of network devices, e.g. terminals
Abstract
The application relates to the technical field of digital twins, and discloses a method for generating a family environment panorama based on digital twins, which is applied to a server side and comprises the following steps: determining equipment to be bound in a preset area, judging whether image recognition equipment exists in the preset area or not, and obtaining a judgment result; acquiring a house type graph corresponding to the preset area according to the judgment result; and binding the equipment to be bound with a preset central control screen end, and positioning the bound equipment to be bound in the household type graph to obtain a household environment panoramic graph. Therefore, the bound devices to be bound can be displayed in the family environment panoramic image in real time, the positions of the bound devices in the family environment panoramic image are the same as the actual positions of the bound devices in the preset area, a user can conveniently find out the devices to be controlled, and the interaction experience of the user and the intelligent household device is improved. The application also discloses a system and a device for generating the family environment panorama based on the digital twin, a server and a storage medium.
Description
Technical Field
The present application relates to the field of digital twin technology, and for example, to a method, a system, an apparatus, a server, and a storage medium for generating a panoramic view of a home environment based on digital twin.
Background
Along with the improvement of living standard, more and more intelligent home devices in a user's house need a central control screen end to bind with each intelligent home device to show information such as device name and position of intelligent home device on the display screen of central control screen end in the form of card information. The user can conveniently control each intelligent household device and check the device state through the central control screen terminal. With the development of the information age, the digital twin technology has become an important method for realizing smart families. The digital twin is to create a virtual model of a physical entity in an information space in a digital manner, and simulate the behavior of the physical entity in a real environment by using data. And more optimization decisions are provided for the physical entity through information fusion and data interaction between the virtual model and the physical entity.
In the process of implementing the embodiments of the present disclosure, it is found that at least the following problems exist in the related art:
in the related art, card information corresponding to each intelligent home device is displayed on the side of the central control screen, and a user can select the intelligent home device to be controlled from the plurality of card information easily and mistakenly, so that the user is inconvenient to find and control, and the interactive experience between the user and the intelligent home device is poor.
Disclosure of Invention
The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview nor is intended to identify key/critical elements or to delineate the scope of such embodiments but rather as a prelude to the more detailed description that is presented later.
The embodiment of the disclosure provides a method, a system, a device, a server and a storage medium for generating a family environment panorama based on a digital twin, so as to improve the interaction experience between a user and intelligent household equipment.
In some embodiments, the method for generating a panoramic view of a home environment based on digital twins is applied to a server side, and the method comprises the following steps: determining equipment to be bound in a preset area, judging whether image recognition equipment exists in the preset area or not, and obtaining a judgment result; acquiring a house type graph corresponding to the preset area according to the judgment result; and binding the equipment to be bound with a preset central control screen end, and positioning the bound equipment to be bound in the household type graph to obtain a household environment panoramic graph so as to realize digital twinning of the household environment.
In some embodiments, the determining the device to be bound in the preset area includes: and scanning the equipment by using a preset wireless communication mode, and determining the scanned equipment as the equipment to be bound.
In some embodiments, the determining whether the image recognition device exists in the preset area to obtain the determination result includes: and under the condition that the equipment with the camera device exists in the preset area, determining that the image recognition equipment exists as a judgment result.
In some embodiments, the determining whether the image recognition device exists in the preset area to obtain the determination result includes: and under the condition that the equipment with the camera device does not exist in the preset area, determining that the image recognition equipment does not exist in the judgment result.
In some embodiments, obtaining the house type graph corresponding to the preset area according to the determination result includes: and under the condition that the image recognition device exists in the judgment result, carrying out image scanning on the preset area by using the image recognition device to obtain the house type picture.
In some embodiments, obtaining the house type map corresponding to the preset area according to the determination result includes: and acquiring first position information corresponding to the preset area under the condition that the image recognition device does not exist in the judgment result. And acquiring a house type graph corresponding to the preset area according to the first position information.
In some embodiments, obtaining the first position information corresponding to the preset area includes: and acquiring a first longitude and latitude coordinate of the central control screen end, and determining the first longitude and latitude coordinate as first position information corresponding to a preset area.
In some embodiments, obtaining the house type map corresponding to the preset area according to the first position information includes: matching a house type graph corresponding to the first position information from a preset house type graph database; the family type graph database stores the corresponding relation between the first position information and the family type graph.
In some embodiments, performing device location on the bound devices to be bound in the household graph to obtain a household environment panorama, includes: and acquiring second position information and equipment information of the bound equipment to be bound, and acquiring an equipment thumbnail model diagram of the bound equipment to be bound according to the equipment information. And positioning the equipment thumbnail model image to the position in the household type image, which is the same as the second position information, so as to obtain the family environment panoramic image.
In some embodiments, obtaining the second location information of the bound device to be bound includes: and acquiring a second longitude and latitude coordinate of the bound device to be bound, and determining the second longitude and latitude coordinate as second position information of the bound device to be bound.
In some embodiments, the device information includes a device model of the bound device to be bound; acquiring an equipment thumbnail model diagram of the bound equipment to be bound according to the equipment information, wherein the equipment thumbnail model diagram comprises the following steps: and matching a device thumbnail model graph corresponding to the device model from a preset device thumbnail model graph database. The device thumbnail model database stores the corresponding relationship between the device model and the device thumbnail model map.
In some embodiments, the system for generating a panoramic view of a home environment based on digital twins comprises: the server is configured to determine equipment to be bound in a preset area, judge whether image recognition equipment exists in the preset area and obtain a judgment result; acquiring a house type graph corresponding to the preset area according to the judgment result; binding the equipment to be bound with a preset central control screen end, and positioning the equipment to be bound in the household type graph to obtain a household environment panoramic graph; sending the family environment panoramic image to the central control screen end, and triggering the central control screen end to display the family environment panoramic image; and the central control screen terminal is configured to receive the family environment panoramic image sent by the server and display the family environment panoramic image.
In some embodiments, the apparatus for generating a home environment panorama based on digital twins comprises a processor and a memory storing program instructions, the processor being configured to execute the method for generating a home environment panorama based on digital twins as described above when executing the program instructions.
In some embodiments, the server comprises the above apparatus for generating a panoramic view of a home environment based on digital twins.
In some embodiments, the storage medium stores program instructions that, when executed, perform the above-described method of generating a panoramic view of a home environment based on digital twins.
The method, the system, the device, the server and the storage medium for generating the family environment panorama based on the digital twin, which are provided by the embodiment of the disclosure, can realize the following technical effects: the device to be bound is bound with a preset central control screen end, and the bound device to be bound is positioned in a household type graph in a preset area, so that a household environment panoramic graph is obtained. Therefore, the bound devices to be bound can be displayed in real time in the family environment panoramic image, the positions of the bound devices to be bound in the family environment panoramic image are the same as the actual positions of the bound devices in the preset area, a user can conveniently find out the devices to be controlled, the user can conveniently control the devices, and the interaction experience of the user and the intelligent household device can be improved.
The foregoing general description and the following description are exemplary and explanatory only and are not restrictive of the application.
Drawings
One or more embodiments are illustrated in the accompanying drawings, which correspond to the accompanying drawings and not in a limiting sense, in which elements having the same reference numeral designations represent like elements, and in which:
FIG. 1 is a schematic diagram of a system for generating a panoramic view of a home environment based on digital twinning provided by an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of a method for generating a panoramic view of a home environment based on digital twins according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of another digital twin-based method for generating a panoramic view of a home environment provided by an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of another digital twin-based method for generating a panoramic view of a home environment provided by an embodiment of the present disclosure;
FIG. 5 is a timing diagram of a method for generating a panoramic view of a home environment based on digital twins according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of an apparatus for generating a panoramic view of a home environment based on digital twinning according to an embodiment of the present disclosure.
Detailed Description
So that the manner in which the features and advantages of the embodiments of the present disclosure can be understood in detail, a more particular description of the embodiments of the disclosure, briefly summarized above, may be had by reference to the appended drawings, which are included to illustrate, but are not intended to limit the embodiments of the disclosure. In the following description of the technology, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the disclosed embodiments. However, one or more embodiments may be practiced without these details. In other instances, well-known structures and devices may be shown in simplified form in order to simplify the drawing.
The terms "first," "second," and the like in the description and in the claims, and the above-described drawings of embodiments of the present disclosure, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged as appropriate for the embodiments of the disclosure described herein. Furthermore, the terms "comprising" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions.
The term "plurality" means two or more unless otherwise specified.
In the embodiment of the present disclosure, the character "/" indicates that the preceding and following objects are in an or relationship. For example, A/B represents: a or B.
The term "and/or" is an associative relationship that describes objects, meaning that three relationships may exist. E.g., a and/or B, represents: a or B, or A and B.
The term "correspond" may refer to an association or binding relationship, and a corresponding to B refers to an association or binding relationship between a and B.
As shown in fig. 1, an embodiment of the present disclosure provides a system for generating a panoramic view of a home environment based on digital twins, the system including: server 1 and central control screen end 2. The server 1 is configured to determine a device to be bound in a preset area, and determine whether an image recognition device exists in the preset area, to obtain a determination result. And acquiring a house type graph corresponding to the preset area according to the judgment result. And binding the equipment to be bound with a preset central control screen end, and positioning the bound equipment to be bound in the household type graph to obtain a household environment panoramic graph. And sending the family environment panoramic image to the central control screen end, and triggering the central control screen end to display the family environment panoramic image. The central control screen terminal 2 is configured to receive the home environment panorama sent by the server and display the home environment panorama. Wherein, well accuse screen end is the panel computer.
By adopting the system for generating the family environment panoramic image based on the digital twin, provided by the embodiment of the disclosure, the device to be bound is bound with the preset central control screen end through the server, and the bound device to be bound is positioned in the family image in the preset area, so that the family environment panoramic image is obtained. Therefore, the bound devices to be bound can be displayed in real time in the family environment panoramic image, the positions of the bound devices to be bound in the family environment panoramic image are the same as the actual positions of the bound devices in the preset area, a user can conveniently find out the devices to be controlled, the user can conveniently control the devices, and the interaction experience of the user and the intelligent household device can be improved.
With reference to fig. 2, an embodiment of the present disclosure provides a method for generating a panoramic view of a home environment based on digital twinning, which is applied to a server side, and the method includes:
step S101, the server determines the equipment to be bound in the preset area, judges whether the image recognition equipment exists in the preset area or not, and obtains a judgment result.
And step S102, the server acquires a house type graph corresponding to the preset area according to the judgment result.
And S103, binding the equipment to be bound with a preset central control screen end by the server, and positioning the bound equipment to be bound in the household type picture to obtain a household environment panoramic picture so as to realize digital twinning of the household environment.
By adopting the method for generating the family environment panoramic image based on the digital twin provided by the embodiment of the disclosure, the equipment to be bound is bound with the preset central control screen end, and the equipment to be bound is positioned in the family image in the preset area, so that the family environment panoramic image is obtained. Like this can demonstrate the equipment of binding after binding in the family environment panorama in real time to the position of the equipment of binding after binding in the family environment panorama is the same with the actual position in predetermineeing the region, and the user of being convenient for finds out the equipment that wants to control, and convenience of customers controls, thereby can improve the interactive experience of user and intelligent house equipment.
Further, the server determines the device to be bound in the preset area, including: the server scans the equipment in a preset area by using a preset wireless communication mode, and determines the scanned equipment as the equipment to be bound. The preset wireless communication mode is wireless communication technology Wi-Fi communication or Bluetooth communication. The preset area can be a bedroom, a living room, an office or an entire home area. The equipment to be bound can be air conditioner, television, smoke exhaust ventilator, floor sweeping robot, loudspeaker box, electric curtain, microwave oven, hall lamp, kitchen lamp, bedroom lamp or toilet lamp and other equipment.
In some embodiments, the server transmits a Wi-Fi signal or a bluetooth signal through the central control screen terminal to perform device scanning on a preset area, and determines the scanned device as a device to be bound.
Optionally, the step of judging whether an image recognition device exists in the preset area by the server to obtain a judgment result includes: and the server determines the equipment with the camera as the image recognition equipment when the equipment with the camera exists in the preset area, and determines that the image recognition equipment exists as a judgment result. The image recognition device is a device to be bound.
For example, the devices to be bound scanned in the preset area include air conditioners, televisions, range hoods, sweeping robots, sound boxes, electric curtains, microwave ovens, hall lights, kitchen lights, bedroom lights or toilet lights. The sweeping robot is provided with a camera device, and the sweeping robot with the camera device is determined as the image recognition equipment.
Optionally, the step of judging, by the server, whether an image recognition device exists in the preset area, to obtain a judgment result includes: and determining that the image recognition equipment does not exist in the judgment result under the condition that the equipment with the camera device does not exist in the preset area.
Optionally, the obtaining, by the server, the house type map corresponding to the preset area according to the determination result includes: and the server scans the image of the preset area by using the image recognition equipment under the condition that the image recognition equipment exists in the judgment result to obtain the house type picture. Therefore, the device with the camera device in the room is used for scanning the image of the room, and the indoor figure of the room can be acquired more conveniently and rapidly.
In some embodiments, the server uses a sweeping robot with a camera in the room as the image recognition device. And scanning the image of the room by the sweeping robot to obtain a house type diagram corresponding to the room. And receives the house type chart sent by the sweeping robot.
Optionally, the obtaining, by the server, the house type diagram corresponding to the preset area according to the determination result includes: and the server acquires first position information corresponding to the preset area under the condition that the image recognition device does not exist in the judgment result. And acquiring a house type graph corresponding to the preset area according to the first position information.
Further, the server obtains the house type diagram corresponding to the preset area according to the first location information, including: the server matches a house type graph corresponding to the first position information from a preset house type graph database; the family pattern database stores the corresponding relation between the first position information and the family pattern. Therefore, the house type graph of the preset area can be accurately obtained even if no equipment with a camera device is arranged in the preset area.
Further, the server obtains first location information corresponding to the preset area, including: the server acquires a first longitude and latitude coordinate of the central control screen end, and the first longitude and latitude coordinate of the central control screen end is determined as first position information corresponding to the preset area.
In some embodiments, the server sends the acquired house type graph to a corresponding user terminal, and triggers the user terminal to display the house type graph sent by the server. The user can compare the house type graph sent by the server with the actual house type graph conveniently. And when the house type graph sent by the server does not completely accord with the actual house type graph, the user can manually adjust the house type graph sent by the server through the user terminal. The house type graph sent by the server is completely consistent with the actual house type graph, so that the user can interact with the intelligent home equipment in the preset area more accurately, and the interaction experience of the user and the intelligent home equipment is improved.
With reference to fig. 3, an embodiment of the present disclosure provides a method for generating a panoramic view of a home environment based on digital twinning, which is applied to a server side, and the method includes:
step S201, the server determines a device to be bound in a preset area.
Step S202, the server judges whether the image recognition device exists in the preset area or not, and obtains a judgment result. If the determination result is that the image recognition device exists in the preset area, executing step S203; or, in case that the image recognition device does not exist in the preset area as a result of the determination, step S204 is performed.
In step S203, the server scans an image of the preset area by using the image recognition device to obtain a house type map. Then, step S205 is executed.
Step S204, the server obtains first position information corresponding to the preset area, and a house type graph corresponding to the first position information is matched from a preset house type graph database. The family type graph database stores the corresponding relation between the first position information and the family type graph. Then, step S205 is executed.
And S205, the server binds the device to be bound with a preset central control screen end, and positions the bound device to be bound in the household type graph to obtain a household environment panoramic graph so as to realize digital twinning of the household environment.
By adopting the method for generating the panoramic image of the home environment based on the digital twin provided by the embodiment of the disclosure, the user-type image is directly obtained by scanning the image recognition device under the condition that the image recognition device exists in the preset area, and the user-type image corresponding to the first position information is directly matched from the preset user-type image database under the condition that the image recognition device does not exist in the preset area. And binding the equipment to be bound with a preset central control screen end, and positioning the bound equipment to be bound in a household type graph in a preset area so as to obtain a household environment panoramic graph. Like this can demonstrate the equipment of binding after binding in the family environment panorama in real time to the position of the equipment of binding after binding in the family environment panorama is the same with the actual position in predetermineeing the region, and the user of being convenient for finds out the equipment that wants to control, and convenience of customers controls, thereby can improve the interactive experience of user and intelligent house equipment.
Further, the server performs device positioning on the bound device to be bound in the house type graph to obtain a panoramic view of the home environment, including: and the server acquires the second position information and the equipment information of the bound equipment to be bound, and acquires an equipment thumbnail model diagram of the bound equipment to be bound according to the equipment information. And positioning the equipment thumbnail model image of the bound equipment to be bound to the position, which is the same as the second position information, in the household type image to obtain the household environment panoramic image.
Further, acquiring second location information of the bound device to be bound, including: and acquiring a second longitude and latitude coordinate of the bound device to be bound, and determining the second longitude and latitude coordinate as second position information of the bound device to be bound. Therefore, the bound devices to be bound and the corresponding device states can be displayed in real time in the home environment panoramic image, and the positions of the bound devices to be bound in the home environment panoramic image are the same as the actual positions in the preset area, so that a user can conveniently find out the devices to be controlled, and the user can conveniently control the devices.
Further, the device information includes a device model of the bound device to be bound. The server acquires the device thumbnail image of the bound device to be bound according to the device information, and the method comprises the following steps: and the server matches a device thumbnail model map corresponding to the device model from a preset device thumbnail model map database. The corresponding relation between the equipment model and the equipment thumbnail model map is stored in the equipment thumbnail model map database. Therefore, the device thumbnail model map of the bound device to be bound is positioned in the user-type map, so that the user can conveniently and quickly find out the device to be controlled. Meanwhile, the user can check the equipment state and the equipment information by clicking the equipment thumbnail model diagram.
With reference to fig. 4, an embodiment of the present disclosure provides a method for generating a panoramic view of a home environment based on a digital twin, which is applied to a server side, and the method includes:
step S301, the server determines the device to be bound in the preset area, and judges whether the image recognition device exists in the preset area, so as to obtain a judgment result.
Step S302, the server acquires a house type graph corresponding to the preset area according to the judgment result.
Step S303, the server binds the device to be bound with a preset central control screen end, and acquires second position information of the bound device to be bound.
And S304, the server positions the bound device to be bound to the position, which is the same as the second position information, in the house type picture to obtain the family environment panoramic picture.
By adopting the method for generating the family environment panoramic image based on the digital twinning, which is provided by the embodiment of the disclosure, the equipment to be bound is bound with the preset central control screen end, and the equipment to be bound is positioned in the family image in the preset area, so that the family environment panoramic image is obtained. Therefore, the bound devices to be bound can be displayed in real time in the family environment panoramic image, the positions of the bound devices to be bound in the family environment panoramic image are the same as the actual positions of the bound devices in the preset area, a user can conveniently find out the devices to be controlled, the user can conveniently control the devices, and the interaction experience of the user and the intelligent household device can be improved.
In some embodiments, when a user logs in the central control screen terminal for the first time, the server sends out a Wi-Fi signal or a bluetooth signal to transmit to scan equipment in a preset area by using the central control screen terminal, and the scanned equipment is determined as the equipment to be bound. And judging whether the image recognition device exists in the preset area. And under the condition that the image recognition equipment exists in the preset area, carrying out image scanning on the preset area by utilizing the image recognition equipment to obtain the house type picture. Under the condition that no image recognition device exists in the preset area, the server acquires a first longitude and latitude coordinate of the central control screen end, and the first longitude and latitude coordinate of the central control screen end is determined as first position information corresponding to the preset area. And matching the house type graph corresponding to the first position information from a preset house type graph database. And binding the equipment to be bound with a preset central control screen end, and positioning the equipment to be bound in a household type graph in a preset area, so as to obtain a household environment panoramic graph. Therefore, when a user controls the equipment through the central control screen end, the actions, states and modes of the bound equipment to be bound in the family environment panoramic image are completely consistent with those of each actual equipment, and screen end offline consistent experience can be achieved. Meanwhile, the user can be more humanized when the equipment is controlled, and the state of the equipment in the house can be clearly mastered.
As shown in fig. 5, an embodiment of the present disclosure provides a method for generating a panoramic view of a home environment based on digital twins, including:
step S401, the server scans the devices in the preset area by using the preset wireless communication mode, determines the scanned devices as the devices to be bound, and acquires the device information of the devices to be bound. The device information of the device to be bound comprises one or more of a device ID, a device name, longitude and latitude coordinates of the device or attribute information of the device to be bound.
And step S402, the server sends the equipment information of the equipment to be bound to the central control screen terminal.
And S403, the central control screen end receives and stores the equipment information of the equipment to be bound, and the equipment to be bound is bound with the central control screen end.
And step S404, the server determines that the image recognition device exists as a judgment result when the device with the camera exists in the preset area, and performs image scanning on the preset area by using the image recognition device to obtain the user-type diagram.
Step S405, the server obtains second position information of the bound device to be bound.
And S406, the server positions the bound device to be bound to the position, which is the same as the second position information, in the house type image to obtain a family environment panoramic image.
And step S407, the server sends the family environment panoramic image to the central control screen terminal.
And step S408, the central control screen end receives the family environment panoramic image sent by the server and displays the family environment panoramic image.
By adopting the method for generating the family environment panoramic image based on the digital twin provided by the embodiment of the disclosure, the server scans equipment in a preset area by using a preset central control screen end to determine the equipment to be bound. And determining whether the image recognition device exists in the preset area or not to obtain a judgment result. And under the condition that the image recognition equipment exists in the preset area, directly scanning the image of the preset area through the image recognition equipment to obtain the house type image. Under the condition that no image recognition equipment exists in the preset area, matching a house type graph corresponding to first position information from a preset house type graph database according to the first position information by acquiring the first position information of the preset area. And the determined devices to be bound are bound with the central control screen terminal, and the bound devices to be bound are positioned in the household type picture to obtain a household environment panoramic picture, so that a user can quickly find out the devices to be controlled in the household environment panoramic picture through the central control screen terminal. The convenience of customers controls to can improve the user and intelligent house equipment's mutual experience.
In some embodiments, after the home environment panoramic image is generated, the user clicks an air conditioner in the home environment panoramic image through the central control screen terminal to start, and meanwhile, the air conditioner in the preset area is also started, and the actual air conditioner and the air conditioner in the home environment panoramic image are started synchronously.
In some embodiments, after the home environment panoramic image is generated, the user turns on the air conditioner in the preset area through the remote controller, and simultaneously, the air conditioner in the home environment panoramic image in the central control screen end is also turned on, and the swing speed and the dynamic effect of the fan blades are consistent with those of an actual air conditioner. When a user replaces the air conditioner, the central control screen end is unbound with the replaced air conditioner, equipment scanning is carried out through the central control screen end to obtain the color, the size, the equipment style and the like of the replaced new air conditioner, the replaced new air conditioner is bound with the central control screen end, and the new air conditioner is displayed in the family environment panoramic image.
As shown in fig. 6, an apparatus for generating a panoramic view of a home environment based on a digital twin according to an embodiment of the present disclosure includes a processor (processor) 600 and a memory (memory) 601. Optionally, the apparatus may also include a Communication Interface 602 and a bus 603. The processor 600, the communication interface 602, and the memory 601 may communicate with each other via a bus 603. The communication interface 602 may be used for information transfer. The processor 600 may call logic instructions in the memory 601 to perform the method of generating a panoramic view of a home environment based on digital twinning of the above embodiment.
By adopting the device for generating the family environment panoramic image based on the digital twin provided by the embodiment of the disclosure, the equipment to be bound is bound with the preset central control screen end, and the equipment to be bound is positioned in the family image in the preset area, so that the family environment panoramic image is obtained. Like this can demonstrate the equipment of binding after binding in the family environment panorama in real time to the position of the equipment of binding after binding in the family environment panorama is the same with the actual position in predetermineeing the region, and the user of being convenient for finds out the equipment that wants to control, and convenience of customers controls, thereby can improve the interactive experience of user and intelligent house equipment.
In addition, the logic instructions in the memory 601 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products.
The memory 601 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure. The processor 600 executes functional applications and data processing, i.e., a method of generating a panoramic view of a home environment based on a digital twin in the above-described embodiment, by executing program instructions/modules stored in the memory 601.
The memory 601 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. In addition, the memory 601 may include a high speed random access memory, and may also include a non-volatile memory.
The embodiment of the disclosure provides a server, which comprises the device for generating the family environment panoramic image based on the digital twin.
By adopting the server provided by the embodiment of the disclosure, the device to be bound is bound with the preset central control screen end, and the bound device to be bound is positioned in the indoor type graph in the preset area, so that the family environment panoramic graph is obtained. Like this can demonstrate the equipment of binding after binding in the family environment panorama in real time to the position of the equipment of binding after binding in the family environment panorama is the same with the actual position in predetermineeing the region, and the user of being convenient for finds out the equipment that wants to control, and convenience of customers controls, thereby can improve the interactive experience of user and intelligent house equipment.
The embodiment of the disclosure provides a storage medium, which stores program instructions, and when the program instructions are executed, the method for generating the family environment panoramic image based on the digital twin is executed.
The disclosed embodiments provide a computer program product comprising a computer program stored on a computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, cause the computer to perform the above-mentioned method of generating a panoramic view of a home environment based on digital twins.
The computer readable storage medium described above may be a transitory computer readable storage medium or a non-transitory computer readable storage medium.
The technical solution of the embodiments of the present disclosure may be embodied in the form of a software product, where the computer software product is stored in a storage medium and includes one or more instructions to enable a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method of the embodiments of the present disclosure. And the aforementioned storage medium may be a non-transitory storage medium comprising: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes, and may also be a transient storage medium.
The above description and drawings sufficiently illustrate embodiments of the disclosure to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. The examples merely typify possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in or substituted for those of others. Furthermore, the words used in the specification are words of description for example only and are not limiting upon the claims. As used in the description of the embodiments and the claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Similarly, the term "and/or" as used in this application is meant to encompass any and all possible combinations of one or more of the associated listed. Furthermore, the terms "comprises" and/or "comprising," when used in this application, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Without further limitation, an element defined by the phrase "comprising one of 8230," does not exclude the presence of additional like elements in a process, method or device comprising the element. In this document, each embodiment may be described with emphasis on differences from other embodiments, and the same and similar parts between the respective embodiments may be referred to each other. For methods, products, etc. of the embodiment disclosures, reference may be made to the description of the method section for relevance if it corresponds to the method section of the embodiment disclosure.
Those of skill in the art would appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software may depend upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments. It can be clearly understood by the skilled person that, for convenience and brevity of description, the specific working processes of the system, the apparatus and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, apparatuses, etc.) may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units may be merely a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form. The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to implement the present embodiment. In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. In the description corresponding to the flowcharts and block diagrams in the figures, operations or steps corresponding to different blocks may also occur in different orders than disclosed in the description, and sometimes there is no specific order between the different operations or steps. For example, two sequential operations or steps may in fact be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. Each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Claims (15)
1. A method for generating a family environment panorama based on digital twins is applied to a server side, and is characterized by comprising the following steps:
determining equipment to be bound in a preset area, judging whether image recognition equipment exists in the preset area or not, and obtaining a judgment result;
acquiring a house type graph corresponding to the preset area according to the judgment result;
and binding the equipment to be bound with a preset central control screen end, and positioning the bound equipment to be bound in the household type graph to obtain a household environment panoramic graph so as to realize digital twinning of the household environment.
2. The method according to claim 1, wherein the determining the devices to be bound in the preset area comprises:
and scanning the equipment by using a preset wireless communication mode, and determining the scanned equipment as the equipment to be bound.
3. The method of claim 1, wherein determining whether an image recognition device exists in the preset area to obtain a determination result comprises:
and under the condition that the equipment with the camera device exists in the preset area, determining that the image recognition equipment exists as a judgment result.
4. The method according to claim 1, wherein determining whether the image recognition device exists in the preset area and obtaining a determination result comprises:
and under the condition that the equipment with the camera device does not exist in the preset area, determining that the image recognition equipment does not exist in the judgment result.
5. The method according to claim 1, wherein obtaining the house type map corresponding to the preset area according to the determination result comprises:
and under the condition that the image recognition equipment exists in the judgment result, carrying out image scanning on the preset area by utilizing the image recognition equipment to obtain the house type picture.
6. The method according to claim 1, wherein obtaining the house type map corresponding to the preset area according to the determination result comprises:
acquiring first position information corresponding to the preset area under the condition that the image recognition device does not exist in the judgment result;
and acquiring a house type graph corresponding to the preset area according to the first position information.
7. The method of claim 6, wherein obtaining the first position information corresponding to the preset area comprises:
acquiring a first longitude and latitude coordinate of the central control screen end;
and determining the first longitude and latitude coordinate as first position information corresponding to a preset area.
8. The method of claim 6, wherein obtaining the house type map corresponding to the preset area according to the first location information comprises:
matching a house type graph corresponding to the first position information from a preset house type graph database; the family type graph database stores the corresponding relation between the first position information and the family type graph.
9. The method of claim 1, wherein performing device location on the bound device to be bound in the indoor type graph to obtain a home environment panorama, comprises:
acquiring second position information and equipment information of the bound equipment to be bound;
acquiring an equipment thumbnail model diagram of the bound equipment to be bound according to the equipment information;
and positioning the equipment thumbnail model map to the same position in the house type map as the second position information to obtain the family environment panoramic map.
10. The method of claim 9, wherein obtaining the second location information of the bound device to be bound comprises:
acquiring a second longitude and latitude coordinate of the bound device to be bound;
and determining the second longitude and latitude coordinate as second position information of the bound device to be bound.
11. The method according to claim 9, wherein the device information includes a device model of the bound device to be bound; acquiring an equipment thumbnail model diagram of the bound equipment to be bound according to the equipment information, wherein the equipment thumbnail model diagram comprises the following steps:
matching a device thumbnail model graph corresponding to the device model from a preset device thumbnail model graph database; and the corresponding relation between the equipment model and the equipment thumbnail model map is stored in the equipment thumbnail model map database.
12. A system for generating a panoramic view of a home environment based on digital twinning, the system comprising:
the server is configured to determine equipment to be bound in a preset area, judge whether image recognition equipment exists in the preset area and obtain a judgment result; acquiring a house type graph corresponding to the preset area according to the judgment result; binding the equipment to be bound with a preset central control screen end, and positioning the equipment to be bound in the household type graph to obtain a household environment panoramic graph; sending the family environment panoramic image to the central control screen end, and triggering the central control screen end to display the family environment panoramic image;
and the central control screen terminal is configured to receive the family environment panoramic image sent by the server and display the family environment panoramic image.
13. An apparatus for generating a digital twin-based home environment panorama comprising a processor and a memory storing program instructions, wherein the processor is configured to execute the method for generating a digital twin-based home environment panorama of any one of claims 1-11 when executing the program instructions.
14. A server, characterized in that it comprises a device for generating a panoramic view of a home environment based on digital twins according to claim 13.
15. A storage medium storing program instructions which, when executed, perform a method of generating a panoramic view of a home environment based on digital twinning as claimed in any one of claims 1 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210607901.1A CN115529201A (en) | 2022-05-31 | 2022-05-31 | Method, system, device, server and storage medium for generating family environment panorama based on digital twinning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210607901.1A CN115529201A (en) | 2022-05-31 | 2022-05-31 | Method, system, device, server and storage medium for generating family environment panorama based on digital twinning |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115529201A true CN115529201A (en) | 2022-12-27 |
Family
ID=84695485
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210607901.1A Pending CN115529201A (en) | 2022-05-31 | 2022-05-31 | Method, system, device, server and storage medium for generating family environment panorama based on digital twinning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115529201A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104181884A (en) * | 2014-08-11 | 2014-12-03 | 厦门立林科技有限公司 | Device and method for controlling intelligent home based on panoramic view |
| CN106844614A (en) * | 2017-01-18 | 2017-06-13 | 天津中科智能识别产业技术研究院有限公司 | A kind of floor plan functional area system for rapidly identifying |
| CN107819652A (en) * | 2017-10-10 | 2018-03-20 | 北京小米移动软件有限公司 | The control method and device of intelligent home device |
| CN111025962A (en) * | 2019-11-26 | 2020-04-17 | 上海欣能信息科技发展有限公司 | Panoramic-map-based indoor visual monitoring method for power transformation and distribution station |
| CN111031293A (en) * | 2019-11-29 | 2020-04-17 | 三一重工股份有限公司 | Panoramic monitoring display method, device and system and computer readable storage medium |
| CN112862640A (en) * | 2021-02-04 | 2021-05-28 | 上海松鼠课堂人工智能科技有限公司 | Digital school zone cloud platform management system |
| CN113110095A (en) * | 2021-05-19 | 2021-07-13 | 云米互联科技(广东)有限公司 | HomeMap construction method and system based on sweeping robot |
| CN113592390A (en) * | 2021-07-12 | 2021-11-02 | 嘉兴恒创电力集团有限公司博创物资分公司 | Warehousing digital twin method and system based on multi-sensor fusion |
-
2022
- 2022-05-31 CN CN202210607901.1A patent/CN115529201A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104181884A (en) * | 2014-08-11 | 2014-12-03 | 厦门立林科技有限公司 | Device and method for controlling intelligent home based on panoramic view |
| CN106844614A (en) * | 2017-01-18 | 2017-06-13 | 天津中科智能识别产业技术研究院有限公司 | A kind of floor plan functional area system for rapidly identifying |
| CN107819652A (en) * | 2017-10-10 | 2018-03-20 | 北京小米移动软件有限公司 | The control method and device of intelligent home device |
| CN111025962A (en) * | 2019-11-26 | 2020-04-17 | 上海欣能信息科技发展有限公司 | Panoramic-map-based indoor visual monitoring method for power transformation and distribution station |
| CN111031293A (en) * | 2019-11-29 | 2020-04-17 | 三一重工股份有限公司 | Panoramic monitoring display method, device and system and computer readable storage medium |
| CN112862640A (en) * | 2021-02-04 | 2021-05-28 | 上海松鼠课堂人工智能科技有限公司 | Digital school zone cloud platform management system |
| CN113110095A (en) * | 2021-05-19 | 2021-07-13 | 云米互联科技(广东)有限公司 | HomeMap construction method and system based on sweeping robot |
| CN113592390A (en) * | 2021-07-12 | 2021-11-02 | 嘉兴恒创电力集团有限公司博创物资分公司 | Warehousing digital twin method and system based on multi-sensor fusion |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2758838B1 (en) | Using hdmi-cec to identify a codeset | |
| WO2017215308A1 (en) | Method, device and system for controlling electrical appliance | |
| EP3432092A1 (en) | Control method and device for smart home | |
| JP2016511603A (en) | System and method for media streaming for multi-user control and shared display | |
| US20240028181A1 (en) | Selecting a picture of a device to identify an associated codeset | |
| CN107168085A (en) | A kind of intelligent home device long-range control method, device, medium and computing device | |
| KR20170061635A (en) | Interface display method and device | |
| EP3764673A1 (en) | Air conditioner unit wireless networking method, apparatus and system | |
| CN105827494A (en) | Method, device and system for adding equipment | |
| CN108810049A (en) | Control method, device, system and the Virtual Reality equipment of equipment | |
| CN107590337A (en) | A kind of house ornamentation displaying interactive approach and device | |
| EP3145160B1 (en) | Apparatus and method for transmitting image files. | |
| CN115390713A (en) | Screen control method, screen control device, electronic apparatus, program, and medium | |
| CN110780598B (en) | Intelligent device control method and device, electronic device and readable storage medium | |
| CN109974232B (en) | Rapid control method and terminal of air conditioner system, air conditioner system and medium | |
| US20200327386A1 (en) | Two-dimensional code based communication method, apparatus, and lift desk | |
| CN113329241A (en) | Air conditioner and method and device for multimedia playing in air conditioner | |
| CN115529201A (en) | Method, system, device, server and storage medium for generating family environment panorama based on digital twinning | |
| CN111412588A (en) | Control method of air conditioner system, server and medium | |
| CN110361978B (en) | Intelligent equipment control method, device and system based on Internet of things operating system | |
| CN115373570B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN110677546B (en) | Information processing apparatus, information processing method, and non-transitory computer readable medium | |
| JP4327622B2 (en) | ENVIRONMENT CONTROL METHOD AND ENVIRONMENT CONTROL DEVICE | |
| WO2019196458A1 (en) | Air conditioner controller and air conditioner | |
| CN114726664B (en) | Binding method and binding equipment for household equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |