CN116431852A - Environment state visualization method and device, storage medium and electronic device - Google Patents
Environment state visualization method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN116431852A CN116431852A CN202310333390.3A CN202310333390A CN116431852A CN 116431852 A CN116431852 A CN 116431852A CN 202310333390 A CN202310333390 A CN 202310333390A CN 116431852 A CN116431852 A CN 116431852A
- Authority
- CN
- China
- Prior art keywords
- environment
- dimension
- environmental
- data
- graph
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007794 visualization technique Methods 0.000 title claims abstract description 28
- 230000007613 environmental effect Effects 0.000 claims abstract description 186
- 230000004927 fusion Effects 0.000 claims abstract description 25
- 238000012800 visualization Methods 0.000 claims abstract description 18
- 239000013598 vector Substances 0.000 claims description 44
- 238000000034 method Methods 0.000 claims description 27
- 238000004590 computer program Methods 0.000 claims description 11
- 238000013507 mapping Methods 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 abstract description 4
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 4
- 238000001035 drying Methods 0.000 description 3
- 238000007605 air drying Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000013618 particulate matter Substances 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- 238000004140 cleaning Methods 0.000 description 1
- 238000010411 cooking Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010408 sweeping Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/55—Clustering; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses an environmental state visualization method, an environmental state visualization device, a storage medium and an electronic device, and relates to the technical field of smart families. And carrying out image fusion on the dimension graphs of the plurality of environment dimensions to obtain an environment state graph, wherein the information corresponding to the plurality of environment dimensions can be represented through the environment state graph, and the content is richer. Determining the environmental state graph according to the environmental data realizes the conversion of abstract data into a materialized pseudo-materialized graph. The environment state graph is displayed through the target equipment, so that a user can intuitively and comprehensively know the overall state of the environment, and the use experience of the user is improved.
Description
Technical Field
The application relates to the technical field of smart families, in particular to an environment state visualization method, an environment state visualization device, a storage medium and an electronic device.
Background
In the prior art, the environmental information is not usually displayed to the user, or the numerical value of the environmental information is only displayed in a digital manner, for example, the humidity is 45%, so that the user cannot easily understand the relationship between the concept of the numerical value and physical feeling, and cannot easily understand the environmental state according to the displayed content.
Therefore, the method for visualizing the environment state is provided, so that a user can intuitively know the environment state, and the method is an important current research direction.
Disclosure of Invention
The application provides an environment state visualization method, an environment state visualization device, a storage medium and an electronic device, which are used for solving the defect that a user cannot easily know the environment state through numerical values in the prior art, realizing visualization and simulation of environment information, and enabling the user to intuitively know the environment state through a simulation graph.
The application provides an environment state visualization method, which comprises the following steps:
acquiring environmental data;
determining environment dimension data corresponding to each of a plurality of environment dimensions according to the environment data;
determining a dimension graph corresponding to each environment dimension according to the numerical value of the environment dimension data, wherein the dimension graph is a pseudo-physical graph matched with the environment dimension data of the corresponding environment dimension;
performing graph fusion according to the dimension graphs corresponding to the plurality of environment dimensions to generate an environment state graph, wherein the environment state graph is a pseudo-physical graph matched with the environment data of each environment dimension;
and sending the environment state graph to target equipment for display.
According to the environmental state visualization method provided by the application, the determining environmental dimension data corresponding to each of a plurality of environmental dimensions according to the environmental data comprises the following steps:
classifying the environmental data according to the acquisition sources of the environmental data to obtain the environmental data corresponding to different acquisition sources;
based on the mapping relation between the acquisition sources and the environment dimension types, the environment data corresponding to the different acquisition sources are divided into environment dimension data of a plurality of environment dimensions.
According to the method for visualizing the environmental state provided by the application, the determining a dimension graph corresponding to each environmental dimension according to the numerical value of the environmental dimension data comprises the following steps:
determining a target value interval in a plurality of preset value intervals of the environment dimension corresponding to the value interval according to the value of the environment dimension data;
inquiring the dimension graph corresponding to the environment dimension data according to the target value interval and a relation table corresponding to a plurality of preset value intervals and the simulated graph.
According to the environmental state visualization method provided by the application, the graphic fusion is performed according to the dimension graphs corresponding to the plurality of environmental dimensions, so as to generate an environmental state graph, which comprises the following steps:
extracting virtual object feature information of the dimension graph corresponding to each environment dimension, wherein the virtual object feature information is used for representing information of the environment dimension and information of environment dimension data corresponding to the environment dimension;
and carrying out feature fusion according to the virtual object feature information, and generating an environment state graph based on the fused virtual object feature information, wherein the environment state graph is used for representing information of a plurality of environment dimensions and information of environment dimension data corresponding to each environment dimension.
According to the method for visualizing the environmental state provided by the application, the extracting the virtual object characteristic information of the dimension graph corresponding to each environmental dimension includes:
inputting a pre-trained image recognition model for each dimension graph corresponding to the environment dimension, and determining a virtual object in the dimension graph;
and inputting the virtual object in the dimension graph into a pre-trained image semantic model, outputting a virtual object semantic vector corresponding to the virtual object, and determining the virtual object semantic vector as virtual object feature information.
According to the method for visualizing the environmental state provided by the application, feature fusion is performed according to a plurality of pieces of virtual object feature information, and the environmental state graph is generated based on the fused virtual object feature information, and the method comprises the following steps:
vector stitching is carried out on the plurality of virtual object semantic vectors to obtain stitching vectors, and the stitching vectors are determined to be the fused virtual object characteristic information;
inputting the spliced vector into a pre-trained image reconstruction model, and generating the environment state graph based on the spliced vector.
According to the environmental state visualization method provided by the application, the environmental data acquisition comprises the following steps:
acquiring original environment data acquired by at least one environment information acquisition device;
and summarizing according to the original environment data to determine the environment data.
The application also provides an environmental status visualization device, comprising:
an acquisition unit configured to acquire environmental data;
the analysis unit is used for determining environment dimension data corresponding to each of a plurality of environment dimensions according to the environment data;
the graphic unit is used for determining a dimension graphic corresponding to each environment dimension according to the numerical value of the environment dimension data, wherein the dimension graphic is a pseudo-physical graphic matched with the environment dimension data of the corresponding environment dimension;
performing graph fusion according to the dimension graphs corresponding to the plurality of environment dimensions to generate an environment state graph, wherein the environment state graph is a pseudo-physical graph matched with the environment data of each environment dimension;
and the control unit is used for sending the environment state graph to target equipment for display.
The present application also provides an electronic device comprising a memory having stored therein a computer program and a processor arranged to implement an environmental state visualization method as described in any of the above by execution of the computer program.
The present application also provides a computer-readable storage medium comprising a stored program, wherein the program when run performs a method of visualizing an environmental state as described in any of the above.
The present application also provides a computer program product comprising a computer program which when executed by a processor implements the method of visualizing an environmental state as described in any of the above.
According to the environmental state visualization method, the device, the storage medium and the electronic device, the environmental data are acquired, the data of a plurality of environmental dimensions are determined according to the analysis of the environmental data, the classification of the environmental information is realized, different dimension graphs are convenient to determine for different dimension data, and the corresponding information of the environmental dimensions is represented through the dimension graphs. And carrying out image fusion on the dimension graphs of the plurality of environment dimensions to obtain an environment state graph, wherein the information corresponding to the plurality of environment dimensions can be represented through the environment state graph, and the content is richer. Determining the environmental state graph according to the environmental data realizes the conversion of abstract data into a materialized pseudo-materialized graph. The environment state graph is displayed through the target equipment, so that a user can intuitively and comprehensively know the overall state of the environment, and the use experience of the user is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a schematic diagram of a hardware environment for an environment state visualization method according to an embodiment of the present application;
FIG. 2 is a flow diagram of an environmental status visualization method provided herein;
FIG. 3 is a schematic diagram of an environmental status visualization flow provided herein;
FIG. 4 is a schematic view of the structure of the environmental status visualization device provided by the present application;
fig. 5 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
According to one aspect of an embodiment of the present application, an environmental state visualization method is provided. The environment state visualization method is widely applied to full-house intelligent digital control application scenes such as intelligent Home (Smart Home), intelligent Home equipment ecology, intelligent Home (Intelligence House) ecology and the like. Alternatively, in the present embodiment, the above-described environment state visualization method may be applied to a hardware environment constituted by the terminal device 102 and the server 104 as shown in fig. 1. As shown in fig. 1, the server 104 is connected to the terminal device 102 through a network, and may be used to provide services (such as application services and the like) for a terminal or a client installed on the terminal, a database may be set on the server or independent of the server, for providing data storage services for the server 104, and cloud computing and/or edge computing services may be configured on the server or independent of the server, for providing data computing services for the server 104.
The network may include, but is not limited to, at least one of: wired network, wireless network. The wired network may include, but is not limited to, at least one of: a wide area network, a metropolitan area network, a local area network, and the wireless network may include, but is not limited to, at least one of: WIFI (Wireless Fidelity ), bluetooth. The terminal device 102 may not be limited to a PC, a mobile phone, a tablet computer, an intelligent air conditioner, an intelligent smoke machine, an intelligent refrigerator, an intelligent oven, an intelligent cooking range, an intelligent washing machine, an intelligent water heater, an intelligent washing device, an intelligent dish washer, an intelligent projection device, an intelligent television, an intelligent clothes hanger, an intelligent curtain, an intelligent video, an intelligent socket, an intelligent sound box, an intelligent fresh air device, an intelligent kitchen and toilet device, an intelligent bathroom device, an intelligent sweeping robot, an intelligent window cleaning robot, an intelligent mopping robot, an intelligent air purifying device, an intelligent steam box, an intelligent microwave oven, an intelligent kitchen appliance, an intelligent purifier, an intelligent water dispenser, an intelligent door lock, and the like.
The application provides an environment state visualization method, as shown in fig. 2, comprising the following steps:
s21, acquiring environment data;
s22, determining environment dimension data corresponding to each of a plurality of environment dimensions according to the environment data;
s23, determining a dimension graph corresponding to each environment dimension according to the numerical value of the environment dimension data, wherein the dimension graph is a pseudo-materialized graph matched with the environment dimension data of the corresponding environment dimension;
s24, performing graph fusion according to the dimension graphs corresponding to the plurality of environment dimensions to generate an environment state graph, wherein the environment state graph is a quasi-materialized graph matched with the environment data of each environment dimension;
and S25, sending the environment state graph to target equipment for display.
Specifically, the environmental data is a collection of information including, but not limited to, temperature, humidity, concentration of a specified gas in the air, concentration of particulate matter, etc., and the environmental dimension data is one of a single type of data in the collection. The virtual objects in the simulated physical graphics may include, but are not limited to, animal and/or plant types.
Preferably, the environment data can be acquired in real time, the environment dimension data of a plurality of environment dimensions and the corresponding dimension graphs are determined in real time, the graph fusion is performed on the basis of the dimension graphs of the plurality of dimensions in real time, the environment state graphs are generated, and the environment state graphs are sent to the target equipment. And displaying the real-time environment state through the target equipment.
Specifically, a dimension graph corresponding to an environment dimension can be determined according to the environment dimension data of the environment dimension, so that abstract environment dimension data of the corresponding environment dimension can be embodied into a graph for viewing.
According to the dimension graphs corresponding to the environment dimensions, graph fusion is carried out to generate an environment state graph, abstract environment dimension data of all environment dimensions can be synthesized through the environment state graph, the environment state graph is embodied into a graph which expresses rich content and can simultaneously express information of all environment dimensions for viewing.
According to the embodiment of the application, the environmental data are acquired, the data of a plurality of environmental dimensions are determined by analyzing the environmental data, the classification of the environmental information is realized, different dimension graphs are conveniently determined for different dimension data, and the corresponding environmental dimension information is represented through the dimension graphs. And carrying out image fusion on the dimension graphs of the plurality of environment dimensions to obtain an environment state graph, wherein the information corresponding to the plurality of environment dimensions can be represented through the environment state graph, and the content is richer. Determining the environmental state graph according to the environmental data realizes the conversion of abstract data into a materialized pseudo-materialized graph. The environment state graph is displayed through the target equipment, so that a user can intuitively and comprehensively know the overall state of the environment, and the use experience of the user is improved.
According to the environmental status visualization method provided by the present application, step S21 includes:
s211, acquiring original environment data acquired by at least one environment information acquisition device;
s212, summarizing according to the original environment data to determine the original environment data.
Specifically, the acquisition of the original environmental data may be performed by the user registering the bound environmental information acquisition device in advance, and the environmental information acquisition device includes, but is not limited to, an air conditioner, a thermometer, a hygrometer, a dehumidifier, a humidifier, an air purifier, and the like, and the original environmental data may include, but is not limited to, temperature, humidity, concentration of a specified gas in the air, concentration of particulate matter, and the like.
For example, temperature data can be collected through a thermometer, humidity data can be collected through a hygrometer, the concentration of specified gas and the concentration of particulate matters in air can be collected through an air purifier, and the collected environmental data can be summarized to obtain the environmental data including the temperature, the humidity, the concentration of the specified gas and the concentration of the particulate matters.
In the embodiment of the application, the original environmental data are collected through the environmental information collection equipment, the environmental data are collected, the collected data of the environmental data are more accurate for the original environmental data collected by the plurality of environmental information collection equipment, and the dimensionality is more abundant.
According to the environmental status visualization method provided in the present application, step S22 includes:
s221, classifying the environmental data according to the acquisition sources of the environmental data to obtain the environmental data corresponding to different acquisition sources;
s222, dividing the environment data corresponding to the different acquisition sources into environment dimension data of a plurality of environment dimensions based on the mapping relation between the acquisition sources and the environment dimension types.
Specifically, the environmental data can be classified according to different acquisition sources by setting a preset classification rule, and the classified environmental data is divided into a plurality of environmental dimension data with different dimensions according to the acquisition sources.
Specifically, the environmental data is classified according to the kind of the environmental information collection device, i.e., the acquisition source. In one example, the environmental data includes environmental data a collected by a thermometer and environmental data B collected by a dehumidifier. Environmental data collected by a thermometer are preset to be classified into environmental dimension data of a dimension of 'temperature', and environmental data collected by a dehumidifier is classified into environmental dimension data of a dimension of 'humidity'. In classifying the environmental data according to the acquisition source, the environmental data a is determined as environmental dimension data of the "temperature" dimension, and the environmental data B is determined as environmental dimension data of the "humidity" dimension.
One acquisition source may also correspond to a plurality of environmental dimensions, and for example, when classifying environmental data according to the acquisition source, the environmental data collected by the preset air conditioner may be classified into two environmental dimensions of "temperature" and "humidity". Specifically: the environmental data may be classified according to a statistical unit of the environmental data. In one example, the environmental data includes environmental data a collected by an air conditioner, where the statistical unit is the temperature, i.e., the degree celsius; the air conditioner also comprises environmental data B collected by the air conditioner, wherein the statistical unit is% rh, namely the percentage of saturated water vapor in the condition that the water vapor in the air is the same as the air. Environmental data in the unit of%rh is classified into environmental dimension data in the dimension of "humidity", and environmental data in the unit of%rh is classified into environmental dimension data in the dimension of "temperature" in advance. When the environmental data is classified according to the acquisition source, the environmental data A acquired by the air conditioner is determined to be environmental dimension data of a 'temperature' dimension, and the environmental data B acquired by the air conditioner is determined to be environmental dimension data of a 'humidity' dimension.
According to the embodiment of the application, the environmental data are classified according to the acquired sources, the environmental dimension data with different dimensions are determined, the simplification and classification of the environmental data are realized, the information with different dimensions is determined, and the dimension graph corresponding to each environmental dimension is conveniently determined according to different dimensions.
According to the environmental status visualization method provided by the application, the step S23 includes S231-S232:
s231, determining a target numerical value interval in a plurality of preset numerical value intervals of the environment dimension corresponding to the numerical value interval according to the numerical value of the environment dimension data;
s232, inquiring the dimension graph corresponding to the environment dimension data according to the target value interval and a preset relation table corresponding to the plurality of value intervals and the simulated graph.
Specifically, a plurality of value intervals may be set for each environmental dimension according to actual needs, for example, for a dimension of temperature, a value interval divided into a high temperature interval and a value interval divided into a low temperature interval, and a value interval of a temperature greater than or equal to a value of B and less than or equal to a value of a temperature is divided into a medium temperature interval. Corresponding simulated patterns are preset for different numerical intervals, such as a high-temperature interval corresponds to the simulated pattern 1, a medium-temperature interval corresponds to the simulated pattern 2, and a low-temperature interval corresponds to the simulated pattern 3.
If the value of the environmental dimension data of the temperature dimension is greater than or equal to the value B and less than or equal to the value A, the medium temperature interval is determined to be a target value interval, and the corresponding pseudo-physical pattern 2 is determined to be a dimension pattern.
In the embodiment of the application, the target value interval where the dimension data is located can be simply, conveniently and quickly determined by presetting a plurality of value intervals and the value of the environment dimension data, and the dimension graph corresponding to the environment dimension data can be quickly and accurately determined by inquiring the relation table corresponding to the preset value interval and the simulated physical and chemical graph.
According to the environmental status visualization method provided in the present application, step S24 includes:
s241, extracting virtual object feature information of the dimension graph corresponding to each environment dimension, wherein the virtual object feature information is used for representing information of the environment dimension and information of environment dimension data corresponding to the environment dimension;
and S242, carrying out feature fusion according to the virtual object feature information, and generating an environment state graph based on the fused virtual object feature information, wherein the environment state graph is used for representing information of a plurality of environment dimensions and information of environment dimension data corresponding to each environment dimension.
Specifically, feature extraction can be performed on each dimension graph to obtain virtual object feature information of each dimension graph, wherein the virtual object feature information can represent a corresponding environment dimension and can also represent environment dimension data. For example, the virtual object characteristic information is a dried flower, the environmental dimension of "humidity" is represented by the state of drying, and the environmental dimension data of "humidity value" is represented by the degree of drying.
For another example, the environmental dimension data includes a dimension pattern determined for a temperature dimension as a and a humidity, and the extracted virtual object feature information is a flower with full petals; for the dimension graph with the humidity dimension determined as B, the extracted virtual object characteristic information is a colorful flower; and carrying out graph fusion according to the characteristic information of the two virtual objects, namely the flower with full petals and the flower with bright color, generating a graph C with the flower with full petals and bright color, and determining the graph C as an environment state graph. And fusing the imaging graphs combined with the multiple dimensions to obtain a fused graph with the information of the multiple dimensions, and simultaneously representing the information of the multiple dimensions.
In the embodiment of the application, firstly, virtual object feature information of dimension graphs corresponding to each environment dimension is extracted, and then an environment state graph is generated according to the virtual object feature information corresponding to all the dimension graphs. The method and the device have the advantages that the environment state graph with rich contents is determined based on factors of each environment dimension, and the environment state graph is guaranteed to have rich information.
According to the environmental status visualization method provided in the present application, step S241 includes:
s2411, inputting a pre-trained image recognition model for each dimension graph corresponding to the environment dimension, and determining a virtual object in the dimension graph;
s2412, inputting the virtual object in the dimension graph into a pre-trained image semantic model, outputting a virtual object semantic vector corresponding to the virtual object, and determining the virtual object semantic vector as virtual object feature information.
Specifically, the dimension graphs corresponding to each environment dimension can be identified through a pre-trained image identification model, and virtual objects in the dimension graphs are identified. And reducing the influence of other non-critical areas in the dimension graph, such as corner areas or blank areas, on the main expression content of the image, and determining virtual objects of the main expression content in the image.
The feature extraction is carried out on the virtual objects in the dimension graph through the pre-trained image semantic model, the graph form data of the virtual objects are quantized into the form of semantic vectors, and the features of the virtual objects in the dimension graph can be expressed abundantly and accurately through the form of the semantic vectors.
In the embodiment of the application, the virtual objects in the dimension graph are identified through the image identification model, and the virtual objects in the dimension graph are quantized into the virtual object semantic vectors, so that the characteristics of the virtual objects mainly expressed in the dimension graph can be expressed abundantly and accurately.
According to the environmental status visualization method provided in the present application, step S242 includes:
s2421, vector stitching is carried out on a plurality of virtual object semantic vectors to obtain stitching vectors, and the stitching vectors are determined to be the fused virtual object characteristic information;
s2422, inputting the spliced vector into a pre-trained image reconstruction model, and generating the environment state graph based on the spliced vector.
Specifically, virtual object semantic vectors of dimension graphs corresponding to a plurality of environment dimensions can be spliced to obtain spliced vectors. The splicing vector can fully and completely express the characteristics of the virtual objects in the dimension graphs corresponding to the environment dimensions.
Through the pre-trained image reconstruction model, image reconstruction can be performed based on the spliced vectors, comprehensive characteristics of virtual objects in dimension graphs corresponding to all the fused environment dimensions are converted into image expression forms from vector expression forms, an environment state graph is generated, the comprehensive characteristics of the virtual objects in the dimension graphs corresponding to all the environment dimensions, namely environment dimension data corresponding to all the environment dimensions, can be expressed in a rich and accurate mode through the environment state graph in a visual image form.
In the embodiment of the application, vector stitching is performed on a plurality of virtual object semantic vectors, and the characteristics of the virtual objects in the dimension graphs corresponding to all environment dimensions are expressed in a quantitative mode through the stitched vectors. And carrying out image reconstruction on the spliced vector based on the image reconstruction model to generate a visualized environment state graph, and enriching and accurately expressing environment dimension data corresponding to each environment dimension.
In one example based on the embodiments described above, an environment state visualization flow is shown in fig. 3. And acquiring original environment data through the environment information acquisition equipment and uploading the original environment data to the cloud server. After the cloud server gathers the environmental data, the environmental dimension data of the temperature dimension and the environmental dimension data of the humidity dimension are obtained through division. The temperature dimension comprises 5 preset numerical intervals, namely a very high temperature, a moderate temperature, a low temperature and a very low temperature, and corresponding dimension patterns 1-5. The humidity dimension comprises 5 preset numerical intervals, namely extremely high humidity, large humidity, moderate humidity, low humidity and drying, and corresponding patterns 6-10. According to the environmental dimension data of the temperature dimension and the environmental dimension data of the humidity dimension, a temperature dimension graph A and a humidity dimension graph B are determined in a corresponding dimension interval, the A and the B are subjected to graph fusion to obtain a final environmental state graph, the final environmental state graph is sent to target equipment with a screen, the environmental state graph is displayed through the screen when the target equipment is standby, information of the environmental state is intuitively transmitted to a user, the user can conveniently understand and quickly make corresponding decisions, for example, the air humidity in the environment is 10%rh, the physical meaning is air drying, the current air drying can be quickly understood when the user sees the environmental state graph with the flower dried on the screen of the standby target equipment, and the user can quickly make judgment that a humidifier needs to be started.
The environmental state visualization device provided by the application is described below, and the environmental state visualization device described below and the environmental state visualization method described above can be referred to correspondingly.
The present application also provides an environmental status visualization apparatus, as shown in fig. 4, including:
an acquisition unit 41 for acquiring environmental data;
an parsing unit 42, configured to determine environmental dimension data corresponding to each of the plurality of environmental dimensions according to the environmental data;
a graphic unit 43, configured to determine a dimension graphic corresponding to each environmental dimension according to the value of the environmental dimension data, where the dimension graphic is a pseudo-materialized graphic matched with the environmental dimension data of the corresponding environmental dimension; performing graph fusion according to the dimension graphs corresponding to the plurality of environment dimensions to generate an environment state graph, wherein the environment state graph is a pseudo-physical graph matched with the environment data of each environment dimension;
and the control unit 44 is used for sending the environment state graph to the target equipment for displaying.
According to the embodiment of the application, the environmental data are acquired, the data of a plurality of environmental dimensions are determined by analyzing the environmental data, the classification of the environmental information is realized, different dimension graphs are conveniently determined for different dimension data, and the corresponding environmental dimension information is represented through the dimension graphs. And carrying out image fusion on the dimension graphs of the plurality of environment dimensions to obtain an environment state graph, wherein the information corresponding to the plurality of environment dimensions can be represented through the environment state graph, and the content is richer. Determining the environmental state graph according to the environmental data realizes the conversion of abstract data into a materialized pseudo-materialized graph. The environment state graph is displayed through the target equipment, so that a user can intuitively and comprehensively know the overall state of the environment, and the use experience of the user is improved.
According to the environmental status visualization apparatus provided in the present application, the obtaining unit 41 is specifically configured to:
acquiring original environment data acquired by at least one environment information acquisition device;
and summarizing according to the original environment data to determine the environment data.
According to the environmental status visualization device provided in the present application, the parsing unit 42 is specifically configured to:
classifying the environmental data according to the acquisition sources of the environmental data to obtain the environmental data corresponding to different acquisition sources;
based on the mapping relation between the acquisition sources and the environment dimension types, the environment data corresponding to the different acquisition sources are divided into environment dimension data of a plurality of environment dimensions.
According to an environmental status visualization device provided in the present application, the graphic unit 43 is specifically configured to:
determining a target value interval in a plurality of preset value intervals of the environment dimension corresponding to the value interval according to the value of the environment dimension data;
inquiring the dimension graph corresponding to the environment dimension data according to the target value interval and a relation table corresponding to a plurality of preset value intervals and the simulated graph.
According to an environmental status visualization device provided in the present application, the graphic unit 43 is specifically configured to:
extracting virtual object feature information of the dimension graph corresponding to each environment dimension, wherein the virtual object feature information is used for representing information of the environment dimension and information of environment dimension data corresponding to the environment dimension;
and carrying out feature fusion according to the plurality of virtual object feature information, and generating an environment state graph based on the fused virtual object feature information, wherein the environment state graph is used for representing information of a plurality of environment dimensions and information of environment dimension data corresponding to each environment dimension.
According to an environmental status visualization device provided in the present application, the graphic unit 43 is specifically configured to:
inputting a pre-trained image recognition model for each dimension graph corresponding to the environment dimension, and determining a virtual object in the dimension graph;
and inputting the virtual object in the dimension graph into a pre-trained image semantic model, outputting a virtual object semantic vector corresponding to the virtual object, and determining the virtual object semantic vector as virtual object feature information.
According to an environmental status visualization device provided in the present application, the graphic unit 43 is specifically configured to:
vector stitching is carried out on the plurality of virtual object semantic vectors to obtain stitching vectors, and the stitching vectors are determined to be the fused virtual object characteristic information;
inputting the spliced vector into a pre-trained image reconstruction model, and generating the environment state graph based on the spliced vector.
Fig. 5 illustrates a physical schematic diagram of an electronic device, as shown in fig. 5, the electronic device may include: processor 510, communication interface (Communications Interface) 520, memory 530, and communication bus 540, wherein processor 510, communication interface 520, memory 530 complete communication with each other through communication bus 540. Processor 510 may invoke logic instructions in memory 530 to perform an environmental state visualization method comprising: acquiring environmental data; determining environment dimension data corresponding to each of a plurality of environment dimensions according to the environment data; determining a dimension graph corresponding to each environment dimension according to the numerical value of the environment dimension data, wherein the dimension graph is a pseudo-physical graph matched with the environment dimension data of the corresponding environment dimension; performing graph fusion according to the dimension graphs corresponding to the plurality of environment dimensions to generate an environment state graph, wherein the environment state graph is a pseudo-physical graph matched with the environment data of each environment dimension; and sending the environment state graph to target equipment for display.
Further, the logic instructions in the memory 530 described above may be implemented in the form of software functional units and may be stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In another aspect, the present application also provides a computer program product, the computer program product including a computer program, the computer program being storable on a computer readable storage medium, the computer program, when executed by a processor, being capable of performing the method of visualizing an environmental state provided by the methods described above, the method comprising: acquiring environmental data; determining environment dimension data corresponding to each of a plurality of environment dimensions according to the environment data; determining a dimension graph corresponding to each environment dimension according to the numerical value of the environment dimension data, wherein the dimension graph is a pseudo-physical graph matched with the environment dimension data of the corresponding environment dimension; performing graph fusion according to the dimension graphs corresponding to the plurality of environment dimensions to generate an environment state graph, wherein the environment state graph is a pseudo-physical graph matched with the environment data of each environment dimension; and sending the environment state graph to target equipment for display.
In still another aspect, the present application further provides a computer readable storage medium, where the computer readable storage medium includes a stored program, where the program when executed performs an environmental state visualization method provided by the methods above, the method includes: acquiring environmental data; determining environment dimension data corresponding to each of a plurality of environment dimensions according to the environment data; determining a dimension graph corresponding to each environment dimension according to the numerical value of the environment dimension data, wherein the dimension graph is a pseudo-physical graph matched with the environment dimension data of the corresponding environment dimension; performing graph fusion according to the dimension graphs corresponding to the plurality of environment dimensions to generate an environment state graph, wherein the environment state graph is a pseudo-physical graph matched with the environment data of each environment dimension; and sending the environment state graph to target equipment for display.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting thereof; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the corresponding technical solutions.
Claims (10)
1. A method of visualizing an environmental condition, comprising:
acquiring environmental data;
determining environment dimension data corresponding to each of a plurality of environment dimensions according to the environment data;
determining a dimension graph corresponding to each environment dimension according to the numerical value of the environment dimension data, wherein the dimension graph is a pseudo-physical graph matched with the environment dimension data of the corresponding environment dimension;
performing graph fusion according to the dimension graphs corresponding to the plurality of environment dimensions to generate an environment state graph, wherein the environment state graph is a pseudo-physical graph matched with the environment data of each environment dimension;
and sending the environment state graph to target equipment for display.
2. The method for visualizing an environmental state of claim 1, wherein said determining environmental dimension data corresponding to each of a plurality of environmental dimensions from said environmental data comprises:
classifying the environmental data according to the acquisition sources of the environmental data to obtain the environmental data corresponding to different acquisition sources;
based on the mapping relation between the acquisition sources and the environment dimension types, the environment data corresponding to the different acquisition sources are divided into environment dimension data of a plurality of environment dimensions.
3. The method for visualizing an environmental state as in claim 1, wherein said determining a dimension graph corresponding to each of said environmental dimensions based on values of said environmental dimension data comprises:
determining a target value interval in a plurality of preset value intervals of the environment dimension corresponding to the value interval according to the value of the environment dimension data;
inquiring the dimension graph corresponding to the environment dimension data according to the target value interval and a relation table corresponding to a plurality of preset value intervals and the simulated graph.
4. The method for visualizing an environmental state according to claim 1, wherein said performing graphic fusion according to the dimension graphics corresponding to the plurality of environmental dimensions to generate an environmental state graphic comprises:
extracting virtual object feature information of the dimension graph corresponding to each environment dimension, wherein the virtual object feature information is used for representing information of the environment dimension and information of environment dimension data corresponding to the environment dimension;
and carrying out feature fusion according to the virtual object feature information, and generating an environment state graph based on the fused virtual object feature information, wherein the environment state graph is used for representing information of a plurality of environment dimensions and information of environment dimension data corresponding to each environment dimension.
5. The method for visualizing an environmental state according to claim 4, wherein said extracting virtual object feature information of said dimension graphic corresponding to each of said environmental dimensions comprises:
inputting a pre-trained image recognition model for each dimension graph corresponding to the environment dimension, and determining a virtual object in the dimension graph;
and inputting the virtual object in the dimension graph into a pre-trained image semantic model, outputting a virtual object semantic vector corresponding to the virtual object, and determining the virtual object semantic vector as virtual object feature information.
6. The method of claim 5, wherein the performing feature fusion based on the plurality of virtual object feature information, and generating the environmental state graph based on the fused virtual object feature information, comprises:
vector stitching is carried out on the plurality of virtual object semantic vectors to obtain stitching vectors, and the stitching vectors are determined to be the fused virtual object characteristic information;
inputting the spliced vector into a pre-trained image reconstruction model, and generating the environment state graph based on the spliced vector.
7. The environmental condition visualization method of claim 1, wherein the acquiring environmental data comprises:
acquiring original environment data acquired by at least one environment information acquisition device;
and summarizing according to the original environment data to determine the environment data.
8. An environmental condition visualization apparatus, comprising:
an acquisition unit configured to acquire environmental data;
the analysis unit is used for determining environment dimension data corresponding to each of a plurality of environment dimensions according to the environment data;
the graphic unit is used for determining a dimension graphic corresponding to each environment dimension according to the numerical value of the environment dimension data, wherein the dimension graphic is a pseudo-physical graphic matched with the environment dimension data of the corresponding environment dimension;
performing graph fusion according to the dimension graphs corresponding to the plurality of environment dimensions to generate an environment state graph, wherein the environment state graph is a pseudo-physical graph matched with the environment data of each environment dimension;
and the control unit is used for sending the environment state graph to target equipment for display.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored program, wherein the program when run performs the environmental state visualization method of any one of claims 1 to 7.
10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method of visualizing an environmental state according to any one of claims 1 to 7 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310333390.3A CN116431852A (en) | 2023-03-30 | 2023-03-30 | Environment state visualization method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310333390.3A CN116431852A (en) | 2023-03-30 | 2023-03-30 | Environment state visualization method and device, storage medium and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116431852A true CN116431852A (en) | 2023-07-14 |
Family
ID=87080832
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310333390.3A Pending CN116431852A (en) | 2023-03-30 | 2023-03-30 | Environment state visualization method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116431852A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117708680A (en) * | 2024-02-06 | 2024-03-15 | 青岛海尔科技有限公司 | Method and device for improving accuracy of classification model, storage medium and electronic device |
-
2023
- 2023-03-30 CN CN202310333390.3A patent/CN116431852A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117708680A (en) * | 2024-02-06 | 2024-03-15 | 青岛海尔科技有限公司 | Method and device for improving accuracy of classification model, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104394044B (en) | The method and apparatus of self-defined smart machine scene mode | |
| CN111104341A (en) | Automatic testing method, device, equipment and storage medium for intelligent household equipment | |
| CN109218416A (en) | Internet of things system based on cloud platform | |
| CN116431852A (en) | Environment state visualization method and device, storage medium and electronic device | |
| CN114821236A (en) | Smart home environment sensing method, system, storage medium and electronic device | |
| Qin et al. | Electricity consumption in the digital era: Micro evidence from Chinese households | |
| CN115358395A (en) | Knowledge graph updating method and device, storage medium and electronic device | |
| CN114385287B (en) | Presentation content determining method, apparatus, electronic device and storage medium | |
| CN115047778A (en) | Control method and device for intelligent equipment, storage medium and electronic device | |
| CN113468033B (en) | Household appliance testing method and system | |
| CN117456089A (en) | Three-dimensional scene generation method and device, storage medium and electronic device | |
| WO2024001189A1 (en) | Food storage information determination method and apparatus, storage medium, and electronic apparatus | |
| WO2024001196A1 (en) | Household appliance control method and apparatus, storage medium, and electronic apparatus | |
| Albataineh et al. | DEVS-IoT: performance evaluation of smart home devices network | |
| CN114915514B (en) | Method and device for processing intention, storage medium and electronic device | |
| CN116484083A (en) | Dish information display method and device, storage medium and electronic device | |
| CN114676400A (en) | Identity determination method, storage medium and electronic device | |
| Foti et al. | On Visualizing Distribution Systems for Next Generation Power Distribution Grids | |
| CN117726908B (en) | Training method and device for picture generation model, storage medium and electronic device | |
| CN114911381B (en) | Interactive feedback method and device, storage medium and electronic device | |
| Zhang et al. | Introducing a novel method for simulating stochastic movement and occupancy in residential spaces using time-use survey data | |
| CN116560974A (en) | Interface testing method of Internet of things equipment, storage medium and electronic device | |
| CN115314332B (en) | Equipment theme setting method and device, storage medium and electronic device | |
| CN115988152B (en) | Method and device for generating target cooking video, storage medium and electronic device | |
| CN118228350A (en) | Spatial layout processing method and device for household equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |