CN117055737B - Human-computer interaction method and device based on AR device - Google Patents
Human-computer interaction method and device based on AR device Download PDFInfo
- Publication number
- CN117055737B CN117055737B CN202311308350.XA CN202311308350A CN117055737B CN 117055737 B CN117055737 B CN 117055737B CN 202311308350 A CN202311308350 A CN 202311308350A CN 117055737 B CN117055737 B CN 117055737B
- Authority
- CN
- China
- Prior art keywords
- indoor
- user
- equipment
- operation effect
- household equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000003993 interaction Effects 0.000 title claims abstract description 22
- 230000000694 effects Effects 0.000 claims abstract description 188
- 238000004140 cleaning Methods 0.000 claims description 37
- 230000004044 response Effects 0.000 claims description 20
- 238000012544 monitoring process Methods 0.000 claims description 7
- 230000001815 facial effect Effects 0.000 claims description 6
- 230000003044 adaptive effect Effects 0.000 claims description 5
- 238000007664 blowing Methods 0.000 claims description 5
- 230000001105 regulatory effect Effects 0.000 claims description 5
- 238000004519 manufacturing process Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 19
- 238000004891 communication Methods 0.000 abstract description 13
- 238000012790 confirmation Methods 0.000 description 6
- 230000003190 augmentative effect Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000012937 correction Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 241001417527 Pempheridae Species 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 239000000356 contaminant Substances 0.000 description 3
- 238000001816 cooling Methods 0.000 description 3
- 238000004378 air conditioning Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000003749 cleanliness Effects 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000010813 municipal solid waste Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The application discloses a man-machine interaction method and device based on an AR device. By applying the technical scheme, after the instruction of the user planning to start the household equipment in a certain operation mode is detected, the operation effect after the starting of the household equipment is displayed for the user by the AR equipment dynamically based on the environment where the household equipment is positioned and the operation power. So that the user can choose whether to replace other operation modes to start the household equipment according to the virtual operation effect. And sending a starting instruction to the household equipment after determining the instruction of starting the household equipment by the user in a certain running mode. Therefore, the purpose that the AR equipment in the related technology can only passively accept the control instruction of the user and cannot improve the user experience is avoided. On the other hand, the communication overhead can be optimized by reducing the mode of frequently sending control instructions to the household equipment, and the household equipment can be ensured to operate for the first time, namely, the user can be satisfied with the operation state to provide corresponding services for the user.
Description
Technical Field
The application relates to a data processing technology, in particular to a man-machine interaction method and device based on an AR device.
Background
With the breakthrough of the virtual reality technology and the gradual appearance of domestic household equipment, the virtual reality technology becomes an important component of domestic life, and the user experiences unprecedented feeling.
The AR augmented reality technology is applied to a plurality of fields, and the device interaction control system based on the AR augmented reality technology is gradually applied, and fuses a new generation information technology with control depth of each household device in a home scene, so that the function of intelligently controlling the household devices is achieved.
However, the existing AR augmented reality technology can only mechanically execute the control instruction of the user, which also results in poor user experience.
Disclosure of Invention
The embodiment of the application provides a man-machine interaction method and device based on an AR device. Therefore, the problem that the AR equipment can only mechanically execute the control instruction of the user to influence the user interaction experience in the related technology is solved.
According to an aspect of the embodiments of the present application, a human-computer interaction method based on an AR device is provided, which is applied to an AR device, and includes:
receiving an initial starting instruction acted on the AR equipment by a user, wherein the initial starting instruction is used for planning to operate the household equipment in a target operation mode;
Acquiring indoor environment parameters of the household equipment, acquiring a prestored running power table of the household equipment, calculating to obtain an indoor running effect achieved by running the household equipment in the target running mode based on the indoor environment parameters and the running power table, and calculating to obtain overhead data consumed by the AR equipment for displaying the indoor running effect;
dynamically displaying the indoor operation effect to the user and statically displaying the overhead data to the user by using a plurality of display modules deployed in the AR device;
and receiving response data fed back by the user to the indoor operation effect and the overhead data, and if the response data is determined to correspond to agreement, sending indication information for entering an operation state in the target operation mode to the household equipment.
Optionally, in another embodiment of the method according to the present application, the calculating, based on the indoor environment parameter and the operation power table, an indoor operation effect achieved by operating the home appliance in the target operation mode includes:
based on the operation power meter, calculating an initial operation effect achieved by operating the household equipment in the target operation mode;
And adaptively adjusting the initial operation effect based on at least one of a temperature parameter, a humidity parameter, a brightness parameter and an area parameter included in the indoor environment parameter to obtain the indoor operation effect.
Optionally, in another embodiment of the foregoing method of the present application, the adaptively adjusting the initial operation effect based on at least one of a temperature parameter, a humidity parameter, a brightness parameter and an area parameter included in the indoor environment parameter, to obtain the indoor operation effect includes:
if the household equipment is determined to be temperature and humidity regulation equipment, the initial operation effect is adaptively regulated based on the temperature parameter, the humidity parameter and the area parameter corresponding to the indoor environment, so that the indoor operation effect used for representing the indoor temperature and humidity can be obtained;
or alternatively, the first and second heat exchangers may be,
if the household equipment is determined to be picture display equipment, the initial operation effect is adaptively adjusted based on the area parameter and the brightness parameter corresponding to the indoor environment, so that the indoor operation effect used for representing the picture display quality which can be achieved by the household equipment indoors is obtained;
Or alternatively, the first and second heat exchangers may be,
and if the household equipment is determined to be cleaning equipment, carrying out adaptive adjustment on the initial operation effect based on the area parameter corresponding to the indoor environment, so as to obtain the indoor operation effect used for representing the cleaning quality which can be achieved by the household equipment in the room.
Optionally, in another embodiment of the method according to the present application, the calculating, based on the indoor environment parameter and the operation power table, overhead data consumed by the AR device to display the indoor operation effect includes:
acquiring the starting number of display modules required for displaying the indoor operation effect based on the type of the electric appliance corresponding to the household equipment; determining the operation power of each display module based on the actual effect corresponding to the indoor operation effect;
and calculating overhead data consumed by the AR equipment for displaying the indoor operation effect based on the starting number of the display modules and the operation power of each display module.
Optionally, in another embodiment of the method according to the present application, the dynamically displaying the indoor operation effect to the user by using a plurality of display modules deployed in the AR device includes:
If the indoor operation effect is determined to be used for displaying the preset temperature and humidity which can be achieved in the room, blowing air to a preset human body area of the user by using a temperature and humidity braking module deployed in the AR equipment at a first preset operation power, wherein the first preset operation power is the power capable of achieving the preset temperature and humidity;
or alternatively, the first and second heat exchangers may be,
if the indoor operation effect is determined to be used for displaying the picture display quality, a first virtual picture is generated by using a picture display module deployed in the AR equipment, and the first virtual picture is displayed at a first preset area of the AR equipment, wherein the first virtual picture is a display picture achieved by operating the household equipment in the target operation mode;
or alternatively, the first and second heat exchangers may be,
if the indoor operation effect is determined to be used for displaying the cleaning quality, a second virtual picture is generated by using a picture display module deployed in the AR equipment, and the second virtual picture is displayed at a second preset area of the AR equipment, wherein the second virtual picture is an indoor cleaning picture which is achieved after the household equipment is operated in the target operation mode for a preset time period.
Optionally, in another embodiment of the method according to the present application, the statically presenting the overhead data to the user with a plurality of presentation modules deployed in the AR device includes:
And generating a third virtual picture by using picture display modules deployed in the AR equipment, and displaying the third virtual picture at a third preset area of the AR equipment, wherein the third virtual picture comprises the starting number of display modules, the running power of each display module and the predicted electric quantity consumption value.
Optionally, in another embodiment of the method according to the present application, the receiving response data fed back by the user based on the indoor operation effect and the overhead data includes:
monitoring facial images of the user in a preset time period after the indoor operation effect and the overhead data are confirmed to be displayed to the user;
and if the face image is detected to meet the preset condition, determining that a confirmation starting instruction of the user is received.
According to still another aspect of the embodiments of the present application, a human-computer interaction device based on an AR device is provided, which is applied to an AR device, and includes:
a receiving module configured to receive an initial start-up instruction from a user acting on the AR device, the initial start-up instruction being for planning to operate the home device in a target operation mode;
the computing module is configured to acquire indoor environment parameters of the household equipment, acquire a pre-stored running power table of the household equipment, calculate and obtain indoor running effects achieved by running the household equipment in the target running mode based on the indoor environment parameters and the running power table, and calculate and obtain overhead data consumed by the AR equipment for displaying the indoor running effects;
A presentation module configured to dynamically present the indoor operation effect to the user and to statically present the overhead data to the user using a plurality of presentation modules deployed in the AR device;
and the starting module is configured to receive response data fed back by the user to the indoor operation effect and the overhead data, and send indication information for entering an operation state in the target operation mode to the household equipment if the response data is determined to correspond to agreement.
According to still another aspect of the embodiments of the present application, there is provided an electronic device including:
a memory for storing executable instructions; and
and the display is used for executing the executable instructions with the memory so as to finish the operation of the human-computer interaction method based on the AR device.
According to still another aspect of embodiments of the present application, there is provided a computer-readable storage medium storing computer-readable instructions that, when executed, perform the operations of any one of the above-described AR device-based human-computer interaction methods.
In the application, an initial starting instruction acted on the AR equipment by a user is received, wherein the initial starting instruction is used for planning to operate the household equipment in a target operation mode; acquiring indoor environment parameters of the current household equipment, acquiring a pre-stored running power meter of the household equipment, calculating to obtain an indoor running effect achieved by running the household equipment in a target running mode based on the indoor environment parameters and the running power meter, and calculating to obtain overhead data consumed by the AR equipment for displaying the indoor running effect; dynamically displaying indoor operation effects to a user and statically displaying overhead data to the user by using a plurality of display modules deployed in the AR equipment; after a confirmation starting instruction of a user is automatically detected within a preset time period, sending indication information for entering an operation state in a target operation mode to the household equipment.
By applying the technical scheme, after detecting the instruction of the user to start the household equipment in a certain running mode, the equipment can be started not at the first time. The AR device is dynamically utilized to display the running effect of the home device after the home device is started for a user based on the environment in which the home device is located and the running power. So that the user can choose whether to replace other operation modes to start the household equipment according to the virtual operation effect. And sending a starting instruction to the household equipment after determining the instruction of starting the household equipment by the user in a certain running mode.
Therefore, the purpose that the AR equipment in the related technology can only passively accept the control instruction of the user and cannot improve the user experience is avoided. On the other hand, the communication overhead can be optimized by reducing the mode of frequently sending control instructions to the household equipment, and the household equipment can be ensured to operate for the first time, namely, the user can be satisfied with the operation state to provide corresponding services for the user.
The technical scheme of the present application is described in further detail below through the accompanying drawings and examples.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the application and, together with the description, serve to explain the principles of the application.
The present application will be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:
fig. 1 is a schematic diagram of a man-machine interaction method based on an AR device according to the present application;
FIG. 2 is a flowchart of a human-computer interaction method based on an AR device according to the present application;
fig. 3 is a schematic structural diagram of an electronic device according to the present application;
fig. 4 is a schematic structural diagram of an electronic device according to the present application.
Detailed Description
Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present application unless it is specifically stated otherwise.
Meanwhile, it should be understood that the sizes of the respective parts shown in the drawings are not drawn in actual scale for convenience of description.
The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the application, its application, or uses.
Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.
In addition, the technical solutions of the embodiments of the present application may be combined with each other, but it is necessary to be based on the fact that those skilled in the art can implement the technical solutions, and when the technical solutions are contradictory or cannot be implemented, the combination of the technical solutions should be considered to be absent, and is not within the scope of protection claimed in the present application.
It should be noted that all directional indicators (such as up, down, left, right, front, and rear … …) in the embodiments of the present application are merely used to explain the relative positional relationship, movement conditions, and the like between the components in a specific posture (as shown in the drawings), and if the specific posture is changed, the directional indicator is correspondingly changed.
A human-computer interaction method for performing an AR-based device according to an exemplary embodiment of the present application is described below with reference to fig. 1-2. It should be noted that the following application scenario is only shown for the convenience of understanding the spirit and principles of the present application, and embodiments of the present application are not limited in any way in this respect. Rather, embodiments of the present application may be applied to any scenario where applicable.
The application also provides a man-machine interaction method and device based on the AR device.
Fig. 1 schematically shows a flow chart of a human-computer interaction method based on an AR device according to an embodiment of the present application. As shown in fig. 1, the method is applied to an AR device, and includes:
s101, receiving an initial starting instruction acted on the AR equipment by a user, wherein the initial starting instruction is used for planning to operate the household equipment in a target operation mode.
S102, acquiring indoor environment parameters of the current household equipment, acquiring a pre-stored running power table of the household equipment, calculating to obtain indoor running effects achieved by running the household equipment in a target running mode based on the indoor environment parameters and the running power table, and calculating to obtain overhead data consumed by the AR equipment for displaying the indoor running effects.
S103, dynamically showing indoor operation effects to a user and statically showing overhead data to the user by using a plurality of showing modules deployed in the AR equipment.
And S104, receiving response data fed back by the user on the indoor operation effect and the overhead data, and if the response data is determined to correspond to agreement, sending indication information for entering the operation state in the target operation mode to the household equipment.
In the related art, with the breakthrough of the virtual reality technology and the gradual appearance of domestic household equipment, the virtual reality technology becomes an important component of domestic life, so that users experience unprecedented feeling.
Further, AR is an english abbreviation of an augmented reality technology, which is a newer technology content that promotes integration between real world information and virtual world information content, and performs analog simulation processing on the basis of scientific technologies such as a computer on the entity information that is originally difficult to experience in a spatial range of the real world, and the virtual information content is effectively applied in the real world by superposition, and can be perceived by human senses in the process, so that a sense experience exceeding reality is realized, and after the real environment and the virtual object are overlapped, the virtual information content can exist in the same picture and space at the same time.
However, the existing AR augmented reality technology can only mechanically execute the control instruction of the user, which also results in poor user experience.
Based on the above problems, the present application proposes a man-machine interaction method based on an AR device, which adopts the scheme that after detecting an instruction that a user plans to start a home appliance in a certain operation mode, the AR device is dynamically utilized to display an operation effect after the user starts the home appliance based on an environment in which the home appliance is located and an operation power. So that the user can choose whether to replace other operation modes to start the household equipment according to the virtual operation effect. And sending a starting instruction to the household equipment after determining the instruction of starting the household equipment by the user in a certain running mode.
It can be appreciated that the technical scheme of the application can enable the interaction mode of the AR equipment and the user not to be limited to a single instruction receiving and transmitting mode, namely, more intelligent environment understanding capability can be given to the AR equipment, and therefore more abundant use information of the household equipment is displayed for the user.
Further, the present application is specifically described herein with reference to fig. 2:
and step 1, receiving an initial starting instruction acted on the AR equipment by a user.
Wherein the initial start-up instruction is for planning to operate the home appliance in the target operation mode.
In one manner, the home device may be a smart device with display functionality, such as a cell phone, tablet, computer, television, or the like. The intelligent device can also be used for adjusting indoor temperature and humidity, such as an air conditioner, a humidifier, a purifier and the like. The cleaning device can also be an intelligent device for cleaning indoors, such as a cleaning robot and the like.
And 2, calculating an initial operation effect achieved by operating the household equipment in the target operation mode based on the operation power meter.
It can be understood that the initial operation effect is an operation effect achieved regardless of the indoor environment factor in which the home appliance is located. Namely, the operation effect of the household equipment in the ideal state.
Further, the indoor operation effect is a result obtained by adaptively correcting the initial operation effect by combining indoor environment factors of the current household equipment on the basis of the initial operation effect.
And step 3, adaptively adjusting the initial operation effect based on at least one of the temperature parameter, the humidity parameter, the brightness parameter and the area parameter included in the indoor environment parameter to obtain the indoor operation effect.
Wherein, this step includes the following three cases:
first case:
if the household equipment is determined to be temperature and humidity regulation equipment, the initial operation effect is adaptively regulated based on temperature parameters, humidity parameters and area parameters corresponding to the indoor environment, so that the indoor operation effect used for representing the indoor temperature and humidity can be obtained;
for example, when the temperature and humidity regulation type device is an air conditioner, the AR device may calculate, based on the operation power meter, that the air conditioner is operated in a cooling mode of 16 degrees when the air conditioner is operated in the target operation mode. Then the initial operating effect is that the indoor temperature can reach 16 degrees.
However, if the indoor environment (such as a large indoor area and a high current indoor temperature and humidity value) of the air conditioner is considered, the embodiment of the application needs to make a certain correction on the initial operation effect (the actual effect is necessarily hotter than the ideal value due to the large current indoor area and the high temperature and humidity value), so as to obtain a new indoor operation effect, that is, the actual indoor temperature is 20 degrees.
In other words, although the set temperature of the air conditioner is 16 degrees (i.e., the temperature of 16 degrees can be achieved in the room in an ideal case), the present application requires a certain correction of the temperature according to the indoor environment in the actual situation (for example, the larger the indoor area is, the higher the corrected temperature value is relatively, because the cooling effect of the air conditioner is dependent on the indoor area). Thus, the new indoor operation effect is 20 degrees.
Second case:
if the household equipment is determined to be picture display equipment, based on the area parameter and the brightness parameter corresponding to the indoor environment, carrying out adaptive adjustment on the initial operation effect to obtain the indoor operation effect for representing the picture display quality which can be achieved by the household equipment indoors;
for example, when the screen presentation class device is a television, the AR device may calculate, based on the operation power table, that the television is operated in the target operation mode, the television being operated with a luminance value of 50 and a definition of 1080p. Then the initial running effect is that the picture display quality is 50 luminance value and the sharpness is 1080p.
However, if the indoor environment (for example, the indoor area is large and the brightness value is low) of the air conditioner is considered again, then the embodiment of the application needs to make a certain correction on the initial operation effect (the distance between the watching user and the television may be far because the current indoor area is large and the actual effect of the picture brightness is higher and the actual effect of the picture definition is more blurred because of the dark indoor brightness), so as to obtain a new indoor operation effect, that is, the picture display quality actually achieved indoors is 60 brightness value and 960p definition.
Third case:
if the household equipment is determined to be cleaning equipment, the initial operation effect is adaptively adjusted based on the area parameter corresponding to the indoor environment, so that the indoor operation effect used for representing the cleaning quality of the household equipment can be achieved indoors is obtained.
For example, when the cleaning-type device is a sweeper, the AR device may calculate that the cleaning quality is superior when the sweeper is operated in the target operation mode based on the operation power meter.
However, if the indoor environment in which the air conditioner is located (for example, the indoor mess area is large, etc.) is considered again, then the embodiment of the present application needs to make a certain correction to the initial operation effect (the actual cleaning quality is inevitably reduced due to the large mess area), so as to obtain a new indoor operation effect, that is, the cleaning quality actually achieved in the room is moderate.
In one approach, the manner in which the cleaning quality is assessed as being either superior or moderate or poor may be based on the amount of contaminants per unit area (e.g., 1 square meter). It will be appreciated that the greater the amount of contaminants per unit area, the lower the corresponding cleaning level.
By way of example, the contaminant may be trash, dust, dirt, or the like.
Step 4, acquiring the starting number of the display modules required by displaying the indoor operation effect based on the type of the electric appliance corresponding to the household equipment; and determining the operation power of each display module based on the actual effect corresponding to the indoor operation effect.
It can be understood that household appliances of different appliance types correspond to different indoor operation effects, and further different display modules can be started to operate different operation powers.
For example, when the home appliance is an air conditioner, a cooling (heating) module, a humidity module and the like are started, and corresponding operation power is selected to operate according to corresponding actual effects. When the household equipment is a television, the picture display module is started and a corresponding virtual picture is generated for the user to watch the effect.
And 5, calculating to obtain overhead data consumed by the AR equipment for displaying the indoor operation effect based on the starting number of the display modules and the operation power of each display module.
It will be appreciated that whatever display module is running, and what operating state each display module needs to reach, will cause some power loss overhead to the AR device.
To sum up, the present application aims to prompt the user of the remaining power status of the AR device in time so as to achieve the purpose of prompting the user whether to start the function later. The overhead data may be presented to the user at a preset area of the AR device (e.g., which presentation modules are activated, and the amount of power consumed to present the indoor effect with the presentation modules, etc.).
And 6a, dynamically displaying the indoor operation effect to the user by using a plurality of display modules deployed in the AR equipment.
In one mode, the application can dynamically display the user through the plurality of display modules, so that the user can feel the indoor effect achieved when the household equipment is operated in the target operation mode in advance. And further, the defects that the optimal experience service cannot be provided for the user quickly and the communication transmission cost is increased due to the fact that the running mode is repeatedly changed after the user starts the household equipment can be avoided.
Wherein, this step also includes the following three cases:
first case:
if the indoor operation effect is determined to be used for displaying the preset temperature and humidity which can be achieved in the room, the temperature and humidity braking module deployed in the AR equipment is utilized to blow air to a preset human body area of a user with the first preset operation power, wherein the first preset operation power is the power capable of achieving the preset temperature and humidity.
In one mode, the temperature and humidity braking module may be a braking module capable of producing cold (hot) wind and moisture, and it can be understood that the application makes by starting the braking module a wind which is matched with the indoor operation effect and can reach a preset temperature and humidity to blow to a preset human body area (such as an arm, a face and the like) of a user, so that the user has a subjective temperature and humidity feeling.
In other words, the indoor temperature and humidity reached in the room when the indoor air conditioning equipment is operated in the target operation mode can be sensed in advance by the user through the mode. And then, whether to actually operate the indoor air conditioning equipment in other operation modes (for example, change to an operation mode capable of making the indoor temperature lower or change to an operation mode capable of making the indoor temperature higher) or not is conveniently selected according to the temperature and humidity experience sensed by the preset human body area. And further, the defect that the service of the optimal environment experience cannot be provided for the user rapidly and the communication transmission cost is increased due to the fact that the running mode is repeatedly changed after the user starts the isothermal humidity control equipment of the air conditioner can be avoided.
Second case:
if the indoor operation effect is determined to be used for displaying the picture display quality, a picture display module deployed in the AR equipment is utilized to generate a first virtual picture, the first virtual picture is displayed at a first preset area of the AR equipment, and the first virtual picture is a display picture achieved by operating the household equipment in a target operation mode.
In one mode, the screen display module may be a braking module capable of generating a virtual screen, and it can be understood that by starting the braking module, the present application makes a display screen matched with an indoor operation effect, which can reflect that the screen display device (i.e. the home device) is in the indoor, so that a user has a subjective viewing experience.
In other words, the method can enable the user to feel the picture display effect achieved in the room (namely, reflected by the first virtual picture in the first preset area of the AR device) when the picture display device in the room is operated in the target operation mode in advance. And further facilitate selection of whether to operate the indoor picture presentation type device in other modes of operation (e.g., to change to a mode of operation that allows for lower brightness of the picture, and/or to change to a mode of operation that allows for higher definition of the picture), etc., based on the viewing experience perceived by the user.
It can be appreciated that, by adopting the above manner in the embodiment of the present application, the defect that the service of providing the best viewing experience for the user cannot be rapidly provided and the communication transmission overhead is increased due to the fact that the operation mode is repeatedly changed after the user starts the television and other picture display devices can be avoided.
Third case:
if the indoor operation effect is determined to be used for displaying the cleaning quality, a second virtual picture is generated by using a picture display module deployed in the AR equipment, and the second virtual picture is displayed at a second preset area of the AR equipment, wherein the second virtual picture is an indoor cleaning picture which is achieved after the household equipment is operated in the target operation mode for a preset time period.
In one mode, the screen display module may be a braking module capable of generating a virtual screen, and it can be understood that the screen display module is started to manufacture a screen matched with an indoor operation effect and capable of reflecting the indoor cleaning effect of the cleaning display device (i.e. the household device), so that a user has a subjective feeling of cleanliness.
As an example, the preset duration may be a duration set for the target operation mode (e.g., 5min, 30min, etc.).
In other words, the present application can make the user feel in advance the cleaning effect achieved in the room (i.e., reflected by the second virtual screen in the second preset area of the AR device) when the cleaning device in the room is operated in the target operation mode. Further facilitating selection of whether to operate the cleaning device in the room in other modes of operation (e.g., changing to a mode of operation that is capable of higher cleaning intensity, and/or changing to a mode of operation that is capable of longer cleaning time), etc., based on the viewing experience perceived by the user.
It can be appreciated that the above manner of the embodiment of the application can avoid the situation that the operation mode is repeatedly changed after the user starts the cleaning equipment such as the sweeper, so that the service of the optimal cleaning experience cannot be provided for the user quickly, and the defect of communication transmission overhead is also increased.
And 6b, generating a third virtual picture by using a picture display module deployed in the AR equipment, and displaying the third virtual picture at a third preset area of the AR equipment.
The third virtual picture comprises the starting number of the display modules, the running power of each display module and the predicted electric quantity consumption value.
And 7, monitoring the facial image of the user in a preset time period after the indoor operation effect and the overhead data are displayed to the user.
In one mode, after the indoor operation effect and the overhead data are displayed to the user, the embodiment of the application can judge whether to start the household equipment in the target operation mode or not through monitoring the face image of the user.
And 8, determining that a confirmation starting instruction of the user is received if the face image is detected to meet the preset condition.
As an example, the AR device may determine user satisfaction with the indoor operation effect by monitoring facial features such as whether the user's eyebrows are wrinkled, whether the corners of the mouth are raised, and the like. To thereby determine whether to change other modes of operation to activate the home appliance.
In the application, an initial starting instruction acted on the AR equipment by a user is received, wherein the initial starting instruction is used for planning to operate the household equipment in a target operation mode; acquiring indoor environment parameters of the current household equipment, acquiring a pre-stored running power meter of the household equipment, calculating to obtain an indoor running effect achieved by running the household equipment in a target running mode based on the indoor environment parameters and the running power meter, and calculating to obtain overhead data consumed by the AR equipment for displaying the indoor running effect; dynamically displaying indoor operation effects to a user and statically displaying overhead data to the user by using a plurality of display modules deployed in the AR equipment; after a confirmation starting instruction of a user is automatically detected within a preset time period, sending indication information for entering an operation state in a target operation mode to the household equipment.
By applying the technical scheme, after detecting the instruction of the user to start the household equipment in a certain running mode, the equipment can be started not at the first time. The AR device is dynamically utilized to display the running effect of the home device after the home device is started for a user based on the environment in which the home device is located and the running power. So that the user can choose whether to replace other operation modes to start the household equipment according to the virtual operation effect. And sending a starting instruction to the household equipment after determining the instruction of starting the household equipment by the user in a certain running mode. Therefore, the purpose that the AR equipment in the related technology can only passively accept the control instruction of the user and cannot improve the user experience is avoided. On the other hand, the communication overhead can be optimized by reducing the mode of frequently sending control instructions to the household equipment, and the household equipment can be ensured to operate for the first time, namely, the user can be satisfied with the operation state to provide corresponding services for the user.
Optionally, in another embodiment of the method according to the present application, the calculating, based on the indoor environment parameter and the operation power table, an indoor operation effect achieved by operating the home appliance in the target operation mode includes:
Based on the operation power meter, calculating an initial operation effect achieved by operating the household equipment in the target operation mode;
and adaptively adjusting the initial operation effect based on at least one of a temperature parameter, a humidity parameter, a brightness parameter and an area parameter included in the indoor environment parameter to obtain the indoor operation effect.
Optionally, in another embodiment of the foregoing method of the present application, the adaptively adjusting the initial operation effect based on at least one of a temperature parameter, a humidity parameter, a brightness parameter and an area parameter included in the indoor environment parameter, to obtain the indoor operation effect includes:
if the household equipment is determined to be temperature and humidity regulation equipment, the initial operation effect is adaptively regulated based on the temperature parameter, the humidity parameter and the area parameter corresponding to the indoor environment, so that the indoor operation effect used for representing the indoor temperature and humidity can be obtained;
or alternatively, the first and second heat exchangers may be,
if the household equipment is determined to be picture display equipment, the initial operation effect is adaptively adjusted based on the area parameter and the brightness parameter corresponding to the indoor environment, so that the indoor operation effect used for representing the picture display quality which can be achieved by the household equipment indoors is obtained;
Or alternatively, the first and second heat exchangers may be,
and if the household equipment is determined to be cleaning equipment, carrying out adaptive adjustment on the initial operation effect based on the area parameter corresponding to the indoor environment, so as to obtain the indoor operation effect used for representing the cleaning quality which can be achieved by the household equipment in the room.
Optionally, in another embodiment of the method according to the present application, the calculating, based on the indoor environment parameter and the operation power table, overhead data consumed by the AR device to display the indoor operation effect includes:
acquiring the starting number of display modules required for displaying the indoor operation effect based on the type of the electric appliance corresponding to the household equipment; determining the operation power of each display module based on the actual effect corresponding to the indoor operation effect;
and calculating overhead data consumed by the AR equipment for displaying the indoor operation effect based on the starting number of the display modules and the operation power of each display module.
Optionally, in another embodiment of the method according to the present application, the dynamically displaying the indoor operation effect to the user by using a plurality of display modules deployed in the AR device includes:
If the indoor operation effect is determined to be used for displaying the preset temperature and humidity which can be achieved in the room, blowing air to a preset human body area of the user by using a temperature and humidity braking module deployed in the AR equipment at a first preset operation power, wherein the first preset operation power is the power capable of achieving the preset temperature and humidity;
or alternatively, the first and second heat exchangers may be,
if the indoor operation effect is determined to be used for displaying the picture display quality, a first virtual picture is generated by using a picture display module deployed in the AR equipment, and the first virtual picture is displayed at a first preset area of the AR equipment, wherein the first virtual picture is a display picture achieved by operating the household equipment in the target operation mode;
or alternatively, the first and second heat exchangers may be,
if the indoor operation effect is determined to be used for displaying the cleaning quality, a second virtual picture is generated by using a picture display module deployed in the AR equipment, and the second virtual picture is displayed at a second preset area of the AR equipment, wherein the second virtual picture is an indoor cleaning picture which is achieved after the household equipment is operated in the target operation mode for a preset time period.
Optionally, in another embodiment of the method according to the present application, the statically presenting the overhead data to the user with a plurality of presentation modules deployed in the AR device includes:
And generating a third virtual picture by using picture display modules deployed in the AR equipment, and displaying the third virtual picture at a third preset area of the AR equipment, wherein the third virtual picture comprises the starting number of display modules, the running power of each display module and the predicted electric quantity consumption value.
Optionally, in another embodiment of the method according to the present application, the receiving response data fed back by the user based on the indoor operation effect and the overhead data includes:
monitoring facial images of the user in a preset time period after the indoor operation effect and the overhead data are confirmed to be displayed to the user;
and if the face image is detected to meet the preset condition, determining that a confirmation starting instruction of the user is received.
By applying the technical scheme, after detecting the instruction of the user to start the household equipment in a certain running mode, the equipment can be started not at the first time. The AR device is dynamically utilized to display the running effect of the home device after the home device is started for a user based on the environment in which the home device is located and the running power. So that the user can choose whether to replace other operation modes to start the household equipment according to the virtual operation effect. And sending a starting instruction to the household equipment after determining the instruction of starting the household equipment by the user in a certain running mode. Therefore, the purpose that the AR equipment in the related technology can only passively accept the control instruction of the user and cannot improve the user experience is avoided. On the other hand, the communication overhead can be optimized by reducing the mode of frequently sending control instructions to the household equipment, and the household equipment can be ensured to operate for the first time, namely, the user can be satisfied with the operation state to provide corresponding services for the user.
Optionally, in another embodiment of the present application, as shown in fig. 3, the present application further provides a human-computer interaction device based on the AR device. Comprising the following steps:
a receiving module 201 configured to receive an initial start-up instruction from a user acting on the AR device, the initial start-up instruction being for planning to operate the home device in a target operation mode;
a calculating module 202, configured to obtain an indoor environment parameter where the home appliance is currently located, obtain a pre-stored operation power table of the home appliance, calculate, based on the indoor environment parameter and the operation power table, an indoor operation effect achieved by operating the home appliance in the target operation mode, and calculate, to obtain overhead data consumed by the AR device to display the indoor operation effect;
a presentation module 203 configured to dynamically present the indoor operation effect to the user and statically present the overhead data to the user using a plurality of presentation modules deployed in the AR device;
and the starting module 204 is configured to receive response data fed back by the user to the indoor operation effect and the overhead data, and send indication information for entering an operation state in the target operation mode to the household equipment if the response data is determined to correspond to agreement.
By applying the technical scheme, after detecting the instruction of the user to start the household equipment in a certain running mode, the equipment can be started not at the first time. The AR device is dynamically utilized to display the running effect of the home device after the home device is started for a user based on the environment in which the home device is located and the running power. So that the user can choose whether to replace other operation modes to start the household equipment according to the virtual operation effect. And sending a starting instruction to the household equipment after determining the instruction of starting the household equipment by the user in a certain running mode. Therefore, the purpose that the AR equipment in the related technology can only passively accept the control instruction of the user and cannot improve the user experience is avoided. On the other hand, the communication overhead can be optimized by reducing the mode of frequently sending control instructions to the household equipment, and the household equipment can be ensured to operate for the first time, namely, the user can be satisfied with the operation state to provide corresponding services for the user.
In another embodiment of the present application, the computing module 202 is configured to:
based on the operation power meter, calculating an initial operation effect achieved by operating the household equipment in the target operation mode;
And adaptively adjusting the initial operation effect based on at least one of a temperature parameter, a humidity parameter, a brightness parameter and an area parameter included in the indoor environment parameter to obtain the indoor operation effect.
In another embodiment of the present application, the computing module 202 is configured to:
if the household equipment is determined to be temperature and humidity regulation equipment, the initial operation effect is adaptively regulated based on the temperature parameter, the humidity parameter and the area parameter corresponding to the indoor environment, so that the indoor operation effect used for representing the indoor temperature and humidity can be obtained;
or alternatively, the first and second heat exchangers may be,
if the household equipment is determined to be picture display equipment, the initial operation effect is adaptively adjusted based on the area parameter and the brightness parameter corresponding to the indoor environment, so that the indoor operation effect used for representing the picture display quality which can be achieved by the household equipment indoors is obtained;
or alternatively, the first and second heat exchangers may be,
and if the household equipment is determined to be cleaning equipment, carrying out adaptive adjustment on the initial operation effect based on the area parameter corresponding to the indoor environment, so as to obtain the indoor operation effect used for representing the cleaning quality which can be achieved by the household equipment in the room.
In another embodiment of the present application, the computing module 202 is configured to:
acquiring the starting number of display modules required for displaying the indoor operation effect based on the type of the electric appliance corresponding to the household equipment; determining the operation power of each display module based on the actual effect corresponding to the indoor operation effect;
and calculating overhead data consumed by the AR equipment for displaying the indoor operation effect based on the starting number of the display modules and the operation power of each display module.
In another embodiment of the present application, the computing module 202 is configured to:
if the indoor operation effect is determined to be used for displaying the preset temperature and humidity which can be achieved in the room, blowing air to a preset human body area of the user by using a temperature and humidity braking module deployed in the AR equipment at a first preset operation power, wherein the first preset operation power is the power capable of achieving the preset temperature and humidity;
or alternatively, the first and second heat exchangers may be,
if the indoor operation effect is determined to be used for displaying the picture display quality, a first virtual picture is generated by using a picture display module deployed in the AR equipment, and the first virtual picture is displayed at a first preset area of the AR equipment, wherein the first virtual picture is a display picture achieved by operating the household equipment in the target operation mode;
Or alternatively, the first and second heat exchangers may be,
if the indoor operation effect is determined to be used for displaying the cleaning quality, a second virtual picture is generated by using a picture display module deployed in the AR equipment, and the second virtual picture is displayed at a second preset area of the AR equipment, wherein the second virtual picture is an indoor cleaning picture which is achieved after the household equipment is operated in the target operation mode for a preset time period.
In another embodiment of the present application, the computing module 202 is configured to:
and generating a third virtual picture by using picture display modules deployed in the AR equipment, and displaying the third virtual picture at a third preset area of the AR equipment, wherein the third virtual picture comprises the starting number of display modules, the running power of each display module and the predicted electric quantity consumption value.
In another embodiment of the present application, the computing module 202 is configured to:
monitoring facial images of the user in a preset time period after the indoor operation effect and the overhead data are confirmed to be displayed to the user;
and if the face image is detected to meet the preset condition, determining that a confirmation starting instruction of the user is received.
Fig. 4 is a block diagram of a logic structure of an electronic device, according to an example embodiment. For example, the electronic device 300 may be an electronic device.
In an exemplary embodiment, there is also provided a non-transitory computer readable storage medium including instructions, such as a memory including instructions, executable by an electronic device processor to perform a human-machine interaction method based on an AR device as described above, the method comprising: receiving an initial starting instruction acted on the AR equipment by a user, wherein the initial starting instruction is used for planning to operate the household equipment in a target operation mode; acquiring indoor environment parameters of the household equipment, acquiring a prestored running power table of the household equipment, calculating to obtain an indoor running effect achieved by running the household equipment in the target running mode based on the indoor environment parameters and the running power table, and calculating to obtain overhead data consumed by the AR equipment for displaying the indoor running effect; dynamically displaying the indoor operation effect to the user and statically displaying the overhead data to the user by using a plurality of display modules deployed in the AR device; and receiving response data fed back by the user to the indoor operation effect and the overhead data, and if the response data is determined to correspond to agreement, sending indication information for entering an operation state in the target operation mode to the household equipment.
Optionally, the above instructions may also be executed by a processor of the electronic device to perform the other steps involved in the above-described exemplary embodiments. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
In an exemplary embodiment, there is also provided an application/computer program product comprising one or more instructions executable by a processor of an electronic device to perform a human-machine interaction method based on an AR device as described above, the method comprising: receiving an initial starting instruction acted on the AR equipment by a user, wherein the initial starting instruction is used for planning to operate the household equipment in a target operation mode; acquiring indoor environment parameters of the household equipment, acquiring a prestored running power table of the household equipment, calculating to obtain an indoor running effect achieved by running the household equipment in the target running mode based on the indoor environment parameters and the running power table, and calculating to obtain overhead data consumed by the AR equipment for displaying the indoor running effect; dynamically displaying the indoor operation effect to the user and statically displaying the overhead data to the user by using a plurality of display modules deployed in the AR device; and receiving response data fed back by the user to the indoor operation effect and the overhead data, and if the response data is determined to correspond to agreement, sending indication information for entering an operation state in the target operation mode to the household equipment.
Optionally, the above instructions may also be executed by a processor of the electronic device to perform the other steps involved in the above-described exemplary embodiments.
Referring to fig. 4, a schematic diagram of an electronic device according to some embodiments of the present application is shown. As shown in fig. 4, the electronic device 3 includes: a processor 300, a memory 301, a bus 302 and a communication interface 303, the processor 300, the communication interface 303 and the memory 301 being connected by the bus 302; the memory 301 stores a computer program that can be executed by the processor 300, and the processor 300 executes the service level calculating method for the highway section according to any one of the foregoing embodiments of the present application when executing the computer program.
The memory 301 may include a high-speed random access memory (RAM: random Access Memory), and may further include a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory. The communication connection between the device network element and at least one other network element is achieved through at least one communication interface 303 (which may be wired or wireless), the internet, a wide area network, a local network, a metropolitan area network, etc. may be used.
Bus 302 may be an ISA bus, a PCI bus, an EISA bus, or the like. The buses may be classified as address buses, data buses, control buses, etc. The memory 301 is configured to store a program, and the processor 300 executes the program after receiving an execution instruction, and the video transmission method disclosed in any of the foregoing embodiments of the present application may be applied to the processor 300 or implemented by the processor 300.
The processor 300 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in the processor 300 or by instructions in the form of software. The processor 300 may be a general-purpose processor, including a processor (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but may also be a Digital Signal Processor (DSP), application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present application may be embodied directly in hardware, in a decoded processor, or in a combination of hardware and software modules in a decoded processor. The software modules may be located in a random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, etc. as well known in the art. The storage medium is located in the memory 301, and the processor 300 reads the information in the memory 301, and in combination with its hardware, performs the steps of the above method.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It is to be understood that the present application is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (8)
1. The man-machine interaction method based on the AR device is characterized by being applied to AR equipment and comprising the following steps of:
receiving an initial starting instruction acted on the AR equipment by a user, wherein the initial starting instruction is used for planning to operate the household equipment in a target operation mode;
acquiring indoor environment parameters of the household equipment, acquiring a prestored running power table of the household equipment, calculating to obtain an indoor running effect achieved by running the household equipment in the target running mode based on the indoor environment parameters and the running power table, and calculating to obtain overhead data consumed by the AR equipment for displaying the indoor running effect;
Dynamically displaying the indoor operation effect to the user and statically displaying the overhead data to the user by using a plurality of display modules deployed in the AR device;
receiving response data fed back by the user to the indoor operation effect and the overhead data, and if the response data is determined to correspond to agreement, sending indication information for entering an operation state in the target operation mode to the household equipment;
wherein dynamically displaying the indoor operation effect to the user by using a plurality of display modules deployed in the AR device, comprises:
if the indoor operation effect is determined to be used for displaying the preset temperature and humidity which can be achieved in the room, blowing air to a preset human body area of the user at a first preset operation power by utilizing a temperature and humidity braking module deployed in the AR equipment;
the first preset operation power is power capable of reaching the preset temperature and humidity, the temperature and humidity braking module is a braking module capable of manufacturing cold, hot air and moisture, and the preset human body area is an arm area or a face area.
2. The method of claim 1, wherein the calculating an indoor operation effect achieved by operating the home appliance in the target operation mode based on the indoor environment parameter and the operation power table comprises:
Based on the operation power meter, calculating an initial operation effect achieved by operating the household equipment in the target operation mode;
and adaptively adjusting the initial operation effect based on at least one of a temperature parameter, a humidity parameter, a brightness parameter and an area parameter included in the indoor environment parameter to obtain the indoor operation effect.
3. The method of claim 2, wherein said adaptively adjusting said initial operating effect based on at least one of a temperature parameter, a humidity parameter, a brightness parameter, and an area parameter included in said indoor environment parameter, comprises:
if the household equipment is determined to be temperature and humidity regulation equipment, the initial operation effect is adaptively regulated based on the temperature parameter, the humidity parameter and the area parameter corresponding to the indoor environment, so that the indoor operation effect used for representing the indoor temperature and humidity can be obtained;
or alternatively, the first and second heat exchangers may be,
if the household equipment is determined to be picture display equipment, the initial operation effect is adaptively adjusted based on the area parameter and the brightness parameter corresponding to the indoor environment, so that the indoor operation effect used for representing the picture display quality which can be achieved by the household equipment indoors is obtained;
Or alternatively, the first and second heat exchangers may be,
and if the household equipment is determined to be cleaning equipment, carrying out adaptive adjustment on the initial operation effect based on the area parameter corresponding to the indoor environment, so as to obtain the indoor operation effect used for representing the cleaning quality which can be achieved by the household equipment in the room.
4. The method of claim 1, wherein the calculating overhead data consumed by the AR device to exhibit the indoor operation effect based on the indoor environment parameters and the operation power table comprises:
acquiring the starting number of display modules required for displaying the indoor operation effect based on the type of the electric appliance corresponding to the household equipment; determining the operation power of each display module based on the actual effect corresponding to the indoor operation effect;
and calculating overhead data consumed by the AR equipment for displaying the indoor operation effect based on the starting number of the display modules and the operation power of each display module.
5. The method of claim 1, wherein the dynamically displaying the indoor operation effect to the user using a plurality of display modules deployed in the AR device comprises:
If the indoor operation effect is determined to be used for displaying the picture display quality, a first virtual picture is generated by using a picture display module deployed in the AR equipment, and the first virtual picture is displayed at a first preset area of the AR equipment, wherein the first virtual picture is a display picture achieved by operating the household equipment in the target operation mode;
or alternatively, the first and second heat exchangers may be,
if the indoor operation effect is determined to be used for displaying the cleaning quality, a second virtual picture is generated by using a picture display module deployed in the AR equipment, and the second virtual picture is displayed at a second preset area of the AR equipment, wherein the second virtual picture is an indoor cleaning picture which is achieved after the household equipment is operated in the target operation mode for a preset time period.
6. The method of claim 1, wherein the statically exposing the overhead data to the user with a plurality of presentation modules deployed in the AR device comprises:
and generating a third virtual picture by using picture display modules deployed in the AR equipment, and displaying the third virtual picture at a third preset area of the AR equipment, wherein the third virtual picture comprises the starting number of display modules, the running power of each display module and the predicted electric quantity consumption value.
7. The method of claim 1, wherein the receiving response data fed back by the user based on the indoor operation effect and the overhead data comprises:
monitoring facial images of the user in a preset time period after the indoor operation effect and the overhead data are confirmed to be displayed to the user;
and if the face image is detected to meet the preset condition, determining that response data of the user is received.
8. Human-computer interaction device based on AR device, characterized in that is applied to AR equipment, includes:
a receiving module configured to receive an initial start-up instruction from a user acting on the AR device, the initial start-up instruction being for planning to operate the home device in a target operation mode;
the computing module is configured to acquire indoor environment parameters of the household equipment, acquire a pre-stored running power table of the household equipment, calculate and obtain indoor running effects achieved by running the household equipment in the target running mode based on the indoor environment parameters and the running power table, and calculate and obtain overhead data consumed by the AR equipment for displaying the indoor running effects;
A presentation module configured to dynamically present the indoor operation effect to the user and to statically present the overhead data to the user using a plurality of presentation modules deployed in the AR device;
the starting module is configured to receive response data fed back by the user to the indoor operation effect and the overhead data, and if the response data is determined to correspond to agreement, the starting module is configured to send indication information for entering an operation state in the target operation mode to the household equipment;
wherein dynamically displaying the indoor operation effect to the user by using a plurality of display modules deployed in the AR device, comprises:
if the indoor operation effect is determined to be used for displaying the preset temperature and humidity which can be achieved in the room, blowing air to a preset human body area of the user at a first preset operation power by utilizing a temperature and humidity braking module deployed in the AR equipment;
the first preset operation power is power capable of reaching the preset temperature and humidity, the temperature and humidity braking module is a braking module capable of manufacturing cold, hot air and moisture, and the preset human body area is an arm area or a face area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311308350.XA CN117055737B (en) | 2023-10-11 | 2023-10-11 | Human-computer interaction method and device based on AR device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311308350.XA CN117055737B (en) | 2023-10-11 | 2023-10-11 | Human-computer interaction method and device based on AR device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117055737A CN117055737A (en) | 2023-11-14 |
| CN117055737B true CN117055737B (en) | 2024-01-26 |
Family
ID=88655734
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311308350.XA Active CN117055737B (en) | 2023-10-11 | 2023-10-11 | Human-computer interaction method and device based on AR device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117055737B (en) |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104807147A (en) * | 2015-05-21 | 2015-07-29 | 京东方科技集团股份有限公司 | Controller, indoor environment regulating system and indoor environment regulation method |
| CN109586998A (en) * | 2018-11-09 | 2019-04-05 | 珠海格力电器股份有限公司 | A kind of method, cloud and the equipment of indicating equipment operating status |
| CN109724220A (en) * | 2018-12-25 | 2019-05-07 | 广东美的制冷设备有限公司 | Control method, device and the apparatus of air conditioning of the apparatus of air conditioning |
| CN112099374A (en) * | 2020-11-11 | 2020-12-18 | 广东恩胜科技有限公司 | Indoor environment comfort control method and system, electronic equipment and storage medium |
| CN112762585A (en) * | 2021-01-08 | 2021-05-07 | 青岛海信日立空调系统有限公司 | Air conditioning system and control method |
| CN112860046A (en) * | 2019-11-27 | 2021-05-28 | 宇龙计算机通信科技(深圳)有限公司 | Method, apparatus, electronic device and medium for selecting operation mode |
| CN114625247A (en) * | 2022-02-15 | 2022-06-14 | 广州小鹏汽车科技有限公司 | Scene display system and method based on virtual reality and vehicle |
| CN114838488A (en) * | 2022-04-12 | 2022-08-02 | 海尔(深圳)研发有限责任公司 | Method and device for linkage control of intelligent household appliances, air conditioner and storage medium |
| CN115200146A (en) * | 2022-04-29 | 2022-10-18 | 青岛海尔科技有限公司 | Method and device for sending closing command, storage medium and electronic device |
| WO2022218014A1 (en) * | 2021-04-15 | 2022-10-20 | 青岛海尔空调器有限总公司 | Household appliance control method and apparatus, and household appliance |
| CN115900005A (en) * | 2022-11-29 | 2023-04-04 | 珠海格力智能装备有限公司 | Control method and device of air conditioner and air conditioner |
| WO2023077830A1 (en) * | 2021-11-02 | 2023-05-11 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner, air conditioner and storage medium |
| CN116339164A (en) * | 2023-02-21 | 2023-06-27 | 浙江摩根集团有限公司 | Interface display method, terminal and intelligent home system |
| WO2023125393A1 (en) * | 2021-12-31 | 2023-07-06 | 华为技术有限公司 | Method and device for controlling smart home appliance, and mobile terminal |
| CN116785683A (en) * | 2023-06-12 | 2023-09-22 | 杭州易现先进科技有限公司 | AR multi-person interaction system, head display device, method and storage medium |
-
2023
- 2023-10-11 CN CN202311308350.XA patent/CN117055737B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104807147A (en) * | 2015-05-21 | 2015-07-29 | 京东方科技集团股份有限公司 | Controller, indoor environment regulating system and indoor environment regulation method |
| CN109586998A (en) * | 2018-11-09 | 2019-04-05 | 珠海格力电器股份有限公司 | A kind of method, cloud and the equipment of indicating equipment operating status |
| CN109724220A (en) * | 2018-12-25 | 2019-05-07 | 广东美的制冷设备有限公司 | Control method, device and the apparatus of air conditioning of the apparatus of air conditioning |
| CN112860046A (en) * | 2019-11-27 | 2021-05-28 | 宇龙计算机通信科技(深圳)有限公司 | Method, apparatus, electronic device and medium for selecting operation mode |
| CN112099374A (en) * | 2020-11-11 | 2020-12-18 | 广东恩胜科技有限公司 | Indoor environment comfort control method and system, electronic equipment and storage medium |
| CN112762585A (en) * | 2021-01-08 | 2021-05-07 | 青岛海信日立空调系统有限公司 | Air conditioning system and control method |
| WO2022218014A1 (en) * | 2021-04-15 | 2022-10-20 | 青岛海尔空调器有限总公司 | Household appliance control method and apparatus, and household appliance |
| WO2023077830A1 (en) * | 2021-11-02 | 2023-05-11 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner, air conditioner and storage medium |
| WO2023125393A1 (en) * | 2021-12-31 | 2023-07-06 | 华为技术有限公司 | Method and device for controlling smart home appliance, and mobile terminal |
| CN114625247A (en) * | 2022-02-15 | 2022-06-14 | 广州小鹏汽车科技有限公司 | Scene display system and method based on virtual reality and vehicle |
| CN114838488A (en) * | 2022-04-12 | 2022-08-02 | 海尔(深圳)研发有限责任公司 | Method and device for linkage control of intelligent household appliances, air conditioner and storage medium |
| CN115200146A (en) * | 2022-04-29 | 2022-10-18 | 青岛海尔科技有限公司 | Method and device for sending closing command, storage medium and electronic device |
| CN115900005A (en) * | 2022-11-29 | 2023-04-04 | 珠海格力智能装备有限公司 | Control method and device of air conditioner and air conditioner |
| CN116339164A (en) * | 2023-02-21 | 2023-06-27 | 浙江摩根集团有限公司 | Interface display method, terminal and intelligent home system |
| CN116785683A (en) * | 2023-06-12 | 2023-09-22 | 杭州易现先进科技有限公司 | AR multi-person interaction system, head display device, method and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117055737A (en) | 2023-11-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11430415B2 (en) | Apparatus and method | |
| WO2017215308A1 (en) | Method, device and system for controlling electrical appliance | |
| CN108413574B (en) | Air conditioner running state control method and air conditioner system | |
| JP2011153744A (en) | Air-conditioning control device, air conditioning system and air-conditioning control method | |
| US20220086522A1 (en) | Display method, display terminal and non-transitory computer readable storage medium | |
| CN111023485A (en) | Air conditioner control method and device, air conditioner and storage medium | |
| CN108195032B (en) | Air conditioner control method, device and computer readable storage medium | |
| JP2016095066A (en) | Control device of air conditioner and control method of air conditioner | |
| CN113494758B (en) | Terminal equipment and method for calculating PMV value | |
| WO2021047379A1 (en) | Television and backlight control method therefor, control device, and readable storage medium | |
| CN117055737B (en) | Human-computer interaction method and device based on AR device | |
| WO2019064616A1 (en) | Network system | |
| JP5498517B2 (en) | Server device, home appliance control method and program | |
| TW201915403A (en) | Air cleaner and network system | |
| CN114659252A (en) | Interconnection control method and device for air conditioner and lighting device | |
| CN114110971B (en) | Control method of air conditioner, air conditioner and storage medium | |
| CN115421639A (en) | Panorama display method and device, electronic equipment and medium | |
| CN108600724A (en) | A kind of method and apparatus of adjustment gamma | |
| CN111108489A (en) | Server, information processing method, network system and air purifier | |
| TWM547792U (en) | Home appliance system with script function | |
| CN108880956B (en) | Interface display method, terminal device and computer readable storage medium | |
| TWI635721B (en) | Home appliance system with script function and control method thereof | |
| CN112628949A (en) | Control method, device and equipment of air conditioning equipment and storage medium | |
| JP2002228225A (en) | Method and system for operating energy saving effect achievement | |
| JP6876947B2 (en) | How to notify automatic control results, servers, and programs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |