CN113485136A - System and method for displaying and controlling working state of smart home in real time based on AR-HUD - Google Patents
System and method for displaying and controlling working state of smart home in real time based on AR-HUD Download PDFInfo
- Publication number
- CN113485136A CN113485136A CN202110737196.2A CN202110737196A CN113485136A CN 113485136 A CN113485136 A CN 113485136A CN 202110737196 A CN202110737196 A CN 202110737196A CN 113485136 A CN113485136 A CN 113485136A
- Authority
- CN
- China
- Prior art keywords
- home
- module
- hud
- vehicle
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000005540 biological transmission Effects 0.000 claims description 38
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 abstract description 5
- 238000012544 monitoring process Methods 0.000 description 19
- 238000013500 data storage Methods 0.000 description 5
- 230000006855 networking Effects 0.000 description 4
- 238000011217 control strategy Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 239000000779 smoke Substances 0.000 description 2
- 240000007594 Oryza sativa Species 0.000 description 1
- 235000007164 Oryza sativa Nutrition 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000004886 process control Methods 0.000 description 1
- 235000009566 rice Nutrition 0.000 description 1
- 238000010792 warming Methods 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a system and a method for displaying and controlling the working state of an intelligent home in real time based on AR-HUD.A driver and a passenger open an AR-HUD device, select concerned intelligent home information and issue an instruction; the vehicle-mounted system transmits the information to the cloud service platform; the method comprises the steps that latest stored home information is called by a cloud service platform according to a query instruction and fed back to a vehicle-mounted system, a setting instruction is issued to an intelligent home system by the cloud service platform according to the setting instruction, a home end feedback result is sent to the cloud service platform, and the cloud service platform feeds back the home end feedback result to the vehicle-mounted system; the vehicle-mounted system displays the information selected by the driver and the passengers on the AR-HUD device. The method of the invention can be used for facilitating the driver to know the home environment condition and the working state of the home equipment in real time in the driving process and control the home intelligent home equipment. And the AR-HUD display is adopted, so that the driver is prevented from being distracted and looking over the mobile phone or the vehicle-mounted screen, the safety is ensured, and the life convenience and the life quality of the vehicle owner are greatly improved.
Description
Technical Field
The invention belongs to the technical field of intelligent networking, and particularly relates to a system and a method for displaying and controlling the working state of an intelligent home in real time based on AR-HUD.
Technical Field
With the rapid development of science and technology, automobiles become a necessary tool for people to live, and the auxiliary functions of the automobiles are more and more, so that more and more help is provided for drivers. Corresponding automobile-related derivatives are also increasing. Meanwhile, with the rapid development of economy, people not only meet the problem of full eating and warming, but also have higher-level pursuits on home life, and smart homes are produced at the same time. At present, most of methods for controlling the smart home through the vehicle-mounted system simply control home equipment through a preset control strategy, and do not show the working state in a vehicle based on the working state of real-time monitoring equipment, so that a driver can know the working progress of each home equipment and adjust the working state in real time, and meanwhile, whether a safety risk exists or not is confirmed by monitoring the state of each equipment, so that the handling is timely carried out.
The high-speed development of autopilot technique and AR-HUD technique makes more and more mutual information can show on HUD, is released gradually along with driver's hand, foot, eye and brain, and the driver can have more time to handle work and life's thing in driving the in-process, for example control intelligent air conditioner and open to comfortable temperature in the way of going home, open intelligent electric rice cooker and cook etc.. At present, more intelligent home display and control are controlled by a mobile phone or an APP at a mobile terminal, a driver needs to be distracted to check the state of the mobile phone while driving a vehicle, and the driving risk is high.
The prior art is a system and a method for interactive control between a vehicle and an intelligent home. The intelligent home terminal comprises a vehicle-mounted terminal module, a vehicle-mounted networking platform, an intelligent home terminal, a vehicle-mounted positioning module, wherein the vehicle-mounted positioning module acquires position information of a vehicle and sends the position information to the vehicle-mounted terminal module, the vehicle-mounted terminal module is connected with the vehicle-mounted networking platform through a network, the vehicle-mounted networking platform analyzes the state of the vehicle according to the uploaded position information of the vehicle and sends the state to the intelligent home terminal, and the intelligent home terminal analyzes the control strategy of the intelligent home terminal corresponding to the state of the vehicle according to the state information of the vehicle and sends the control strategy to the intelligent home terminal. And inputting a control command through voice and a touch screen, and broadcasting and displaying a control result. However, the input and display of the touch screen require the driver to perform distracted input and look over with a low head, the operation is not convenient and humanized enough, and safety risks can be generated. Meanwhile, only the control result is fed back, and a driver cannot know the working progress in real time, so that the household working state can be adjusted according to the self requirement.
The second prior art is an intelligent home device control method based on a vehicle-mounted system, which obtains the driving information of a vehicle; judging the residence position of the vehicle to an account related to a vehicle-mounted terminal of the vehicle according to the driving information; acquiring working state configuration information of the intelligent household equipment at the residence position; and sending a control instruction to the intelligent household equipment according to a preset condition in the working state configuration information. According to the method and the device, the control instruction is sent to the intelligent household equipment through the preset condition, the control instruction is too simple, the requirements of a user are changed, and the single preset condition cannot meet diversified requirements; meanwhile, the participation sense of the user and the interaction between the user and the system are reduced, and the working state of the equipment cannot be displayed in real time, so that the user can judge whether the self expectation and the requirement are met.
Disclosure of Invention
The invention aims to provide a system and a method for displaying the working state of intelligent household equipment in real time based on AR-HUD, which are used for displaying the working states of various intelligent household equipment in real time through the AR-HUD at a vehicle end, so that a driver can know the working progress of the intelligent household equipment in time and flexibly adjust the working progress, and more comfortable and attentive experience is provided for the driver.
The method for displaying and controlling the working state of the smart home in real time based on the AR-HUD, which is one of the purposes of the invention, comprises the following steps: the driver and the passenger open the AR-HUD device, select concerned intelligent household information and issue an instruction; the vehicle-mounted system transmits the information to the cloud service platform; the method comprises the steps that latest stored home information is called by a cloud service platform according to a query instruction and fed back to a vehicle-mounted system, a setting instruction is issued to an intelligent home system by the cloud service platform according to the setting instruction, a home end feedback result is sent to the cloud service platform, and the cloud service platform feeds back the home end feedback result to the vehicle-mounted system; the vehicle-mounted system displays the information selected by the driver and the passengers on the AR-HUD device.
The sensor of the intelligent home system monitors home environment data (such as temperature, humidity, illuminance, smoke and the like) and the working state of home equipment in real time, the home environment data and the working state of the home equipment are transmitted to the gateway control module comprising the serial WIFI module through an internal network, and the home gateway control module sends the environment data and the state of each piece of equipment to the cloud service platform through a TCP/IP protocol through the wireless transmission module. The vehicle-mounted system is connected with the cloud service platform through the wireless transmission module, a driver can send a control instruction (a voice or gesture instruction) to the intelligent household equipment through the vehicle-mounted system, the vehicle-mounted system transmits the control instruction to the cloud service platform through the wireless transmission module, and the control instruction is transmitted to the intelligent household equipment through the cloud service platform to be flexibly controlled by the intelligent household system. And then transmitting the home environment information and the selected working state of the intelligent home equipment to the vehicle-mounted system for voice broadcasting according to the input of the driver in the vehicle-mounted system, and performing real-time projection display through the AR-HUD.
The wireless data transmission module is arranged between the vehicle-mounted system and the cloud service platform, the wireless data transmission module realizes communication between the vehicle-mounted system and the cloud end through a 5G communication technology, the vehicle-mounted system transmits a control instruction of a collected driver for the household equipment to the cloud service platform, and meanwhile, the cloud service platform can transmit household environment information and the working state of the household equipment to the vehicle-mounted system.
The further technical scheme comprises the following steps: the method also comprises the step that a driver and a passenger can select the household equipment needing attention at the AR-HUD end of the vehicle-mounted system.
The vehicle-mounted system is provided with an AR-HUD system, and a driver can independently select which home environment data and the working state of the home equipment in the vehicle-mounted system to perform projection display. The area and form of the projection can be freely defined by the driver in the on-board system.
The further technical scheme comprises the following steps: the intelligent home system also comprises a vehicle-mounted system, wherein the vehicle-mounted system can be used for issuing an instruction to the intelligent home at the vehicle end by using natural voice information or gesture control information, carrying out A/D conversion on the signal, identifying and processing the generated signal and outputting a corresponding instruction code.
The acquisition module of the vehicle-mounted system CAN identify voice or gesture control information of drivers and passengers, carry out A/D conversion on signals, identify and process generated signals, output corresponding instruction codes, generate corresponding control signals, transmit the control signals to the wireless transmission module through the CAN bus, and transmit the control signals to the cloud service platform through the wireless transmission module.
Optionally, the control information instruction of the driver carries the identifier and the ID information of the smart home device, the identifier information can be edited and named in the smart home system according to the preference of the driver, and the ID is analyzed in the transmission process of the information to realize accurate distribution.
The further technical scheme comprises the following steps: the intelligent home equipment feeds back the state of the current home equipment to the cloud service platform every other fixed frequency.
Various sensors in the monitoring module of the intelligent home system monitor the current home environment in real time, the monitoring module is connected with the gateway control module through WIFI, monitoring data are transmitted to the gateway controller every other fixed frequency, the gateway controller transmits the monitoring data to the cloud service platform through the wireless transmission module, and the cloud service platform stores the monitoring information.
The cloud service platform is provided with a data storage module, the data storage module can store and process control instructions from a vehicle-mounted system, environment information of an intelligent home system and working state information of home equipment, the storage module adopts a distributed storage technology, in order to reduce storage pressure, information of the home system can be set to store data in a recent period of time, and after the period of time is exceeded, the previous data are covered.
The further technical scheme comprises the following steps: the intelligent home system can also arbitrate the priority of the state information of the home equipment and then send the state information to the cloud service platform.
The gateway control module of the intelligent home system obtains home environment information and state information of home equipment from the monitoring module, and transmits the home environment information and the state information to the cloud service platform through a TCP/IP protocol at a certain frequency after carrying out priority arbitration on data. And receiving a control instruction transmitted from the cloud service platform, analyzing a corresponding equipment node and a control command from the control instruction, and controlling the household equipment to perform corresponding work through the home internal network.
For important information such as work start, completion, failure, danger, etc., a high priority may be set in data transmission. The gateway control module performs priority arbitration, and when any important information appears in the data stream, the important information needs to be transmitted preferentially.
The priority arbitration logic can be set according to the following classification, and the priority of the household equipment can be set in the gateway control module according to the preference of the driver.
The system for displaying the working state of the intelligent home in real time based on the AR-HUD, which realizes the second aim of the invention, comprises an AR-HUD module: the intelligent home display system is used for displaying the current working state of the intelligent home selected by the current driver and crew at the vehicle end; cloud service platform module: the intelligent home terminal is used for connecting data transmission of the vehicle terminal and the intelligent home terminal and performing conversion processing on the data; a vehicle-mounted system module: the system comprises an AR-HUD module, a cloud service platform and an AR-HUD module, wherein the AR-HUD module is used for acquiring a control instruction of a driver and a crew for home equipment, transmitting the control instruction to the cloud service platform, receiving home environment information transmitted by the cloud service platform and the working state of the home equipment, and transmitting the working state to the AR-HUD module for display; the intelligent household module: the intelligent home system is used for acquiring the working state of the intelligent home; the wireless data transmission module: the data transmission method is used for data transmission of the vehicle end, the cloud service platform end and the home end.
The further technical scheme includes that the vehicle-mounted system module further comprises a data acquisition module: the system comprises a cloud service platform, a voice playing module and an AR-HUD, wherein the cloud service platform is used for acquiring home environment data and home equipment working state data from the cloud service platform, transmitting the data to the voice playing module for broadcasting and transmitting the data to the AR-HUD for displaying; an acquisition module: the voice or gesture control module is used for acquiring a voice or gesture command of a driver, converting the voice or gesture command into a control command of an electric signal and sending the control command to the wireless transmission module.
The data acquisition module of the vehicle-mounted system further comprises an information classification module which can classify information input by the cloud service platform, important information is broadcasted through voice, and other information is displayed through AR-HUD; the voice playing module: and the data acquisition module is used for converting the home equipment information acquired from the data acquisition module into a voice form and playing the voice form.
A further technical scheme includes that the intelligent home system further comprises a gateway control module: the data sent from the cloud service platform can be analyzed and assigned to the corresponding household equipment; a position positioning module: the method is used for determining the geographical position of the intelligent home system.
The position positioning module determines the geographic position of the intelligent home system, the gateway control module sends the geographic position information and the home environment information to the cloud service platform, and the cloud service platform can feed back the home environment information to the vehicle-mounted system and can also feed back the weather and climate trend of the residential area.
The intelligent home system further comprises a monitoring module, various sensors in the monitoring module monitor the current home environment in real time, the monitoring module is connected with the gateway control module through WIFI, and monitoring data are transmitted to the gateway controller at fixed frequency intervals.
The intelligent home module further comprises a priority arbitration module for arbitrating the information appearing in the data stream and preferentially transmitting the important information with high priority.
For important information such as work start, completion, failure, danger, etc., a high priority may be set in data transmission.
The method of the invention can be used for facilitating the driver to know the home environment condition and the working state of the home equipment in real time in the driving process and controlling the home intelligent home equipment. And the AR-HUD display is adopted, so that the driver is prevented from being distracted and looking over the mobile phone or the vehicle-mounted screen, the safety is ensured, and the life convenience and the life quality of the vehicle owner are greatly improved.
Drawings
FIG. 1 is a schematic diagram of a system architecture according to the present invention;
FIG. 2 is a control command data flow diagram according to the present invention;
fig. 3 is a schematic diagram of monitoring information data flow according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. (the embodiments are each described in detail with reference to a drawing to the extent that one skilled in the art can practice the embodiments as described.
The preferred embodiments of the present application will be described in further detail with reference to the accompanying drawings.
As shown in fig. 1, the invention provides a system for displaying an intelligent home in real time based on an AR-HUD, which comprises a vehicle-mounted system 1, a cloud server platform 2 and an intelligent home system 3, wherein the vehicle-mounted system 1 comprises a voice broadcast module 10, an AR-HUD11, a data acquisition module 13, an acquisition module 12 and a wireless transmission module 14; the cloud server platform 2 comprises a wireless transmission module 21 and a data storage module 22; the smart home system 3 includes a wireless transmission module 31, a gateway control module 32, a monitoring module 33, smart home devices 34, and a home environment 35.
The intelligent household equipment comprises various equipment such as an intelligent door lock, an intelligent air conditioner, a washing machine, a refrigerator, a water heater, an electric cooker, a humidifier, a lamp, an electric curtain, a smoke monitor, an anti-theft alarm and the like.
In the embodiment, in the using process, firstly, a driver selects the smart home devices 34 to be displayed on the AR-HUD11, acquires the states of the smart home devices 34 and the home environment information 35 (including temperature, humidity and illuminance) from the cloud service platform 2 through the data acquisition module 13, inputs a voice control instruction through the acquisition module 12, identifies the voice instruction and converts the voice instruction into a control instruction of an electric signal, and sends the control instruction to the wireless transmission module 14 of the vehicle-mounted system 1, the wireless transmission module 14 transmits the control instruction to the cloud service platform 2, the cloud service platform 2 transmits the control instruction to the smart home system 3 through the wireless transmission module 21, the wireless transmission module 31 of the smart home system 3 transmits the control instruction to the gateway control module 32 through internal WIFI, and the gateway control module 32 analyzes the control instruction and controls the corresponding home devices 34, the home devices 34 feed the control result back to the gateway control module 32, the gateway control module 32 arbitrates according to the priority of the data, the arbitrated data are transmitted to the cloud service platform 2 through the wireless transmission module 31, the data storage module 22 of the cloud service platform 2 stores and analyzes the information fed back by the intelligent home system 3, the control result corresponding to the control instruction is fed back to the vehicle-mounted system 1 through the wireless transmission module 21, the data acquisition module 13 of the vehicle-mounted system 1 acquires the control result, and the control result is sent to the voice broadcast module 10 for broadcast and sent to the AR-HUD11 for real-time display.
The data flow between the vehicle-mounted system 1 and the intelligent home system 3 is divided into two parts: the control instruction is forwarded to the smart home system 3 from the vehicle-mounted system 1 through the cloud service platform 2, referring to fig. 2; the home environment and home device state information of the smart home system 3 are stored and forwarded to the vehicle-mounted system 1 through the cloud service platform 2, see fig. 3.
The method for displaying the working state of the intelligent household equipment in real time based on AR-HUD comprises the following implementation steps:
step 1: a monitoring module of the intelligent home system monitors current home environment information in real time, and the monitoring module and home equipment transmit the environment information and equipment state information to a gateway control module at a fixed frequency.
Step 2: the gateway control module of the intelligent home system carries out priority arbitration on home environment information, current state information of the intelligent home equipment and geographical position information by the intelligent home equipment, and data after arbitration are transmitted to the cloud service platform through the wireless transmission module;
and step 3: the cloud service platform classifies and stores data transmitted by the home system and acquires weather and climate change trend according to geographical position information;
step 4, a driver inputs a request to start the intelligent home system through voice or gestures of the vehicle-mounted system;
and 5: the method comprises the steps that a driver starts an AR-HUD, information to be inquired and identification or ID (identity) of intelligent home equipment to be displayed are input through voice, and a cloud service platform feeds back corresponding equipment information and home environment information to a vehicle-mounted system;
step 6: the AR-HUD projects the state of the selected intelligent household equipment and the household environment information to a specified area of a front windshield glass;
and 7: a driver inputs a control instruction (a voice or gesture instruction) through an acquisition module of the vehicle-mounted system and sends the control instruction to the cloud server through the wireless transmission module;
and 8: the cloud server transmits the control instruction to the intelligent home control system;
and step 9: the gateway control module in the intelligent home control system analyzes the command and sends the control command to the corresponding home equipment for control operation through the unique ID
Step 10: the intelligent household equipment and the monitoring module feed back the working state and the environmental information of the equipment to the gateway control module at a fixed frequency;
step 11: the gateway control module arbitrates the feedback information and uploads the arbitrated information to the cloud service platform through the wireless transmission module according to the arbitrated priority;
step 12: the cloud service platform processes and screens information fed back by the gateway control module, and transmits state information inquired by the vehicle-mounted system end to a data acquisition module of the vehicle-mounted system;
step 13: the data acquisition module carries out classification processing on the information, sends the information to the AR-HUD to display the working state of the selected household equipment in real time, and carries out voice broadcast on important information such as start work, completion work and faults of the intelligent household equipment through the voice broadcast module.
And 14, checking the state information displayed on the AR-HUD by the driver, and sending an adjustment control instruction according to a real-time requirement.
The following describes a method for intelligently controlling indoor temperature and humidity and displaying the indoor temperature and humidity through AR-HUD by taking the regulation of the indoor temperature and humidity as an example:
1) temperature and humidity conditions in a house are monitored by a temperature and humidity sensor of a monitoring module 33 in the intelligent home system 3 in real time, and are fed back to a gateway controller through WIFI in the house, and the gateway controller is networked with a cloud service platform through a TCP/IP protocol and transmits the temperature and humidity conditions to the cloud service platform.
2) When a driver enters the vehicle, starting the vehicle and opening an AR-HUD device configured in a vehicle-mounted system, selecting a home information display position on a display interface of the AR-HUD, and performing voice input to inquire the home temperature and humidity conditions;
3) the vehicle-mounted system comprises a vehicle-mounted system, a CAN (controller area network) and a wireless transmission module, wherein the vehicle-mounted system comprises a vehicle-mounted system and a vehicle-mounted system, the vehicle-mounted system comprises a vehicle-mounted system acquisition module, a vehicle-mounted system wireless transmission module and a vehicle-mounted system control module, the vehicle-mounted system acquisition module acquires voice information of a driver, converts a voice signal into a control instruction and transmits the control instruction to the vehicle-mounted system wireless transmission module through the CAN;
4) the wireless transmission module sends the control instruction to the cloud service platform through the 5G wireless network;
5) the cloud service platform calls the latest temperature and humidity information stored in the data storage module according to the query information, queries weather and climate information of the area where the house is located according to the position information provided by the home system, and feeds the weather and climate information back to the vehicle-mounted system through a 5G wireless network;
6) the data acquisition module of the vehicle-mounted machine system obtains information fed back by the cloud service platform and then forwards the information to the AR-HUD through the CAN line for display, and meanwhile, the voice broadcasting system broadcasts the temperature and humidity conditions of a home and broadcasts the weather and climate conditions of a residential area;
7) a driver sends control instructions for an air conditioner and a humidifier/dehumidifier to an acquisition module of the vehicle-mounted system according to the broadcasting condition;
8) the acquisition module 12 of the vehicle-mounted system 1 converts the voice information into an electric signal, transmits the electric signal to the wireless transmission module through the CAN bus, and transmits the electric signal to the cloud service platform through the 5G wireless network;
9) the cloud service platform analyzes the control instruction and transmits the control instruction to a gateway control module of the intelligent home system through a wireless network;
10) the gateway control module analyzes the control instruction and sends the analyzed control instruction to an air conditioner and a humidifier/dehumidifier respectively through WIFI in the house;
11) the air conditioner and the humidifier/dehumidifier execute the control instruction and continuously feed back working state information to the gateway controller through WIFI; meanwhile, the monitoring module monitors the environmental information of the household equipment after working in real time and feeds the environmental information back to the gateway controller through WIFI.
12) The gateway controller arbitrates the state and environment information, determines the state information priority of the air conditioner and the humidifier/dehumidifier, and transmits the signals to the cloud service platform according to the identified priority.
13) The cloud service platform carries out classified storage and processing on the received information, and then transmits the information to the vehicle-mounted system through the 5G wireless network.
14) The data acquisition module of the vehicle-mounted system classifies the state information and the environment information of the air conditioner and the humidifier/dehumidifier, sends the information that the air conditioner and the humidifier/dehumidifier start to work to the voice broadcast system through the CAN bus according to the information that the equipment starts to work, and sends the environment information and the working state information to the AR-HUD for displaying in a set area.
Claims (10)
1. A method for displaying the working state of an intelligent home in real time based on AR-HUD is characterized in that a driver and a passenger open an AR-HUD device, select concerned intelligent home information and issue an instruction; the vehicle-mounted system transmits the information to the cloud service platform; the method comprises the steps that latest stored home information is called by a cloud service platform according to a query instruction and fed back to a vehicle-mounted system, a setting instruction is issued to an intelligent home system by the cloud service platform according to the setting instruction, a home end feedback result is sent to the cloud service platform, and the cloud service platform feeds back the home end feedback result to the vehicle-mounted system; the vehicle-mounted system displays the information selected by the driver and the passengers on the AR-HUD device.
2. The method for displaying the working state of the smart home in real time based on the AR-HUD according to claim 1, further comprising the step that a driver and a passenger can select the home equipment needing attention at the AR-HUD end of the vehicle-mounted system.
3. The AR-HUD-based method for displaying working state of an intelligent home in real time according to claim 1, further comprising the step that a driver and a crew can issue an instruction to the intelligent home at a car end by using natural voice information or gesture control information, the car end can perform A/D conversion on the signal, recognize the generated signal and output a corresponding instruction code.
4. The AR-HUD-based method for displaying the working state of the smart home in real time according to claim 1, further comprising the step that the smart home devices feed back the current state of the smart home devices to the cloud service platform every other fixed frequency.
5. The AR-HUD-based method for displaying the working state of the smart home in real time according to claim 1 or 4, further comprising the step that the smart home system can conduct priority arbitration on the state information of the home devices and then sends the state information to the cloud service platform.
6. The utility model provides a system for show intelligent house operating condition in real time based on AR-HUD which characterized in that, it contains AR-HUD module: the intelligent home display system is used for displaying the current working state of the intelligent home selected by the current driver and crew at the vehicle end; cloud service platform module: the intelligent home terminal is used for connecting data transmission of the vehicle terminal and the intelligent home terminal and performing conversion processing on the data; a vehicle-mounted system module: the system comprises an AR-HUD module, a cloud service platform and an AR-HUD module, wherein the AR-HUD module is used for acquiring a control instruction of a driver and a crew for home equipment, transmitting the control instruction to the cloud service platform, receiving home environment information transmitted by the cloud service platform and the working state of the home equipment, and transmitting the working state to the AR-HUD module for display; the intelligent household module: the intelligent home system is used for acquiring the working state of the intelligent home; the wireless data transmission module: the data transmission method is used for data transmission of the vehicle end, the cloud service platform end and the home end.
7. The AR-HUD based system for displaying the working state of a smart home in real time according to claim 6, wherein the vehicle-mounted system module further comprises a data acquisition module: the system comprises a cloud service platform, a voice playing module and an AR-HUD, wherein the cloud service platform is used for acquiring home environment data and home equipment working state data from the cloud service platform, transmitting the data to the voice playing module for broadcasting and transmitting the data to the AR-HUD for displaying; an acquisition module: the voice or gesture control module is used for acquiring a voice or gesture command of a driver, converting the voice or gesture command into a control command of an electric signal and sending the control command to the wireless transmission module.
8. The system for displaying the working state of the smart home in real time based on the AR-HUD according to claim 7, wherein the data acquisition module of the vehicle-mounted system further comprises an information classification module, the information classification module can classify the information input by the cloud service platform, important information is broadcasted through voice, and other information is displayed through the AR-HUD; the voice playing module: and the data acquisition module is used for converting the home equipment information acquired from the data acquisition module into a voice form and playing the voice form.
9. The AR-HUD based system for displaying the working state of the smart home in real time according to claim 6, wherein the smart home system further comprises a gateway control module: the data sent from the cloud service platform can be analyzed and assigned to the corresponding household equipment; a position positioning module: the method is used for determining the geographical position of the intelligent home system.
10. The AR-HUD real-time intelligent home working state display system according to claim 6, wherein the intelligent home module further comprises a priority arbitration module for arbitrating information appearing in the data stream and preferentially transmitting important information with high priority.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110737196.2A CN113485136A (en) | 2021-06-30 | 2021-06-30 | System and method for displaying and controlling working state of smart home in real time based on AR-HUD |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110737196.2A CN113485136A (en) | 2021-06-30 | 2021-06-30 | System and method for displaying and controlling working state of smart home in real time based on AR-HUD |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113485136A true CN113485136A (en) | 2021-10-08 |
Family
ID=77937081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110737196.2A Pending CN113485136A (en) | 2021-06-30 | 2021-06-30 | System and method for displaying and controlling working state of smart home in real time based on AR-HUD |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113485136A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113824794A (en) * | 2021-10-09 | 2021-12-21 | 京东科技信息技术有限公司 | Control method and system of Internet of things |
| CN114043932A (en) * | 2021-11-17 | 2022-02-15 | 中汽创智科技有限公司 | Control method, device and equipment of vehicle head-up display and storage medium |
| CN114674031A (en) * | 2022-03-25 | 2022-06-28 | 阿维塔科技(重庆)有限公司 | Heating equipment control method, device and system and computer readable storage medium |
| CN115047780A (en) * | 2022-07-19 | 2022-09-13 | 重庆长安汽车股份有限公司 | System and method for remotely controlling smart home through smart car machine terminal |
| CN115390465A (en) * | 2022-07-22 | 2022-11-25 | 青岛海尔科技有限公司 | Equipment monitoring method, device, system, storage medium and electronic device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104635501A (en) * | 2014-12-25 | 2015-05-20 | 芜湖市汽车产业技术研究院有限公司 | Intelligent home control method and system |
| CN104850012A (en) * | 2015-04-27 | 2015-08-19 | 奇瑞汽车股份有限公司 | Intelligent home control method and system |
| CN109067626A (en) * | 2018-07-25 | 2018-12-21 | 北京小米移动软件有限公司 | Report the method, apparatus and storage medium of information |
| CN208665056U (en) * | 2018-08-07 | 2019-03-29 | 吉林奥坦途科技有限公司 | A kind of vehicle running intelligent alarm set |
| CN110989371A (en) * | 2019-11-13 | 2020-04-10 | 上海博泰悦臻电子设备制造有限公司 | Intelligent household control method and system |
| CN112463000A (en) * | 2020-11-10 | 2021-03-09 | 赵鹤茗 | Interaction method, device, system, electronic equipment and vehicle |
-
2021
- 2021-06-30 CN CN202110737196.2A patent/CN113485136A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104635501A (en) * | 2014-12-25 | 2015-05-20 | 芜湖市汽车产业技术研究院有限公司 | Intelligent home control method and system |
| CN104850012A (en) * | 2015-04-27 | 2015-08-19 | 奇瑞汽车股份有限公司 | Intelligent home control method and system |
| CN109067626A (en) * | 2018-07-25 | 2018-12-21 | 北京小米移动软件有限公司 | Report the method, apparatus and storage medium of information |
| CN208665056U (en) * | 2018-08-07 | 2019-03-29 | 吉林奥坦途科技有限公司 | A kind of vehicle running intelligent alarm set |
| CN110989371A (en) * | 2019-11-13 | 2020-04-10 | 上海博泰悦臻电子设备制造有限公司 | Intelligent household control method and system |
| CN112463000A (en) * | 2020-11-10 | 2021-03-09 | 赵鹤茗 | Interaction method, device, system, electronic equipment and vehicle |
Non-Patent Citations (2)
| Title |
|---|
| 思必驰: "捷报|车萝卜智能HUD智炫版火热上线小米众筹", 《微信公众号》 * |
| 车云，陈卓: "《智能汽车 决战2020》", 30 April 2018 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113824794A (en) * | 2021-10-09 | 2021-12-21 | 京东科技信息技术有限公司 | Control method and system of Internet of things |
| CN114043932A (en) * | 2021-11-17 | 2022-02-15 | 中汽创智科技有限公司 | Control method, device and equipment of vehicle head-up display and storage medium |
| CN114674031A (en) * | 2022-03-25 | 2022-06-28 | 阿维塔科技(重庆)有限公司 | Heating equipment control method, device and system and computer readable storage medium |
| CN115047780A (en) * | 2022-07-19 | 2022-09-13 | 重庆长安汽车股份有限公司 | System and method for remotely controlling smart home through smart car machine terminal |
| CN115390465A (en) * | 2022-07-22 | 2022-11-25 | 青岛海尔科技有限公司 | Equipment monitoring method, device, system, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113485136A (en) | System and method for displaying and controlling working state of smart home in real time based on AR-HUD | |
| CN111885547B (en) | Vehicle-mounted man-machine interaction system | |
| US10843524B2 (en) | Remote vehicle control system and method | |
| CN104272202B (en) | Automotive universal control device for interfacing with sensor and controller | |
| US20180024541A1 (en) | Smart home system and product thereof | |
| CN108501653B (en) | Vehicle air conditioner control system and method | |
| CN204856135U (en) | Indoor environment intelligent monitoring system | |
| CN110901341A (en) | System and method for intelligently adjusting temperature in vehicle | |
| CN104019522A (en) | Air conditioner control method and system | |
| CN203533806U (en) | Remote intelligent monitoring system of automobile air conditioner device | |
| CN104197483A (en) | Vehicular air detecting and purifying system and utilization method thereof | |
| CN107272490A (en) | Automobile and family intelligent control system | |
| CN204674332U (en) | Based on the vehicle-mounted automatic air conditioner control system of wireless technology | |
| CN110716446A (en) | Method and system for controlling home based on Internet of vehicles | |
| CN114347932A (en) | Vehicle personalized control system and method based on state of passenger in vehicle | |
| CN114326484A (en) | Scene type remote vehicle control system and method based on mobile phone voice | |
| CN110616980A (en) | Cloud computing platform-based automobile glass window opening and closing control system and method | |
| CN109076099B (en) | Method and control device for coordinating functional components of a motor vehicle with one another and/or with at least one offboard functional component | |
| CN205450841U (en) | Greenhouse control system based on CAN bus | |
| CN114537088A (en) | Intelligent in-vehicle air conditioning system | |
| CN113253679A (en) | Method and device for home control of remote controller and remote controller | |
| CN109130780B (en) | Remote control system and method for air purification of vehicle | |
| CN106352509A (en) | Smart air conditioning system and the application thereof | |
| US20220348055A1 (en) | Connected car climate control integration and automation | |
| CN114674031A (en) | Heating equipment control method, device and system and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211008 |
|
| RJ01 | Rejection of invention patent application after publication |