KR102594358B1 - Terminal apparatus, method of transmitting control command thereof - Google Patents

Abstract

This disclosure relates to a terminal device and its control command transmission method. A method of transmitting a control command of a terminal device according to the present disclosure includes the operations of storing location information of at least one air purifying device in a home, and air pollution information for each area in the home acquired while a mobile cleaning device moves within the home. An operation of obtaining, based on the obtained air pollution information for each area within the home and the location information of at least one air purifying device within the home, supplying purified air to a polluted area among the areas within the home. Obtaining a control command to control the operation of the air purifying device, and transmitting the obtained control command to the at least one air purifying device.

Description

Terminal device and its control command transmission {TERMINAL APPARATUS, METHOD OF TRANSMITTING CONTROL COMMAND THEREOF}

The present disclosure relates to a terminal device and a method of transmitting control commands thereof, and more particularly, to a terminal device that transmits control commands for controlling an air purifying device.

Various electronic devices may be installed at home to remove contaminants within the home. For example, there may be a mobile cleaning device for cleaning the ground within the home, and an air purifying device may exist for purifying the air within the home.

The cleaning moving device includes a cleaning module for cleaning the ground, such as the floor inside a house, and a moving module for moving on the ground, and can automatically perform cleaning while moving on the ground. The cleaning mobile device may be controlled to avoid collisions with obstacles present in the travel path while traveling on the floor of a home and to uniformly clean the cleaning area.

Air purifying devices can remove contaminants from the air in your home. Air purifying devices can remove bacteria, viruses, mold, fine dust, and chemicals that cause bad odors in the inhaled air. An air purifying device may be equipped with a filter to purify polluted indoor air. As the air sucked into the air purifying device passes through a filter, contaminants are removed and purified into clean air, and the purified air can be discharged to the outside of the air purifying device.

In this case, a terminal device for controlling a mobile cleaning device or an air purifying device to remove contaminants in the home may be considered. The terminal device may control the operation mode of the cleaning mobile device or the air purifying device while performing a wireless communication function with the cleaning mobile device or the air purifying device.

As a way to remove contaminants from your home, you can use an air purifying device. In order to check the level of air pollution in your home, you need to operate an air purifying device. For example, an air purifying device can display the current fine dust level and whether the air pollution level is good or bad. The user can directly check the air pollution level displayed by the air purifying device and operate the air purifying device if it is determined that the air pollution level in the home is bad. For example, a user can turn the air purifying device on or off, or keep it on at all times.

When a user directly checks the air pollution level and operates the air purifying device, the air purifying device is operated and placed according to the user's subjective judgment. In this case, it may be difficult for the air purifying device to operate in an optimal mode or be placed in an optimal location. Therefore, the cleaning efficiency within the home inevitably decreases compared to the operating time of the air purifying device, and unnecessary power consumption may occur due to the operation of the air purifying device for a long period of time.

In order to solve the above-mentioned overall problems, the present disclosure seeks to present a method for improving the cleaning efficiency in a home using an air purifying device using a terminal device and a mobile cleaning device.

A method of transmitting a control command of a terminal device according to an embodiment of the present disclosure includes the operation of storing location information of at least one air purifying device in the home, and location information for each area in the home acquired while the cleaning mobile device moves within the home. An operation of acquiring air pollution information, supplying purified air to a polluted area among the areas in the house based on the obtained air pollution information for each area in the house and the location information of at least one air purifying device in the house. Preferably, the method includes obtaining a control command to control the operation of the at least one air cleaning device, and transmitting the obtained control command to the at least one air cleaning device.

A terminal device according to an embodiment of the present disclosure includes a communication unit capable of communicating with an external device, at least one processor electrically connected to the communication unit and the display unit, and electrically connected to the at least one processor to communicate with at least one device in the home. A memory that stores location information of the air purifying device, wherein, when the processor is executed, the memory acquires air pollution information for each area within the home acquired while the cleaning mobile device moves within the home, Based on the obtained air pollution information for each area within the home and the location information of the at least one air purifying device within the home, the at least one air purifying device so that purified air is supplied to a polluted area among the areas within the home. Obtains a control command for controlling the operation of and stores at least one command set to control the communication unit to transmit the obtained control command to the at least one air purifying device.

A computer program product according to an embodiment of the present disclosure controls a cleaning mobile device to obtain air pollution information for each area within the house acquired while moving within the house, and obtains the acquired air pollution information for each area within the house and the Based on the location information of at least one air purifying device in the home, control to obtain a control command for controlling the operation of the at least one air cleaning device so that purified air is supplied to a polluted area among the areas in the home; , and a computer-readable storage medium including at least one command for controlling transmission of the obtained control command to the at least one air purifying device.

A method of providing information by a mobile cleaning device according to an embodiment of the present disclosure includes, as the mobile cleaning device moves within the home, the first air pollution level in the home measured at a first time and the level of air pollution measured at a second time. An operation of obtaining a second air pollution level in the home, an operation of obtaining air pollution level change information indicating a decrease or increase in the air pollution level in the home based on the first air pollution level and the second air pollution level, and the air It includes an operation of transmitting pollution level change information to an external device that is in communication with the cleaning mobile device.

A method of providing information by a terminal device according to an embodiment of the present disclosure includes receiving, from a mobile cleaning device, information on changes in air pollution level within a home to which the mobile cleaning device has moved, and receiving real-time images of at least one area within the home. Obtaining, and based on the air pollution level change information and the real-time image, displaying a synthesized augmented reality image so that graphics indicating a decrease or increase in air pollution in the at least one area overlap with the real-time image. Includes.

A cleaning mobile device according to an embodiment of the present disclosure includes a communication unit capable of communicating with an external device, a cleaning unit that performs a cleaning task, a traveling unit capable of moving the cleaning mobile device, and air on the movement path of the cleaning mobile device. It includes a dust detection unit capable of detecting a degree of contamination, at least one processor electrically connected to the cleaning unit, the driving unit, the dust detection unit, and the communication unit, and a memory electrically connected to the at least one processor. The memory is configured to: the processor determines the first air pollution level measured through the dust detection unit at a first time and the second air pollution level measured through the dust detection unit at a second time as the cleaning mobile device moves within the house. First, the pollution level is acquired through the sensor, and based on the first air pollution level and the second air pollution level, air pollution level change information indicating a decrease or increase in the air pollution level in the house is acquired, and the air pollution level change information is obtained. Stores at least one command set to control the communication unit to transmit to the external device that is communicated with the cleaning mobile device.

A terminal device according to an embodiment of the present disclosure includes a communication unit capable of communicating with an external device, a display unit capable of displaying graphics, at least one processor electrically connected to the communication unit and the display unit, and the at least one processor Contains electrically connected memory. The memory is such that the processor receives, from the mobile cleaning device, information on changes in air pollution level within the home to which the mobile cleaning device has moved through the communication unit, acquires a real-time image of at least one area within the home, and Based on pollution level change information and the real-time image, at least one set to display through the display unit an augmented reality image synthesized so that graphics indicating a decrease or increase in air pollution in the at least one area overlap the real-time image. Save commands.

According to the present disclosure, optimal operation and arrangement of the air cleaning device are possible, and the efficiency of the air cleaning device can be greatly improved. In particular, as the cleaning mobile device moves through each space in the home, it is possible to obtain accurate air pollution information for each area in the home, and the entire space in the home can be maintained in a uniformly clean state according to the operation of the air purifying device that reflects this. .

Additionally, when guide information guiding the placement or operation of the air purifying device is displayed on the terminal, it may be possible for the user to operate or place the air purifying device in consideration of air pollution information in the home. In particular, when the air pollution level is displayed on the terminal based on augmented reality, it becomes possible for the user to easily determine the air pollution situation in the home and control the air purifying device.

In addition, various effects that can be directly or indirectly identified through this document may be provided.

1A and 1B are diagrams illustrating a system according to an embodiment of the present disclosure.
FIG. 2 is a block diagram illustrating the respective configurations of a cleaning mobile device, an air purifying device, and a terminal device included in a system according to an embodiment of the present disclosure.
3A to 3D are flowcharts of a cleaning mobile device according to an embodiment of the present disclosure.
4A to 4D are flowcharts of a terminal device according to an embodiment of the present disclosure.
Figure 5 is a diagram illustrating an example in which a mobile cleaning device obtains air pollution level according to an embodiment of the present disclosure.
FIG. 6 is a diagram illustrating an example in which a dust sensor is installed in a mobile cleaning device according to an embodiment of the present disclosure.
7 and 8 are diagrams showing graphics displayed by a terminal device according to various embodiments of the present disclosure.
Figure 9 is a flowchart showing a method of providing information by a mobile cleaning device according to an embodiment of the present disclosure.
Figure 10 is a flowchart showing a method for a terminal device to provide information according to an embodiment of the present disclosure.

Hereinafter, various embodiments of the present disclosure are described with reference to the attached drawings. The embodiments and terms used herein are not intended to limit the technology described in the present disclosure to specific embodiments, and should be understood to include various modifications, equivalents, and/or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar components. Singular expressions may include plural expressions, unless the context clearly indicates otherwise. In the present disclosure, expressions such as “A or B” or “at least one of A and/or B” may include all possible combinations of the items listed together. Expressions such as “first,” “second,” “first,” or “second” can modify the elements in question, regardless of order or importance, and can be used to distinguish one element from another. However, it does not limit the components. When a component (e.g., a first) component is said to be "connected (functionally or communicatively)" or "connected" to another (e.g., second) component, it means that the component is connected to the other component. It may be connected directly to a component or may be connected through another component (e.g., a third component).

In the present disclosure, “configured to” means “suitable for” or “having the ability to” depending on the situation, for example, in terms of hardware or software. ", "changed to," "made to," "capable of," or "designed to." In some contexts, the expression “a device configured to” may mean that the device is “capable of” working with other devices or components. For example, the phrase "processor configured (or set) to perform A, B, and C" refers to a processor dedicated to performing the operations (e.g., an embedded processor), or by executing one or more software programs stored on a memory device. , may refer to a general-purpose processor (e.g., central processing unit (CPU) or application processor (AP)) capable of performing the corresponding operations.

In this disclosure, the term user may refer to a person using an electronic device or a device (eg, an artificial intelligence electronic device) using an electronic device.

FIG. 1A is a diagram illustrating a system according to an embodiment of the present disclosure.

In FIG. 1A, the system includes at least one of a mobile cleaning device 10 in the home, at least one air purifying device 20 (20-1 to 20-6), a terminal device 30, and a display device 40. can do.

At least two of the cleaning mobile device 10, at least one air purifying device 20, terminal device 30, and display device 40 may communicate with each other through a network.

The network, for example, is a private network and may be configured by an access point (AP) such as a gateway, router, or router to which a predetermined address is assigned.

As another example, at least two of the cleaning mobile device 10, at least one air cleaning device 20, terminal device 30, and display device 40 may perform direct communication with each other without an access point (AP). You can. Direct communication, for example, Bluetooth, Bluetooth low energy, IrDA (infrared data association), Wi-Fi Direct, Zigbee, UWB (Ultra Wideband), NFC It may be communication using at least one of (Near Field Communication) and LTE (Long Term Evolution).

As another example, at least two of the cleaning mobile device 10, at least one air purifying device 20, terminal device 30, and display device 40 communicate with each other through an external server (not shown). You can also perform . Communication may be connected. The server may be connected through a public network to which the network is accessible, and includes a cloud server.

Meanwhile, in the present disclosure, when two or more devices communicate with each other, it may include being directly connected using short-range communication technology or being connected for communication through a third repeater. The third repeater may include, for example, a base station, hub, access point, gateway, switch, relay server, etc.

In FIG. 1A, the terminal device 30 may be implemented as a mobile device such as a mobile phone, a smart phone, or a smart pad such as a tablet. Alternatively, the terminal device 30 may be implemented as a computer (PC) including a laptop or desktop. At least one program that provides a service for managing and controlling the cleaning mobile device 10 or at least one air purifying device 20 may be installed in the terminal device 30. The application may be distributed by the manufacturer of the cleaning mobile device 10 or at least one air purifying device 20, may be embedded and released during the manufacturing process of the terminal device 30, or may be released through a market such as Galaxy Apps or Play Store. It can be downloaded and installed on the terminal device 30 from .

The cleaning mobile device 10 can move around the house and perform cleaning work. Additionally, the cleaning mobile device 10 can generate a map of the home while moving within the home in order to efficiently plan a movement route for cleaning. For example, the mobile cleaning device 10 may photograph the interior of the home using a mounted camera and generate a map of the interior based on the photographed information. Alternatively, the mobile cleaning device 10 may generate a map of the home based on sensor information obtained from a Lidar sensor or the like. For example, the inside of the house may be divided into a first area (a1) to a sixth area (a6).

The cleaning mobile device 10 can measure the air pollution level within the home while moving within the home. For example, the cleaning mobile device 10 may measure the air pollution level in the home based on the amount of dust sucked in by the cleaning mobile device 10 or the sensing value of a dust sensor provided in the cleaning mobile device 10.

In FIG. 1A, the cleaning mobile device 10 measures the air pollution level in the house at a first time (t1) to obtain a first air pollution level (①), and measures the air pollution level in the house at a second time (t2). You can obtain the second air pollution level (②). For example, the cleaning mobile device 10 obtains a first air pollution level measured in a second area (a2) in the house, and obtains a second air pollution level measured in the second area (a2) at a second time (t2). can do. At this time, the position of the cleaning mobile device 10 at the first time t1 and the position of the cleaning mobile device 10 at the first time t1 are the same or an approximate position, for example, within a radius of 1 m error. You can.

The cleaning mobile device 10 may obtain air pollution level change information indicating that the air pollution level in the home has decreased or increased, based on the obtained first air pollution level and second air pollution level. The cleaning mobile device 10 may transmit the acquired air pollution level change information to the terminal device 30 (③).

The terminal device 30 may receive air pollution level change information from the cleaning mobile device 10 . In addition, according to the user's action to project at least one area (a2, a5) in the home through the lens of the camera of the terminal device 30, the terminal device 30 projects at least one area (a2, a5) in the home. Real-time video can be obtained. Based on the air pollution level change information and the real-time image, the terminal device 30 creates an augmented reality image synthesized so that graphics indicating a decrease or increase in the air pollution level in the at least one area (a2, a5) overlap with the real-time image. It can be displayed (④). For example, in the second area (a1), graphics showing a decrease in air pollution may be displayed overlapping with the real-time image, and in the fifth area (a5), graphics showing an increase in air pollution may be displayed overlapping with the real-time image. there is.

Through the augmented reality image, the user can recognize that the air pollution condition in the fifth area (a5) is poor. Accordingly, the user can touch the fifth area (a5) on the screen to purify the air in the fifth area (a5). In response to the user input, the terminal device 30 controls the air conditioning device located close to the fifth area a5 such that at least one air purifying device 20 provides purified air to the fifth area a5. A control command can be sent to 20-5) (⑤).

The air conditioner 20-5 that has received the control command may provide purified air toward the second area a2 according to the control command. For example, the air conditioner 20-5 may provide purified air toward the fifth area a5 by controlling at least one of wind direction, wind volume, and wind speed.

FIG. 1B is a diagram illustrating a system according to another embodiment of the present disclosure.

In FIG. 1B, the system includes at least one of an in-house cleaning mobile device 10, at least one air purifying device 20 (20-1 to 20-6), a terminal device 30, and a display device 40. can do. The cleaning mobile device 10 of FIG. 1B, at least one air purifying device 20 (20-1 to 20-6), terminal device 30, and display device 40 include the cleaning mobile device 10 of FIG. 1A, Overlapping descriptions corresponding to at least one air purifying device 20 (20-1 to 20-6), the terminal device 30, and the display device 40, respectively, will be omitted.

In FIG. 1B, the cleaning mobile device 10 measures the air pollution level in the house at a first time (t1) to obtain a first air pollution level (①), and measures the air pollution level in the house at a second time (t2). You can obtain the second air pollution level (②). For example, the cleaning mobile device 10 obtains a first air pollution level measured in an area (a1) in the house at a first time (t1), and obtains a first air pollution level measured in the same area (a1) at a second time (t2). A second air pollution level can be obtained.

The cleaning mobile device 10 may obtain air pollution level change information indicating that the air pollution level in the home has decreased or increased, based on the obtained first air pollution level and second air pollution level. The cleaning mobile device 10 may transmit the acquired air pollution level change information to the air cleaning device 20-5 (③).

The air purifying device 20-5 may determine that the air in the fifth area a5 is gradually becoming polluted based on the received air pollution level change information. Accordingly, the air purifying device 20-5 can provide purified air toward the fifth area a5 within the home. For example, based on the determined air pollution state, the air conditioner 20-5 may control at least one of wind direction, wind volume, and wind speed to provide purified air toward the fifth area a5.

FIG. 2 is a block diagram showing the configuration of each of the cleaning mobile device 10, the air cleaning device 20, and the terminal device 30 included in the system according to an embodiment of the present disclosure.

In FIG. 2, the mobile cleaning device 10 may include a communication unit 11, a traveling unit 12, a cleaning unit 13, a detection unit 14, a memory 15, and a processor 16.

The cleaning mobile device 10 is a cleaning mobile device 10 that automatically travels and cleans the floor surface of a certain area (eg, each area within the house).

In one embodiment, the mobile cleaning device 10 is equipped with a sensing unit 14 that can determine the surrounding environment, and can be implemented as an autonomous driving device capable of recognizing its own location and moving to its destination.

The communication unit 11 includes hardware such as a communication circuit or communication chip to perform wireless communication based on various wireless protocols. Various types of wireless communication protocols supported by the communication unit 11 may be possible, such as Wi-Fi, Bluetooth, infrared, RF, Zigbee, Wi-Fi Direct, and LTE. For example, according to the protocol supported by the communication unit 11, the mobile cleaning device 10 may communicate with another device through a predetermined network by connecting to an access point (AP), or directly communicate with another device. there is. In addition, the mobile cleaning device 10 communicates with at least one of another device, for example, an air purifying device 20, a terminal device 30, a server (for example, a home server), a charging station, or a gateway, through the communication unit 11. can be performed.

The driving force for the overall operation of the cleaning mobile device 10, including the traveling unit 12 and the cleaning unit 13, is provided by a battery built into the cleaning mobile device 10, and the cleaning mobile device 10 includes a battery. A charging terminal may be provided for charging.

In order to move the cleaning mobile device 10, the traveling unit 12 basically includes one or more wheels in contact with the floor, a motor as a driving unit that generates driving force for movement, a link and an axis that transmit the driving force of the motor to the wheels. May contain structures. The traveling unit 12 has a plurality of wheels, and each wheel is driven individually, allowing the cleaning moving device 10 to travel in various ways, such as forward movement, backward movement, rotational movement, and stationary movement. The moving direction and moving speed of the cleaning mobile device 10 by the traveling unit 12 may be determined by a control signal transmitted to the motor from the processor 16 in the cleaning mobile device 10. Alternatively, the traveling unit 12 may further include a steering mechanism that physically changes the angle of each of the plurality of wheels in response to a control signal from the processor 16.

The cleaning unit 13 may include a brush that scatters foreign substances such as dust present on the floor, a suction module that suctions the scattered foreign substances, and a storage tank that stores the sucked foreign substances. The cleaning unit 13 can clean the floor surface by operating when the cleaning mobile device 10 is moved by the traveling unit 12 or when the cleaning mobile device 10 is stationary.

The detection unit 14 includes at least one sensor capable of detecting the surrounding environment. The detection unit 14 is provided to detect the environment surrounding the cleaning mobile device 10 while it is moving or being cleaned. In one embodiment, the detection unit 14 may operate as a location recognition module capable of recognizing the location of the cleaning mobile device 10 based on the detection result of the sensor.

The sensors of the detection unit 14 include an image sensor provided in the camera, a LiDAR sensor, a 3D sensor, a geomagnetic sensor, an infrared (IR) sensor, an ultrasonic sensor, a laser sensor, and a radar sensor ( It may include position recognition sensors such as radar sensor and PSD (position sensitive detector) sensor.

In one embodiment, a location recognition sensor can measure distance and detect objects using radio waves. The detection unit 14 transmits a detection signal toward the front through a position recognition sensor and receives the reflected signal, and can detect the surrounding environment, including obstacles, using the received reflected signal. The frequency band of the detection signal used in a position recognition sensor is not limited, and may have a spectrum in which energy is distributed over a wide frequency band. As an example, the detection signal is implemented as an ultra-wideband (UWB) RF signal, which can minimize interference with other signals (GPS, Bluetooth, ZigBee, WLAN, etc.) in a relatively narrow band. The image sensor can generate an image by capturing or capturing the surrounding environment of the cleaning mobile device 10.

In one embodiment, the cleaning mobile device 10 may include a camera including an image sensor. The camera includes a lens and an image sensor through which captured images are transmitted. The image sensor may be a CMOS (Complementary Metal-Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor, and can capture the front view of the cleaning mobile device 10 and generate the capture result as a digital image. The camera may be equipped with various types of optical lenses to capture the surrounding environment in a wider range or to capture a more precise image. In one embodiment, a lens with a wide angle of view may be used in the camera so that all surrounding areas can be photographed even at a predetermined location. Additionally, the camera is installed upward, so all areas of the ceiling can be captured. The cleaning mobile device 10 can recognize its own location based on image data captured from the ceiling or generate a map of the cleaning area, that is, a navigation map. Additionally, a previously created map may be modified using image data, and an integrated navigation map for the entire cleaning area may be created using image data captured by another mobile cleaning device 10.

In one embodiment, the camera may be installed in the front or upper side of the cleaning moving device 10 so as to capture the front of the cleaning moving device 10, which is the moving direction of the cleaning moving device 10. In one embodiment, the cleaning mobile device 10 may be provided with a plurality of cameras. In one embodiment, the position recognition sensor of the detection unit 150 may be installed in the front or upper side of the cleaning mobile device 10 to detect obstacles located in the moving direction of the cleaning mobile device 10.

In one embodiment, the mobile cleaning device 10 can use data acquired through the sensing unit 14 to create or modify a map on its own.

The detection unit 14 may include a dust sensor. The dust sensor is used to measure the air quality in the home, and can measure the dust concentration in the air (i.e., air pollution level) and transmit the dust measurement value to the processor 16. In addition, the detection unit 14 includes a gas sensor (VOC sensor) to measure the gas concentration in the air, a CO2 sensor to measure the CO2 concentration in the air, a radon sensor to measure the radon concentration in the air, and a gas sensor to measure the humidity in the air. It may include various types of sensors that can measure air conditions, such as a humidity sensor for air temperature, a temperature sensor for measuring air temperature, etc.

The memory 15 may be provided as a location where data is stored or loaded. The memory 15 may include a non-volatile memory in which data is stored regardless of whether system power is applied, and a volatile memory in which data processed by the processor 190, for example, a control program, is temporarily loaded. Non-volatile memory includes flash memory, EPROM, HDD, SDD, and ROM, and volatile memory may include RAM and buffers.

In one embodiment, a navigation map for the cleaning area is stored in the memory 15. Here, the navigation map may include at least one of an obstacle map for showing the cleaning area and an internally stored feature map. The characteristic map is used by the cleaning mobile device 10 to determine its current location. The memory 15 may store data for the operation of the cleaning mobile device 10 related to cleaning, charging, driving, etc., such as control programs, applications, algorithms, etc.

The processor 16 may be a circuit implemented as a combination of CPU, chipset, microcontroller, or SoC. The processor 16 performs calculations and instruction operations for various operations performed by the cleaning mobile device 10 according to a control program. It can be done. The control program may include program(s) implemented in the form of at least one of BIOS, device driver, operating system, firmware, platform, or application program. In one embodiment, the application program is pre-installed or stored at the time of manufacturing the cleaning mobile device 10, or is installed in the cleaning mobile device 10 based on the data of the application program received from the outside during future use. You can. The data of the application may be downloaded to the cleaning mobile device 10 from an external server, for example an application market. Such an application program is an example of a computer program product of the present disclosure, but is not limited thereto.

In various embodiments, as the cleaning mobile device 10 moves within the home, the memory 15 stores a first air pollution level in the home measured at a first time and a second air pollution level in the home measured at a second time. Obtain, based on the first air pollution level and the second air pollution level, obtain air pollution level change information indicating that the air pollution level in the house has decreased or increased, and communicate the air pollution level change information to the cleaning mobile device 10 and the connected external At least one command set to be transmitted to the device may be stored.

In various embodiments, the memory 15 is configured to obtain the first air pollution level and the second air pollution level based on the amount of dust sucked by the cleaning mobile device 10 or the sensing value of the dust sensor provided in the cleaning mobile device 10. At least one set command can be saved.

In various embodiments, the memory 15 may store at least one command set to obtain the first air pollution level and the second air pollution level based on the dust intake amount per unit time of the cleaning mobile device 10.

In various embodiments, the memory 15 controls to mount a dust sensor provided on the charging station of the cleaning mobile device 10 when the measurement sensitivity of the first air pollution level or the second air pollution level is below a threshold value, and controls the installed dust sensor to be mounted on the charging station of the cleaning mobile device 10. Based on the sensing value of the sensor, at least one command set to obtain the first pollution level and the second air pollution level may be stored.

In various embodiments, the memory 15 may use air pollution level change information to determine a cleaning mode for each area within the home and store at least one command set to perform a cleaning task according to the determined cleaning mode.

In various embodiments, the memory 15 may store at least one command set to obtain the first air pollution level and the second air pollution level for at least one excluded area excluding the area where the air purifier is placed in the home.

In various embodiments, the memory 15 may store at least one command set to obtain air pollution level change information including air pollution level distribution information indicating the air pollution level for each area within the home.

In various embodiments, the memory 15 is at least one set to generate a navigation map within the home as the cleaning mobile device 10 moves within the home and obtain air pollution level distribution information for each area included in the generated navigation map. Commands can be saved.

In various embodiments, the memory 15 is configured to obtain a first air pollution level measured in an area of the house at a first time and a first air pollution level measured in the same area as the area at a second time. Commands can be saved.

In FIG. 2, the air purifying device 20 may include a communication unit 21, a dust detection unit 22, a blower pen 23, a memory 24, and a processor 25.

The communication unit 21 includes hardware such as a communication circuit or communication chip for performing wireless communication based on various wireless protocols. Various types of wireless communication protocols supported by the communication unit 21 may be possible, such as Wi-Fi, Bluetooth, infrared, RF, Zigbee, Wi-Fi Direct, and LTE. For example, according to the protocol supported by the communication unit 21, the air purifying device 20 may communicate with another device through a predetermined network by connecting to an access point (AP), or directly communicate with another device. there is. In addition, the air purifying device 20 may communicate with at least one of another device, for example, a cleaning mobile device 10, a terminal device 30, a server (eg, a home server), or a gateway, through the communication unit 21. You can.

The dust detection unit 22 is used to measure the air quality in the home where the air purifying device 20 is installed, and measures dust concentration (i.e., air pollution level) in the air sucked into the air cleaning device 20. The value can be passed to the processor 25. In addition, the air purifying device 20 includes a gas sensor (VOC sensor) for measuring the gas concentration in the air, a CO2 sensor for measuring the CO2 concentration in the air, a radon sensor for measuring the radon concentration in the air, and a measuring humidity in the air. It may further include various types of sensors capable of measuring air conditions, such as a humidity sensor for measuring air temperature, a temperature sensor for measuring air temperature, etc.

The blower fan 23 forms an air flow according to the drive control signal of the processor 25 and draws outside air, that is, air inside the home, into the inside of the air purifier 20 through the intake port and passes it through the filter unit. After filtering, it can be discharged to the outside of the air purifying device 20 through an outlet. The blowing fan 23 may be rotated by a motor (not shown) to create a flow of air. The rotation speed of the motor can be adjusted by receiving a control signal from the processor 25 according to the dust measurement value measured by the dust detection unit 22. Alternatively, it can be adjusted by receiving a control signal from the processor 25 according to the control command received from the blower pen 23 and the terminal device 30.

The memory 24 may be provided as a location where data storage or loading is performed. The memory 24 may include a non-volatile memory in which data is stored regardless of whether system power is applied, and a volatile memory in which data processed by the processor 25, for example, a control program, is temporarily loaded. Non-volatile memory includes flash memory, EPROM, HDD, SDD, and ROM, and volatile memory may include RAM and buffers.

The processor 25 may be a combination of a CPU, a chipset, a microcontroller, or a circuit implemented as a SoC. The processor 25 can perform calculations and instruction operations for various operations performed by the air purifying device 20 according to the control program. The control program may include program(s) implemented in the form of at least one of BIOS, device driver, operating system, firmware, platform, or application program. In one embodiment, the application program is pre-installed or stored at the time of manufacturing the air cleaning device 20, or is installed in the air cleaning device 20 based on data of the application program received from the outside during future use. You can. Data of the application may be downloaded to the air purifying device 20 from an external server, for example, an application market. Such an application program is an example of a computer program product of the present disclosure, but is not limited thereto.

In various embodiments, the memory 24 obtains a control command from the terminal device 30 to control the operation of the air purifying device 20 so that purified air is supplied to polluted areas among areas within the home, and the obtained At least one command set to control the operation (e.g., wind direction, wind volume, wind speed, or operation time) of the air cleaning device 20 according to the control command may be stored.

In FIG. 2, the terminal device 30 may include a communication unit 31, a display unit 32, a memory 33, and a processor 34.

The terminal device 30 may be a smartphone, tablet PC, mobile phone, video phone, e-book reader, desktop PC, laptop PC, netbook computer, workstation, PDA, portable multimedia player (PMP), MP3 player, medical device, or camera. , or a wearable device. Wearable devices may be accessory (e.g., watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted-device (HMD)), fabric or clothing-integrated (e.g., electronic clothing), It may include at least one of a body-attached circuit (e.g., a skin pad or a tattoo) or a bioimplantable circuit. In addition, the terminal device 30 may include, for example, a television, a digital video disk (DVD) player, or an audio circuit. , refrigerator, air conditioner, vacuum cleaner, oven, microwave, washing machine, air purifier, set-top box, home automation control panel, security control panel, media box (e.g. Samsung HomeSyncTM, Apple TVTM, or Google TVTM), game console ( For example: XboxTM, PlayStationTM), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

The communication unit 31 includes hardware such as a communication circuit or communication chip to perform wireless communication based on various wireless protocols. Various types of wireless communication protocols supported by the communication unit 31 may be possible, such as Wi-Fi, Bluetooth, infrared, RF, Zigbee, Wi-Fi Direct, and LTE. For example, depending on the protocol supported by the communication unit 31, the terminal device 30 can connect to an access point (AP) to communicate with another device through a predetermined network, or directly communicate with another device. . In addition, the terminal device 30 communicates with at least one of another device, e.g., a mobile cleaning device 10, an air purifying device 20 server (e.g., a home server), a charging station, or a gateway, through the communication unit 31. It can be done. Additionally, the communication unit 31 includes a mobile communication unit, and the mobile communication unit can connect to other devices using one or more antennas under the control of the processor 34. The mobile communication unit communicates voice calls, video calls, text messages (SMS), multimedia images (MMS) and data with a mobile phone, smartphone, tablet or other terminal device (portable device) that has a phone number that can be connected to the terminal device 30. You can transmit and receive wireless signals for.

The display unit 32 may display visual information processed by the processor 34. The implementation method of the display unit 32 is not limited, and includes, for example, liquid crystal, plasma, light-emitting diode, organic light-emitting diode, and surface conduction electron gun. It can be implemented in various display methods such as surface-conduction electron-emitter, carbon nano-tube, and nano-crystal. The display unit 32 may further include additional components such as a driving unit depending on its implementation method. The display unit 32 can display objects including menu items of the terminal device 30 (eg, menus, text, images, videos, shapes, icons, and shortcut icons) as a user interface (UI). In one embodiment, the object is displayed on the initial screen of the terminal device 30 and may include an icon corresponding to an application for controlling the mobile cleaning device 10 or the air purifying device 20. In addition, according to the present disclosure, the display unit 32 displays the arrangement or arrangement of at least one air purifying device 20 based on air pollution information for each area within the home and location information of at least one air cleaning device 20 within the home. Guide information to guide operations can be displayed. The guide information includes at least one of air pollution information for each area within the home, graphics indicating the location of at least one air cleaning device 20 within the home, or at least one UI for controlling the at least one air cleaning device 20. It can be included.

The memory 33 may be provided as a location where data is stored or loaded. The memory 33 may include a non-volatile memory in which data is stored regardless of whether system power is applied, and a volatile memory in which data processed by the processor 34, for example, a control program, is temporarily loaded. Non-volatile memory includes flash memory, EPROM, HDD, SDD, and ROM, and volatile memory may include RAM and buffers.

The processor 34 may be a combination of a CPU, a chipset, an application processor (AP), a microcontroller, or a circuit implemented as a SoC. The processor 34 can perform calculations and instruction operations for various operations performed by the terminal device 30 according to a control program. The control program may include program(s) implemented in the form of at least one of BIOS, device driver, operating system, firmware, platform, or application program. In one embodiment, the application program may be installed or stored in advance at the time of manufacturing the terminal device 30, or may be installed in the air purifying device 20 based on application data received from the outside during future use. there is. Data of the application program may be downloaded to the terminal device 30 from an external server, for example, an application market. Such an application program is an example of a computer program product of the present disclosure, but is not limited thereto.

Processor 34 may include single core, dual core, triple core, quad core, and multiple cores thereof. The processor 34 is a plurality of processors, for example, a main processor and a sub processor operating in a sleep mode (for example, only standby power is supplied and does not operate as a display device). ) may include. Additionally, the processor, ROM, and RAM may be interconnected through an internal bus. In one embodiment, when the terminal device 30 is implemented as a desktop or laptop computer, the processor 34 may further include a GPU (Graphics Processing Unit) for graphics processing. In another embodiment, when the terminal device 30 is implemented as a mobile device such as a smartphone or smart pad, or a smart TV, the processor 34 may include a GPU. For example, the processor 34 may include a core ( It can be implemented in the form of a SoC (System On Chip) that combines a core and a GPU.

In various embodiments, the memory 33 acquires air pollution information for each area within the house acquired while the cleaning mobile device 10 moves within the house, and stores the acquired air pollution information for each area within the house and at least one area within the house. Based on the location information of the air cleaning device 20, a control command is obtained to control the operation of at least one air cleaning device 20 so that purified air is supplied to a polluted area among the areas in the home, and the obtained At least one command set to control the communication unit 31 to transmit a control command to at least one air purifying device 20 may be stored.

In various embodiments, the memory 33 determines the arrangement or operation of at least one air purifying device 20 based on air pollution information for each area within the home and location information of the at least one air cleaning device 20 within the home. At least one command set to control the display unit 32 to display guide information may be stored.

In various embodiments, the memory 33 obtains a user's request signal for controlling the operation of at least one air purifying device based on the displayed guide information, and selects a contaminated area among areas within the home based on the request signal. At least one command set to obtain a control command for controlling the operation of at least one air purifying device so that purified air is supplied may be stored.

In various embodiments, the memory 33 acquires a real-time image of at least one area in the house, and based on the air pollution information and the real-time image, the air pollution information of the at least one area is synthesized so that it overlaps the real-time image. At least one command set to control the display unit 32 to display an augmented reality image may be stored.

In various embodiments, the air pollution information for each area within the home may include at least one of air pollution level for each area within the home or air pollution level change information for each area within the home indicating a decrease or increase in air pollution level within the home. In addition, the air pollution information for each area within the home may include the air pollution level for each area within the home obtained based on at least one of the amount of dust inhaled by the mobile cleaning device 10 or the sensing value of a dust sensor provided in the mobile cleaning device. You can. In addition, the air pollution information for each area within the home is obtained based on at least one of the dust intake amount per unit time of the mobile cleaning device 10 or the sensing value per unit time of the dust sensor provided in the mobile cleaning device 10. May include air pollution.

3A to 3D are flowcharts of a cleaning mobile device according to an embodiment of the present disclosure.

FIG. 3A is a flowchart of the cleaning mobile device 10 operating in a basic mode to obtain air pollution levels of each area in the house. Additionally, FIGS. 3B and 3C are flowcharts showing the mobile cleaning device 10 operating in a quick sensing mode in which the cleaning mobile device 10 acquires the air pollution level of at least one area excluding the area where the air cleaning device 20 is placed. FIG. 3D is a flowchart of the cleaning mobile device 10 operating in a cleaning mode.

In FIG. 3A, the mobile cleaning device 10 may obtain a request signal requesting sensing of air pollution level (301). For example, as a user input requesting sensing of air pollution level is performed through the user interface provided in the cleaning mobile device 10, the cleaning mobile device 10 may obtain a user input signal corresponding to the user input as a request signal. there is. Alternatively, as a user input requesting sensing of air pollution is performed through the control application of the cleaning mobile device 10 provided in the terminal device 30, the cleaning mobile device 10 sends a user input signal corresponding to the user input. It can be obtained from the terminal device 30 as a request signal.

When a request signal is obtained, the mobile cleaning device 10 may obtain the air pollution level for at least one area within the home while moving within the home (302). For example, the cleaning mobile device 10 may suck in foreign substances (eg, dust) present on the floor and determine the air pollution level based on the amount of dust sucked. Alternatively, the cleaning mobile device 10 may determine the air pollution level based on a value sensed by a dust sensor provided in the cleaning mobile device 10.

Once the air pollution level is obtained, the cleaning mobile device 10 can generate an air pollution level distribution map including the air pollution level for each area within the home (303). For example, when the cleaning mobile device 10 generates a navigation map within the home as it moves within the home, air pollution level distribution information can be obtained for each region of the generated navigation map. That is, the cleaning mobile device 10 can generate an air pollution level distribution map by mapping the air pollution level for each area of the generated navigation map.

When the air pollution distribution map within the home is generated, the cleaning mobile device 10 transmits the generated air pollution distribution map within the home to an external device (e.g., terminal device 30, air purifier 20) connected to the cleaning mobile device 10. )) can be sent to (304).

In various embodiments, the cleaning mobile device 10 changes the air pollution level indicating a decrease or increase in the air pollution level for at least one area based on the air pollution level measured at a certain period or when an event occurs in at least one area. Information can also be obtained. When information on the change in air pollution level within the home is acquired, the cleaning mobile device 10 transmits an air pollution level distribution map including the acquired air pollution level change information within the home to an external device (e.g., terminal device 30) connected to the cleaning mobile device 10. ), can be transmitted to the air purifying device (20)).

FIG. 3B is a flowchart of the cleaning mobile device 10 operating in the first quick sensing mode according to an embodiment of the present disclosure.

In FIG. 3B, the mobile cleaning device 10 can obtain a quick sensing request signal to quickly determine the level of air pollution in the home (311). For example, as a user input requesting quick sensing of air pollution is performed through the user interface provided in the cleaning mobile device 10, the cleaning mobile device 10 obtains a user input signal corresponding to the user input as a request signal. You can. Alternatively, as a user input requesting sensing of air pollution is performed through the control application of the cleaning mobile device 10 provided in the terminal device 30, the cleaning mobile device 10 sends a user input signal corresponding to the user input. It can be obtained from the terminal device 30 as a request signal.

When the request signal is obtained, the mobile cleaning device 10 can obtain the location information of the air cleaning device 20 and the air pollution level around the air cleaning device 20 from the air cleaning device 20 (312).

Next, the mobile cleaning device 10 may obtain the air pollution level while moving to at least one excluded area in the home excluding the area where the air cleaning device 20 is placed (313).

Once the air pollution level is obtained, the cleaning mobile device 10 may generate an air pollution level distribution map including air pollution level distribution information for the excluded area (314). At this time, the air pollution level distribution map may include the air pollution level for at least one excluded area.

Additionally, the cleaning mobile device 10 may obtain at least one of air pollution level change information or air pollution level around the air cleaning device 20 from the air cleaning device 20 . The mobile cleaning device 10 may generate an air pollution level distribution map within the home using the air pollution level distribution map targeting the excluded area and the air pollution level obtained from the air cleaning device 20 (315).

When the air pollution distribution map within the house is generated, the cleaning mobile device 10 transmits the generated air pollution distribution map to an external device (e.g., terminal device 30, air purifying device 20) connected to the cleaning mobile device 10. Can be transmitted to (316).

In various embodiments, when a request signal is obtained, the cleaning mobile device 10 may acquire location information of the air cleaning device 20 and information on changes in air pollution level around the air cleaning device 20 from the air cleaning device 20. You can. In addition, the cleaning mobile device 10 provides air pollution level change information indicating a decrease or increase in air pollution level for at least one excluded area based on the air pollution level measured at a certain period or whenever an event occurs in at least one excluded area. You can also obtain . The cleaning mobile device 10 uses the air pollution level change information for at least one exclusion area and the air pollution level change information obtained from the air purifying device 20 to create an air pollution level distribution map within the home including the air pollution level change information within the home. can be created.

When the air pollution level distribution map within the home is generated, the cleaning mobile device 10 transmits the air pollution level distribution map including the generated air pollution level change information within the home to an external device (for example, the terminal device 30) connected to the cleaning mobile device 10. ), can be transmitted to the air purifying device (20)).

FIG. 3C is a flowchart of the cleaning mobile device 10 operating in the second quick sensing mode according to an embodiment of the present disclosure.

In FIG. 3C, while the cleaning mobile device 10 is storing the location information of the air cleaning device 20 and the air pollution level around the air cleaning device 20, a quick sensing request signal is sent to quickly determine the air pollution level in the home. You can obtain (321).

When a request signal is obtained, the mobile cleaning device 10 may acquire the air pollution level while moving to at least one excluded area in the home excluding the area where the air cleaning device 20 is placed (322).

Once the air pollution level is obtained, the cleaning mobile device 10 may generate an air pollution level distribution map including air pollution level distribution information for the excluded area (323). At this time, the air pollution level distribution information may include the air pollution level for at least one excluded area.

When an air pollution distribution map within the home is obtained targeting at least one exclusion area, the cleaning mobile device 10 uses the air pollution distribution map and the air pollution level obtained from the air purifying device 20 to determine the air pollution level distribution within the home. A map can be created (324).

When a map of air pollution distribution information within the home is generated, the cleaning mobile device 10 transmits the generated air pollution distribution map to an external device (e.g., terminal device 30, air purifier 20) connected to the cleaning mobile device 10. )) can be sent to (325).

In various embodiments, the mobile cleaning device 10 may obtain a quick sensing request signal while storing the location information of the air cleaning device 20 and the change information of air pollution level around the air cleaning device 20. When the request signal is obtained, air pollution level change information indicating a decrease or increase in air pollution level for at least one exclusion area can be obtained. The cleaning mobile device 10 uses the air pollution level change information for at least one exclusion area and the air pollution level change information obtained from the air purifying device 20 to create an air pollution level distribution map within the home including the air pollution level change information within the home. can be created.

When the air pollution level distribution map within the home is generated, the cleaning mobile device 10 transmits the air pollution level distribution map including the generated air pollution level change information within the home to an external device (for example, the terminal device 30) connected to the cleaning mobile device 10. ), can be transmitted to the air purifying device (20)).

FIG. 3D is a flowchart of the cleaning mobile device 10 operating in a cleaning mode according to an embodiment of the present disclosure.

In FIG. 3D, operations 331 to 334, in which the cleaning mobile device 10 generates and transmits an air pollution distribution map according to a request for sensing the air pollution level, correspond to operations 301 to 304 of FIG. 3A described above, and overlapping descriptions are omitted. do.

Based on the transmission of the air pollution level distribution map, the cleaning mobile device 10 may obtain a request signal requesting the setting of a cleaning mode for each area within the home (335). For example, as a user input requesting setting of a cleaning mode is performed through the user interface provided in the cleaning mobile device 10, the cleaning mobile device 10 may obtain a user input signal corresponding to the user input as a request signal. there is. Alternatively, as a user input requesting setting of the cleaning mode is performed through the control application of the cleaning mobile device 10 provided in the terminal device 30, the cleaning mobile device 10 sends a user input signal corresponding to the user input. It can be obtained from the terminal device 30 as a request signal.

The cleaning mobile device 10 may determine a cleaning mode for each area within the home by considering the degree of contamination for each area within the home (336). For example, the cleaning mobile device 10 may determine a cleaning mode in which at least one of dust suction intensity, movement speed, and movement order is determined for each area within the home.

Once the cleaning mode is determined for each area within the home, the cleaning mobile device 10 may perform cleaning work while moving within the home and changing the cleaning mode for each area within the home according to the determined cleaning mode (337). For example, the cleaning mobile device 10 may perform cleaning in the order from an area with high air pollution to an area with low air pollution. Alternatively, the cleaning mobile device 10 may operate with strong dust suction intensity in areas with high air pollution, and operate with weak dust suction intensity in areas with low air pollution.

4A to 4D are flowcharts of a terminal device according to an embodiment of the present disclosure.

FIG. 4A is a flowchart of the terminal device 30 operating in the basic mode, FIG. 4B is a flowchart of the terminal device 30 operating in the augmented reality mode, and FIG. 4C is a flowchart of the terminal device controlling the air purifying device 20. This is a flowchart, and Figure 4d is a flowchart of a terminal device controlling a peripheral device.

In FIG. 4A, the terminal device 30 may obtain a request signal requesting sensing of air pollution level (401). For example, as a user input requesting sensing of air pollution level is performed through an air pollution level display application provided in the terminal device 30, the terminal device 30 may obtain a user input signal corresponding to the user input as a request signal. there is.

When the request signal is obtained, the terminal device 30 requests the cleaning mobile device 10 to sense the air pollution level, and receives a distribution map of the air pollution level in the home containing the air pollution level information in the home from the mobile cleaning device 10. You can do it (402). For example, the air pollution information may include at least one of air pollution level by area within the home or air pollution level change information by area within the home.

For example, the mobile cleaning device 10 may generate an air pollution level distribution map through the process shown in FIGS. 3A to 3C described above, and transmit the generated air pollution level distribution map to the terminal device 30.

The terminal device 30 may display a map graphic showing air pollution information for each area within the home based on the received air pollution distribution map (403).

FIG. 4B is a flowchart of the terminal device 30 operating in an augmented reality mode according to an embodiment of the present disclosure.

In FIG. 4B, the terminal device 30 may obtain a request signal requesting sensing of air pollution level (411).

When the request signal is obtained, the terminal device 30 requests the cleaning mobile device 10 to sense the air pollution level, and receives a distribution map of the air pollution level in the home containing the air pollution level information in the home from the mobile cleaning device 10. It can be done (412).

Next, the terminal device 30 may obtain a request signal requesting display of the augmented reality mode (413). For example, as a user input requesting display of an augmented reality mode is performed through an air pollution level display application provided in the terminal device 30, the terminal device 30 may obtain a user input signal corresponding to the user input as a request signal. You can.

When the request signal is obtained, the terminal device 30 can acquire real-time images of at least one area within the home.

Based on the air pollution level distribution map and the real-time image, the terminal device 30 may display an augmented reality image synthesized so that graphics indicating that the air pollution level in the home has changed or is changing overlaps with the real-time image in the home (414) ).

FIG. 4C is a flowchart of how the terminal device 30 controls the air purifying device 20 according to an embodiment of the present disclosure.

In FIG. 4C, the terminal device 30 may receive an air pollution distribution map including air pollution information for each area within the home from the mobile cleaning device 10 (421). Additionally, the terminal device 30 may obtain and store location information of at least one air purifying device 20 in the home. The location information of the air cleaning device 20 can be received from the cleaning mobile device 10 or the air cleaning device 20. Alternatively, the location information of the air purifying device 20 may be obtained from a home server that manages/operates devices in the home.

The terminal device 30 displays a screen containing guide information guiding the placement or operation of at least one air cleaning device 20, based on the air pollution distribution map and the location information of the at least one air cleaning device 20. It can be displayed.

For example, the terminal device 30 may display guide information guiding the control or arrangement of the air purifying device 20 (422). The guide information may include air pollution information for each area within the home, graphics indicating the location of at least one air purifying device 20 within the home, and at least one UI for controlling the air cleaning device 20. At this time, at least one of the graphics indicating the location of the air purifying device 20 and the UI for controlling the air cleaning device 20 may be displayed to overlap with the augmented reality image of operation 414 of FIG. 4B described above. Additionally, at least one of the graphics indicating the location of the air purifying device 20 and the UI for controlling the air cleaning device 20 may be displayed on a separate screen. Additionally, when selecting a graphic indicating the location of the air cleaning device 20, a UI for controlling the air cleaning device 20 may be displayed on a pop-up screen or a separate screen. The UI for controlling the air cleaning device 20 may be, for example, a UI for setting at least one of on/off, wind speed, wind volume, wind direction, and operation time of the air cleaning device 20. The user may operate at least one UI for controlling the air purifying device 20 by referring to the air pollution level in the home included in the augmented reality image. Alternatively, the user may operate at least one UI for controlling the air purifying device 20 by referring to information on changes in air pollution level in the home included in the augmented reality image.

Next, the terminal device 30 may obtain a user's request signal requesting control of the air purifying device 20 through the at least one UI (423). When the request signal is obtained, the terminal device 30 may obtain a control command to control the operation of at least one air purifying device 20 so that purified air is supplied to polluted areas among areas within the home. For example, the terminal device 30 generates and obtains a control command to control the operation of the air purifying device 20 based on the user's request signal, or generates a control command corresponding to the user's request signal from a previously stored matching table. You can also obtain it by searching.

The terminal device 30 may transmit a control command to the air purifying device 20 based on the user's request signal (424).

In various embodiments, the terminal device 30 may display guide information on the screen to guide where to place the air purifying device 20. For example, the terminal device 30 may display guide information on the screen suggesting moving the air purifying device 20 to a specific location or adjusting the direction in which airflow is discharged from the air purifying device 20. there is.

Alternatively, the terminal device 30 may display guide information related to the air purifying device 20 on the screen for each time period. For example, the terminal device 30 may display guide information guiding the control or arrangement of the air purifying device 20 on the screen by distinguishing between breakfast, lunch, and dinner times. Alternatively, the terminal device 30 controls or places the air purifying device 20 by classifying it according to environmental information (e.g., fine dust high/normal/low, spring/summer/autumn/winter, clear/cloudy/rainy). Guide information can be displayed on the screen. An example of guide information related to the air cleaning device 20 will be described later with reference to FIG. 7 .

FIG. 4D is a flowchart of how the terminal device 30 controls a peripheral device according to an embodiment of the present disclosure. A peripheral device is a device that can change the level of air pollution in the home. For example, it may be a device that can change the level of air pollution in the home by generating air currents, such as a fan or air conditioner.

In FIG. 4D, the terminal device 30 may receive an air pollution distribution map including air pollution information for each area within the home from the mobile cleaning device 10 (431). Additionally, the terminal device 30 may obtain and store location information of at least one nearby device within the home. Location information of a nearby device may be received from a nearby device, or may be obtained from a home server that manages/operates devices within the home.

For example, the terminal device 30 may display guide information that guides the control or arrangement of nearby devices (432). The guide information may include air pollution information for each area within the home, graphics indicating the location of at least one peripheral device 20 within the home, and at least one UI for controlling the peripheral device. At this time, at least one of graphics indicating the location of the nearby device and a UI for controlling the nearby device may be displayed to overlap with the augmented reality image of operation 414 of FIG. 4B described above. Additionally, at least one of graphics indicating the location of a peripheral device and a UI for controlling the peripheral device may be displayed on a separate screen. Additionally, when selecting a graphic indicating the location of a peripheral device, a UI for controlling the peripheral device may be displayed in a pop-up screen or a separate screen. The UI for controlling a peripheral device may be, for example, a UI for setting at least one of on/off, wind speed, wind volume, wind direction, and operation time of the peripheral device. The user may operate at least one UI for controlling nearby devices by referring to the air pollution level in the home included in the augmented reality image. Alternatively, the user may operate at least one UI for controlling the air purifying device 20 by referring to information on changes in air pollution in the home included in the augmented reality image.

Next, the terminal device 30 may obtain a user's request signal requesting control of a nearby device through the at least one UI (433). When the request signal is obtained, the terminal device 30 may transmit a control command to a peripheral device based on the user's request signal (434).

Figure 5 is a diagram illustrating an example in which a mobile cleaning device obtains air pollution level according to an embodiment of the present disclosure.

Referring to FIG. 5, the mobile cleaning device 10 can obtain the air pollution level for each area within the home based on the amount of dust inhaled per unit time.

For example, as shown in (a) of FIG. 5, the cleaning mobile device 10 can obtain air pollution levels while moving from the first area to the sixth area in the house.

Figure 5(b) shows air quality information acquired while the cleaning mobile device 10 moves from the first area to the sixth area. Air quality information may include, for example, dust intake amount, cleaning period for each area, dust intake amount per unit time, and air pollution level. In Figure 5(b), the cleaning mobile device 10 sucks 200 mg of dust for 10 minutes in the first area, 3000 mg of dust for 300 minutes in the second area, and 40 minutes in the third area. It can inhale 1600mg of dust, inhale 190mg of dust in 1 minute in zone 4, inhale 230mg of dust in 10 minutes in zone 5, and inhale 380mg of dust in 20 minutes in zone 6. .

In Figure 5(b), when determining the air pollution level by considering the amount of dust intake, the second area may be determined to have the highest amount of dust intake. However, when determining the air pollution level by considering the amount of dust intake per unit time, the air pollution level in the second area may be very good. Additionally, when determining the air pollution level by considering the amount of dust intake, the fourth area may be determined to have the lowest dust intake amount. However, when determining the air pollution level by considering the amount of dust inhaled per unit time, the air pollution level in the fourth area may be very bad. In other words, if the dust intake amount per unit time is considered rather than determining the air pollution level by considering only the dust intake amount, a more accurate air pollution level can be obtained for each area within the home.

If it is determined that the fourth area has the worst level of air pollution as a result of considering the amount of dust intake per unit time, the cleaning mobile device 10 may determine the fourth area as the area that needs to be cleaned with the highest priority. Accordingly, the cleaning mobile device 10 or the terminal device 30 that obtains the air pollution level distribution information for each area within the home provides purified air to the fourth area, or provides purified air to the fourth area or exhausts the polluted air in the fourth area. A control command may be transmitted to the air purifying device 20 in the fourth area or to a peripheral device (eg, fan, air conditioner) in the fourth area.

In various embodiments, the cleaning mobile device 10 or the terminal device 30 determines an area to perform cleaning work using the air cleaning device 20 or a peripheral device, considering the air pollution level for each area within the home, or The cleaning mobile device 10 can be used to determine the area on which cleaning work is to be performed. For example, referring to FIG. 5, in the order of poor air pollution, cleaning work or cleaning work is performed in the order of the fourth area, the third area, the fifth area, the first area, the sixth area, and the second area. It can be.

In various embodiments, the mobile cleaning device 10 may obtain the air pollution level for each area within the home in response to a trigger signal. For example, if the air pollution level sensed by the air purifying device 20 is above a critical level (e.g., fine dust level ≥ 10 μg/m ² ), the air cleaning device 20 makes a request to obtain the air pollution level in your home. A signal can be transmitted to the cleaning mobile device 10. In particular, the air cleaning device 20 may transmit a request signal to the cleaning mobile device 10 to obtain air pollution levels for areas other than the area where the air cleaning device 20 is located. there is.

The air purifying device 20 may transmit the request signal to the cleaning mobile device 10 through a home gateway, home server, or other device. In addition, the air purifying device 20 may first transmit the request signal to the terminal device 30, and if the user approves the transmission through the terminal device 30, the request signal may be transmitted to the mobile cleaning device 10. there is. Additionally, when transmitting the request signal, the air purifying device 20 may transmit location information of the air cleaning device 20 to the cleaning mobile device 10 or the terminal device 30.

Figure 6 is a diagram showing a process of installing a dust sensor in a mobile cleaning device according to an embodiment of the present disclosure.

Referring to FIG. 6, the mobile cleaning device 10 may obtain the air pollution level in the home using an external dust sensor (eg, a dust sensor provided in the charging station 601).

The cleaning mobile device 10 can obtain the air pollution level within the home while moving within the home. For example, the cleaning mobile device 10 may attempt to measure the air pollution level in the home while performing cleaning work in the second area a2 and the first area a1. In this case, the measurement sensitivity of air pollution in the home may be below a threshold value. For example, a situation may occur in which the dust intake amount in the home is less than or equal to the first threshold value or the dust intake amount in the home is more than the second threshold value, so that the measurement sensitivity of the air pollution level is less than the threshold value. For example, if it is determined that the measurement sensitivity of air pollution is below the first threshold, the cleaning mobile device 10 may move to the charging station 601 to install a dust sensor (①). The cleaning mobile device 10 moved to the charging station 601 may be equipped with a dust sensor (or a module including a dust sensor) provided in the charging station 601 (②). The mobile cleaning device 10 equipped with a dust sensor can measure the air pollution level within the home while moving within the home. At this time, the cleaning mobile device 10 can move back to the second area (a2) and the first area (a1) where the measurement sensitivity of the air pollution level is less than the threshold value and measure the air pollution level for each area again.

7 and 8 are diagrams in which a terminal device according to various embodiments of the present disclosure displays air pollution information through augmented reality images.

In FIG. 7 , the terminal device 30 can display guide information for controlling the air purifying device 20 through an augmented reality image.

In (a) of FIG. 7, the terminal device 30 can obtain air pollution information for each area within the home acquired while the mobile cleaning device 10 moves. Additionally, the terminal device 30 can acquire real-time images of at least one area within the home. Based on the acquired air pollution information and the real-time image, the terminal device 30 may further include displaying an augmented reality image synthesized so that the air pollution information overlaps the real-time image. In (a) of FIG. 7, air pollution information for each area (a2, a5) in the home and the air purifying device 20-5 included in the real-time image may be displayed. At this time, based on the location of the air purifying device 20-5, a UI for receiving a user input signal may be mapped to a location corresponding to the air purifying device 20-5 in the augmented reality image.

In this case, when a user input signal for selecting the air cleaning device 20-5 is obtained, as shown in (b) of FIG. 7, the terminal device 30 provides a guide that guides the placement of the air cleaning device 20-5. Information 711 can be displayed. In (b) of FIG. 7, guide information 711 requesting to move the air cleaning device 20-5 to a specific point 711-1 may be displayed.

As another example, when a user input signal for selecting the air cleaning device 20-5 is obtained, as shown in (c) of FIG. 7, the terminal device 30 provides a guide that guides the operation of the air cleaning device 20-5. Information can be displayed. In (c) of FIG. 7, guide information 712 that guides the air volume 712-1, wind direction 712-2, and operation time 712-3 of the air cleaning device 20-5 may be displayed. . At this time, when a user input signal for selecting a UI (e.g., OK button) accepting the guide is received, the terminal device 30 issues a control command to control the operation of the air purifying device 20-5 according to the displayed guide information. can be transmitted to the air purifying device (20-5).

In various embodiments, the placement or operation of the air purifying device 20-5 capable of purifying the fifth area a5 is guided based on a user input signal for selecting the fifth area a5 with severe air pollution. Available guide information 711 and 712 may be displayed.

In various embodiments, the arrangement or operation of the air purifying device 20-5 capable of purifying the fifth area a5 is displayed along with the display of an augmented reality image according to the shooting of the fifth area a5 with severe air pollution. Guide information 711 and 712 that can guide may be displayed.

In various embodiments, the terminal device 30 may display the above-described air pollution level distribution map within the home instead of the augmented reality image. In this case, the location of at least one air purifying device 20 in your home may be displayed on the air pollution distribution map. For example, an image, icon, or text representing the air cleaning device 20 may be displayed at the location of at least one air cleaning device 20 in the home.

In this case, when a user input signal for selecting the air cleaning device 20 from the air pollution distribution map is obtained, the terminal device 30 displays guide information that can guide the placement or operation of the air cleaning device 20. You can. Alternatively, when a user input signal for selecting a specific area on the air pollution distribution map is obtained, the terminal device 30 identifies at least one air purifying device 20 capable of purifying the specific area, and identifies the identified air purifying device. Guide information that can guide the arrangement or operation of (20) can be displayed.

In FIG. 8, the terminal device 30 can display a situation in which the air pollution level changes through an augmented reality image.

In FIG. 8, the terminal device 30 can obtain the air pollution level by time obtained while the cleaning mobile device 10 moves.

For example, the terminal device 30 may obtain the air pollution level for each area within the home from the cleaning mobile device 10 at regular intervals (eg, 10 minutes).

In this case, as shown in FIGS. 7 (a) to 7 (c), the terminal device 30 may display an augmented reality image synthesized so that the air pollution level overlaps with the real-time image. At this time, the terminal device 30 may also display a timeline indicating the measurement time of the air pollution level in the home.

For example, Figure 7(a) shows the air pollution level in your home 20 minutes ago, Figure 7(b) shows the air pollution level in your home 10 minutes ago, and Figure 7(c) shows the current air pollution level in your home. It can be expressed. In this case, when the user selects a specific time on the timeline, the air pollution level in the home at that time may be displayed overlapping with the real-time image. Accordingly, it becomes possible for the user to understand the process by which the air pollution level changes in each area within the home.

Figure 9 is a flowchart showing a method of providing information by a mobile cleaning device according to an embodiment of the present disclosure.

In FIG. 9, as the cleaning mobile device 10 moves within the home, a first air pollution level in the home measured at a first time and a second air pollution level in the home measured at a second time. can be obtained (901). For example, the cleaning mobile device 10 may obtain the first air pollution level and the second air pollution level based on the amount of dust sucked by the cleaning mobile device 10 or the sensing value of the dust sensor provided in the cleaning mobile device 10. there is. In this case, the cleaning mobile device 10 may obtain the first air pollution level and the second air pollution level based on the dust intake amount per unit time of the cleaning mobile device 10.

In various embodiments, when the measurement sensitivity of the first air pollution level or the second air pollution level measured by the cleaning mobile device 10 is less than or equal to a threshold value, the cleaning mobile device 10 moves to the charging station and collects dust stored in the charging station. Sensors can be installed. And, the cleaning mobile device 10 may obtain the first and second air pollution levels based on the sensing value of the installed dust sensor.

In various embodiments, the cleaning mobile device 10 may obtain the first air pollution level and the second air pollution level for at least one excluded area within the home, excluding the area where the air cleaning device 20 is placed. You can.

In various embodiments, the mobile cleaning device 10 may obtain a first air pollution level measured in an area of the house at a first time and a first air pollution level measured in the same area as the area at a second time. .

In operation 901, when the first air pollution level and the second air pollution level are obtained, the cleaning mobile device 10 determines that the air pollution level in the home is reduced or increased based on the obtained first air pollution level and the second air pollution level. Information on changes in air pollution level can be obtained (903). For example, the air pollution level change information may include air pollution level distribution information indicating the air pollution level for each area within the home. As another example, when a map of the home is generated as the mobile cleaning device 10 moves within the home, the mobile cleaning device 10 may acquire air pollution level distribution information for each area included in the generated map.

In operation 903, when air pollution level change information is acquired, the mobile cleaning device 10 may transmit the acquired air pollution level change information to an external device that is in communication with the cleaning mobile device (905). The external device may be, for example, the air purifying device 2 or the terminal device 30.

In various embodiments, the mobile cleaning device 10 may use air pollution level change information to determine a cleaning mode for each area within the home and perform cleaning work according to the determined cleaning mode.

FIG. 10 is a flowchart showing a method for a terminal device to transmit a control command according to an embodiment of the present disclosure.

In FIG. 10, the terminal device 30 may store location information of at least one air purifying device 20 in the home (1001). The terminal device 30 may obtain and store location information of at least one air purifying device 20 in the home from the air purifying device 20, a home gateway, a home server, or a mobile cleaning device 10.

Additionally, the terminal device 30 may obtain air pollution information for each area within the home obtained while the cleaning mobile device 10 moves within the home (1003). The air pollution information for each area within the home may include at least one of the air pollution level for each area within the home or air pollution level change information for each area within the home indicating a decrease or increase in the air pollution level within the home. In addition, the air pollution information for each area within the home is the air for each area within the home obtained based on at least one of the dust intake amount per unit time of the cleaning mobile device 10 or the sensing value per unit time of the dust sensor provided in the cleaning mobile device 10. Contamination level may be included. In addition, the air pollution information for each area within the home is the air for each area within the home obtained based on at least one of the dust intake amount per unit time of the cleaning mobile device 10 or the sensing value per unit time of the dust sensor provided in the cleaning mobile device 10. Contamination level may be included. Additionally, the air pollution information for each area within the home may include the air pollution level for each area within the home measured for at least one excluded area excluding the area where the air purifying device is placed.

Based on the acquired air pollution information for each area in the home and the location information of at least one air purifying device 20 in the home, the terminal device 30 at least supplies purified air to a polluted area among the areas in the home. A control command for controlling the operation of one air purifying device may be obtained (1005). At this time, the control command may be a control command that controls at least one of wind direction, wind volume, wind speed, or operation time of at least one air cleaning device.

In various embodiments, the terminal device 30 may identify the air cleaning device 20 located in a contaminated area based on the location information of the air cleaning device 20. The terminal device 30 may obtain a control command to control the operation of the identified air purifying device 20. For example, the terminal device 30 may generate and obtain a control command for controlling the operation of the air purifying device 20, or may obtain the control command by searching a pre-stored matching table for a control command corresponding to the user's request signal.

Alternatively, the terminal device 30 identifies at least one area in the home with air pollution level above a certain value and sends a control command to control the operation of at least one air purifying device 20 located in the identified at least one area. It can be obtained.

Alternatively, if a plurality of air purifying devices 20 exist in the home, the terminal device 30 may provide a plurality of air purifying devices capable of purifying the contaminated area based on the location information of the plurality of air purifying devices 20. Devices 20 can be identified. The terminal device 30 may obtain a control command to control the operations of the identified plurality of air purifying devices 20.

In various embodiments, the terminal device 30 guides the placement or operation of at least one air purifying device based on the acquired air pollution information for each area in the home and the location information of at least one air cleaning device in the home. Guide information can be displayed. In this case, when a user's request signal for controlling the operation of at least one air purifying device 20 is obtained based on the displayed guide information, the terminal device 30 detects contamination among areas within the home based on the request signal. A control command may be obtained to control the operation of at least one air purifying device 20 so that purified air is supplied to the designated area.

In various embodiments, the terminal device 30 may acquire real-time images of at least one area within the home. Based on the air pollution information and the acquired real-time image, the terminal device 30 may display an augmented reality image synthesized so that the air pollution information of the at least one area overlaps the real-time image. At this time, guide information guiding the placement or operation of at least one air purifying device may be displayed on the augmented reality image. In this case, when a user's request signal for controlling the operation of at least one air purifying device 20 is obtained based on the displayed guide information, the terminal device 30 detects contamination among areas within the home based on the request signal. A control command may be obtained to control the operation of at least one air purifying device 20 so that purified air is supplied to the selected area.

When a control command for controlling the operation of the air cleaning device 20 is obtained, the terminal device 30 may transmit the obtained control command to at least one air cleaning device 20 (1007). At least one air purifying device 20 may operate based on the received control command. For example, at least one of wind direction, wind volume, wind speed, or operating time of at least one air cleaning device 20 may be controlled.

In various embodiments, the cleaning mobile device 10 may determine whether the current location of the terminal device 30 is within the home based on the location information of the terminal device 30. If it is determined that the location of the terminal device 30 is not inside the home, the cleaning mobile device 10 transmits air pollution information for each area within the home to other terminal devices (e.g., the display device 40 in FIG. 1A, a digital TV in the living room, etc.) ) can be provided to. In this case, the other terminal device provides guide information that guides the placement or operation of at least one air purifying device 20, based on the acquired air pollution information for each area in the home and the location information of at least one air cleaning device 20 in the home. can be displayed. At this time, the location information of at least one air cleaning device 20 may be pre-stored in another terminal device, or may be received from the mobile cleaning device 10 along with air pollution information for each area within the home. Another terminal device may display guide information on the display of the other terminal device. For example, another terminal device may display guide information while operating in ambient mode. Alternatively, when a user is watching content provided by another terminal device, the other terminal device may display guide information in the form of a pop-up or notification message.

In various embodiments, when the home gateway receives air pollution information for each area in the home that is requested to be transmitted from the cleaning mobile device 10 to the terminal device 30, the home gateway determines the current location of the terminal device 30. You can judge whether it is mine or not. If it is determined that the location of the terminal device 30 is within the home, the home gateway may transmit air pollution information for each area within the home to the terminal device 30. On the other hand, if it is determined that the location of the terminal device 30 is not inside the home, the home gateway transmits air pollution information for each area within the home to other terminal devices (e.g., the display device 40 in FIG. 1A, a digital TV in the living room, etc.) can be provided to. Another terminal device that has received the air pollution information may display the guide information on the display of the other terminal device.

In various embodiments, location information of at least one air purifying device 20 may be stored in a home gateway. In this case, when the terminal device 30 or another terminal device (e.g., the display device 40 in FIG. 1A) requests, the home gateway provides location information of at least one air purifier 20 stored in the home gateway. It can be provided to the terminal device 30 or another terminal device. The terminal device 30 or another terminal device operates at least one device to supply purified air to a polluted area among areas within the home based on air pollution information for each area within the home and location information of at least one air purifying device within the home. A control command that controls the operation of the air purifying device can be obtained. Additionally, the terminal device 30 or another terminal device may transmit the obtained control command to the at least one air purifying device. Alternatively, the terminal device 30 or another terminal device places at least one air purifying device 20 based on air pollution information for each area within the home and location information of at least one air cleaning device 20 within the home. Guide information to guide operations can be displayed.

As used in this document, the term “module” or “unit” may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. can be used A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium that can be read by a machine (e.g., a cleaning mobile device 10, an air purifying device 20, a terminal device 30, etc.). It may be implemented as software (or program) including these. For example, the device (e.g., cleaning mobile device 10, air purifying device 20, terminal device 30, etc.) calls at least one command among one or more commands stored from a storage medium and executes it. You can. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments of this document may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be stored on a storage medium (e.g., compact disc read only memory (CD)) that can be read by a computer (e.g., personal computer, server, cleaning mobile device (10), air purifier device (20), terminal device (30), etc.) -ROM), or distributed online (e.g. downloaded or uploaded) via an application store (e.g. Play StoreTM) or directly between two user devices (e.g. smartphones). there is. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single entity or a plurality of entities. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

10: Cleaning moving device 20: Air purifying device
30: terminal device

Claims (20)

In a method of transmitting control commands of a terminal device,
storing location information of at least one air purifying device within the home;
Obtaining air pollution information for each area within the home obtained while the mobile cleaning device moves within the home from the mobile cleaning device;
Based on the obtained air pollution information for each area within the home and the location information of the at least one air purifying device within the home, the at least one air purifying device so that purified air is supplied to a polluted area among the areas within the home. Obtaining a control command to control the operation of;
transmitting the obtained control command to the at least one air purifying device;
Obtaining a real-time image of at least one area in the home including the at least one air purifying device through a camera of the terminal device;
Displaying a synthesized augmented reality (AR) image such that air pollution information for each area within the home is superimposed on the real-time image including the at least one air purifying device; and
In response to a user input signal for selecting the at least one air purifying device in the augmented reality image, based on the obtained air pollution information for each area in the home and location information of the at least one air cleaning device in the home, Including an operation of displaying guide information suggesting movement of the air purifying device on the augmented reality image,
How to transmit control commands.
In paragraph 1:
Based on the obtained air pollution information for each area in the home and the location information of the at least one air cleaning device in the home, further comprising displaying guide information for guiding the operation of the at least one air cleaning device,
How to transmit control commands.
In paragraph 2,
Based on the displayed guide information, further comprising obtaining a user request signal for controlling the operation of the at least one air purifying device,
The operation of obtaining the control command is,
Based on the request signal, obtaining a control command to control the operation of the at least one air purifying device to supply purified air to a polluted area among the areas in the home,
How to transmit control commands.
In paragraph 2,
The above guide information is:
Containing at least one of air pollution information for each area within the home, graphics indicating the location of at least one air purifying device within the home, or at least one UI for controlling the at least one air cleaning device,
How to transmit control commands.
delete In paragraph 1:
Air pollution information for each area within your home is
Containing at least one of the air pollution level for each area within the home, or the air pollution level change information for each area within the home indicating a decrease or increase in the air pollution level within the home,
How to transmit control commands.
In paragraph 1:
The control command for controlling the operation of the at least one air purifying device is:
Controlling at least one of wind direction, wind volume, wind speed, or operating time of the at least one air cleaning device,
How to transmit control commands.
In paragraph 1:
Air pollution information for each area within your home is:
Containing the air pollution level for each area in the house obtained based on at least one of the amount of dust sucked by the cleaning mobile device or the sensing value of the dust sensor provided in the cleaning mobile device,
How to transmit control commands.
According to paragraph 1,
Air pollution information for each area within your home is:
Containing the air pollution level for each area in the house obtained based on at least one of the dust intake amount per unit time of the cleaning mobile device or the sensing value per unit time of the dust sensor provided in the cleaning mobile device,
How to transmit control commands.
According to paragraph 1,
Air pollution information for each area within your home is:
Containing air pollution levels for each area within the home measured for at least one excluded area excluding the area where the air purifying device is placed within the home,
How to transmit control commands.
In the terminal device,
A communication unit capable of communicating with external devices;
At least one processor electrically connected to the communication unit and the display unit; and
A memory electrically connected to the at least one processor and storing location information of at least one air purifying device in the home,
When the processor executes, the memory
Obtain from the mobile cleaning device air pollution information for each area within the home obtained while the mobile cleaning device moves within the home,
Based on the obtained air pollution information for each area within the home and the location information of the at least one air purifying device within the home, the at least one air purifying device so that purified air is supplied to a polluted area among the areas within the home. Obtain control commands to control the operation of
Controlling the communication unit to transmit the obtained control command to the at least one air purifying device,
Obtain real-time images of at least one area in the home including the at least one air purifying device through the camera of the terminal device,
Displaying a synthesized augmented reality (AR) image such that air pollution information for each area within the home is superimposed on the real-time image including the at least one air purifying device,
In response to a user input signal for selecting the at least one air purifying device in the augmented reality image, based on the obtained air pollution information for each area in the home and location information of the at least one air cleaning device in the home, Storing at least one command set to control the display unit to display guide information suggesting movement of the air purifying device on the augmented reality image,
terminal device.
In paragraph 11:
When the processor executes, the memory
Based on the obtained air pollution information for each area in the home and the location information of at least one air cleaning device in the home, the display unit is set to control the display unit to display guide information guiding the operation of the at least one air cleaning device. storing at least one instruction,
terminal device.
In paragraph 12:
When the processor executes, the memory
Based on the displayed guide information, obtain a user's request signal for controlling the operation of the at least one air purifying device,
Based on the request signal, storing at least one command set to obtain a control command for controlling the operation of the at least one air purifying device so that purified air is supplied to a polluted area among the areas in the home,
terminal device.
In paragraph 12:
The above guide information is:
Containing at least one of air pollution information for each area within the home, graphics indicating the location of at least one air purifying device within the home, or at least one UI for controlling the at least one air cleaning device,
terminal device.
delete In paragraph 11:
Air pollution information for each area within your home is
Containing at least one of the air pollution level for each area within the home, or the air pollution level change information for each area within the home indicating a decrease or increase in the air pollution level within the home,
terminal device.
In paragraph 11:
The control command for controlling the operation of the at least one air purifying device is:
Containing a control command for controlling at least one of wind direction, wind volume, wind speed, or operation time of the at least one air cleaning device,
terminal device.
In paragraph 11:
Air pollution information for each area within your home is:
Containing the air pollution level for each area in the house obtained based on at least one of the amount of dust sucked by the cleaning mobile device or the sensing value of the dust sensor provided in the cleaning mobile device,
terminal device.
According to clause 11,
Air pollution information for each area within your home is:
Containing the air pollution level for each area in the house obtained based on at least one of the dust intake amount per unit time of the cleaning mobile device or the sensing value per unit time of the dust sensor provided in the cleaning mobile device,
terminal device.
Controlling the cleaning mobile device to acquire air pollution information for each area within the home obtained while the cleaning mobile device moves within the home, from the cleaning mobile device,
Based on the obtained air pollution information for each area within the home and the location information of the at least one air purifying device within the home, the at least one air purifying device so that purified air is supplied to a polluted area among the areas within the home. Control to obtain control commands that control the operation of,
Control to transmit the obtained control command to the at least one air purifying device,
Control to acquire real-time images of at least one area in the house including the at least one air purifying device through the camera of the terminal device,
Controlling to display a synthesized augmented reality (AR) image such that air pollution information for each area within the home is superimposed on the real-time image including the at least one air purifying device,
In response to a user input signal for selecting the at least one air purifying device in the augmented reality image, based on the obtained air pollution information for each area in the home and location information of the at least one air cleaning device in the home, A computer-readable storage medium comprising at least one command for controlling the display of guide information suggesting movement of an air purifying device on the augmented reality image.

Images