KR20210099787A - Electronic device providing safety service and method thereof - Google Patents

Abstract

An electronic device may include a driving device, at least one sensor, a wireless communication circuit, and a processor. The processor receives state information of a risk element using a wireless communication circuit, determines whether the risk element is in a dangerous state based on the state information of the risk element, uses a driving device to move the electronic device to an area where the risk element is placed when the risk element is in a dangerous state, uses at least one sensor to detect the approach of a person to the area where the risk element is placed, obtains height information of the person, and decide whether to provide or not a warning based on the height information of the person. In addition to this, various embodiments identified through the specification are possible.

Description

ELECTRONIC DEVICE PROVIDING SAFETY SERVICE AND METHOD THEREOF

Embodiments disclosed in this document relate to an electronic device and method for providing a safety service.

The recent smart home environment continues to increase with the spread of IoT (Internet of Things) home appliances based on intelligent wireless sensor networks. With the development of IoT technology, consumers have a variety of IoT appliances in their homes.

The service based on the smart home environment has been extended to the prevention of safety accidents. The smart home environment provides a service that can prevent safety accidents by using the interaction of IoT home appliances in the home that includes various sensors and parts such as cameras and can perform various functions.

In the conventional smart home environment, risk factors in the home have been monitored by using a camera and a sensor attached to a fixed location to prevent safety accidents. Accordingly, it is required to install additional cameras and/or sensors at a location capable of monitoring the area where the hazard is disposed. In addition, since the monitoring of the relevant area involves acquiring and analyzing images of the residents and the living environment in the home, there was a problem of protecting the privacy of the residents.

An electronic device according to an embodiment disclosed in this document includes a driving device, at least one sensor, a wireless communication circuit, and a processor, wherein the processor receives state information of a risk element using the wireless communication circuit, and , when the risk element is in a dangerous state based on the state information of the risk element, the electronic device is moved to an area in which the risk element is disposed using the driving device, and the risk element is moved using the at least one sensor After detecting a person's approach to the area where the element is disposed, it may be configured to acquire height information of the person, and determine whether to provide a warning based on the height information of the person.

In addition, the electronic device according to an embodiment disclosed in this document includes a communication circuit, a memory, and a processor, wherein the processor receives the state information of the risk element using the communication circuit, and It is determined whether the dangerous element is in a dangerous state based on the state information, and when the dangerous element is in a dangerous state, a control signal for moving a first external electronic device to an area in which the dangerous element is disposed is transmitted using the communication circuit. The first external electronic device transmits to the first external electronic device, and the first external electronic device moves from the first external electronic device to the region where the risk element is disposed and accesses the area where the risk element is disposed using the communication circuit It may be configured to receive data about a person who does, obtain height information of the person based on the data, and determine whether to provide an alert based on the person's height information.

In addition, in a computer-readable recording medium storing one or more instructions executable by at least one processor according to an embodiment disclosed in this document, the one or more instructions may include state information of a risk element using a wireless communication circuit. the operation of receiving the information, the operation of determining whether the dangerous element is in a dangerous state based on the state information of the dangerous element, and when the dangerous element is in the dangerous state, using a driving device to move the electronic device to the area in which the dangerous element is disposed The operation of moving, the operation of detecting a person's approach to the area where the risk element is disposed using at least one sensor, the operation of acquiring the person's height information, and whether to provide a warning based on the person's height information It may include an action to determine.

According to the embodiments disclosed in this document, it is possible to prevent a safety accident by moving an electronic device including a driving unit to an area in which a risk element is disposed in a smart home environment. By utilizing the mobility of the electronic device, safety accidents can be prevented without installing additional cameras and/or sensors in the smart home environment.

By arranging the camera to face the ceiling, the electronic device can provide strong privacy protection.

Inconvenience due to unnecessary warning can be prevented by identifying a person using a camera and providing a warning method differently depending on the person.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments.
2 is a diagram illustrating that the IoT cloud acquires state information of a risk element and transmits it to an electronic device.
3 is a diagram illustrating that the robot cleaner moves to an area where the hazardous element is disposed.
4 is a diagram illustrating that the robot cleaner performs an operation for preventing a safety accident.
5 is a diagram illustrating a method for the robot cleaner to obtain height information of a person.
6A to 6E are views illustrating a UI for setting a kids safety mode and a screen of a mobile terminal on which the UI is displayed.
7 is a flowchart of an in-home safety accident prevention service provided by a robot cleaner.
8 is a block diagram illustrating the configuration of an IoT cloud.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments of the present invention are included.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments of the present disclosure.

Referring to FIG. 1 , in a network environment 100 , an electronic device 101 may communicate with an electronic device 104 or a server 108 through a second network 199 (eg, a remote wireless communication network). For example, the electronic device 101 may be an IoT home appliance (eg, a robot cleaner) that can be driven by the driving unit 140 . According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , a driver 140 , an input device 150 , a sound output device 155 , a display device 160 , and an audio module 170 . , a sensor module 176 , an interface 177 , a camera module 180 , a battery 189 , or a communication module 190 . In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120 may, for example, execute software (eg, a program) to control at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . and can perform various data processing or operations. According to one embodiment, as at least part of data processing or computation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the non-volatile memory 134 . According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphic processing unit, an image signal processor) that can be operated independently or together with the main processor 121 . , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190 ). there is.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . Data may include, for example, input data or output data for software (eg, a program) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The driving unit 140 may move the electronic device 101 . For example, the driving unit 140 may include at least one driving wheel for moving the electronic device 101 . The driving unit 140 may include a driving motor connected to the driving wheel to rotate the driving wheel. The driving wheel may include left and right wheels respectively provided on the left and right sides of the main body of the robot cleaning device. The left wheel and the right wheel may be driven by one driving motor, but if necessary, a left wheel driving motor for driving the left wheel and a right wheel driving motor for driving the right wheel may be provided, respectively. In this case, the driving direction of the electronic device 101 may be switched to the left or right by making a difference between the rotation speeds of the left and right wheels. As another example, the electronic device 101 may include a spherical housing. The driving unit 140 may include a driving motor connected to the housing of the electronic device 101 to rotate the housing. The driving unit 140 may move the electronic device 101 by rotating the housing using a driving motor. The driving method of the driving unit 140 is exemplary and is not limited by the embodiment of this document, but the embodiment of the present document may be understood as an embodiment of the electronic device 101 driven by the driving wheel. .

The input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 .

The sound output device 155 may output a sound signal to the outside of the electronic device 101 . The sound output device 155 may include, for example, a speaker or a receiver.

The display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 160 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. there is.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The electronic device 102) (eg, a speaker or headphones) may output a sound.

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 establishes a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 104 or the server 108), and establishes communication It can support performing communication through a channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : LAN (local area network) communication module, or a power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct or IrDA (infrared data association)) or a second network 199 (eg, a cellular network, the Internet, Alternatively, it may communicate with the external electronic device 104 through a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C” and “A, Each of the phrases "at least one of B, or C" may include any one of, or all possible combinations of, items listed together in the corresponding one of the phrases. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. that one (e.g. first) component is "coupled" or "connected" to another (e.g. second) component with or without the terms "functionally" or "communicatively" When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

2 is a diagram illustrating that the IoT cloud acquires state information of a risk element and transmits it to an electronic device.

According to an embodiment, the IoT cloud 250 (eg, the server 108 of FIG. 1 ) may send and receive data to and from IoT appliances in the home. For example, an IoT home appliance in the home may include a wireless communication circuit and may communicate with the IoT cloud 250 with unique identifiers (UIDs). A plurality of IoT appliances may exist in a home. In a smart home environment, the IoT cloud 250 receives status information of the risk factor 240 from an IoT home appliance in order to prevent safety accidents in the home, and transmits the received status information to an electronic device (eg, the electronic device of FIG. 1 ). (101)). For example, the electronic device 101 that provides the safety accident prevention service may include the robot cleaner 200 . The types of the electronic device 101 are exemplary and are not limited by the embodiments herein.

According to one embodiment, the risk element 240 may include a smart appliance 210 , a legacy appliance 220 , and/or a structure 230 in the home.

The smart home appliance 210 is a type of IoT home appliance and may include a heating device such as an induction and oven including a wireless communication circuit. The smart home appliance 210 and the IoT home appliance in the home may be associated with the same user account. The smart home appliance 210 and the IoT home appliance in the home may communicate with the IoT cloud based on the same user account. The smart home appliance 210 may communicate with the IoT cloud 250 with unique identifiers (UIDs). The state of the smart home appliance 210 may be sensed by the smart home appliance 210 or other IoT appliances in the home. For example, the smart home appliance 210 may detect its own state, acquire state information, and transmit the acquired state information to the IoT cloud 250 using a wireless communication circuit. As another example, other IoT appliances in the home may detect the state of the smart appliance 210 , acquire state information, and transmit the acquired state information to the IoT cloud 250 using a wireless communication circuit. The state information may include a determination as to whether the smart home appliance 210 is in a dangerous state. For example, the smart home appliance 210 and/or other IoT home appliances in the home determines the smart home appliance 210 as a dangerous state when the smart home appliance 210 (eg, induction) is operating, and includes the determination information. The state information may be transmitted to the IoT cloud 250 . For another example, the smart home appliance 210 and/or other IoT home appliances in the home transmits the state information of the smart home appliance 210 to the IoT cloud 250 when the smart home appliance 210 (eg, induction) is operating. and whether the smart home appliance 210 is in a dangerous state may be determined by the IoT cloud 250 and/or the electronic device 101 receiving state information from the IoT cloud 250 . The determination method for the type and risk state of the smart home appliance 210 is exemplary, and is not limited by the embodiments herein.

The legacy home appliance 220 is not an IoT home appliance, and may be a home appliance that does not include a wireless communication circuit or cannot communicate directly with the IoT cloud 250 . For example, the legacy home appliance 220 may include an electric kettle, a heating device such as a stove, or a fan. The legacy home appliance 220 may be operated by a user's manipulation when power is supplied. For example, the legacy home appliance 220 may be turned on/off by a user's manipulation while being connected to an electric plug and receiving power. The legacy home appliance 220 may be connected to a smart plug (eg, an IoT home appliance in the home) to receive power. The state of the legacy appliance 220 may be detected by an IoT appliance in the home. For example, an IoT home appliance in the home may include at least one sensor (eg, a thermal sensor, a motion sensor, an infrared sensor, an EM sensor), and the state of the legacy home appliance 220 using at least one sensor can detect For example, the legacy home appliance 220 may generate an electromagnetic (EM) signal. The IoT home appliance in the home may include an EM sensor, and the EM sensor may include an antenna module for receiving an EM signal. When the IoT home appliance in the home comes into contact with the legacy appliance 220 or approaches within a certain distance from the legacy appliance 220, the IoT appliance in the home receives the EM signal generated from the legacy appliance 220 and state can be detected. The IoT home appliance in the home may acquire state information of the legacy appliance 220 and transmit the acquired state information to the IoT cloud 250 using a wireless communication circuit. As another example, when the legacy home appliance 220 is connected to the smart plug and used, the smart plug obtains state information related to the state of power supply to the legacy home appliance 220 and uses the obtained state information using a wireless communication circuit. to the IoT cloud 250 . The state information may include a determination as to whether the legacy appliance 220 is in a dangerous state. For example, when another IoT home appliance in the home detects that the legacy home appliance 220 (eg, a fan) is in operation, it determines the legacy home appliance 220 as a dangerous state, and transmits state information including the determination information to the IoT cloud. (250). As another example, when the legacy home appliance 220 is connected to the smart plug and in use, the smart plug detects the amount of power supplied to the legacy home appliance 220, and when the amount of power supplied is greater than or equal to a threshold, the legacy home appliance 220 can be judged as dangerous. The smart plug may transmit state information including determination information to the IoT cloud 250 . The method for determining the type and dangerous state of the legacy home appliance 220 is exemplary and is not limited by the embodiment of the present document.

The structure 230 in the home is a physical structure in the home and may be described as a structure that may cause a safety accident. For example, the structure 230 in the home may include an openable and openable structure (eg, a door, a window). A door or window may be opened by the occupant. The state of the structure 230 in the home may be sensed by an IoT appliance in the home. For example, the IoT home appliance in the home may include at least one sensor (eg, a heat sensor, a motion sensor, an infrared sensor), and detect the state of the structure 230 in the home using the at least one sensor. can do. For example, an IoT home appliance in the home may detect an open/closed state of a door or window. The in-home IoT home appliance may acquire state information of the in-home structure 230 and transmit the acquired state information to the IoT cloud 250 using a wireless communication circuit. The state information may include a determination as to whether the structure 230 in the home is in a dangerous state. For example, when the IoT home appliance detects that a door or window is open, the home building 230 may be determined as a dangerous state, and state information including the determination information may be transmitted to the IoT cloud 250 . . The method for determining the type and risk state of the building 230 in the home is exemplary and is not limited by the embodiment of this document.

According to an embodiment, the IoT cloud 250 may transmit the state information to the electronic device 101 after receiving the state information of the risk element 240 . For example, before transmitting the state information, the IoT cloud 250 may determine whether the risk element 240 is in a dangerous state based on the state information. For another example, after receiving the state information, the electronic device 101 may determine whether the risk factor 240 is in a dangerous state based on the state information. As another example, the electronic device 101 may directly detect the state of the risk element 240 to obtain the state information without receiving the state information of the risk element 240 from the IoT cloud 250 . When the risk factor 240 is in a dangerous state, the electronic device 101 (eg, the robot cleaner 200) may perform an operation for preventing a safety accident in the home.

3 is a diagram illustrating that the robot cleaner moves to an area where the hazardous element is disposed.

A method by which the robot cleaner 200 (eg, the electronic device 101 of FIG. 1 ) acquires state information of the dangerous element 240 may be referred to by the description of FIG. 2 .

According to an embodiment, the oven 300 (eg, the hazard element 240 of FIG. 2 ) may be disposed in the home. The IoT cloud 250 may receive status information of the oven 300 from an IoT home appliance in the home. For example, when the oven 300 is a smart home appliance (eg, the smart home appliance 210 of FIG. 2 ), the oven 300 detects its own state and obtains state information, and then transmits the obtained state information wirelessly. It can be transmitted to the IoT cloud 250 using a communication circuit. As another example, if the oven 300 is a legacy home appliance (eg, the legacy home appliance 220 in FIG. 2 ), other IoT appliances in the home use a sensor (eg, a heat sensor, a motion sensor, an infrared sensor) to After detecting the state of the oven 300 and obtaining state information, the obtained state information may be transmitted to the IoT cloud 250 using a wireless communication circuit. The state information may include operation information of the risk element 240 , information on whether the risk element 240 is in a dangerous state, and/or location information of an area in which the risk element 240 is disposed. The type of information included in the status information is exemplary and is not limited by the embodiment of this document.

After receiving the state information of the oven 300 , the IoT cloud 250 may transmit the state information to the robot cleaner 200 (eg, the electronic device 101 of FIG. 1 ). For example, the processor (eg, the processor 120 of FIG. 1 ) of the robot cleaner 200 transmits state information of the oven 300 using a wireless communication module (eg, the wireless communication module 194 of FIG. 1 ). can be delivered. As another example, the processor 120 may directly acquire state information after detecting the state of the oven 300 using a sensor module (eg, the sensor module 176 of FIG. 1 ).

According to an embodiment, the processor 120 may determine whether the oven 300 is in a dangerous state based on the state information. According to another embodiment, the determination of whether the oven 300 is in a dangerous state is performed by the IoT cloud 250 and the processor 120 may receive it. For example, when the oven 300 is operating based on the state information, the processor 120 may determine that the oven 300 is in a dangerous state.

According to an embodiment, when the processor 120 determines that the oven 300 is in a dangerous state, the processor 120 may cause the robot cleaner 200 to perform an operation to prevent a safety accident. According to another embodiment, when the IoT cloud 250 determines that the oven 300 is in a dangerous state, the IoT cloud 250 includes information including that the oven 300 is in a dangerous state and the robot cleaner 200 is safe. A control command to perform an operation for preventing an accident (eg, executing a kids safety mode) may be transmitted to the robot cleaner 200 . The processor 120 may receive a control command from the IoT cloud 250 and cause the robot cleaner 200 to perform an operation to prevent a safety accident.

The processor 120 may acquire area information in which the risk element 240 is disposed based on the state information. The processor 120 may use a driving unit (eg, the driving unit 140 of FIG. 1 ) to move the robot cleaner 200 to the area where the dangerous element 240 is disposed. The robot cleaner 200 may perform an operation for preventing a safety accident in the area where the dangerous element 240 is disposed.

4 is a diagram illustrating that the robot cleaner performs an operation for preventing a safety accident.

Descriptions of the same reference numbers as those of FIG. 4 may be referred to by the descriptions of FIGS. 1 to 3 . When it is determined that the dangerous element 240 (eg, the oven 300 of FIG. 3 ) is in a dangerous state, the robot cleaner 300 may perform an operation according to FIG. 4 .

According to one embodiment, the processor 120 uses the sensor module 176 of the robot cleaner 200 (eg, a motion detection sensor, a heat sensor, a distance measurement sensor) in the area where the risk element 240 is disposed. human approach can be detected. According to another embodiment, when a person is already located in the area where the risk element 240 is disposed, the processor 120 detects a person located in the area where the risk element 240 is disposed using the sensor module 176 . can do.

When detecting a person's approach to the area where the risk factor 240 is disposed or a person located in the area where the risk factor 240 is disposed, the processor 120 uses the sensor module 176 to collect the person's height information. can be obtained The processor 120 may determine whether to provide a warning based on the person's height information. A method for the processor 120 to obtain height information of a person may be specifically described with reference to FIG. 5 .

Referring to FIG. 5 , FIG. 5 illustrates a method for the robot cleaner to obtain height information of a person.

According to an embodiment, the robot cleaner 200 may include a sensor module (eg, the sensor module 176 of FIG. 1 ) and a camera (eg, the camera module 180 of FIG. 1 ). The sensor module 176 may detect an environmental state (eg, a user state) and generate an electrical signal or data value corresponding to the sensed state. The sensor module 176 may include a motion detection sensor, a thermal sensor, and/or a distance measurement sensor. The camera 180 may capture still images and moving images. The processor 120 of the robot cleaner 200 may detect a person approaching the area where the risk element 240 is disposed using the sensor module 176, and a distance measuring sensor ( (not shown) and the camera 180 may be used.

The processor 120 may measure a distance from the robot cleaner 200 to a person by using a distance measuring sensor. For example, when the child 500 approaches the area in which the risk element 240 is disposed, the processor 120 uses a distance measuring sensor to determine the first distance from the robot cleaner 200 to the child 500 . A distance 504 may be measured. For example, when the adult 510 approaches the area in which the risk element 240 is disposed, the processor 120 uses a distance measuring sensor to control the second, which is the distance from the robot cleaner 200 to the adult 510 . A distance 514 may be measured.

The camera 180 may be disposed on a surface facing the ceiling direction of the robot cleaner 200 . The ceiling direction may be referred to as a direction toward the ceiling among directions orthogonal to a plane in which the robot cleaner 200 is driven by a driving unit (eg, the driving unit 140 of FIG. 1 ). Since the camera 180 is disposed on the surface facing the ceiling of the robot cleaner 200 , the processor 120 may acquire height information of the resident without directly capturing a still image or video of the resident and the living environment. When a part of a human body is photographed within the area of the maximum angle of view of the camera 180 , the processor 120 may calculate a minimum angle of view up to the part of the human body based on the direction axis 530 toward which the camera 180 is directed. For example, when the child 500 approaches the area where the risk factor 240 is disposed, a body part (eg, head) of the child 500 may be photographed within the maximum field of view area of the camera 180 . . The processor 120 may measure the angle of view θ1 505 from the direction axis 530 toward which the camera is directed to the body part (eg, head) of the child 500 . For example, when the adult 510 approaches the area in which the risk element 240 is disposed, a body part (eg, head) of the adult 510 may be photographed within the maximum field of view area of the camera 180 . . The processor 120 may measure θ2 515 , which is an angle of view from a direction axis 530 toward which the camera faces to a body part (eg, a head) of the adult 510 .

The processor 120 may acquire height information of the person using the distance measured using the distance measuring sensor and the angle of view measured using the camera 180 . The height information of the person is calculated by the processor 120 , and an error may occur in the height information of the person due to an error occurring when the distance measurement sensor measures the distance and the angle of view using the camera 180 . For example, the processor 120 may obtain information on the height of a person using a trigonometric function as shown in Equation (1). In Equation 1, the height information of a person may be described by Equation 1 as a trigonometric formula for obtaining height information of a person.

[Equation 1]

For example, when the child 500 approaches the area where the risk factor 240 is disposed, the processor 120 divides the first distance 504 by tan(θ1(505)) to determine the height of the person. can be obtained with For example, when the adult 510 approaches the area where the risk factor 240 is disposed, the processor 120 divides the second distance 514 by tan(θ2(515)) to determine the height of the person. can be obtained with

The processor 120 may identify an approaching person using height information of the person obtained using the distance measuring sensor and the camera 180 . According to an embodiment, when the height of the approaching person is less than the threshold value, the processor 120 may determine the approaching person as the child 500 . When the calculated height of the person is equal to or greater than the threshold value, the processor 120 may determine that the person approaching is an adult 510 . According to another embodiment, the user may pre-register height information of a plurality of people (eg, residents) in the server. The processor 120 obtains height information for residents from a server (eg, server 108 of FIG. 1 ) using a wireless communication circuit (eg, 190 ), and height information and risk factors 240 for residents ) can be identified by comparing the height information about the person accessing the area where the arrangement is placed. When the height information of the person approaching matches the height information of the residents or is included within a preset determination range, the processor 120 specifies a person accessing the area in which the risk factor 240 is disposed as one of the residents. can do. Since an error may be included in the height information of the person, the processor 120 may identify the person after adjusting the height information of the person by reflecting a preset error range in the height information of the person.

Referring back to FIG. 4 , the processor 120 may change whether to provide a warning and/or a method to provide a warning according to who is accessing the information. Whether the processor 120 provides a warning and/or a warning providing method may be determined by a user's setting for the robot cleaner 200 or may be determined by data received by the processor 120 from the server 108 .

According to an embodiment, the processor 120 may determine whether to provide a warning based on the height information obtained as described with reference to FIG. 5 . For example, if the processor 120 identifies a person approaching the area where the hazard 240 is disposed as the adult 510 , the processor 120 does not provide a warning about the safety accident to the adult 510 . may not be When the processor 120 identifies a person approaching the area in which the risk element 240 is disposed as the child 500 , the processor 120 may provide a warning about the safety accident to the child 500 . A description of whether to provide a warning is exemplary, and embodiments of the present document are not limited thereto.

According to one embodiment, the processor 120 may directly provide a warning to a person approaching the area where the hazard 240 is disposed. The processor 120 may provide an auditory warning to the approaching person using a speaker (eg, the sound output device 155 of FIG. 1 ) of the robot cleaner 200 . For example, the processor 120 may provide a warning voice 400 to a person using a speaker. The warning voice 400 may include, for example, information indicating the state of the risk element, such as 'This is dangerous due to induction/oven operation.' The warning sound 400 may be a simple warning sound that does not include semantic information. The type and content of the warning voice 400 are exemplary, and the embodiment of the present document is not limited thereto.

The processor 120 may control the operation of the risk element 240 when a person's approach to the area in which the risk element 240 is disposed is detected. For example, the robot cleaner 200 may include a remote control (not shown). When the oven 300 is the legacy home appliance 220 , the oven 300 may include a remote control receiving circuit. The processor 120 may emit a signal for controlling (eg, turning off) the operation of the oven 300 using the remote control of the robot cleaner 200 . The oven 300 may be turned off by receiving a signal from the robot cleaner 200 through the remote control receiving circuit. As another example, when the oven 300 is the smart home appliance 210 , the processor 120 uses the wireless communication module 190 to control the operation of the oven 300 (eg, turn-off). )) to transmit control commands. The oven 300 may be turned off by receiving a control command. As another example, when the oven 300 is the smart home appliance 210 , the processor 120 transmits information on a method of providing a warning to the IoT cloud 250 using the wireless communication module 190 , and the IoT The cloud 250 may generate a control command for controlling (eg, turning off) the operation of the oven 300 based on the warning providing method. The oven 300 may be turned off by receiving a control command from the IoT cloud 250 . The control command may be generated by the processor 120 of the robot cleaner 200 and transmitted to the IoT cloud 250 .

The processor 120 may provide a warning to the external electronic device. The processor 120 may transmit information on a method of providing an alert to the IoT cloud 250 using the wireless communication module 190 . The IoT cloud 250 may transmit a control command for providing a warning to an external electronic device based on the information on the warning providing method. For example, when the person approaching is the child 500 , the IoT cloud 250 may transmit a control command warning of the risk of a safety accident to the parent's mobile terminal 410 (eg, an external electronic device). After receiving the control command, the mobile terminal 410 may provide a warning to the parent through the display according to the control command, and transmit a command to control the oven 300 to the IoT cloud 250 in response to the parent's manipulation. can As another example, the IoT cloud 250 may transmit a control command for warning of a risk of a safety accident to the speaker 420 (eg, an external electronic device) disposed in the home. After receiving the control command, the speaker 420 may provide an auditory warning to a person approaching the area where the dangerous element 240 is disposed according to the control command.

6A to 6E are views illustrating a UI for setting a kids safety mode and a screen of a mobile terminal on which the UI is displayed.

According to an embodiment, the kids safety mode may be referred to as a safety accident prevention service of the robot cleaner 200 (eg, the robot cleaner 200 of FIG. 2 ) described with reference to FIGS. 1 to 5 . When the user has the robot cleaner 200, the user can set the kids safety mode of the robot cleaner 200 by using an application of the mobile terminal. The processor 120 of the robot cleaner 200 may receive the user's setting information using the wireless communication module 190 and perform a safety accident prevention operation according to the setting information. The mobile terminal may provide a user interface (UI) for setting the kids safety mode on the application. The mobile terminal may interact with the user by receiving the user's input with respect to the UI. The user's input may be referenced by a touch and/or a gesture on the display of the portable terminal. The user's input is exemplary, and embodiments of the present document are not limited thereto.

Referring to FIG. 6A , the mobile terminal may provide an image display area 600 as a UI. The mobile terminal may receive a user's input for the area 600 in which an image can be displayed, and display the structure or design diagram in the home in the area 600 in which the image can be displayed. For example, the mobile terminal may receive a user input for the UI 605 and display the screen of FIG. 6B .

FIG. 6B shows a screen on which an indoor map (eg, a structure diagram in a home) is displayed in an area 600 where the mobile terminal can display an image according to a user's input. The mobile terminal may provide UIs 612 , 613 , and 616 corresponding to each risk factor so that the user's home appliance (eg, the risk factor 240 ) can be placed on the indoor map image. The UIs 612 , 613 , and 616 corresponding to each risk element may include a name of the risk element 240 , a location where the risk element is disposed in an actual environment, and/or a circular icon. According to an embodiment, the mobile terminal receives location information of the risk element 240 from the IoT cloud (eg, the IoT cloud 250 of FIG. 2 ) and automatically places each risk element 240 on the indoor map image. can do. For example, the mobile terminal may display each risk element 240 on an indoor map image based on location information of the risk element 240 and a location where the risk element is disposed in an actual environment. According to another embodiment, the user may drag and drop the circular icons of the UIs 612 , 613 , and 616 corresponding to each risk element on the indoor map image. The mobile terminal may display each risk element 240 on the indoor map image according to the user's drag and drop operation. The user's UI manipulation method and the risk factor 240 display method on the mobile terminal are exemplary, and the embodiment of the present document is not limited thereto.

FIG. 6C shows that each risk factor 240 is displayed on an indoor map image of a mobile terminal in response to a user's input. When a user input is received for the UI 620 , the mobile terminal may switch to a screen for setting a safety accident protection target.

Referring to FIG. 6D , the user may set whether to provide a warning to the robot cleaner 200 based on the height information of the person by manipulating the UI provided by the portable terminal.

According to an embodiment, when the threshold is set to 120 cm as in 630 of FIG. 6D , the robot cleaner 200 warns only when it is determined that the height of a person approaching the area where the risk factor 240 is disposed is less than 120 cm. can provide The mobile terminal may receive a user input for the UIs 632 and 634 and adjust the threshold value. The mobile terminal may provide a UI 640 for determining whether to provide a warning according to family members.

According to an embodiment, the mobile terminal may provide UIs 642 , 644 , and 646 corresponding to each family member to set whether to provide a warning for each family member in the UI 640 . UIs 642 , 644 , and 646 corresponding to each family member may include the family member's name, height information, and/or a control UI. For example, when the mobile terminal receives a user's input with respect to the control UI 648 corresponding to Mark bennet among family members as shown in FIG. 6D , the mobile terminal displays the circular indicator of the control UI 648 from left to right or Conversely, the moved control UI 648 may be provided. According to the user's input to the control UI, the robot cleaner 200 may determine whether to provide a warning to the corresponding family member. For example, when the control UI 648 receives a user's input as shown in FIG. 6D , the robot cleaner 200 may be set to provide a warning to Mark bennet. When the robot cleaner 200 identifies that the person approaching the risk factor 240 is Mark bennet based on the person's height information, the robot cleaner 200 may provide a warning to Mark bennet.

Referring to FIG. 6E , the mobile terminal may provide a UI for setting a warning providing method of the robot cleaner 200 .

According to an embodiment, the mobile terminal may set an external electronic device to which the robot cleaner 200 provides a warning by receiving a user input for the UI 660 . A description of a method of providing a warning to the external electronic device of the robot cleaner 200 may be referred to by reference to FIG. 4 . The mobile terminal may provide UIs 662 , 664 , and 666 corresponding to each external electronic device in the UI 660 . The UIs 642 , 644 , and 646 corresponding to each external electronic device may include a name of the external electronic device, device information, and/or a control UI. For example, when the mobile terminal receives a user's input with respect to the control UI 668 corresponding to the Bedroom TV among the external electronic devices as shown in FIG. 6E , the mobile terminal displays the circular indicator of the control UI 668 from left to right. Or vice versa, the moved control UI 668 may be provided. According to a user's input to the control UI, the robot cleaner 200 may determine whether to provide a warning from an external electronic device corresponding thereto. For example, when the control UI 668 receives a user's input as shown in FIG. 6E , the robot cleaner 200 may be set to provide a warning to the Bedroom TV.

According to an embodiment, the mobile terminal may receive a user input for the UI 670 and set whether the robot cleaner 200 turns off the dangerous device (eg, the smart home appliance 210 of FIG. 2 ). . For example, when receiving a user's input for the control UI 678 , the portable terminal may provide the control UI 678 in which the circular indicator of the control UI 678 is moved from left to right or vice versa. When the control UI 678 receives the user's input as shown in FIG. 6e , the robot cleaner 200 receives a control command to turn off the risk device when the target of providing a warning approaches the area where the risk element 240 is disposed. It can be set to transmit to a dangerous device.

The mobile terminal may receive a user input for the UI 680 and end the setting for the kid safety mode.

7 is a flowchart of an in-home safety accident prevention service provided by a robot cleaner.

The description of FIG. 7 may be referred to by the description of FIGS. 1 to 6 .

Referring to FIG. 7 , in operation 700 , the IoT home appliance in the home may detect the state of the risk element 240 . The IoT home appliance in the home may acquire state information by detecting the state of the risk factor 240 .

In operation 710 , the IoT home appliance in the home may transmit state information of the risk element 240 to the IoT cloud 250 using a wireless communication circuit. The IoT cloud 250 may transmit state information to the robot cleaner 200 . The processor 120 of the robot cleaner 200 may determine whether the dangerous element 240 is in a dangerous state based on the received state information. Determination of the dangerous state may be performed in the IoT cloud 250 .

In operation 720 , when the processor 120 determines that the dangerous element 240 is in a dangerous state, the robot cleaner 200 may be moved to the area where the dangerous element 240 is disposed by using the driving unit 140 . .

Since operations 710 to 720 are sequentially illustrated for convenience of description, they may be performed differently or simultaneously. For example, the processor 120 may acquire the state information of the dangerous element 240 by using the sensor module 176 while moving the robot cleaner 200 to the area where the dangerous element 240 is disposed.

In operation 730 , when a person approaches the area in which the risk element 240 is disposed, the processor 120 may detect a person approaching using the sensor module 176 . When a person is already located in the area where the risk element 240 is disposed, the processor 120 may detect a person located in the area where the risk element 240 is disposed using the sensor module 176 .

In operation 740 , the processor 120 may obtain height information of a person approaching the area in which the risk element 240 is disposed by using the distance measuring sensor and the camera 180 . Acquisition of height information of a person may be referred to by Equation (1).

In operation 750 , the processor 120 may determine whether to provide a warning based on the height information of the person. For example, when a person's height is less than a threshold value, the processor 120 may provide a warning about a safety accident. When a person's height is equal to or greater than the threshold, the processor 120 may not provide a warning about a safety accident. As another example, whether to provide a warning to the residents in the home may be preset. The processor 120 may identify who is approaching based on the height information, and determine whether to provide a warning according to whether a preset warning is provided.

In operation 760 , the processor 120 may provide an alert in various ways. For example, the processor 120 may directly control (eg, turn-off) the operation of the risk factor 240 . As another example, the processor 120 may provide a warning to the external electronic device. As another example, the processor 120 may provide an aural warning to the resident using a speaker included in the robot cleaner 200 .

8 is a block diagram illustrating the configuration of an IoT cloud.

The IoT cloud 250 of FIG. 8 (eg, the server 108 of FIG. 1 ) may include a communication circuit 810 , a processor 820 , and/or a memory 830 . The components of the IoT cloud 250 in FIG. 8 are exemplary, and the embodiment of the present document is not limited thereto. The description of FIG. 8 may be referred to by the description of FIGS. 1 to 6 .

According to an embodiment, the operation performed by the processor 120 of the electronic device (eg, the robot cleaner 200) in FIG. 7 is also performed by the IoT cloud 250 (eg, the server 108 in FIG. 1 ). can be

The communication circuit 810 may include one or more components that allow communication with an external electronic device (eg, the robot cleaner 200 of FIG. 2 ) and/or a wireless communication circuit included in an IoT home appliance in the home. For example, the communication circuit 810 may include a wireless Internet module, a mobile communication module, a wired Internet module, a short-range communication module, and the like. The IoT cloud 250 may exchange data with an external electronic device and/or an IoT home appliance using the communication circuit 810 .

A program for processing and controlling the processor 820 may be stored in the memory 830 , and transmitted/received data (eg, state information of a risk factor (eg, 240 in FIG. 2 ), a person's height) information, etc.) may be stored.

The processor 820 may control the communication circuit 810 and/or the memory 830 . The processor 820 may determine the height information of the person, whether to provide a warning, etc. based on the data received using the communication circuit 810 .

According to an embodiment, the IoT home appliance in the home may detect the state of the risk element 240 . The IoT home appliance in the home may acquire state information by detecting the state of the risk factor 240 . The processor 820 of the IoT cloud 250 may receive the state information of the risk element 240 from the IoT home appliance in the home using the communication circuit 810 . The processor 820 may determine whether the risk factor 240 is in a dangerous state based on the state information. When the processor 820 determines that the dangerous element 240 is in a dangerous state, the processor 820 may transmit a control signal to an external electronic device using the communication circuit 810 . In the control signal, the processor of the external electronic device (eg, the processor 120 of FIG. 1 ) uses a driving unit (eg, the driving unit 140 of FIG. 1 ) to move the external electronic device to the area where the risk element 240 is disposed. can be controlled to do so.

In response to the control signal, when the external electronic device moves to the area where the risk element 240 is disposed, and a person approaches the area where the risk element 240 is disposed, the processor 120 of the external electronic device operates the sensor module ( 176) can be used to detect an approaching person. When a person is already located in the area where the risk element 240 is disposed, the processor 120 may detect a person located in the area where the risk element 240 is disposed using the sensor module 176 .

The processor 120 may acquire data for acquiring height information of a person approaching the area in which the risk factor 240 is disposed by using the distance measuring sensor and the camera 180 . The data for acquiring the height information of the person may include a distance from the external electronic device to the person and a minimum angle of view from a direction axis toward which the camera is directed to a body part of the person. The processor 820 may receive data acquired by the external electronic device from the external electronic device using the communication circuit 810 . The processor 820 may acquire height information of the person based on the data. The height information of a person may be calculated by Equation 1 of FIG. 5 . Data for acquiring height information of a person and a description of acquisition of height information of a person may be referred to with reference to the description of FIG. 5 .

The processor 820 may determine whether to provide a warning based on the person's height information. For example, if the height of the person is less than the threshold value, the processor 820 may provide a warning about a safety accident. If the height of the person is equal to or greater than the threshold, the processor 820 may not provide a warning about a safety accident. As another example, whether to provide a warning to the residents in the home may be preset. The processor 820 may identify who is approaching based on the height information, and determine whether to provide a warning according to whether a preset warning is provided.

The processor 820 may provide an alert in a variety of ways. For example, the processor 820 uses the communication circuit 810 to directly control (eg, turn-off) the operation of the risk factor 240 by sending a signal to the risk factor 240 (eg, FIG. It can be transmitted to the smart home appliance 210 of 2). As another example, the processor 820 may provide a warning to another external electronic device (eg, a smartphone or a speaker). As another example, the processor 820 may transmit a control signal to an external electronic device using the communication circuit 810 . The control signal may control the external electronic device to audibly provide a warning to the occupant using a speaker included in the external electronic device.

Claims (20)

In an electronic device,
drive;
at least one sensor;
wireless communication circuitry; and
processor; including;
The processor is
Using the wireless communication circuit to receive the status information of the risk factor,
Determining whether the risk factor is in a dangerous state based on the status information of the risk factor,
If the risk element is in a dangerous state, moving the electronic device to an area where the risk element is disposed using the driving device;
After detecting a person's approach to the area where the risk factor is disposed using the at least one sensor, the height information of the person is obtained,
configured to determine whether to provide an alert based on the person's height information;
electronic device.
According to claim 1,
a camera; further comprising
The at least one sensor comprises a distance measuring sensor,
The processor is
using the camera to obtain information on a minimum angle of view from a direction axis toward which the camera is directed to a part of the body of the person;
Obtaining distance information from the electronic device to the person using the distance measuring sensor,
Further configured to obtain the height information of the person based on the minimum angle of view information and the distance information,
electronic device.
3. The method of claim 2,
The camera is disposed on a surface facing the ceiling direction of the electronic device,
The ceiling direction is a direction toward the ceiling among directions orthogonal to a plane in which the electronic device is moved by the driving unit.
electronic device.
4. The method of claim 3,
The processor is
Acquire information on whether to provide height information and warnings of a plurality of people using the wireless communication circuit,
After identifying the person by comparing the height information of the plurality of people with the height information of the person,
further configured to determine whether to provide a warning to the person based on the information on whether to provide the warning,
Information on whether to provide height information and warnings for the plurality of people is registered in the server by the user,
electronic device.
According to claim 1,
The processor is further configured to directly obtain the state information of the risk factor using the at least one sensor,
electronic device.
According to claim 1,
The risk factors include smart home appliances,
The processor is
If it is decided to give a warning to said person,
Further configured to transmit a signal for controlling the operation of the smart home appliance to the smart home appliance using the wireless communication circuit,
electronic device.
According to claim 1,
speaker; further comprising,
The processor is
If it is decided to give a warning to said person,
further configured to audibly provide the warning using the speaker,
electronic device.
According to claim 1,
The processor is
If it is decided to give a warning to said person,
further configured to provide the warning to an external electronic device using the wireless communication circuitry,
electronic device.
The electronic device of claim 1 , wherein the electronic device is a robot cleaner.
In an electronic device,
communication circuit;
Memory; and
processor; including;
The processor is
Receive status information of the risk element using the communication circuit,
Determining whether the risk factor is in a dangerous state based on the status information of the risk factor,
When the risk element is in a dangerous state, a control signal for moving a first external electronic device to an area in which the risk element is disposed is transmitted to the first external electronic device using the communication circuit,
Receive data about a person approaching the area in which the risk element is disposed, obtained by moving the first external electronic device to the area in which the risk element is disposed from the first external electronic device using the communication circuit,
obtaining height information of the person based on the data;
configured to determine whether to provide an alert based on the person's height information;
electronic device.
11. The method of claim 10,
The data includes information on a minimum angle of view from a direction axis toward which a camera of a first external electronic device is directed to a body part of the person and information on a distance from the first external electronic device to the person,
The processor is further configured to obtain the height information of the person based on the minimum angle of view information and the distance information,
electronic device.
12. The method of claim 11,
The processor is
After identifying the person by comparing the height information of a plurality of people with the height information of the person,
further configured to determine whether to provide a warning to the person based on the information on whether to provide a warning,
The height information for the plurality of people and information on whether to provide a warning are registered in the electronic device by a user,
electronic device.
11. The method of claim 10,
The risk factors include smart home appliances,
The processor is
If it is decided to give a warning to said person,
Further configured to transmit a signal for controlling the operation of the smart home appliance to the smart home appliance using the communication circuit,
electronic device.
11. The method of claim 10,
The processor is
If it is decided to give a warning to said person,
further configured to transmit a signal for controlling the first external electronic device to provide a warning to the first external electronic device using the communication circuit;
electronic device.
11. The method of claim 10,
the processor
If it is decided to give a warning to said person,
further configured to provide the warning to a second external electronic device using the communication circuitry;
electronic device.
A computer-readable recording medium storing one or more instructions executable by at least one processor,
The one or more instructions,
receiving status information of the risk element using a wireless communication circuit;
determining whether the risk element is in a dangerous state based on the state information of the risk element;
moving the electronic device to an area in which the risk element is disposed using a driving device when the risk element is in a dangerous state;
detecting a person's approach to the area in which the risk element is disposed using at least one sensor, and then obtaining height information of the person; and
Including; determining whether to provide a warning based on the height information of the person
computer readable recording medium.
17. The method of claim 16,
The one or more instructions,
obtaining information on a minimum angle of view from a direction axis toward which the camera is directed by using a camera to the part of the human body;
obtaining distance information from the electronic device to the person using a distance measuring sensor; and
Further comprising the operation of obtaining the height information of the person based on the minimum angle of view information and the distance information,
computer readable recording medium.
18. The method of claim 17,
The camera is disposed on a surface facing the ceiling direction of the electronic device,
The ceiling direction is a direction toward the ceiling among directions orthogonal to a plane in which the electronic device is moved by the driving unit.
computer readable recording medium.
19. The method of claim 18,
The one or more instructions,
obtaining information about height information of a plurality of persons and whether a warning is provided by using the wireless communication circuit;
comparing the height information of the plurality of persons with height information of the person to identify the person; and
Further comprising; based on the information on whether to provide the warning, determining whether to provide the warning to the person;
The height information for the plurality of people and information on whether to provide a warning are registered in the electronic device by the user,
computer readable recording medium.
17. The method of claim 16,
The one or more instructions,
The operation of directly acquiring the state information of the risk element by using the at least one sensor; further comprising,
computer readable recording medium.

Images