KR20240061773A - Electronic device and method for controlling the electronic device - Google Patents

Abstract

One embodiment of the present invention includes a communication unit connecting to an external device; A display unit that outputs a character shape; A microphone that receives the user's voice; A speaker that outputs sound data; and a control unit, wherein the external device includes a doorbell including a camera, and the control unit recognizes a person through the doorbell while connected to the doorbell, and creates the character based on the person's movements. An electronic device characterized by controlling its shape is provided.

Description

Electronic device and control method of electronic device {ELECTRONIC DEVICE AND METHOD FOR CONTROLLING THE ELECTRONIC DEVICE}

The present invention relates to electronic devices and methods for controlling electronic devices.

The functions of electronic devices are becoming more diverse. For example, there are functions such as data and voice communication, photography and video shooting using a camera, voice recording, music file playback through a speaker system, and outputting images or videos to the display. Some electronic devices add electronic game play functions or perform multimedia player functions. In particular, modern electronic devices can receive multicast signals that provide broadcast and visual content such as video or television programs.

In addition, the Internet is evolving from a human-centered network where humans create and consume information to an IoT (Internet of Things) network that exchanges and processes information between distributed components such as objects. IoE (Internet of Everything) technology, which combines IoT technology with big data processing technology through connection to cloud servers, etc., is also emerging.

To implement IoT, technological elements such as sensing technology, wired and wireless communication and network infrastructure, service interface technology, and security technology are required. Recently, sensor networks for connection between objects and machine to machine communication have been developed. , M2M), and MTC (Machine Type Communication) technologies are being researched.

In the IoT environment, intelligent IT (Internet Technology) services can be provided that create new value in human life by collecting and analyzing data generated from connected objects. IoT is used in fields such as smart home, smart building, smart city, smart car or connected car, smart grid, healthcare, smart home appliances, and advanced medical services through the convergence and combination of existing IT (information technology) technology and various industries. It can be applied to .

As communication technology has recently developed, interest in communication methods that link various communication devices with the Internet of Things and/or the Internet of Everything is increasing. As an example, a technology is provided to control a lighting device from a smartphone by pairing a user's smartphone with a lighting device equipped with Bluetooth technology. However, the technology to simply control lighting devices from a smartphone is simply the application of general Bluetooth technology to smartphones and lighting devices.

The purpose of the present invention is to provide an electronic device and a control method of the electronic device that control an external device based on a user pattern in order to solve the above-mentioned problems.

In one embodiment of the present invention, a communication unit connecting to an external device; A display unit that outputs a character shape; A microphone that receives the user's voice; A speaker that outputs sound data; and a control unit, wherein the external device includes a doorbell including a camera, and the control unit recognizes a person through the doorbell while connected to the doorbell, and creates the character based on the person's movements. An electronic device characterized by controlling its shape is provided.

The control unit is characterized in that when the recognized person presses the door bell, the control unit receives a voice input from the user through the microphone and outputs sound data that modulates the voice input through the door bell.

The control unit is characterized in that it outputs first sound data through the speaker when the person is detected for more than N seconds, knocks on the door, or attempts to enter the door lock password.

When the recognized person presses the door bell, the control unit receives the voice type and speech content from the user through the display unit, and outputs the speech content according to the voice type through the door bell. .

The control unit receives an automatic mode setting from the user, and when the recognized person presses the doorbell while the automatic mode is set, recognizes the person's voice, analyzes the person's voice, and rings the doorbell. It is characterized by automatically responding through.

The external device includes a wireless vacuum cleaner including a camera, and the control unit moves the wireless vacuum cleaner toward the front door when the recognized person presses the door bell and the front door is opened. An electronic device, characterized in that it controls the wireless vacuum cleaner to record the direction of the front door through a camera.

The control unit executes the patrol mode of the wireless vacuum cleaner based on user settings, and when the patrol mode is running, when a user registered through the door bell is recognized, the patrol unit sends the patrol to the user through the door bell. An electronic device characterized in that it guides the mode.

The wireless vacuum cleaner further includes a speaker, and the control unit outputs a pre-recorded user's voice to the companion animal or music exclusive to the companion animal through the speaker of the wireless vacuum cleaner.

If the recognized person is included in the list of frequent visitors, the control unit asks the user whether the door lock is open, and when the door lock is opened, the control unit responds to the recognized person through the door bell. It is characterized by printing a greeting.

The external device includes at least one light, the control unit receives a do-not-disturb mode from the user, and when the recognized person presses a door bell while the do-not-disturb mode is set, the at least one light It is characterized by flashing.

The control unit is characterized in that it adjusts at least one of the illuminance and color temperature of the at least one light based on time.

It further includes a PIR sensor that recognizes the distance to the user, and when the recognized person presses the door bell, the control unit recognizes the distance to the user using the PIR sensor, and detects the distance to the user. If is less than the first distance, an alarm is output at a first decibel (dB) through the speaker, and when the distance to the user exceeds the first distance, an alarm is output at a second decibel (dB) through the speaker. An alarm is output, wherein the second decibel is greater than the first decibel.

When the distance to the user is less than or equal to the first distance, the control unit outputs the alarm with the sound level gradually decreasing from the first decibel.

When the distance to the user exceeds the first distance, the control unit outputs the alarm with the sound level gradually increasing from the second decibel.

In one embodiment of the present invention, in an electronic device including a communication unit for connecting to an external device including a doorbell including a camera and a display unit for outputting a character shape, in a state connected to the doorbell, the doorbell is activated. Recognizing a person through; and controlling the character shape output on the display unit based on the person's motion.

The effects of the electronic device and the control method for the electronic device according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, there is an effect of making it impossible to know who is inside the house by using voice modulation of an electronic device.

According to at least one of the embodiments of the present invention, even when the user is away from the house, external devices are controlled as if the user is at home, which has the effect of making it appear as if the house is not empty.

Further scope of applicability of the present invention will become apparent from the detailed description that follows. However, since various changes and modifications within the spirit and scope of the present invention can be clearly understood by those skilled in the art, the detailed description and specific embodiments such as preferred embodiments of the present invention are understood to be given only as examples. It has to be.

1 is a block diagram for explaining an electronic device according to an embodiment of the present invention.
Figure 2 is a diagram showing a system in which an electronic device is used according to an embodiment of the present invention.
Figure 3 is a diagram showing an electronic device according to an embodiment of the present invention.
Figure 4 is a diagram explaining the voice guard function of an electronic device according to an embodiment of the present invention.
5 and 6 are diagrams illustrating an actual use example of the voice guard function of an electronic device according to an embodiment of the present invention.
7 and 8 are diagrams illustrating an example in which an electronic device controls an external device according to an embodiment of the present invention.
FIG. 9 is a diagram illustrating an example of controlling a wireless vacuum cleaner from an electronic device according to an embodiment of the present invention.
Figure 10 is a diagram explaining an example of controlling a door lock in an electronic device according to an embodiment of the present invention.
Figure 11 is a diagram explaining the do not disturb mode function of an electronic device according to an embodiment of the present invention.
FIG. 12 is a diagram illustrating an example of actual use of the do not disturb mode function of an electronic device according to an embodiment of the present invention.
13 and 14 are diagrams explaining the work-from-home mode function of an electronic device according to an embodiment of the present invention.
15 and 16 are diagrams illustrating an example in which an electronic device controls a speaker based on the distance from the user according to an embodiment of the present invention.

Hereinafter, embodiments disclosed in the present specification will be described in detail with reference to the attached drawings. However, identical or similar components will be assigned the same reference numbers regardless of reference numerals, and duplicate descriptions thereof will be omitted. The suffixes “module” and “part” for components used in the following description are given or used interchangeably only for the ease of preparing the specification, and do not have distinct meanings or roles in themselves. Additionally, in describing the embodiments disclosed in this specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed descriptions will be omitted. In addition, the attached drawings are only for easy understanding of the embodiments disclosed in this specification, and the technical idea disclosed in this specification is not limited by the attached drawings, and all changes included in the spirit and technical scope of the present invention are not limited. , should be understood to include equivalents or substitutes.

Electronic devices described in this specification include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation, and slate PCs. , tablet PC, ultrabook, wearable device (e.g., smartwatch), glass-type terminal (smart glass), HMD (head mounted display), etc. may be included. there is.

However, except for the case where the configuration according to the embodiment described in this specification is applicable only to electronic devices, it can also be applied to fixed terminals such as digital TVs, desktop computers, digital signage, etc., according to a person skilled in the art. Any technician will be able to figure this out easily.

1 is a block diagram for explaining an electronic device according to an embodiment of the present invention.

Referring to FIG. 1, the electronic device 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, and a control unit 180. and a power supply unit 190. The components shown in FIG. 1A are not essential for implementing an electronic device, so the electronic device described herein may have more or fewer components than those listed above.

More specifically, among the above components, the wireless communication unit 110 is used between the electronic device 100 and the wireless communication system, between the electronic device 100 and another electronic device 100, or between the electronic device 100 and an external server. It may include one or more modules that enable wireless communication between the devices. Additionally, the wireless communication unit 110 may include one or more modules that connect the electronic device 100 to one or more networks.

This wireless communication unit 110 may include at least one of a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 or an audio input unit for inputting an audio signal, and a user input unit 123 for receiving information from a user, for example. , touch keys, push keys (mechanical keys, etc.). Voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information within the electronic device, information on the surrounding environment surrounding the electronic device, and user information. For example, the sensing unit 140 includes a proximity sensor (141), an illumination sensor (142), a touch sensor, an acceleration sensor, a magnetic sensor, and a gravity sensor. Sensor (G-sensor), gyroscope sensor, motion sensor, RGB sensor, IR sensor (infrared sensor), fingerprint scan sensor, ultrasonic sensor , optical sensors (e.g., cameras (see 121)), microphones (see 122), battery gauges, environmental sensors (e.g., barometers, hygrometers, thermometers, radiation detection sensors, It may include at least one of a heat detection sensor, a gas detection sensor, etc.) and a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the electronic device disclosed in this specification can utilize information sensed by at least two of these sensors by combining them.

The output unit 150 is intended to generate output related to vision, hearing, or tactile sensation, and may include at least one of a display 151, a speaker 152, a haptip module 153, and an optical output unit. The display 151 can implement a touch screen by forming a mutual layer structure or being integrated with the touch sensor. Such a touch screen may function as a user input unit 123 that provides an input interface between the electronic device 100 and the user, and simultaneously provide an output interface between the electronic device 100 and the user.

The interface unit 160 serves as a passageway for various types of external devices connected to the electronic device 100. This interface unit 160 connects devices equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In response to an external device being connected to the interface unit 160, the electronic device 100 may perform appropriate control related to the connected external device.

Additionally, the memory 170 stores data supporting various functions of the electronic device 100. The memory 170 may store a plurality of application programs (application programs or applications) running on the electronic device 100, data for operating the electronic device 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Additionally, at least some of these applications may be present on the electronic device 100 from the time of shipment for the basic functions of the electronic device 100 (e.g., call incoming and outgoing functions, message receiving and sending functions). Meanwhile, the application program may be stored in the memory 170, installed on the electronic device 100, and driven by the control unit 180 to perform an operation (or function) of the electronic device.

In addition to operations related to the application program, the control unit 180 typically controls the overall operation of the electronic device 100. The control unit 180 can provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the components discussed above, or by running an application program stored in the memory 170.

Additionally, the control unit 180 may control at least some of the components examined with FIG. 1A in order to run an application program stored in the memory 170. Furthermore, the control unit 180 may operate at least two of the components included in the electronic device 100 in combination with each other in order to run the application program.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 and supplies power to each component included in the electronic device 100. This power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the above components may operate in cooperation with each other to implement operation, control, or a control method of an electronic device according to various embodiments described below. Additionally, the operation, control, or control method of the electronic device may be implemented on the electronic device by running at least one application program stored in the memory 170.

Figure 2 is a diagram showing a system in which an electronic device is used according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 2, the electronic device 100 according to an embodiment of the present invention can communicate with an external device. Here, the external device may include a door bell 200a, a door lock 200b, and at least one light 300. At this time, the electronic device 100 may communicate with an external device using the method described above in FIG. 1 (eg, Wi-Fi or Bluetooth communication).

In one embodiment, the door bell 200a and the door lock 200b may include a door lock 200b attached to the front door of a house and a door bell 200a including a video phone attached outside the front door. . In particular, at least one of the video phone 200a and the door lock 200b may include a camera. Hereinafter, for convenience of explanation, the video phone 200a and the door lock 200b may not be distinguished.

In one embodiment, at least one light 300 may correspond to a light capable of communicating with the electronic device 100. In the embodiment of FIG. 2, only one light is shown, but the electronic device 100 can communicate with all communicable lights located in the house.

In one embodiment, the electronic device 100 may record the lighting time of at least one light 300 when the door lock 200b is in an open or closed state. At this time, the electronic device 100 may remove invalid records during recording and generate a user pattern. Here, the invalid record may correspond, for example, to a special pattern other than the user's general pattern. For example, records such as a case where an office worker who always comes to work and leaves at a certain time leaves something at home on one day and comes back briefly can be removed.

Additionally, the electronic device 100 can detect commuting time and manage history by recognizing the open or closed state of the door lock 200b. Additionally, the electronic device 100 may record the turn-on time and turn-off time of at least one light 300 in the open or closed state of the door lock 200b.

In one embodiment, the electronic device 100 may generate a user pattern based on the record. At this time, the electronic device 100 may receive environmental variables from an external server and change the user pattern based on the environmental variables. Here, environmental variables may include weather information, sunrise time, and sunset time.

In one embodiment, the electronic device 100 may control the external devices 200a, 200b, and 300 based on the generated user pattern. At this time, the electronic device 100 may control at least one of the illuminance and color temperature of at least one light 300 based on the user pattern.

In one embodiment, the electronic device 100 further includes a display unit, receives a selection signal for the first user pattern through the display unit, and can control at least one light 300 based on the first user pattern. there is.

In one embodiment, the electronic device 100 may further include a speaker that outputs sound data, recognize the open state of the door lock 200b, and output first sound data through the speaker.

In one embodiment, when the electronic device 100 recognizes a user registered with the door locks 200a and 200b, the electronic device 100 turns on the light closest to the door lock 200b among the at least one lights 300. )can do. On the other hand, when the electronic device 100 recognizes a user who is not registered with the door locks 200a and 200b, the electronic device 100 may turn on another external device connected to the electronic device 100.

Figure 3 is a diagram showing an electronic device according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 3, the electronic device 100 further includes a support member 310 that supports the electronic device 100, and an image 320 corresponding to the shape of the support member 310 is displayed on the display unit 151. ) can be output.

More specifically, the support member 310 may be made of synthetic resin such as plastic to support the electronic device 100. Additionally, as shown in FIG. 3, the support member 310 may be made into a cone-shaped lower shape and placed on the floor.

In one embodiment, the electronic device 100 may output an image 320 corresponding to the shape of the support member 310 on the display unit 151 by considering the shape of the support member 310. For example, when the shape of the support member 310 is a cone-shaped bottom, an image 320 showing the remaining cone-shaped top can be output on the display unit 151. Through this, the user can understand that the image 320 is connected to the support member 310 to form a cone shape.

Likewise, although not shown in the drawing, when the support member 310 is formed in a different shape, the electronic device 100 considers the shape of the support member 310 and creates an image corresponding to the shape of the support member 310. (320) can be output.

Figure 4 is a diagram explaining the voice guard function of an electronic device according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

The electronic device 100 may output the image 320 described above in FIG. 3 through the display unit. At this time, the output image may be the shape 320 of a character. The character's shape 320 can be controlled according to the situation to output motion and sound. Hereinafter, we will look at the voice guard function of the electronic device 100.

More specifically, referring to FIG. 4, the electronic bidice 100 can communicate with the doorbell 200a. Here, the doorbell 200a is installed outside the front door and may include a camera that can capture the situation outside the front door.

The electronic device 100 can receive the situation outside the front door from the door bell 200a, and can maintain the idle state of the character 320 being displayed on the display unit when nothing happens.

In one embodiment, when the electronic device 100 detects the noise of people passing in the hallway through the door bell 200a, the electronic device 100 may output a movement of the character 320 being displayed on the display unit moving left and right. there is. Accordingly, the user may notice that people are walking around outside the house as the character 320 of the electronic device 100 moves left and right.

In one embodiment, when the electronic device 100 detects an outside visitor loitering around for more than N seconds through the camera of the door bell 200a, knocks on the door, attempts to press the door lock password, etc., the electronic device 100 The sound of a dog barking or a man's voice can be output through the speaker (100). At this time, sound data output through the speaker of the electronic device 100 may correspond to sound data received through the server. Accordingly, it can give external visitors the same effect as if there is someone at home. This will be explained in detail through the drawings below.

In one embodiment, when an outside visitor rings the doorbell 200a, the electronic device 100 may output sound data such as “Ding dong~ Someone is outside.” At this time, the electronic device 100 may transform the character 320 on the display unit. Additionally, the electronic device 100 may output a camera image captured at the doorbell 200a on the display unit.

Thereafter, the electronic device 100 can receive a voice input from the user and output sound data modulated by the input voice through the door bell 200a. Here, the modulated sound data may be a machine sound or another person's voice downloaded from a server. This will be explained in detail through the drawings below.

For example, the electronic device 100 may control the door bell 200a to receive a voice input from a user asking “Who are you?” and output sound data asking “Who are you?” using a modulated voice. Thereafter, an outside visitor receives a voice input through the door bell 200a, saying “Isn’t Seok Seok home?”, and the electronic device 100 can output this to the user as is. Thereafter, the electronic device 100 may receive a voice input of “No” from the user and control the doorbell 200a to output sound data “No” as a modulated voice.

In this process, the electronic device 100 can control the character 320 to take the shape of having a conversation while holding a loudspeaker. When the conversation ends, the electronic device 100 may switch the character 320 to an idle state.

5 and 6 are diagrams illustrating an actual use example of the voice guard function of an electronic device according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

According to the above-described embodiment, the electronic device may modulate and output the user's voice in conjunction with the doorbell. At this time, Figure 5 illustrates an example of inputting a voice into the electronic device, modulating the voice, and outputting sound data when the user sets the electronic device to manual mode, and Figure 6 illustrates an example in which the user sets the electronic device to automatic mode. When set to , an embodiment in which the electronic device automatically outputs modulated sound data will be described.

To this end, the electronic device may receive input from the user as to whether the voice guard is in a manual mode or an automatic mode.

With the electronic device set to voice guard manual mode, the door bell may be pressed as shown on the left side of FIG. 5.

Accordingly, referring to the drawing on the right side of FIG. 5, the electronic device can confirm the identity of the external visitor through the door bell. For example, when an external visitor says, “I have a delivery,” the electronic device can transmit the voice to the user through the door bell.

More specifically, the electronic device can output the camera image and voice received from the doorbell on the first area 151a of the display unit 151, and display the voice type 500 on the second area 151b. and a content list 510 can be output. Here, the voice type 500 and content list 510 can be downloaded from an external server. In another embodiment, the content list 510 may include content that the user has learned from existing conversation content and patterned it into a response message. Additionally, the user can directly write content as text, and the electronic device can include the content input by the user in the content list 510.

Accordingly, the user can select (520) the type of voice to be output (500) and the list of contents to be output (510). For example, the user can select “A Voice” from the voice types (500) and “Leave it at the door” from the content list (510). Accordingly, the electronic device can text to speech (TTS) the content selected by the user based on the “A voice” received from the server. At this time, the A voice can respond to a strong male voice. Accordingly, users who live alone can chat with the delivery driver without revealing their identity when a delivery arrives.

In another embodiment, as shown in the left diagram of FIG. 6, the electronic device may receive a voice guard automatic mode setting from the user. In one embodiment, the electronic device may receive voice recognition from the user to set the automatic mode. For example, an electronic device may receive a voice message from a user, such as “Don’t disturb, take care of it yourself.” Additionally, the user can input the setting time of the voice guard automatic mode through the display unit of the electronic device. For example, a user can set the electronic device's Voice Guard automatic mode from 9 a.m. to 6 p.m.

Accordingly, referring to the drawing on the right side of FIG. 6, when an external visitor presses the door bell and utters a voice, the electronic device can recognize and analyze the voice uttered.

In one embodiment, the electronic device may automatically respond through a doorbell when the uttered voice is a patterned voice. More specifically, if the uttered voice includes the text “delivery,” the electronic device can automatically output the voice “Please leave it in front of the house” through the door bell. Additionally, if the uttered voice includes the text “gas,” the electronic device can automatically output the voice “There is no one at home right now” through the doorbell. At this time, the electronic device can learn the content of the conversation by collecting and analyzing the voice uttered by the external visitor. Afterwards, the electronic device can later use it as a response message based on the learned content.

Accordingly, you can automatically respond to external visitors in situations where you are reluctant to expose your voice to external visitors or when it is difficult to respond immediately. This can be useful when a woman lives alone or there are only children at home.

Additionally, in one embodiment, when the electronic device utters a response message through a doorbell, ambient noise may be additionally output. More specifically, the electronic device can output a response message along with the sound of a dog barking through a doorbell. Alternatively, the electronic device may output a response message along with the voices of multiple people through a doorbell. This allows external visitors to feel as if the user is not alone at home.

7 and 8 are diagrams illustrating an example in which an electronic device controls an external device according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

In one embodiment, the electronic device may be connected to the doorbell 200a and the wireless cleaner 400.

Referring to the left drawing of FIG. 7 , the electronic device can detect that the connected doorbell 200a is pressed and the front door is opened. Accordingly, the electronic device can move the connected wireless vacuum cleaner 400 toward the front door. At this time, the wireless vacuum cleaner 400 may be charging or cleaning at the docking station. In either case, the wireless vacuum cleaner 400 can move to the front door under the control of an electronic device.

Referring to the drawing on the right of FIG. 7, when the front door is opened, the electronic device can control the wireless vacuum cleaner 400 to record the direction of the front door through the camera of the moved wireless cleaner 400.

In other words, when the doorbell 200a is pressed and the front door is opened, the situation can be recorded to provide a solution to problems that arise in such an emergency situation. For example, the wireless vacuum cleaner 400 can download recorded images to an external storage medium or transmit them to a server with the user's consent. In addition, in another embodiment, if an emergency occurs in the video recorded through the camera of the wireless vacuum cleaner 400, the electronic device connects a call to the police 112 or the fire department 119 to use the camera of the wireless vacuum cleaner 400. You can transmit the captured video.

Referring to the left drawing of FIG. 8, the electronic device can use the wireless vacuum cleaner 400 for patrolling inside the house.

More specifically, the electronic device may receive settings for a mode for leaving the house, such as an outing mode, a stay-out mode, or a travel mode, from the user. Accordingly, the electronic device can patrol the house using the linked wireless cleaner 400. This may be referred to as the patrol mode of the wireless vacuum cleaner 400.

In one embodiment, the electronic device may turn on lights (not shown) in the house according to the patrol route of the wireless vacuum cleaner 400. Additionally, if an emergency situation occurs while patrolling the house under the control of the electronic device, the wireless vacuum cleaner 400 can notify the user through the electronic device. For example, if the front door is opened while the wireless vacuum cleaner 400 is patrolling, the electronic device may notify the user of this.

In addition, referring to the drawing on the right of FIG. 8, when the wireless cleaner 400 is patrolling or patrolling the house, the electronic device outputs a status indication that the wireless cleaner 400 has patrolled the house through the door bell 200a. can do. In one embodiment, when a registered user is recognized through the door bell 200a, the electronic device may output a message such as “The wireless vacuum cleaner has patrolled the house.” In another embodiment, when the doorbell 200a includes a display unit, the electronic device may inform that the wireless vacuum cleaner 400 is in patrol mode through the doorbell 200a. Accordingly, the user can relieve anxiety just before opening the door.

FIG. 9 is a diagram illustrating an example of controlling a wireless vacuum cleaner from an electronic device according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to the left drawing of FIG. 9 , an electronic device (not shown) may be connected to the door lock 200b and the door beam 200c. Here, the door beam 200c is attached to the front door and functions to detect the user and turn on the lighting. Additionally, the door beam 200c may further include a speaker.

The electronic device may recognize the user's voice or user's motion through at least one of the connected external devices. For example, the electronic device can predict that the user will go out through the door lock 200b and the door beam 200c. At this time, when the electronic device detects that there is a companion animal in the house, it can take care of the companion animal using the wireless vacuum cleaner 400.

Referring to the drawing on the right of FIG. 9, the wireless vacuum cleaner 400 including a camera and a speaker can output a pre-recorded user's voice or output separately learned music exclusively for companion animals. At this time, the electronic device may download music exclusively for companion animals from the server and transmit it to the wireless vacuum cleaner 400.

In addition, when the user is out and the pet is waiting for the user at the front door or barking meaninglessly, the electronic device uses the wireless vacuum cleaner 400 to output music exclusively for the pet or output the user's pre-recorded voice. can do.

Figure 10 is a diagram explaining an example of controlling a door lock in an electronic device according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to the first drawing of FIG. 10, the electronic device can recognize an external visitor through the door bell 200a. At this time, the electronic device can identify external visitors through the door bell 200a. To this end, the electronic device can ask the outside visitor, “Who are you?” through the door bell 200a and recognize the outside visitor’s voice. Additionally, the electronic device can recognize external visitors through the camera of the doorbell 200a.

Referring to the second drawing of FIG. 10, when the electronic device recognizes an external visitor, it may query the user whether the door lock 200b is open. For example, an electronic device can output a voice message to the user, such as “Would you like me to open the door for Suji, who has visited n times so far?”

Additionally, in another embodiment, if the user is not at home, the electronic device may transmit an alarm to the connected user's smartphone, such as “Would you like me to open the door for Suji, who has visited n times so far?” For this purpose, the electronic device may be linked in advance with the registered user's smartphone.

In one embodiment, the electronic device may open the door lock 200b based on the user response. For example, when the user responds with a smartphone to open the door or instructs the electronic device to open the door with a voice, the electronic device may open the door lock 200b.

At this time, the electronic device can remember external visitors who frequently visit the house, remotely open the door lock 200b, and output customized greetings for the visitors. In one embodiment, the electronic device may generate a list of frequently visited external visitors. At this time, the electronic device can individually recognize and record users and visitors in the house. An electronic device can recognize the voices and faces of visitors other than the user and record the number of times they visit the home.

In one embodiment, when an external visitor is included in the list of frequent external visitors, the electronic device automatically opens the door lock 200b and recognizes the “name” of the registered external visitor through the door bell 200a. can do. For example, an electronic device might say, “Hello Suzy, this is your n+1st time visiting our house. You can print greetings such as “Have fun.” In other words, the electronic device can provide a customized greeting to the visitor based on the number of visits by the external visitor. At this time, in preparation for an unexpected situation, a camera such as a wireless vacuum cleaner (not shown) can be activated to film a situation where an outside visitor enters the front door.

In particular, the embodiment of Figure 10 can be useful when an acquaintance decides to come to the house to visit, but arrives home before the owner.

Figure 11 is a diagram explaining the do not disturb mode function of an electronic device according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 11, the electronic device 100 may be set to a do not disturb mode by the user. The electronic device 100 may receive a voice input containing the text “disturbance” from the user. At this time, the electronic device 100 may output the character 320 as if its body is rotating in the direction of the user (direction of speech).

The electronic device 100, which has received a Do Not Disturb mode input from the user, can control the character 320 to listen carefully to the user's words through the display unit and make an OK motion when the user's speech ends. Additionally, the electronic device may output voice data such as “I will activate Do Not Disturb mode.”

When the do not disturb mode is executed, the electronic device 100 may output an image of the character 320 wearing a headset and watching TV through the display unit. Additionally, the electronic device 100 may lower the illuminance of the linked lighting 300.

With the do not disturb mode running, when the door bell 200a is pressed, the electronic device may flash the light 300. For example, the electronic device 100 may blink the light 300 on and off at a pulse rate. Through this, the user can know that the door bell 200a has been pressed through the lighting 300 without any motion or sound alarm of the electronic device 100.

At this time, as described above, in response to the door bell 200a, the automatic mode of the voice guard function may be executed. More specifically, the electronic device 100 can ask an external visitor “Who are you?” under automatic mode and respond based on the external visitor's conversation pattern. At this time, the user may not be able to hear a conversation with an external visitor through the doorbell 200a.

Additionally, in one embodiment, the electronic device 100 may set a do-not-disturb time. At this time, the do not disturb time can be set by the user. The electronic device 100 can be set so that a password for a door lock (not shown) cannot be entered from outside and a card cannot be touched within the do-not-disturb time. Accordingly, in the do not disturb mode, the electronic device 100 can minimize alarms to the user.

FIG. 12 is a diagram illustrating an example of actual use of the do not disturb mode function of an electronic device according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to (a) of FIG. 12, the user can utter a voice setting the do not disturb mode to the electronic device. For example, a user can utter voices such as “I’m going to play a game,” “I’m going to watch TV,” or “I’m going to listen to music.” In one embodiment, the electronic device may extract keywords for “game,” “TV,” and “music” from the user’s spoken voice and set the do not disturb mode.

Additionally, in one embodiment, when the electronic device is connected to a game device, TV, or sound device, the electronic device may automatically set the do not disturb mode when it detects that the user is accessing the game device, TV, or sound device.

Referring to (b) of FIG. 12, with the do not disturb mode set, external visitors can visit. For example, an outside visitor may ring the door bell 200a.

Referring to (c) of FIG. 12, the electronic device 100 may notify through the display unit that an external visitor has visited. For example, the electronic device 100 may output text on the display unit.

Referring to (d) of FIG. 12, the electronic device can notify an external visitor by blinking the light 300. In one embodiment, the electronic device may set the blinking rate of the light 300 differently based on the degree of urgency of the notification. For example, for urgent notifications, the electronic device may set the lights 300 more quickly than usual.

Additionally, if the electronic device is connected to the lighting 300 that can output multiple colors rather than a single color, the color of the lighting 300 can be adjusted to inform external visitors. At this time, the color of the lighting 300 can be set directly by the user. For example, the electronic device may change the light 300 to blue when a delivery arrives, and change the light 300 to green when a friend arrives. Additionally, as another example, the electronic device may quickly flash the light 300 in red when a registered user arrives, and slowly flash the light 300 in blue when an unregistered external visitor arrives. there is.

11 and 12 illustrate the do not disturb mode of the electronic device, but the name of the mode is not important. In other words, the electronic device can run a work-from-home mode that operates with the same functionality. Even in the case of work-from-home mode, it can operate in the same way as the do not disturb mode.

Hereinafter, the work-from-home mode function of an electronic device according to an embodiment of the present invention will be described in FIGS. 13 and 14.

Referring to FIG. 13 , the electronic device 100 may output an image of a character 320 working from home on the display unit 151 while the work-from-home mode is in effect. Additionally, the electronic device 100 may automatically adjust at least one of the illuminance and color temperature of at least one light 300 while the work-from-home mode is in effect. For example, the electronic device 100 may set the color temperature to 4500K in the morning, 4000K in the afternoon, and 3500K in the late afternoon. Accordingly, users can perform their work more comfortably when working from home.

In one embodiment, the electronic device 100 may use the lighting 300 to notify break times and meal times while the work-from-home mode is in effect. At this time, rest time and meal time can be changed according to the user's settings. For example, when 10:30 AM is set as the break time, the electronic device 100 changes the color of the lighting 300, lasts for 15 seconds, and then returns to the original color. Likewise, when 12 PM, which is set as lunch time, the electronic device 100 changes the color of the lighting, lasts for 15 seconds, and then returns to the original color.

In one embodiment, the electronic device 100 may automatically end the telework mode when the set telework mode time elapses. Accordingly, the electronic device 100 may change the character 320 being output on the display unit 151 to an idle shape. At this time, the electronic device 100 may change the color of the lighting 300 for 15 seconds when the work-from-home mode ends.

Referring to FIG. 14, the electronic device 100 may be connected to at least one external device 600. Here, the external device 600 may include all home appliances that can be used in the house, such as a washing machine, dryer, styler, dishwasher, water purifier, air conditioner, and vacuum cleaner.

The electronic device 100 may receive an operation completion alarm of the connected external device 600 while the work-from-home mode is in effect. At this time, the dryer 601 may not output an operation completion alarm. That is, the electronic device 100 can control the external device 600 not to output a sound alarm while the telecommuting mode is in effect.

However, the electronic device 100 can set an alarm allowable time during the work-from-home mode. At this time, the alarm allowable time can be set by the user. The electronic device 100 may output an operation completion alarm of the external device 600 through a speaker when the alarm allowable time expires. For example, when the alarm time is allowed, the electronic device 100 may notify through a speaker that the operation of the dryer 601 has been completed.

15 and 16 are diagrams illustrating an example in which an electronic device controls a speaker based on the distance from the user according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 15 , when an external visitor presses the door bell 200a, the electronic device 100 may output different decibels (dB) of an alarm based on the distance from the user. To this end, the electronic device 100 may further include a PIR sensor that recognizes the distance to the user.

Here, the PIR sensor (passive infrared sensor) is a passive infrared sensor and can refer to a sensor that detects human movement (motion) through infrared rays. The PIR sensor can detect human movement in a certain section through a Fresnel lens. Accordingly, the electronic device 100 can detect the distance to the user through the PIR sensor.

More specifically, when an outside visitor rings the doorbell 200a, the electronic device can analyze the distance to the user using a PIR sensor.

In one embodiment, when the distance from the user is less than the first distance (eg, 1 meter), the electronic device 100 sends an alarm to the user at a first decibel (dB) through the speaker of the electronic device 100. Can be printed. At this time, the first distance, which is the standard for distance from the user, and the first decibel, which is the volume of sound, can be set by the user.

In another embodiment, when the distance from the user exceeds the first distance, the electronic device 100 may output an alarm at a second decibel to the user through the speaker of the electronic device 100. At this time, the second decibel is characterized as being greater than the first decibel. Likewise, the second decibel can be set by the user.

Accordingly, the electronic device 100 may output an alarm louder when the electronic device 100 is further away from the user, based on the user's distance.

Referring to (a) of FIG. 16, an outside visitor can press the door bell 200a. Accordingly, the electronic device 100 can recognize the distance to the user through the PIR sensor. At this time, based on user settings, the electronic device 100 may set the distance standard with the user to a first distance (eg, 1 meter).

Referring to (b) of FIG. 16, when the distance to the user is less than or equal to the first distance, the electronic device 100 may output an alarm with the sound level gradually decreasing from the first decibel. For example, when the electronic device 100 first outputs the volume of voice data saying “Delivery has arrived,” it outputs the volume at 1 decibel, gradually outputs the volume at a lower level, and finally outputs the volume at 1 decibel. It can be output at a size of 1 decibel-20 decibel.

Referring to (c) of FIG. 16, when the distance from the user exceeds the first distance, the electronic device 100 may output an alarm with the sound volume gradually increasing from the second decibel. For example, when the electronic device 100 first outputs the volume of voice data saying “Delivery has arrived,” it outputs the volume at the second decibel level, gradually outputs the volume at a larger level, and finally outputs the volume at the second decibel level. It can be output at a size of 2 decibels + 20 decibels.

Components of the electronic device according to the embodiments described in FIGS. 1 to 16 may be implemented as hardware including one or more processors combined with memory, software, firmware, or a combination thereof. Components of devices according to embodiments may be implemented as one chip, for example, as one hardware circuit. Additionally, components of electronic devices according to embodiments may each be implemented as separate chips. Additionally, at least one of the components of the electronic device according to embodiments may be composed of one or more processors capable of executing one or more programs, and the one or more programs are shown in FIGS. 1 to 16. It may include instructions for performing or performing one or more of the described electronic device operations/methods.

For convenience of explanation, each drawing has been described separately, but it is also possible to design a new embodiment by merging the embodiments described in each drawing. In addition, according to the needs of those skilled in the art, designing a computer-readable recording medium on which programs for executing the previously described embodiments are recorded also falls within the scope of the rights of the embodiments. Devices according to embodiments may be limited to the configuration and method of the embodiments described above. Rather, the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made. Although preferred embodiments of the embodiments have been shown and described, the embodiments are not limited to the specific embodiments described above, and are within the scope of common knowledge in the technical field to which the invention pertains without departing from the gist of the embodiments claimed in the claims. Of course, various modifications are possible by those who have, and these modifications should not be understood individually from the technical ideas or perspectives of the embodiments. Descriptions of devices according to embodiments may be applied to complement each other.

Various components of devices according to embodiments may be configured by hardware, software, firmware, or a combination thereof. Various components of the embodiments may be implemented with one chip, for example, one hardware circuit. Depending on the embodiments, the components according to the embodiments may be implemented with separate chips. Depending on the embodiments, at least one or more of the components of the device according to the embodiments may be composed of one or more processors capable of executing one or more programs, and the one or more programs may be configured according to the embodiments. It may perform one or more of the following operations/methods, or may include instructions for performing them.

In this document, “/” and “,” are interpreted as “and/or.” For example, “A/B” is interpreted as “A and/or B”, and “A, B” is interpreted as “A and/or B”. Additionally, “A/B/C” means “at least one of A, B and/or C.” Additionally, “A, B, C” also means “at least one of A, B and/or C.” Additionally, in this document, “or” is interpreted as “and/or.” For example, “A or B” may mean 1) only “A”, 2) only “B”, or 3) “A and B”. In other words, “or” in this document may mean “additionally or alternatively.”

Terms such as first, second, etc. may be used to describe various components of the embodiments. However, the interpretation of various components according to the embodiments should not be limited by the above terms. These terms are merely used to distinguish one component from another. It's just a thing. For example, a first user input signal may be referred to as a second user input signal. Similarly, the second user input signal may be referred to as the first user input signal. The use of these terms should be interpreted without departing from the scope of the various embodiments. The first user input signal and the second user input signal are both user input signals, but do not mean the same user input signals unless clearly indicated in the context.

The terminology used to describe the embodiments is for the purpose of describing specific embodiments and is not intended to limit the embodiments. As used in the description of the embodiments and the claims, the singular is intended to include the plural, unless the context clearly dictates otherwise. The expressions and/or are used in a sense that includes all possible combinations between the terms. The expression includes describes the presence of features, numbers, steps, elements, and/or components and does not imply the absence of additional features, numbers, steps, elements, and/or components. . Conditional expressions such as when, when, etc. used to describe the embodiments are not limited to optional cases. It is intended that when a specific condition is satisfied, the relevant action is performed or the relevant definition is interpreted in response to the specific condition.

100: Electronic device

Claims (15)

A communication unit connecting to an external device;
A display unit that outputs a character shape;
A microphone that receives the user's voice;
A speaker that outputs sound data; and
Including the control unit,
The external device includes a door bell including a camera,
The control unit
When connected to the doorbell, recognize a person through the doorbell,
An electronic device, characterized in that controlling the character shape based on the person's movements. According to claim 1,
The control unit
When the recognized person presses the door bell, a voice is input from the user through the microphone,
An electronic device, characterized in that it outputs sound data that modulates the voice input through the door bell. According to claim 1,
The control unit
An electronic device that outputs first sound data through the speaker when the person is detected for more than N seconds, knocks on the door, or attempts to enter the door lock password. According to claim 1,
The control unit
When the recognized person presses the door bell, the type of voice and content of speech are input from the user through the display unit,
An electronic device, characterized in that the content of the speech according to the type of voice is output through the door bell. According to claim 1,
The control unit
Receive automatic mode settings from the user,
With the automatic mode set, when the recognized person presses the door bell, the person's voice is recognized,
An electronic device, characterized in that it analyzes the person's voice and automatically answers the door bell. According to claim 1,
The external device includes a wireless vacuum cleaner including a camera,
The control unit
When the recognized person presses the doorbell and the front door opens, the wireless vacuum cleaner is moved toward the front door,
An electronic device, characterized in that the wireless vacuum cleaner is controlled to record the direction of the front door through the camera of the wireless vacuum cleaner. According to claim 6,
The control unit
Execute the patrol mode of the wireless vacuum cleaner based on user settings,
When the patrol mode is in effect and a registered user is recognized through the doorbell, the electronic device guides the user to the patrol mode through the doorbell. According to claim 6,
The wireless vacuum cleaner further includes a speaker,
The control unit
An electronic device, characterized in that it outputs a pre-recorded user's voice to a companion animal or music exclusive to the companion animal through the speaker of the wireless vacuum cleaner. According to claim 1,
The control unit
If the recognized person is included in the list of frequent visitors, ask the user whether the door lock is open,
An electronic device, characterized in that when opening the door lock, a greeting corresponding to the recognized person is output through the door bell. According to claim 1,
The external device includes at least one light,
The control unit
Receive Do Not Disturb mode from the user,
An electronic device, characterized in that, when the recognized person presses a door bell while the do not disturb mode is set, the at least one light flashes. According to claim 10,
The control unit
An electronic device, characterized in that adjusting at least one of the illuminance and color temperature of the at least one light based on time. According to claim 1,
Further comprising a PIR sensor that recognizes the distance to the user,
The control unit
When the recognized person presses the door bell, the distance to the user is recognized using the PIR sensor,
If the distance from the user is less than a first distance, output an alarm at a first decibel (dB) through the speaker,
When the distance to the user exceeds the first distance, the alarm is output at a second decibel (dB) through the speaker, wherein the second decibel is greater than the first decibel. . According to claim 12,
The control unit
When the distance to the user is less than or equal to the first distance, the alarm is output with the sound level gradually decreasing from the first decibel. According to claim 12,
The control unit
When the distance to the user exceeds the first distance, the electronic device outputs the alarm with a sound level gradually increasing from the second decibel. In an electronic device including a communication unit that connects to an external device, including a doorbell that includes a camera, and a display unit that outputs a character shape,
Recognizing a person through the doorbell while connected to the doorbell; and
A method of controlling an electronic device, comprising the step of controlling the character shape output on the display unit based on the person's motion.

Images