KR20180134628A - Method and apparatus for providing appropriate information for location and space of user using moving device - Google Patents

Abstract

The present invention provides a method for providing information appropriate to the location and space of a user by using a moving device and an apparatus thereof. According to an embodiment of the present invention, the information providing apparatus includes: a sensor unit sensing the information related to the surroundings of the information providing apparatus; a driving unit for moving the information providing apparatus; and one or more processors realized to execute computer-readable commands and a voice-based input/output (I/O) interface. The processors control the driving unit in order to recognize multiple spaces separately based on the surrounding information sensed by the sensing unit while moving the information providing apparatus, determine the location of the user based on at least one of the surrounding information sensed by the sensing unit and voice signals received through the voice-based I/O interface, and provide information to the user based on the location of the user determined in advance and the spaces recognized in a separate manner.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a method and apparatus for providing information suitable for a user's location and space using a moving device,

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following description is directed to a method and apparatus for providing information appropriate to a user's location and space using a moving device and a computer readable recording medium in combination with the computer for executing a method of providing information according to embodiments of the present invention, A computer program stored in a medium, and a recording medium therefor.

An interface that operates based on voice, such as an artificial intelligent speaker of a home network service, receives a user's voice request through a microphone, synthesizes an answer voice to provide response information corresponding to the voice request, Or output the audio of the contents included in the response information. For example, Korean Patent Laid-Open No. 10-2011-0139797 discloses a home media device and a home network system and method using the home media device. In the home network service, a home network service using a second communication network such as Wi- And discloses a technique in which a plurality of multimedia devices in a home can be multiplexed and controlled through a voice command without a user having to perform a separate button operation.

In such a home network service, in order to provide more appropriate information in response to a user's voice request, there is a need to grasp information about the space where the device is located, such as the structure of the room and the artificial intelligent speaker, exist. However, in the conventional technology, it is difficult to grasp the whole structure of the room and all the divided spaces of the room through a single device, and it is also difficult to cover the space except for the space where the single device is installed and the space around it.

The user can distinguish the plurality of divided spaces in the indoor space by collecting the indoor environment of the room while moving, and can recognize information corresponding to the user's location and space based on the plurality of divided spaces recognized and distinguished from the user's location And a computer program stored in a computer-readable recording medium for causing a computer to execute an information providing method according to embodiments of the present invention in combination with a computer, and a recording medium therefor.

It is possible to predict the location of the user at the future point and to move to the predicted position to provide the information. If the user does not appear at the predicted position at the future time point, An information providing method and apparatus capable of providing related notifications even when a situation or an action related to a predicted position is forgotten, and a computer readable medium for causing a computer to execute an information providing method according to embodiments of the present invention in combination with a computer And a computer program stored on a recording medium and a recording medium thereof.

Even if the electronic apparatus associated with the user's command can not be specified through the user's voice request, the electronic apparatus corresponding to the user's command can be specified based on the distance between the user and the electronic apparatus and / An information providing method and apparatus, and a computer program stored in a computer-readable recording medium for causing a computer to execute an information providing method according to embodiments of the present invention in combination with a computer, and a recording medium therefor.

An information providing apparatus, comprising: a sensor unit for sensing peripheral information of the information providing apparatus; A driving unit for moving the information providing apparatus; A voice-based input / output interface; And at least one processor configured to execute a computer-readable command, wherein the at least one processor controls the driving unit to move the information providing apparatus and move a plurality of And determines a position of a user based on at least one of the peripheral information sensed by the sensor unit and the voice signal received through the input / output interface based on the voice, And provides the information to the user based on the determined location of the user and the determined location of the user.

A method of providing information to an information providing apparatus, the method comprising: sensing a peripheral information of the information providing apparatus through a sensor unit included in the information providing apparatus while controlling the driving unit included in the information providing apparatus, ; Determining a location of a user based on at least one of the peripheral information sensed by the sensor unit and a voice signal received through a voice-based input / output interface included in the information providing apparatus; And providing information to the user based on the determined plurality of spaces and the determined location of the user.

There is provided a computer-readable recording medium having recorded thereon a computer program for causing a computer to execute the information providing method.

There is provided a computer program stored in a computer-readable recording medium for causing a computer to execute the information providing method in combination with a computer.

The user can distinguish the plurality of divided spaces in the indoor space by collecting the indoor environment of the room while moving, and can recognize information corresponding to the user's location and space based on the plurality of divided spaces recognized and distinguished from the user's location Can be provided.

It is possible to predict the location of the user at the future point and to move to the predicted position to provide the information. If the user does not appear at the predicted position at the future time point, You can also provide relevant notifications if you forget the situation or behavior associated with the predicted location.

Even if the user can not specify the electronic device related to the user's command through the voice request of the user, the electronic device corresponding to the user's command can be specified based on the distance between the user and the electronic device and / or the applicability of the user's command .

1 is a diagram illustrating an example of a service environment using a voice-based input / output interface according to an embodiment of the present invention.
2 is a diagram illustrating another example of a service environment using a voice-based input / output interface according to an embodiment of the present invention.
3 is a diagram illustrating an example of a cloud intelligence platform in one embodiment of the present invention.
4 is a block diagram illustrating an internal configuration of an electronic device and a server according to an embodiment of the present invention.
FIG. 5 is a view showing an example of information on the divided spaces and the position of a room in an embodiment of the present invention. FIG.
6 is a diagram showing an example of an electronic device that follows a user in an embodiment of the present invention.
FIG. 7 is a diagram illustrating an example of an electronic device moving to an expected position of a user at a future time point, according to an embodiment of the present invention.
FIG. 8 is a diagram illustrating an example of an electronic apparatus that visits a user to provide notification in an embodiment of the present invention. FIG.
9 is a diagram showing an example of information on output media in an embodiment of the present invention.
10 is a diagram illustrating an example of specifying an electronic device corresponding to a user command in an embodiment of the present invention.
11 is a flowchart illustrating an example of an information providing method of an electronic device according to an embodiment of the present invention.
FIG. 12 is a flowchart illustrating an example of a method in which an electronic device according to an embodiment of the present invention moves to a user's perimeter to provide information.
13 is a flowchart illustrating an example of a method in which an electronic device according to an embodiment of the present invention predicts a user's position and moves first.
FIG. 14 is a flowchart illustrating an example of a method for an electronic device according to an embodiment of the present invention to specify a device corresponding to a user command.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

The information providing apparatus according to embodiments of the present invention may be implemented through an electronic device that provides an interface that operates based on voice. Such an electronic device can process the voice request by directly processing the voice request and generating the response information or by recognizing and analyzing through an external platform connected through a separate interface connection. For example, the external platform may include a cloud AI platform that receives a user's voice request from the electronic device and analyzes the received voice request to generate a query appropriate to the user's intent or response information corresponding to the query have. At this time, the electronic device senses the surrounding information while directly moving, and can collect the indoor environment of the room, and can recognize the plurality of spaces partitioned in the room through the collected information. Also, the electronic device can determine the location of the user based on the sensed peripheral information and / or the recognized voice, and can provide the information to the user based on the determined plurality of spaces and the determined user's location have.

The information providing method according to the embodiments of the present invention can be performed through the above-described electronic device. At this time, a computer program according to an embodiment of the present invention can be installed and driven in the electronic device, and the electronic device can perform the information providing method according to the embodiment of the present invention by controlling the driven computer program . The above-described computer program may be stored in a computer-readable recording medium for execution by a computer in combination with an electronic device implemented by a computer.

1 is a diagram illustrating an example of a service environment using a voice-based input / output interface according to an embodiment of the present invention. In the embodiment of FIG. 1, an electronic device 100 including a voice-based input / output interface (for example, a microphone and a speaker) in a technology for connecting and controlling home devices such as a smart home or a home network service, An example of outputting response information such as "turn off the living room light" 122 by recognizing and analyzing the voice request received by the user 110 via the microphone 110 via the microphone 120 Respectively. 1, recognizes and analyzes the voice request received according to the utterance word 123 of the user 110 corresponding to the response information, and transmits the voice request to the electronic device 100 through the internal network And the lighting power of the lighting device 130 is controlled.

In addition to household electric appliances 130 described above, domestic appliances may include appliances such as IPTV, personal computers (PC), peripherals, air conditioners, refrigerators, robot cleaners and the like as well as energy consumption devices such as water, A security device such as a door lock, a surveillance camera, and the like, which can be connected and controlled on-line. In addition, the internal network includes a wired network technology such as Ethernet, HomePNA, and IEEE 1394, and a wireless network technology such as Bluetooth, Ultra Wide Band (UWB), ZigBee, Wireless 1394, Can be utilized.

The response information may be output through the main media (for example, a speaker included in the electronic device 100) corresponding to the voice-based input / output interface as in the embodiment of FIG. 1, The response information can be outputted through a variety of media, and the electronic device 100 can determine the media on which the response information is output based on the voice request and / or response information. For example, FIG. 1 further illustrates the IPTV 140 and the mobile device 150 of the user 110. In this case, the response information may be visually output to the user 110 through the display of the IPTV 140 or the mobile device 150. At this time, the electronic device 100 can determine the media for outputting the response information based on the auditory output and the efficiency of the visual output, rather than simply determining the media for outputting the response information.

The electronic device 100 may include a driving unit for moving the electronic device 100 such as the wheel 160 shown in the embodiment of FIG. The driving unit may be implemented in at least one of all the ways that the electronic device 100 can be moved, such as a track 160, a robot leg, a propeller of a drone, etc., in addition to the wheel 160 described in the embodiment of FIG. The electronic device 100 may further include a sensor unit for sensing peripheral information of the electronic device 100 in order to collect the internal environment of the electronic device. The electronic device 100 can sense the surrounding information while moving in the room, and can identify the plurality of divided spaces in the room based on the surrounding information. In addition, the electronic device 100 may determine the location of the user 110 based on this perimeter information and / or the user's voice signal. At this time, the electronic device 100 can provide information to the user based on the plurality of recognized and determined locations of the user 110.

2 is a diagram illustrating another example of a service environment using a voice-based input / output interface according to an embodiment of the present invention. 2 illustrates an example in which an electronic device 100 including a voice-based input / output interface recognizes and analyzes a user's utterance "Today's weather" 210, Information is obtained, and the obtained information is synthesized by voice as in "Today's weather ..." (230) and outputted. For example, the external network may be a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network Lt; RTI ID = 0.0 > and / or < / RTI >

2, the electronic device 100 includes a function for receiving and processing a voice request of the user 110, and a function for communicating with the external server 220 through an external network, And may include a driving unit for moving the electronic device 100, such as the wheel 160, as described above. The electronic device 100 may directly recognize and analyze the voice request of the user to process the voice request. However, according to the embodiment, an external platform associated with the electronic device 100 (for example, the cloud intelligent platform ) To process the voice request.

At this time, the electronic device 100 can automatically determine the media for outputting the response information corresponding to the user's voice request. 2 shows an example in which the electronic device 100 outputs the response information audibly as in the case of "today's weather ..." 230 and visually outputs it through the display of the IPTV 140 . To this end, the electronic device 100 may manage information on a plurality of media capable of outputting response information, and may output at least one of a plurality of media to output response information based on the voice request and / One media can be selected and the response information can be transmitted. The electronic device 100 may also determine the output media based on the user's location. For example, the electronic device 100 may specify an electronic device for outputting information based on a user's location and a distance between the electronic device including the output media.

3 is a diagram illustrating an example of a cloud intelligence platform in one embodiment of the present invention. 3 shows the electronic devices 310, the cloud intelligent platform 320, and the content service 330. As shown in FIG.

For example, the electronic devices 310 may refer to devices provided at home, and may include at least the electronic device 100 described above. Applications (hereinafter referred to as apps) installed and driven in the electronic devices 310 and the electronic devices 310 may be linked to the cloud intelligence platform 320 via the interface connect 340. The interface connect 340 may provide developers with software development kits (SDKs) and / or development documents for developing applications installed and run on the electronic devices 310 or the electronic devices 310. In addition, the interface connect 340 is configured to allow an application program interface (API) that enables applications installed and operated in the electronic devices 310 and the electronic devices 310 to utilize the functions provided by the cloud intelligent platform 320 . As a specific example, a developer can use a software development kit (SDK) provided by the interface connect 340 and / or a device or an application developed using a development document to create a cloud intelligence platform (API) using the API provided by the interface connect 340 320 can be utilized.

Here, the cloud intelligence platform 320 may provide a function for providing a voice-based service. For example, the cloud artificial intelligence platform 320 may include a speech processing module 321 for recognizing the received speech and synthesizing the speech to be output, a vision processing module 322 for analyzing and processing the received image or moving image, A dialog processing module 323 for determining an appropriate dialogue to output a suitable speech according to the received speech, a recommendation module 324 for recommending a function suitable for the received speech, Based services such as Neural Machine Translation (NMT) 325, which enables translation of a language into a language-based service.

For example, in the embodiments of Figures 1 and 2, the electronic device 100 may send a voice request of the user 110 to the cloud intelligence platform 320 using an API provided by the interface connect 340 have. In this case, the cloud intelligent platform 320 can recognize and analyze the received voice request using the above-described modules 321 to 325, synthesize and provide an appropriate answer voice according to the received voice request, Proper operation can be recommended.

In addition, the extension kit 350 may provide a development kit that enables third party content developers or companies to implement new voice-based functionality based on the cloud intelligence platform 320. For example, in the embodiment of FIG. 2, the electronic device 100 may send a voice request of the received user 110 to the external server 220, and the external server 220 may send the voice request of the received user 110 via the extension kit 350 And send the voice request to the cloud intelligence platform 320 via the provided API. In this case, the cloud intelligence platform 320 recognizes and analyzes the received voice request, and provides a synthesized answer voice or transmits recommendation information on the function to be processed through the voice request to the external server 220 ). 2, external server 220 may send a voice request "Today's weather" to cloud intelligence platform 320 and may receive a voice request "Today's Weather" from cloud intelligence platform 320 You can receive keywords "Today" and "Weather" to be extracted. In this case, the external server 220 can generate text information such as "Today's weather ..." through the keyword "Today" and "Weather ", and transmit the generated text information to the cloud intelligence platform 320 again . At this time, the cloud artificial intelligence platform 320 may synthesize the text information by voice and provide it to the external server 220. The external server 220 can transmit the synthesized voice to the electronic device 100 and the electronic device 100 outputs the synthesized voice "Today's weather ..." through the speaker, Voice request "Today's weather" can be processed.

4 is a block diagram illustrating an internal configuration of an electronic device and a server according to an embodiment of the present invention. The electronic device 410 of FIG. 4 may correspond to the electronic device 100 described above, and may correspond to the information providing device according to the embodiments of the present invention. In addition, the server 420 may correspond to one computer apparatus that implements the external server 220 or the cloud intelligent platform 320 described above.

The electronic device 410 and the server 420 may include memories 411 and 421, processors 412 and 422, communication interfaces 413 and 423, and input / output interfaces 414 and 424. The memories 411 and 421 may be a computer-readable recording medium and may include a permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), and a disk drive. The non-decaying mass storage device such as the ROM and the disk drive may be included in the electronic device 410 or the server 420 as a separate persistent storage device different from the memory 411 and 421. In addition, the memories 411 and 421 are stored with an operating system and at least one program code (for example, a code for an application installed in the electronic device 410 and driven by the electronic device 410 for providing a specific service) . These software components may be loaded from a computer readable recording medium separate from the memories 411 and 421. [ Such a computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, and a memory card. In other embodiments, the software components may be loaded into memory 411, 421 via communication interfaces 413, 423 rather than a computer-readable recording medium. For example, at least one program may be provided by a developer or a file distribution system that distributes the installation files of an application based on a computer program (e.g., the application described above) installed by files provided by the network 430. [ May be loaded into the memory 411 of the device 410.

Processors 412 and 422 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and I / O operations. An instruction may be provided to the processor 412, 422 by the memory 411, 421 or the communication interface 413, 423. For example, the processors 412 and 422 may be configured to execute instructions received in accordance with program codes stored in a recording device, such as memories 411 and 421. [

The communication interfaces 413 and 423 may provide functions for the electronic device 410 and the server 420 to communicate with each other through the network 430 and the electronic device 410 and / Electronic devices, or other servers. The request generated by the processor 412 of the electronic device 410 according to the program code stored in the recording device such as the memory 411 is transmitted to the server 420 through the network 430 under the control of the communication interface 213 ). ≪ / RTI > Conversely, control signals, commands, contents, files, and the like provided under the control of the processor 422 of the server 420 are transmitted to the communication interface 413 of the electronic device 410 via the communication interface 423 and the network 430 (Not shown). For example, control signals, commands, contents, files, and the like of the server 420 received through the communication interface 413 may be transmitted to the processor 412 or the memory 411, 410) may be further included in the storage medium (the persistent storage device described above).

The input / output interface 414 may be a means for interfacing with the input / output device 415. For example, the input device may include a device such as a microphone, a keyboard or a mouse, and an output device may include a device such as a display, a speaker, and the like. As another example, the input / output interface 414 may be a means for interfacing with a device having integrated functions for input and output, such as a touch screen. The input / output device 415 may be composed of the electronic device 410 and one device. The input / output interface 424 of the server 420 may be a means for interfacing with the server 420 or an interface with a device (not shown) for input or output that the server 420 may include.

Also, in other embodiments, electronic device 410 and server 420 may include fewer or more components than the components of FIG. However, there is no need to clearly illustrate most prior art components. For example, the electronic device 410 may be implemented to include at least some of the input / output devices 415 described above, or may be implemented with other components such as a transceiver, Global Positioning System (GPS) module, camera, As shown in FIG. More specifically, when the electronic device 410 is a smart phone, it may be an acceleration sensor, a gyro sensor, a camera module, various physical buttons, buttons using a touch panel, an input / output port, May be further included in the electronic device 410.

In one embodiment, the electronic device 410 includes a microphone (e.g., a multi-channel microphone 417 of FIG. 4) for receiving a user's voice request, a speaker (e.g., (E.g., the speaker 416 of FIG. 4) and a sensor (e.g., sensor 418 of FIG. 4) for sensing the environment of the electronic device 410 as the input / output device 415. The input / output device 415 may be embodied such that at least a part of the input / output device 415 is embedded in the electronic device 410.

At this time, the embodiments of the present invention may further consider the divided spaces of the room.

FIG. 5 is a view showing an example of information on the divided spaces and the position of a room in an embodiment of the present invention. FIG. 5 shows an example of the types of compartmentalized spaces (living room, kitchen, porch, toilet, bedroom, etc.), electronic device 410 and user's locations 510, 520, 530 have. 5, the space along the user's first location 510 is a 'living room', the space along the second location 520 is a 'kitchen', the space along the third location 530 is a ' It can be an 'entrance'.

As described above, the electronic device 410 may include a driving unit for moving the electronic device 410 and a sensor unit for sensing peripheral information of the information providing device to collect the indoor environment of the room. At this time, FIG. 5 shows an example in which the electronic device 410 moves from the 'living room' to the 'kitchen'. In other words, it is difficult for a device fixedly disposed in the 'living room' to cover all the room in the room, while the electronic device 410 according to the present embodiment can cover all the rooms in the room through self-running. For example, the electronic device 410 moves to the vicinity of the user located at the third position 530, which is located at the 'entrance', so that the user can recognize that the space currently occupied by the user is the 'entrance'.

The location of the user may be determined based on the peripheral information sensed by the sensor unit included in the electronic device 410 and / or the voice signal received through the voice-based input / output interface included in the electronic device 410. As a first example, the sensor unit of the electronic device 410 may include a camera, and the electronic device 410 may analyze the image input through the camera to determine the position of the user. For example, the electronic device 410 recognizes the types of objects existing in the space where the user is located, and can grasp the characteristics and types of the spaces. More specifically, the electronic device 410 analyzes the image input through the camera, and when the bed is recognized, the user's position is recognized as a bedroom, and in the case where a sink, a refrigerator, or the like is recognized, . Also, various information such as the location of the current electronic device 410 and the distance between the user and the object located between the electronic device 410 and the user can be acquired through the photographed image. As a second example, the sensor unit of the electronic device 410 may include an operation sensor, a proximity sensor, and the like, and may determine the position of the user by sensing movement of the user through the operation sensor or the proximity sensor. As a third example, the electronic device 410 may determine the location of the user through a multi-channel microphone included in the voice-based input / output interface. The voice signal according to the user's utterance can be inputted for each channel through the multi-channel microphone of the electronic device 410, and the electronic device 410 can perform phase shift of the voice signal input to the multi- (E.g., a relative direction based on the electronic device 410) based on the position of the user. Techniques for measuring the position of a sound signal using the phase shift of a plurality of microinputted same sound signals can be readily understood by those skilled in the art through well known techniques such as beam forming techniques. According to an embodiment, the electronic device 410 may determine the position of the user using two or more of the above three methods for determining the position of the user. The electronic device 410 can determine the type of the space in which the electronic device 410 is located and the type of the surrounding space in which the electronic device 410 is located, It is possible to grasp the type of the space in which the user is located. For example, if the electronic device 410 determines that the space where the electronic device 410 is currently located is a "living room" and the relative position of the user is determined to be the same space as the periphery of the electronic device 410, Can be determined as a 'living room'.

In addition, the electronic device 410 can acquire the structure of the room and the information on the divided spaces in advance while autonomously driving the room. For example, the electronic device 410 acquires information on the boundaries of the respective spaces and information on the type of each of the spaces (a living room, a kitchen, a bedroom, a toilet, a doorway, And may determine the type of space in which the electronic device 410 and / or the user is located, depending on the location and the relative location of the user.

At this time, the electronic device 410 can analyze the image input through the camera and recognize the information about the space where the electronic device 410 is located and the surrounding objects, and based on the information about the recognized space and surrounding objects By controlling the movement of the electronic device 410 through the driving unit, it is possible to avoid obstacles and determine the position of the current electronic device 410 in the room, for example, so as to perform more accurate autonomous driving.

As such, when the information on the space and the information on the location of the user are combined, it is possible to grasp the space where the user is located, and accordingly, it is possible to provide more appropriate information to the user according to the type of the space where the user is located. For example, when the user is located in the 'living room', the electronic device 410 may output a song of the artist 'onion' in association with the user's ignition 'onion'. If the user is located in the 'kitchen' You can provide users with information related to the purchase of recipe or ingredient 'onion' related to 'onion'. In addition, the electronic device 410 may further utilize various external information such as the user's schedule and weather. For example, if it is determined that there is a rain on the basis of external information, the electronic device 410 may actively generate and provide information for informing a user located on the 'entrance' to take an 'umbrella'.

As described above, according to the present embodiment, the electronic device 410 collects the indoor environment of the room while moving, thereby recognizing a plurality of divided spaces in the room and recognizing the plurality of divided spaces And can provide information that is appropriate for the user's location and space based on the spaces.

Hereinafter, various embodiments in which the electronic device 410 autonomously travels indoors and provide appropriate information according to the user's location and space will be described.

6 is a diagram showing an example of an electronic device that follows a user in an embodiment of the present invention. A plan view 500 of FIG. 5 shows compartmented spaces and types of spaces (living room, kitchen, entrance hall, restroom, bedroom, etc.) of the interior. 5, when the user 610 moves from the 'living room' to the 'entrance' after the electronic device 410 moves to the vicinity of the user 610 located in the 'living room' Quot; from the living room to the " front door "

As described above, the electronic device 410 analyzes the image input through the camera, detects the motion of the user through various sensors, or detects the direction of the user through the voice signal of the user. Can be determined. At this time, the electronic device 410 periodically determines the position of the user, thereby confirming the movement of the user, and controlling the driving unit to follow the user in accordance with the movement of the user. Accordingly, the electronic device 410 according to the present embodiment can receive and process the voice request of the user immediately from the user's vicinity, quickly collect information on the space where the user is located, And can be utilized to provide information. For example, if the fixed device is far away, it may be difficult to accurately recognize the user's voice request. On the other hand, since the electronic device 410 according to the present embodiment is always located around the user, All the space can be covered.

For example, the electronic device 410 may include an autonomous driving mode, a traveling mode following the user, a stationary mode fixedly located at one place, and these modes may be determined according to a user's command, ) May be determined according to the active selection according to the situation at the point of time. For example, the electronic device 410 in the idle mode may enter and analyze the user's utterance "follow" 620 to change the idle mode to the driving mode and begin to follow the user. As another example, the electronic device 410 in the running mode may change the running mode to the stop mode and wait at the current position by inputting and analyzing the user's ignition "wait" 630.

On the other hand, the electronic device 410 can wait for the user's position at the future time and move to the expected position first and wait.

FIG. 7 is a diagram illustrating an example of an electronic device moving to an expected position of a user at a future time point, according to an embodiment of the present invention. A plan view 700 of FIG. 7 shows compartmented spaces and types of spaces (living room, kitchen, entrance, toilet, bedroom, etc.) of the interior. 7 shows an example in which the electronic device 410 located in the 'living room' is moved in advance to the 'entrance', which is a space determined as the expected location of the user 710 at the future time point. For example, the electronic device 410 may include a communication interface (e.g., the communication interface 413 described with reference to FIG. 4) for receiving external information associated with the user 710 via at least one of an external device and a server . At this time, the electronic device 410 can predict the location of the user 710 at the future time based on at least one of the external information, the space, and the previously stored user information patterned by the time zone. To this end, the electronic device 410 may pattern and store and manage at least one user information of the contents of the user's utterance and the activities of the user in each time zone in which the user is located. For example, the electronic device 410 may determine that the user requests information about 'recipe' in 'kitchen' between 5 pm and 5:30 pm, It can be predicted that the user 710 will be located in the 'kitchen' between 5:30 PM and 5:30 PM.

As another example, the electronic device 410 can obtain the appointment place of '4:00 pm' and the appointment place of '15 minutes' away from home, and the weather information that it will rain in the evening as external information through an external device or server. Also, the electronic device 410 may store user information on an action of the user 710 that the user 710 passes through a space 'entrance' to go outside. The electronic device 410 combines this information to obtain information that the user 710 will be located at the "porch" before "15 minutes" at least at "4 pm", so that the location of the user 710 at the future time point Can be predicted. In this case, the electronic device 410 may first move to the predicted location of the user 710, and when the user 710 moves to the 'entrance' (where the user is located at the 'entrance' Based on the weather information, it says, 'It rains this evening. You can output information related to the predicted location, such as 'Keep your umbrella'.

On the other hand, a case where the user does not appear at the predicted position can be considered. In this case, the electronic device 410 can recognize that there is a possibility that the user has forgotten the situation and / or the action related to the predicted position, and can inform the user of information related to the predicted position. For example, if the electronic device 410 does not appear on the porch until '4:15 pm' despite the appointment of '4 pm' at the appointment location '15 minutes' away from home, The user can browse and notify the user of an appointment at 4 o'clock or provide a notification message through the electronic device of the user's mobile device or a room close to the current location of the user.

FIG. 8 is a diagram illustrating an example of an electronic apparatus that visits a user to provide notification in an embodiment of the present invention. FIG. A plan view 800 of FIG. 8 shows compartmented spaces and types of spaces (living room, kitchen, entrance, toilet, bedroom, etc.) of the interior. 8 shows an example of a process in which the electronic device 410 moves around the current position of the user 810 to notify an alarm or information when there is a time alarm or an information notification to be provided to the user.

For example, if the time alarm is set at 2:00 PM, the electronic device 410 of the 'living room' can change the position of the user 810 from a preset time (for example, 1:55 PM) Can be searched. 8 shows an example in which the electronic device 410 moves directly to the 'bedroom 1' where the user 810 is currently located. However, in order to search for the location of the user 810, . ≪ / RTI > In this case, the electronic device 410 may move to find a user from a location where the user is likely to be located. For example, the electronic device 410 can store and manage information on a location of a user by time zone, and can search for a user from a space where the user is most located in the current time zone. In this way, the electronic device 410 may move around the position of the user 810 and wait for a time alarm at '2:00 pm'.

As another example, the electronic device 410 of the 'living room' may notify the user that there is a notification according to external information such as a schedule of the user 810, or a message transmitted to the mobile device of the user 810 located in the 'living room' The user may be moved to the periphery of the user 810 in order to provide the user 810 with a notification or the like for informing the user 810 of the information.

When the user sets a specific reminder, the electronic device 410 can predict the most suitable space to fire the reminder according to the contents of the reminder. For example, if you say "tell me to take out pasta", you can judge it as a reminder for 'kitchen' because you are a reminder command related to cooking, and you can move to that space at the time of reminder. If the user does not appear in the corresponding space, the electronic device 410 may move to the space where the user is located and fire the corresponding reminder by the above-described method.

9 is a diagram showing an example of information on output media in an embodiment of the present invention. A table 900 in FIG. 9 shows a device item 910 for identifying electronic devices that can communicate with the electronic device 410 in a cooperative manner, a location item 920 for identifying a home location of another electronic device, An output media item 930 for identifying the output media to include, a detail item 940 containing information about the output media, and an information type item 950 for identifying what information type the output media may be associated with, As shown in FIG. The electronic device 410 can manage information about other electronic devices connected to the home in the same manner as the table 900 and information about the output media of the other electronic devices. In addition, such information may be pre-associated with the information type of the response information for the voice request and / or voice request. For example, if the user's voice request or corresponding response information is analyzed as an information type associated with an "external specific location ", the electronic device 410 responds to the map application of the electronic device A It can be determined as an output medium of information. In this case, the response information can be transmitted to the electronic device A, and the electronic device A can provide the map service corresponding to the response information to the user through the map application of the electronic device A. As another example, the response information may be communicated to a service server that provides map services through a map application. In this case, the service server can provide the map service through the map application installed in the electronic device A. To this end, the electronic device 410 may further manage information such as information for accessing the service server and a user's account so that the service server can identify the user's electronic device A. For example, the electronic device 410 can access the service server via a URL that the table 900 stores further in association with the map application, and by sending the response information along with the user's account, It is possible to provide a map service linked with the response information through the map application installed in the electronic device A through the account.

The electronic device 410 may transmit the information to the electronic device D so that the information is visually output through the display 4 of the electronic device D when the user is located in the 'kitchen' based on the table 900. As another example, when a plurality of output media exist in one space, the electronic device 410 can select a device or an output medium of a device closer to the type of information to be output and a device closer to the output medium. At this time, more specific location of the device can be managed in the table 900 to select the output media of the device closer to the user in one space. At this time, the electronic device 410 can directly measure the distance between the user and the device by analyzing the image input through the camera as an example.

10 is a diagram illustrating an example of specifying an electronic device corresponding to a user command in an embodiment of the present invention. The user 1010 may not specify a device to be operated, such as a user command 'turn on' 1020. At this time, the electronic device 410 specifies a device closest to the user 1010 and processes an operation according to a user command, or specifies a device closest to the user 1010, It is possible to confirm whether the device specified by the electronic device 410 is correct.

10, the electronic device 410 analyzes the peripheral information of the space using a sensor unit such as a camera, and displays the indoor lighting device 1030, the mobile device 1040 of the user 1010, The ITPV 1050 is recognized and the nearest domestic lighting device 1030 to the user 1010 is identified based on the distance between the recognized devices and the location of the user 1010. [ At this time, the electronic device 410 may directly turn on the light source of the specified home lighting device 1030, but the electronic device 410 (see FIG. 10), such as "Turn on the living room light" May ask user 1010 whether a particular device is appropriate. In this case, the electronic device 410 can turn on the light power of the home lighting device 1030 specified according to the ignition word 1060 of the user 1010. The position of the user 1010 and the distance between the apparatuses may be measured by analyzing the peripheral information (for example, an image input through the camera) in which the electronic apparatus 410 is sensed by the sensor unit. However, The electronic device 410 measures the travel distance (e.g., calculated using the number of times the wheel rolls) while moving directly from the location of the user 1010 to the location of the device, It is also possible to measure the position of the mobile terminal 1010 and the distance between the apparatuses. The moving distance measured by the electronic device 410 is different from the distance between the position of the user 1010 and the device but the angle obtained through the direction of the firing point measured by the electronic device 410 The position of the user 1010 and the distance between the device 1010 can be more accurately measured in consideration of the relative angle to the specific device analyzed through the input image and the measured travel distance, You will understand.

On the other hand, the electronic device 410 can limit an object to a device to which a user command can be applied without having to target all the devices in the space. For example, for the user command "This is a volume up", devices that can not control the volume can be excluded from being targeted for a particular purpose. When the command of the user 1010 is "turned on ", devices currently in a state of being turned off around the user are designated as targets for specifying, and when the user command is" shown " Can be targeted for a specific purpose.

As described above with reference to FIG. 9, the electronic device 410 can manage information on other electronic devices connected to the electronic device 410 and can utilize the information managed by the electronic device 410, such as the table 900 of FIG. 9 To define an object for device identification. For example, in FIG. 10, it can be seen that the in-house lighting apparatus 1030 can be excluded from the object for the user command "raise the volume".

In addition, when a negative answer is received in the process of confirming the specified device to the user 1010, the electronic device 410 may identify another device close to the user 1010 and be confirmed by the user. Alternatively, if a negative answer is received from the user 1010 by identifying the device A among the applicable devices A and B and receiving the user command, the device 1010 may identify the device B and perform a user command have. In other words, when there is one specific device that can be specified, the electronic device 410 can directly execute a user command for the device without any confirmation.

11 is a flowchart illustrating an example of an information providing method of an electronic device according to an embodiment of the present invention. The information providing method according to the present embodiment may be performed by a computer apparatus such as the electronic apparatus 410 described above. At this time, the processor 412 of the electronic device 410 may be implemented to execute a control instruction according to a code of an operating system included in the memory 411 or a code of at least one program. Here, the processor 412 controls the electronic device 410 to perform the steps 1110 to 1130 included in the information providing method of FIG. 11 according to the control command provided by the code stored in the electronic device 410 410).

In step 1110, the electronic device 410 controls the driving unit included in the electronic device 410 to sense the peripheral information of the electronic device 410 through the sensor unit included in the electronic device 410, A plurality of spaces can be distinguished and recognized. For example, the sensor unit may include one of various sensors capable of acquiring peripheral information such as a camera, a lidar, an IMU, an ultrasonic sensor, and the like. In the above embodiments, only the examples using the camera are described, but any sensor that can acquire the information about the space by acquiring the surrounding information can be used without limitation. In the preferred embodiment, the electronic device 410 analyzes the input image using a relatively inexpensive camera, and can recognize information about the space where the electronic device 410 is located and objects nearby. In addition, the electronic device 410 may control the movement of the electronic device 410 through the driving unit based on the recognized space and information on the surrounding objects.

In step 1120, the electronic device 410 may determine the location of the user based on at least one of the peripheral information sensed by the sensor unit and the voice signal received via the voice-based input / output interface of the electronic device 410 have. As described above, three methods for determining the location of the user have been described. The electronic device 410 can determine the location of the user using at least one of various methods.

In step 1130, the electronic device 410 may provide information to the user based on the determined plurality of spaces and the determined user's location. For example, the electronic device 410 may determine which space the user is located in, and provide information related to the identified space, thereby providing more appropriate information to the user's location and / or space . For example, for a similar pronunciation utterance such as 'gaolang' and 'weighing', the probability of uttering 'weaning' is higher than 'gaolang' in 'kitchen'. Users who are located in the 'kitchen' can be recognized as' weighing 'while those who are located in the' living room 'can be recognized as' have. As another example, if the current user's location is determined to be 'kitchen' at about 5 pm, the electronic device 410 may automatically recommend the type of recipe for preparing dinner, regardless of the user's voice request . As another example, the electronic device 410 may encourage a user located at the 'entrance' to take a car key or an umbrella.

The type of the space where the user is located can be determined based on analysis of the image input through the camera while moving the electronic device 410 and / or patterned user information for each space and time zone. For example, the electronic device 410 may analyze the image and determine the type of the space by inferring the space where the object exists based on the recognized object (for example, refrigerator, TV, bed, etc.). As another example, the electronic device 410 can pattern and store and manage at least one user information of the contents of the user's utterance and the activities of the user by the space in which the user is located by time zone, It is possible to grasp the type of the related space.

Meanwhile, the electronic device 410 may move to the user's perimeter and provide information to the user as described above.

FIG. 12 is a flowchart illustrating an example of a method in which an electronic device according to an embodiment of the present invention moves to a user's perimeter to provide information.

In step 1210, the electronic device 410 may control the driving unit so that the information providing apparatus moves to the periphery of the determined user's position. The determined location of the user may correspond to the location of the user determined in step 1120 of FIG. In this case, step 1210 may be performed after step 1120 of FIG.

In step 1220, the electronic device 410 can determine the type of the space and the space in which the user is located by utilizing the surrounding information sensed by the sensor unit in the vicinity of the determined user's position. Step 1110 of FIG. 11 is a process for acquiring information on spaces, while step 1220 of FIG. 12 may be a process for acquiring information on a space where a user is located.

In step 1230, the electronic device 410 may provide information to the user according to the determined space and type of space. This step 1230 may be performed in step 1130 of FIG.

According to the present embodiment, the electronic device 410 provides information related to the space where the user is located while moving to the user's perimeter or following the user, so that a single fixed device can not cover all the rooms in the room And it is possible to provide more suitable information to the location and / or space of the user. In addition, it has already been described that the user information patterned by space and / or time zone can be further utilized to provide more suitable information to the user's location and / or space.

13 is a flowchart illustrating an example of a method in which an electronic device according to an embodiment of the present invention predicts a user's position and moves first.

In step 1310, the electronic device 410 may receive external information related to the user from at least one of the external device and the server through the communication interface that the electronic device 410 includes. Here, the external device may include all other devices capable of communicating with the electronic device 410, and may preferably include other devices located in the room. In addition, the server may correspond to the external server 220 described with reference to FIG. For example, the quantity of the foodstuffs managed by the refrigerator, the weather information provided by the external server 220, and the like may be received in the electronic device 410 as external information.

In step 1320, the electronic device 410 may predict the location of the user at the future time based on at least one of the external information and the user information that is patterned by space and time zone and stored in advance. How to predict the stored user information or the location of the user has already been described in detail.

In step 1330, the electronic device 410 may control the driver to move to the predicted user's location. For example, the electronic device 410 can move to a space including a predicted user's position using information on a plurality of divided spaces of the room recognized in step 1110 of FIG. 11, The information obtained through the sensor unit can be analyzed to utilize information on the recognized space and surrounding objects.

In step 1340, if there is no user at the predicted location of the user at the future time, the electronic device 410 notifies the user of the information related to the predicted location of the user through the voice-based input / . The absence of a user at a predicted location at that time may mean that there is a possibility that the user may have forgotten the situation or behavior associated with the predicted location, The user may be provided with information on an action that the user is expected to have performed at the predicted location or a situation that is expected to have occurred at the predicted location. At this time, providing information to the user through the communication interface may include providing information to the user through another electronic device communicating with the electronic device 410 through the communication interface. For example, the electronic device 410 may transmit relevant information to the user's mobile device in the form of an SMS message or an instant messenger message.

According to the present embodiment, the electronic device 410 can improve user convenience according to the user's context by predicting the user's position in advance and moving to the predicted position in advance, rather than simply operating according to a user's command, It is possible to solve the problem that a fixed single device can not cover all the spaces in the room. In addition, the electronic device 410 may inform the user of the related situation or behavior when the user does not appear at the predicted position, thereby helping the user to not forget the situation or behavior related to the predicted position .

FIG. 14 is a flowchart illustrating an example of a method for an electronic device according to an embodiment of the present invention to specify a device corresponding to a user command.

In step 1410, the electronic device 410 may manage information about the electronic devices in the room. For example, an example in which the electronic device 410 manages information on other electronic devices has been described with reference to FIG. Although only other electronic devices including output media are described in FIG. 9, it will be easily understood that other electronic devices that do not include a separate output medium can be managed from a similar viewpoint.

In step 1420, the electronic device 410 may control the electronic devices in the room based on the user's voice request received through the voice-based input / output interface. For example, it has been described with reference to FIG. 10 that the home lighting apparatus 1030 can be controlled based on a user's voice request.

If it is determined in step 1430 that the voice request does not include information for specifying the electronic device corresponding to the user's command, the electronic device 410 may transmit the electronic information corresponding to the user's command based on the peripheral information sensed by the sensor unit The device can be specified.

In one embodiment, the electronic device 410 determines the distance between the determined position of the user and the at least one electronic device based on the perimeter information sensed by the sensor unit, and determines, based on the determined distance, Can be specified. For example, an example has been described in which an electronic device corresponding to a command of a user is specified based on a distance determined using a camera through FIG.

In another embodiment, the electronic device 410 may analyze the user's command included in the voice request to define the electronic device to which the user's command is applicable in the indoor electronic devices, The electronic device corresponding to the user's command can be specified based on the distance.

In another embodiment, the electronic device 410 may be configured to move directly from the determined user's location to the location of the at least one electronic device, measure its travel distance, and determine the location of the user based further on the travel distance, The distance between the devices can be determined, and the electronic device corresponding to the user's command can be specified based on the determined distance.

According to the embodiments of FIG. 14, the electronic device 410 moves to the user's surroundings according to the user's utterance, recognizes the user's peripheral devices, and specifies an object suitable for the user's utterance among the recognized peripheral devices It is possible for the user to be provided with the operation according to the user command without explicitly recognizing the specific device to the electronic device 410 in presenting the user command.

As described above, according to the present embodiments, it is possible to recognize the plurality of divided spaces in the room by collecting the indoor environment of the room while moving, and based on the divided plurality of spaces recognized and distinguished from the location of the user It is possible to provide information suitable for the user's location and space. In addition, it is possible to predict the location of the user at the future time and to move to the predicted location first to provide the information. If the user does not appear at the predicted location at the future time point, The user can also provide relevant notifications if the user forgets the situation or behavior associated with the predicted location. In addition, even when the electronic apparatus related to the user's command can not be specified through the user's voice request, the electronic apparatus corresponding to the user's command is specified based on the distance between the user and the electronic apparatus and / .

The system or apparatus described above may be implemented as a hardware component, a software component or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA) , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device As shown in FIG. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The medium may be one that continues to store computer executable programs, or temporarily store them for execution or download. In addition, the medium may be a variety of recording means or storage means in the form of a combination of a single hardware or a plurality of hardware, but is not limited to a medium directly connected to a computer system, but may be dispersed on a network. Examples of the medium include a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as CD-ROM and DVD, a magneto-optical medium such as a floptical disk, And program instructions including ROM, RAM, flash memory, and the like. As another example of the medium, a recording medium or a storage medium managed by a site or a server that supplies or distributes an application store or various other software to distribute the application may be mentioned. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (20)

An information providing apparatus comprising:
A sensor unit for sensing peripheral information of the information providing apparatus;
A driving unit for moving the information providing apparatus;
A voice-based input / output interface; And
At least one processor configured to execute computer readable instructions,
Lt; / RTI >
Wherein the at least one processor comprises:
And a controller for controlling the driving unit to move the information providing device while recognizing a plurality of spaces based on the peripheral information sensed by the sensor unit,
Based on at least one of the peripheral information sensed by the sensor unit and the voice signal received through the voice-based input / output interface,
Providing the information to the user based on the plurality of separately recognized spaces and the determined location of the user
The information providing apparatus comprising: The method according to claim 1,
Wherein the sensor unit includes a camera,
Wherein the at least one processor comprises:
An image input through the camera is analyzed to recognize information about a space where the information providing apparatus is currently located and information about nearby objects,
And controlling the movement of the information providing apparatus through the driving unit based on the information about the recognized space and surrounding objects
The information providing apparatus comprising: The method according to claim 1,
Wherein the at least one processor comprises:
Controls the driving unit to move the information providing apparatus to the vicinity of the determined user's position,
Determining a type of a space in which the user is located by utilizing surrounding information sensed by the sensor unit in the vicinity of the determined user's location,
Providing information to the user according to the determined type of the space
The information providing apparatus comprising: The method according to claim 1,
Wherein the at least one processor comprises:
At least one user information among the contents of the user's utterance and the activities of the user per space,
Determining a type of each of the plurality of spaces classified and recognized based on the user information patterned for each space and time zone
The information providing apparatus comprising: The method according to claim 1,
Wherein the at least one processor comprises:
Estimating a position of a user at a future time point based on at least one of external information related to a user received from at least one of the external device and the server,
And controlling the driving unit to move to the predicted user's position
The information providing apparatus comprising: 6. The method of claim 5,
Wherein the at least one processor comprises:
And providing the user with a notification of information related to the predicted user's position when the user does not exist at the predicted user's position at the future time point
The information providing apparatus comprising: The method according to claim 1,
Wherein the at least one processor comprises:
Manage information about indoor electronic devices,
Wherein the control unit controls the electronic devices in the room based on a user's voice request received through the voice-based input / output interface,
If the voice request does not include information for specifying the electronic device corresponding to the user's command, the electronic device corresponding to the user's command is specified based on the peripheral information sensed by the sensor unit
The information providing apparatus comprising: 8. The method of claim 7,
Wherein the at least one processor comprises:
Determining a distance between the determined user position and at least one electronic device based on the peripheral information sensed by the sensor unit,
Specifying an electronic device corresponding to a command of the user based on the determined distance
The information providing apparatus comprising: 9. The method of claim 8,
Wherein the at least one processor comprises:
Analyzing a command of a user included in the voice request to define an electronic device to which a user's command is applicable,
Specifying an electronic device corresponding to a user's command based on the determined user's location and the distance between the limited electronic devices
The information providing apparatus comprising: The method according to claim 1,
Wherein the at least one processor comprises:
Moving to the position of the at least one electronic device at the determined user's position, measuring the moving distance,
Determining a distance between the determined user location and the at least one electronic device based further on the travel distance
The information providing apparatus comprising: In an information providing method of an information providing apparatus,
A step of recognizing a plurality of spaces by sensing the peripheral information of the information providing apparatus through a sensor unit included in the information providing apparatus while moving the control unit by controlling the driving unit included in the information providing apparatus;
Determining a location of a user based on at least one of the peripheral information sensed by the sensor unit and a voice signal received through a voice-based input / output interface included in the information providing apparatus; And
Providing information to a user on the basis of the determined plurality of spaces and the determined user's location
The information providing method comprising the steps of: 12. The method of claim 11,
Wherein the recognizing comprises:
Analyzing an image input through a camera included in the sensor unit and recognizing information about a space where the information providing apparatus is currently located and information about nearby objects; And
Controlling movement of the information providing apparatus through the driving unit based on the recognized space and information about the surrounding objects
The information providing method comprising the steps of: 12. The method of claim 11,
Controlling the driving unit such that the information providing apparatus moves to a periphery of the determined user's position; And
Determining a type of a space and a space in which the user is located by using surrounding information sensed by the sensor unit in the vicinity of the determined user's position
Lt; / RTI >
Wherein the providing step comprises:
And providing information to the user according to the determined type of the space and the space. 12. The method of claim 11,
Patterning at least one user information of the contents of a user's utterance and an activity of a user by space in a time zone; And
Determining a type of each of the plurality of separately recognized spaces based on the user information patterned for each space and time zone
Further comprising the steps of: 12. The method of claim 11,
Predicting a location of a user at a future time based on at least one of external information related to a user received from at least one of the external device and the server, and the user information patterned by space and time zone and stored in advance; And
Controlling the driving unit to move to the predicted user's position
Further comprising the steps of: 16. The method of claim 15,
If the user does not exist at the predicted user's position at the future time point, providing a notification to the user about information related to the predicted user's position
Further comprising the steps of: 12. The method of claim 11,
Managing information on indoor electronic devices;
Controlling the electronic devices in the room based on a user's voice request received through the voice-based input / output interface; And
Identifying an electronic device corresponding to a command of the user based on the peripheral information sensed by the sensor unit when the voice request does not include information for specifying the electronic device corresponding to the user's command
Further comprising the steps of: 12. The method of claim 11,
Determines a distance between the determined user position and at least one electronic device based on the peripheral information sensed by the sensor unit, and specifies an electronic device corresponding to a command of the user based on the determined distance, Delivery method. A computer program stored on a computer readable recording medium for causing a computer to execute the method of any one of claims 11 to 18 in combination with a computer. A computer-readable recording medium having recorded thereon a program for causing a computer to execute the method of any one of claims 11 to 18.

Images