KR20180063391A - Apparatus and method for scheduling of home service robot using service blueprint - Google Patents

Abstract

The present invention relates to home service robot scheduling based on a service blueprint. According to the present invention, a user interface for enabling a user to set a schedule of a home service robot using a service blueprint is provided. A plurality of user behaviors and home service robot behaviors modularized to be selected and edited as a component of the service blueprint through the user interface are output. The user behaviors and home service robot behaviors selected by the user are input through the user interface. The input user behaviors and home service robot behaviors are mapped based on a preset or user-selected correlation. The mapped user behaviors and home service robot behaviors are arranged in a time-serial manner to set a schedule of the home service robot, and the schedule is applied to the service blueprint to be output through the user interface.

Description

[0001] APPARATUS AND METHOD FOR SCHEDULING OF HOME SERVICE [0002] ROBOT USING SERVICE BLUEPRINT [0003]

The present invention relates to a home service robot scheduling apparatus that handles scheduling of a home service robot based on a service blueprint and a scheduling method thereof.

The modern industrial structure is changing from a manufacturing centered on product production to a service business in which service and marketing converge. As such, the service sector is transformed into a service-oriented paradigm and the service sector creates relatively high value. Therefore, manufacturing companies are paying more attention to creating a new business model related to the service sector than product production. For example, not only products with a substance concept such as automobiles and medical devices, but also products with service concepts such as home appliance rental service are linked with services such as continuous management services. Such linkages between products and services are being developed to provide customized services and user experiences (UX) that provide what customers want when they want.

On the other hand, service design is a new field that focuses on optimal solution through combination of media with and without media. Service system and process are designed with the purpose of delivering overall service to customers. In other words, service design can type intangible services. One such area of service design is Service Blueprint.

Service Blueprint is a blueprint that is applied to the user interface (UI), which is commonly used in the field of building technology. It is used for the role of the parties involved in the service delivery process and the flow of the service phase. It is a map to understand. In other words, service blueprints can see the complex tasks as a whole, can accurately judge the process, and provide information necessary for developing and evaluating new services.

On the other hand, there is a smart home service field as a technology field capable of linking with a service blueprint. In recent years, home service robots, which are a typical technology of smart home services, have been actively developed. Home service robots, also called home robots, have been developed to support housekeeping, laundry, cleaning, and other housework at home. With the development of artificial intelligence technology and home network technology, it is expected that various functions and services related to home service robots will be added in the future.

In connection with such a home robot technology, Korean Patent Laid-Open No. 10-2009-0000075 (title of the invention: remote service providing method and system by a third party using a home robot) provides a remote service by a third party A service provider for providing a service requested by the service user through a service program, a home robot used for providing the service, and a service providing service by the home robot and the third party service provider A service connection server for seamlessly connecting a service provider and a service program for providing a remote service by the service provider, and a remote service providing method and system by a third party using a home robot.

However, the home service robot developed to date has a merit that it performs a fixed function or performs a function of directing a user at a specific time point, and there is a lack of satisfying a user's request technically or in service. Accordingly, there is a need for a user adaptive interface that enables various functions of the home service robot to be easily scheduled based on the user's behavior, in addition to the conditions such as the time and place desired by the user.

An embodiment of the present invention is to provide a home service robot scheduling apparatus and a scheduling method thereof capable of matching the functions of a home service robot to a user behavior through service blueprint and scheduling.

It should be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to one aspect of the present invention, there is provided an apparatus for scheduling a home service robot based on a service blueprint, the apparatus comprising: a user interface unit configured to allow a user to set a schedule of a home service robot using a service blueprint, A memory storing a home service robot scheduling program providing an interface; And a processor for executing the home service robot scheduling program, wherein the processor is responsive to execution of the home service robot scheduling program to perform a plurality of user actions modularized to be selectable and editable as a component of a service blueprint, A home service robot, a home service robot, a home service robot, a home service robot, a home service robot, and a home service robot, And a user interface for scheduling a schedule of the home service robot by arranging the mapped user behavior and home service robot behavior in a time series manner, and applying the schedule to the service blueprint and outputting the schedule. At this time, the user action is an action of at least one member of the home service robot, and the home service robot action is a detailed action for performing the function provided by the home service robot.

According to another aspect of the present invention, there is provided a method for scheduling a home service robot based on a service blueprint through a home service robot scheduling apparatus, the method comprising: providing a user interface for enabling a user to set a schedule of a home service robot using a service blueprint ; Outputting a plurality of user actions and a home service robot behavior modularized so as to be selectable and editable as a component of a service blueprint through the user interface; Receiving a user action selected by a user and a home service robot action through the user interface; Mapping the inputted user behavior and home service robot behavior based on a pre-set or user-determined association relationship; Scheduling a schedule of the home service robot by arranging the mapped user behavior and the home service robot behavior in a time series manner; And applying the schedule to a service blueprint and outputting the schedule through the user interface. At this time, the user action is an action of at least one member of the home service robot, and the home service robot action is a detailed action for performing the function provided by the home service robot.

According to any one of the above-mentioned tasks, a user can directly schedule a home service robot, thereby providing a home service robot function by directly setting conditions such as a time, place, and situation desired by the user And can be conveniently scheduled.

According to any one of the task solutions of the present invention, it is possible to provide a service blueprint as a user interface so that not only a service recipient but also a service provider (i.e., a home service robot) It is possible to design simple and intuitive actions of various stakeholders.

Further, according to any one of the tasks of the present invention, the behavior of each function of the home service robot and the behavior of each user are modularized and provided through the service blueprint interface, so that the functions of the home service robot desired by the user, A schedule of the home service robot can be easily generated by selecting an action.

Further, according to any one of the tasks of the present invention, it is possible to provide a service capable of real-time checking of the current state of the home and children through image, video, and voice through the home service robot from inside and outside the home according to the plan scheduled by the user Lt; / RTI >

Further, according to any one of the tasks of the present invention, a service is provided in which a home service robot interlocks with a home service robot of another home according to a schedule that the user has scheduled, and can check the status of a child visiting another home .

According to any one of the tasks of the present invention, a home service robot captures and edits a child's image according to a plan scheduled by a user, recognizes a service target and a situation set by the plan, And provides a service for reproducing an image.

Further, according to any one of the tasks of the present invention, the home service robot stores a book recorded by the user's voice according to a plan scheduled by the user, and stores a service target (e.g., a child) And provides a reading service for reading the sound source of the corresponding book.

FIG. 1 is a view for explaining the concept of a service blueprint applied to an embodiment of the present invention.
2 is a diagram illustrating a structure of a service blueprint applied to a home service robot scheduling service according to an embodiment of the present invention.
3 is a block diagram illustrating a configuration of a home service robot scheduling apparatus according to an embodiment of the present invention.
4 is a diagram illustrating an example of a daily scenario based on a user action to be applied to a service blueprint according to an exemplary embodiment of the present invention.
5 is a diagram illustrating an example of a service blueprint related to a current state notification function of a home service robot according to an embodiment of the present invention.
6 is a diagram illustrating another example of a service blueprint related to a current state notification function of a home service robot according to an embodiment of the present invention.
7 is a diagram illustrating another example of a service blueprint related to a current state notification function of a home service robot according to an embodiment of the present invention.
FIG. 8 is a diagram illustrating an example of a service blueprint related to the editing and notifying function of a home service robot according to an exemplary embodiment of the present invention. Referring to FIG.
9 is a diagram illustrating an example of a service blueprint related to a book reading function of a home service robot according to an embodiment of the present invention.
10 is an example of a plan setting screen output through a service blueprint interface according to an embodiment of the present invention.
11 is an example of a home state output screen output through a service blueprint interface according to an embodiment of the present invention.
12 is a flowchart illustrating a home service robot scheduling method using a service blueprint according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when an element is referred to as "including" an element, it does not exclude other elements unless specifically stated to the contrary, It is to be understood that the foregoing does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, parts, or combinations thereof.

Herein, the term " part " or " module " means a unit realized by hardware or software and a unit realized by using both units. Or two or more units may be realized by one hardware.

FIG. 1 is a view for explaining the concept of a service blueprint applied to an embodiment of the present invention.

Service blueprint is a representation of all the components involved in providing a service, and the interrelationship of each element and the flow of information can be expressed. Such service blueprints can visually confirm not only the visible parts but also the invisible parts in relation to the service provision.

As shown in FIG. 1, the service blueprint can be divided into four regions on the vertical axis by a line of interaction, a line of visibility, and a line of internal interaction. At this time, the service blueprint is divided into a visible area (Onstage or Front stage) based on the line of visibility and an invisible area (Backstage).

The interaction line is the point where the Service Receiver (SR) that receives the service and the Service Provider (SP) that provides the service interact. That is, the service can actually be seen through a set of activities (ie, actions) of service beneficiaries and service providers that occur on the interaction line. The area of the service recipient and the service provider can be distinguished by this interaction line. The line of sight is the basis for distinguishing between the actual and invisible parts of the service. In the service blueprint, behaviors performed by the respective persons in the areas separated by the interaction line and the visible line and corresponding correspondence can be expressed.

Specifically, the upper area of the interaction line represents the SR actions of the service recipient. And the lower area of the interaction line can be divided into multiple areas based on the act subject. At this time, the lower regions of the interaction line are divided by the visible line and the internal interaction line. The upper area of the line of sight represents the behavior of the service providers (Onstage SP action) directly interacting with the service recipient. And the lower area of the line of sight and the upper area of the inner interaction line represent the behavior of the service providers supporting the service providers directly interacting with the service recipient (Backstage SP action). At this time, if the service blueprint has at least one of the service recipient and the service provider, the corresponding area may be added. The lower area of the internal interaction line represents a support process for providing the service in an appropriate and complete manner.

2 is a diagram illustrating a structure of a service blueprint applied to a home service robot scheduling service according to an embodiment of the present invention.

FIG. 2 shows a service blueprint 10 for activity modeling of related parties in the home service robot scheduling.

At this time, the service blueprint 10 may be composed of a service beneficiary layer (SR layer) and a service provider layer (SP layer). The service beneficiary layer includes a service activity (SR Activity) layer (11). The service provider layer includes an On Stage SP Activity layer 12 in which the service recipient SR directly contacts and a Backstage SP Activity layer 12 in which the service recipient does not directly contact 13). In addition, a support process layer 14 may be added to the service blueprint 10.

As shown in FIG. 2, the service blueprint 10 can be used to define and classify behaviors of interested parties (that is, all persons associated with the service recipient, service provider, and service) . Behavioral modeling can also be performed on the basis of interrelationships between activities of related parties. At this time, an action corresponding to each of the related parties is defined in the service blueprint 10, and displayed in a time-series manner. And associations are visually enumerated according to the interaction (ie, relevance) between the behavior of the service recipient and the service provider.

For example, as shown in FIG. 2, the activities (SR activities 1 to 4) of the service recipient who are provided with various functions of the home service robot are related to the activities (SP activities 1 to 4) of the on-stage service providers , And at least one of the actions of the on-stage service provider (SP Activity 1-4) may be associated with the action of the backstage service provider (SP Activity 5) and the support process (Support 1). Such a relationship between the corresponding actions is visually listed in the service blueprint 10.

The home service robot scheduling apparatus according to an embodiment of the present invention can model (i.e., define and classify) stakeholder activities of users in a scheduling process of a home service robot, Can be designed (i.e., edited and generated), and a user interface for outputting the result in a service blueprint is provided. Hereinafter, a user interface to which such service blueprint is applied will be referred to as a " service blueprint interface ".

Hereinafter, the configuration and operation of a home service robot scheduling apparatus according to an embodiment of the present invention will be described in detail.

3 is a block diagram of a home service robot scheduling apparatus according to an embodiment of the present invention.

3, the home service robot scheduling apparatus 100 according to an embodiment of the present invention includes a communication module 110, a memory 120, and a processor 130.

For reference, in the embodiment of the present invention, various "functions" provided by the home service robot 300 are those provided by at least one detailed operation of the hop service robot 300, Lt; / RTI > The user (for example, a family member using the home service robot) corresponds to the concept of the "service beneficiary ", and the home service robot 300 can correspond to the concept of the" service provider ". Also, various functions provided by the home service robot 300 directly to the user or through the user terminal 200 correspond to the concept of "behavior of the onstage service provider" in the service blueprint, and the home service robot 300 Various operations that are performed on their own or in connection with other devices to perform various functions provided to the user may correspond to the "backstage service provider's behavior" and "support processor" concept.

1, a home service robot scheduling apparatus 100 according to an exemplary embodiment of the present invention is shown as a separate apparatus from the home service robot 300. [ However, according to another embodiment of the present invention, the home service robot scheduling apparatus 100 may be included in the home service robot 300. In this case, the home service robot scheduling apparatus 100 may be configured such that the home service robot scheduling apparatus 100 includes all (Hardware and software) that processes all the operations to perform the functions, or may be included in the control system itself of the home service robot 300 in one configuration.

The communication module 110 processes data transmission / reception with the user terminal 200 under the control of the processor 130.

At this time, the user terminal 200 is a terminal of a user registered in advance to use the home service robot 300. The user terminal 200 may be a Personal Communication System (PCS), a Global System for Mobile communications (GSM), a Personal Digital Cellular (PDC), a Personal Handyphone System (PHS), a Personal Digital Assistant (PDA) ) -2000, Code Division Multiple Access (CDMA) -2000, W-CDMA (W-CDMA), WiBro (Wireless Broadband Internet) terminals, tablet PCs and the like. Device. The user terminal 200 is an intelligent terminal that adds a computer support function such as internet communication and information search to a portable terminal. The user terminal 200 is a smart phone capable of installing and executing a large number of application programs (i.e., applications) Or the like. Also, the user terminal 200 may be a wired communication device such as a PC that can access the home service scheduling apparatus 100 through a network.

In addition, the communication module 110 handles data transmission / reception with the home service robot 300. For reference, the home service robot scheduling apparatus according to another embodiment of the present invention can be implemented to be included in the home service robot itself. In this case, the communication module may be a communication module of the home service robot.

The memory 120 stores a home service robot scheduling program that provides a service blueprint interface.

The service blur print interface is a user interface that enables a user to directly perform various functions that can be provided through the home service robot 300 by matching the '

The home service robot scheduling program and the service blueprint interface will be described in detail through the processor 130 described below.

The memory 120 is collectively referred to as a non-volatile storage device that keeps stored information even when power is not supplied, and a volatile storage device that requires power to maintain stored information. In addition to the home service robot scheduling program, various programs and data for controlling the operation of the home service robot 300 are stored in the memory 120 and can be processed by the processor 130. [

The processor 130 executes the home service robot scheduling program stored in the memory 120 and can process various processes for operation of the home service robot 300. [

In response to the execution of the home service robot scheduling program, the processor 130 provides a service blueprint interface through which the user can directly generate various plans through the communication module 110 to the user terminal 200. [

The processor 130 outputs a plurality of user actions and a behavior of the home service robot 300 that are modularized so as to be selectable as a component of the service blueprint and inputs an action of the user selected by the user and an action of the home service robot 300 And maps the inputted user behavior and the behavior of the home service robot 300 on the basis of a pre-set or an association relationship determined by the user, and maps the actions of the mapped user behavior and the home service robot 300 in a time- A schedule of the home service robot is scheduled, and a schedule of the home service robot is applied to the service blueprint to output the service blueprint interface. At this time, the behavior of the user is an action of at least one member of the household provided with the home service robot 300, and the action of the home service robot 300 is a function of performing a function provided by the home service robot 300 It can be set as a detailed action.

At this time, the service blueprint interface is provided in the form of a graphical user interface (GUI) through the display unit of the user terminal 200 and can be displayed as time information. The processor 130 can also provide a service blueprint interface through the home service robot 300, which can be visually displayed through a display unit provided in the home service robot 300.

In addition, the processor 130 controls driving of the home service robot 300 to operate according to the scheduled plan or transmits necessary information to the home service robot 300 so that the home service robot 300 can perform the corresponding operations.

The processor 130 modulates the service blueprint components in advance so that the user can select and input various plan data (i. E., Behaviors of the interested parties) through the service blueprint interface and map and store do. Specifically, the processor 130 associates one or more of the members of the home (that is, the user) having the home service robot 300, the behavior of the user, and the information on the behavior according to the functions of the home service robot 300, As shown in FIG. At this time, the processor 130 models each action of the concerned person into a situation-based action model including a subject of action, an object (i.e., object) of action, a tool, and a situation element.

In other words, the processor 130 modularizes the behavior and function of the related party, the related party, which are components of the service blueprint, and maps the modularized components based on the respective association relationships. The processor 130 provides a service blueprint interface to the user side (i.e., the display unit of the user terminal and the home service robot) that allows the user to select modularized components and to configure them in a time-series manner. At this time, the user can additionally input the action and function of the person concerned and the person concerned through the service blueprint interface. In addition, the user can newly set or change the association between newly input or previously mapped components through the service blueprint interface.

The processor 130 graphically processes the association between the mapped information and the mapped information, and displays the association through the service blueprint interface. At this time, the processor 130 classifies the actions of the persons concerned in a time-series manner and outputs them in a service blueprint format in which the actions and the functions are associated with each other.

As such, the context-based behavioral model provided by the processor 130 may directly generate various scenarios by the user (i.e., at least one authorized member of the household).

That is, the processor 130 provides a service blueprint interface as a scenario creation template that allows a user to directly select and edit each action and situation of a related person. At this time, the user can create a variety of scenarios by selecting the " action of a related person " visually displayed through the service blueprint interface, and constructing a "situation " by interconnecting behavior concepts according to the selected action. For reference, each action of each function, related person, and related person provided by the home service robot can be subdivided into one or more. Each action has an action concept based on an arbitrary situation, and a behavior scenario for scheduling of a home service robot can be created by selecting a specific action concept from each action and connecting (or combining) the same.

Hereinafter, the manner in which the processor 130 provides the service blueprint interface according to the execution of the home service robot scheduling program will be described in detail with reference to Figs.

4 is a diagram illustrating an example of a daily scenario based on a user action to be applied to a service blueprint according to an exemplary embodiment of the present invention.

FIG. 4 shows a daily scenario in the case of "children" which is one of the service beneficiaries in the home provided with the home service robot 300.

As shown in FIG. 4, when the grandmother visits the house after the child wakes up, the mother goes to work. After that, my dad wakes up and my child goes to bed with my grandmother and prepares for my backpacking. After that, my dad goes to work, my child goes to home, then goes home with grandmother on the way to the house. And when the child plays alone, she goes to dinner with her grandmother, and when she gets home, she goes home. After that, the child spends time with the mother and looks at the book, sleeps, and after the child and mother sleep, the father goes to work.

In order to allow the user to configure such a daily scenario as a service blueprint, the processor 130 modularizes various pertinent behaviors (e.g., "grandmother visit", "mom work", and "mom work" However, the modularized activities of related persons are managed by mapping them to various kinds of information (for example, subject of action, object of action, tool, situation element, event and environment, etc.).

Specifically, the processor 130 provides a service blueprint interface capable of implementing a scheduling scenario of the home service robot 300 by selecting components of the service bluet that the user desires.

Through the service blueprint interface, various functions of the home service robot can be added to the scheduling scenario.

For example, the home service robot 300 may allow a user (i.e., a family member) to store various information (image, video, voice recording, etc.) ), And provides a "current status notification function" such as providing various information so that the user can check the status of the child in the outside (that is, another home) in cooperation with the home service robot of another home can do.

Then, the home service robot 300 shoots the child for a certain period of time, creates an edited image by editing the photographed image (i.e., an image and a moving image), reproduces the edited image according to the plan scheduled by the user Quot; edit " function.

In addition, the home service robot 300 may record a sound in which a user (for example, a parent) reads a book in advance, and record the sound source pre-recorded to the child according to the plan scheduled by the user Quot; book reading function "for playing back and listening to a book reading voice) can be provided.

The types of functions provided by the home service robot 300 are not limited to those described above, and various functions can be set.

Meanwhile, the home service robot 300 according to an embodiment of the present invention includes a memory (not shown) in which a program for performing each set function is stored, and a processor (Not shown). At this time, the processor (not shown) of the home service robot 300 executes a program for performing respective functions under the control of the processor 130 of the home service robot scheduling apparatus 100, The corresponding function can be driven according to the command. For reference, when the home service robot scheduling apparatus 100 is implemented on the home service robot 300, the processor 130 may drive the home service robot 300 directly.

Hereinafter, an exemplary service blueprint showing a scheduling scenario of the home service robot will be described with reference to FIGS. 5 to 9. FIG.

When the processor 130 provides a service blueprint interface to the user terminal 200 to generate the service blueprint shown in Figs. 5-9, the user may access the service blueprint via the service blueprint interface provided on the user terminal 200 The service provider's behavior and the service provider's behavior for scheduling the operation (i.e., function) of the home service robot 300 are selected.

The backstage service provider action "and the" support process "refer to the home service robot 300 itself and the " backstage service provider activity " Or a support process interlocked with the home service robot 300, and thus is omitted in the user interface. However, the processor 130 may provide a service blueprint interface capable of generating a service blueprint that includes a " backstage service provider action "and a" support process. &Quot; The processor 130 may also provide a service blueprint interface that displays together the "back-stage service provider behavior" and the "support process" and the "on-stage service provider behavior" separately.

In the example of the service blueprint which will be described below, only the association between the pertinent activities for the service (i.e., function) provided by the home service robot 300 serving as the service provider is indicated by an arrow. For convenience of explanation, Indications for interactions between actions are omitted.

FIGS. 5-7 illustrate exemplary service blueprints associated with the current status notification function of the home service robot.

5, "mother" is set as the service beneficiary, a home service robot (hereinafter referred to as "robot") is set as a service provider, and "child", "father" Respectively. Then, the home service robot 300 photographs the current state of the child or the inside of the house in a set condition (viewpoint, relevant person behavior, situation, and the like) and provides it to the "mother" Notification function "shows the scheduled service blueprint.

Specifically, in FIG. 5, the actions of the child are set as "move to the playground", "arrive at the playground", "play at the playground", "arrive at home", "move to the living room" The behavior of the child was also set in correspondence with the behavior of the child such as "moving to the playground", "arriving at the playground", "playing at the playground", "arriving at home" and "moving to the living room". At this time, the actions of each participant are arranged in a time series on the service blueprint. In FIG. 5, it is shown that the act of scheduling the robots such as " plan setting "and" save plan " The behavior of the related persons and the beneficiaries of the service may be set in advance on the service blueprint or may be newly selected by the user.

As shown in FIG. 5, the mother can process the scheduling by transmitting the corresponding plan to the robot through setting and storing the plan. 5, a user (i.e., a mother) is a plan, and at any point in time or in a period of time from when the child and grandmother perform the " , And that the actors of the association and the service provider selected the action "take a picture" and "send a picture to the mother".

Accordingly, the robot captures the current state of the inside of the home or the child, transmits the captured state to the user terminal 200 of the outside, receives a photograph taken by the robot through the user terminal 200, Lt; RTI ID = 0.0 > P50 < / RTI >

Another example of the "presence notification function" provided by the home service robot 300 in a manner similar to the above can also be scheduled.

According to another example of the " current state notification function "shown in Fig. 6, the robot captures the current state of the child or the inside of the house in a set condition and transmits the captured moving picture to the" , ≪ / RTI > streaming).

Accordingly, as shown in FIG. 6, the robot captures a moving image of the inside of the house or the child at a set time, transmits the photographed moving image to the user terminal 200 in real time, And a series of actions and functions (P60) for preparing to go to work while checking the images can be scheduled.

5 and 6, the functions of the robot (image or moving picture) are automatically scheduled to be operated under certain conditions, and the result of the photographing is transmitted to the user terminal 200 inside or outside the house to be played "Present status notification function" was described. 7 shows another example of the "current state notification function" in which the home service robot notifies the "mother" of the current state of the "child" visited at another place Service blueprint.

7, the robot 1 is a home service robot provided in the home of a service recipient (i.e., mother), and the robot 2 is a home service robot provided in a home other than the home of a service recipient.

In Fig. 7, behaviors such as " arriving at a housewarming "and" drawing a picture "are set as child's actions and the behavior of a nanny is also referred to as & "Etc., indicating that the actions of these stakeholders are arranged in a time series on the service blueprint. At this time, it has been shown that the act of scheduling the robot such as "setting the plan", "selecting the robot" and "saving the plan" is set as the behavior of the mother. Then, the robot 1 indicates that the action such as " receive a plan "in response to the mother's plan storing action," request permission to the robot 2 "and" send a plan " In addition, the robot 2 has been set to "grant authority" in response to the plan sending behavior of the robot 1, "receive plan" from the robot 1, and "voice hear" to the user terminal of the mother.

That is, in FIG. 7, the user (i.e., mother) who is the service beneficiary receives the "present status notification " for the other place outside the home with the robot 1 at any point in time or situation after the child 'Quot; function "is set. Then, the robot 1 communicates with the home care robot (i.e., the robot 2) to request the robot 2 to perform a " speech "action.

Accordingly, the home service robot (i.e., the robot 2) provided in a home other than the home of the service recipient can record the recorded sound about the place where the child is located in the home (i.e., the home) 200), and a series of actions and functions ("P70") in which a service recipient receives a sound source (that is, a recorded voice, etc.) provided by the robot 2 via the user terminal 200 and " Can be scheduled.

For reference, the home service robot according to an embodiment of the present invention may perform communication with a home service robot of another home and user authority authentication processing by itself or under the control of the processor 130. Specifically, the home service robot 300 registers the right to permit at least one of the 'home' functions from the user of another home, and when receiving a remote use request for a certain function from another home service robot, It is possible to authenticate whether the user is a pre-registered user. Then, the home service robot 300 can perform an action (i.e., function) according to the received plan after processing the "receive plan" from another home service robot for the authenticated user.

8 is a diagram illustrating an example of a service blueprint related to the editing and notifying function of the home service robot.

8 shows that "Dad" and "Mom" are set as service beneficiaries, "Robot" is set as a service provider, and "Child" and "Grandmother" are set as related persons. When the "mom" selects a plurality of photos among the photo cuts photographed by the home service robot 300, the home service robot 300 edits the selected photographs and displays " "Editing < RTI ID = 0.0 > Notification"

Specifically, FIG. 8 shows that the robot is set to store a plurality of pictures by photographing the child according to a plan previously set by a user (e.g., a mother) with respect to the robot. Then, as an act of the mother, an act of scheduling a robot such as "Confirm a photo cut", "Select a picture", "Set a plan", "Save a plan", "Move to a room", " Respectively. In addition, the behavior of the robot indicated that actions such as "receiving a plan", "waiting for a plan", "moving to a living room" and "playing a child photo" corresponding to a mother's "save plan" In addition, dad 's actions indicated that activities such as "going to work", "facing robot", "moving to living room", "viewing child photo" were set up.

In Fig. 8, the user (i.e., mother) has selected the following series of related activities as a plan. In other words, when the dad performs a task such as "going home," "facing the robot," and "moving to the living room," the robot faces the father in a "waiting for a plan" , It is indicated that the robot is scheduled to perform the "play child photo" action after the robot performs the "move to the living room" in response to the dad's "move to the living room".

Accordingly, after the robot recognizes the service recipient, the edited child picture is reproduced through the display unit of the user (or the display device of the separate home network equipment), and the dad as the service recipient views the child picture, A series of actions and functions (P80) can be scheduled.

9 is a diagram illustrating an example of a service blueprint related to a book reading function of a home service robot according to an embodiment of the present invention.

9 shows that "child" and "mother" are set as service beneficiaries, "robot" is set as a service provider, and "dad" and "grandmother" are set as related persons. If the "Mom" prepares a book to be read to the child in advance through a corresponding action with the "robot", the home service robot 300 can read the book in accordance with the reading conditions selected by the "child" A "Book Read Function " providing a " read book by voice" shows a scheduled service blue print.

Specifically, FIG. 9 shows that a user (for example, a mother) selects a book in advance and sets an action to record the book part by robot. In this regard, the actions of the mother, such as "choosing the book of the day", "recording the voice for each part", "putting it in the designated position of today", "recognizing the book QR code of today" Set. In response to these mom's actions, the act of "recording" related to the mother's "part-by-part recording" as a robot's action and the "today's book QR Code recognition "and" save "

In FIG. 9, it is shown that the act of scheduling robots such as "plan setting" and "selecting details" is set as a behavior in which a mother selects a condition for reading a book to a child and stores a plan corresponding thereto . In addition, the robot acts as an activity of "getting plan", "saving the plan", "approaching the cognitive subject and talking and speaking", "showing the screen confirming the child", " Quot ;, " confirming a book title with a QR code ", "switching a voice mode to a mother voice "," recognizing a child with a QR code " In addition, as a child's behavior, in response to the actions of the robot after "approaching a cognitive subject and seeing and talking", "accepting touch screen", "checking book title", " Book view "and the like.

In Fig. 9, the mother indicated that she chose the following related act as a plan. In other words, after the child performs the "supper" action, the robot "approaches the cognitively, and then tells and talks about the book" at any point in time or situation. Then, in response to the child's behavior, Quot; and "play a part of the child's voice" in the book of " QR code. &Quot;

Accordingly, after the robot recognizes the service recipient (that is, the child), a series of actions and functions (P90) for reading the book corresponding to the portion selected by the child in the book recorded in advance by the mother can be scheduled .

Each of the functions provided by the home service robot described in FIGS. 5 to 9 can be configured in a complex manner, and the conditions under which each function is performed can also be changed by mutually crossing. That is, according to the selection of the user, the behavior of a related person included in the scheduling scenario and the function of the home service robot can be freely set.

5 to 9, in order to receive a service blueprint interface capable of handling the scheduling of the home service robot 300, the service recipient (i.e., the user) And connects to the scheduling apparatus 100. For example, when the user terminal 200 is a smart phone, the home service robot scheduling apparatus 100 may include a mobile application for home service robot scheduling (i.e., an "app" or an " To provide a service blueprint interface.

Hereinafter, let us describe in more detail the process in which the user (for example, a mother) applied to FIGS. 5 to 9 processes the action of "setting a plan" and "saving a plan" for the robot.

10 is an example of a plan setting screen output through a service blueprint interface according to an embodiment of the present invention.

FIG. 10 shows an example of a screen on which a mobile application providing a service blueprint interface is executed on the user terminal 200. FIG. At this time, the user can go to a planning menu on the mobile app executed by the user terminal 200 to set a plan. For reference, the plan setting on the mobile app can be processed by text input or the like. For example, when a keyword related to a component to be selected by a user (that is, a behavior of a modular related person) is input as text on a service blueprint interface, components corresponding to the text are displayed on the service blueprint interface Text or an image, and the user can select a desired one of the outputted components and input them as an action to the service blueprint. In FIG. 10, actions such as " Wake up ", "Take Pill ", and" Pay for Util fee "are displayed on the selection window at the bottom of the screen. At this time, when the user selects the " Wake up "action and then inputs the" SAVE "button, the " Wake up" And it is output to the "schedule output window" at the top of the screen. At this time, the schedule of the home service robot of the service blueprint type can be output to the "schedule output window" of the service blueprint interface.

Hereinafter, the process of confirming the current state of the child or the inside of the house will be described in more detail according to the provision of the " current state notification function "of the home service robot described above with reference to Figs. 5 to 7.

11 is an example of a home state output screen output through a service blueprint interface according to an embodiment of the present invention.

As described above with reference to FIG. 10, the service blueprint interface provided by the home service robot scheduling apparatus 100 may be output through a mobile app installed on the user terminal 200.

11, when a "current state notification function" of the home service robot 300 described in FIGS. 5 to 7 is scheduled, a photograph (image) and a moving image transmitted by the home service robot 300 are transmitted to the user terminal 200, Of mobile apps. 11, the moving image (or image) received from the home service robot 300 is output through the "current state output window P110" at the bottom of the screen of the user terminal 200. [ At this time, the user operates the 'direction key' displayed on the current status output window P110. The home service robot 300 can manipulate the direction in which the home service robot 300 is shooting in real time. That is, when the home service robot 300 photographs and streams the inside of the house in real time, it can provide a result of photographing while changing the position of the inside of the house according to the operation of the user.

Hereinafter, a home service robot scheduling method using the home service robot scheduling apparatus 100 will be described in detail with reference to FIG.

12 is a flowchart illustrating a home service robot scheduling method using a service blueprint according to an embodiment of the present invention.

The home service robot scheduling procedure shown in FIG. 12 can be processed through the processor 130 of the home service robot scheduling apparatus 100.

First, a user interface (i.e., a service blueprint interface) according to a home service robot scheduling program is provided through a display unit of the user terminal 200 or the home service robot 300 (S200).

The service blueprint interface is a user interface that outputs modular service blueprint components so that the user can confirm them, and receives information selected by the user. The service blueprint interface displays the schedule of the home service robot, which is set based on the information selected by the user, as a service blueprint.

The modularized service blueprint components include the behavior of the home service robot 300 for each function of the home service robot 300 and the behavior for a plurality of users (i.e., subjects and objects) using the home service robot 300 do. At this time, the service blueprint components are respectively mapped and stored based on the correlation. In addition, the service blueprint components are also mapped to information such as the subject of each action, the object (ie object) of the action, the tool for performing the action, the situation element, the event and the environment, to be.

Next, the service blueprint component selected by the user is received through the service blueprint interface (S210).

That is, it receives a related action selected by the user among the modulated related actions output through the service blueprint interface. At this time, the received related person action includes at least one of the action of the service recipient, the action of the service provider (that is, the home service robot), and the action of other related persons.

Then, the selected service blueprint components are matched according to the conditions selected by the user and are arranged in chronological order to generate a service blueprint (S220), and the generated service blueprint is transmitted to the user side (i.e., The user terminal 200 or the display unit of the home service robot 300) (S230).

At this time, the selected components are modeled as a context-based behavior model based on the correlation with previously mapped information, and then created as a visual service blueprint form.

Meanwhile, in the procedure of scheduling the home service robot according to the information selected by the user through the service blueprint interface, the method described in FIGS. 4 to 9 may be applied. That is, when the user selects the behaviors of the hypothetical members provided in the service blueprint interface, the daily scenarios can be set up by chronologically listing the behaviors selected by the user by applying association. When the user selects the function of the home service robot 300 through the service blueprint interface, the behaviors of the home service robot 300 corresponding to the function selected by the user can be applied and scheduled in the daily scenario. For example, the functions provided by the home service robot 300 can be selected from among functions such as a "current state notification function", "edit and notify function", and "book reading function" Selects an action of the robot 300, and matches the action of the robot 300 according to the pertinent action in the daily scenario.

The schedules of the home service robots generated in the above manner are modeled into a situation based behavior model and displayed visually in the form of service blueprints on the screen of the display unit of the user terminal 200 or the home service robot 300.

Next, when the schedule of the home service robot is finally stored, the home service robot 300 controls the driving of the home service robot 300 according to the set function according to the schedule at step S240.

For example, when the "current state notification function" of the home service robot 300 is scheduled, the home service robot 300 photographs the current state of the inside of the home or the child in a time or any situation selected by the user, And transmits the image to the user terminal 200 at a time or a situation at which the user schedules the image. Accordingly, the user can receive the picture taken by the home service robot 300 through the user terminal 200 (or the display unit of the home service robot 300) and confirm the security of the child in real time.

The home service robot scheduling method based on service blueprint according to an embodiment of the present invention described above may be implemented in the form of a recording medium including instructions executable by a computer such as a program module executed by a computer have. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

While the systems and methods of the present invention have been described with reference to particular embodiments, some or all of their components or operations may be implemented using a computer system having a general purpose hardware architecture.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: Home service robot scheduling device 110: Communication module
120: memory 130: processor
200: user terminal 300: home service robot

Claims (15)

A home service robot scheduling apparatus based on service blueprint,
A memory storing a home service robot scheduling program for providing a user interface for enabling a user to set a schedule of a home service robot using a service blueprint; And
And a processor for executing the home service robot scheduling program,
Wherein the processor outputs, in response to execution of the home service robot scheduling program, actions of a plurality of user actions and a home service robot that are modularized so as to be selectable and editable as a component of a service blueprint, The home service robot behavior is inputted and the inputted user behavior and the home service robot behavior are mapped on the basis of a pre-set or a user-determined association relationship, and the mapped user behavior and the home service robot behavior are arranged in a time- A user interface for scheduling a schedule of the home service robot and applying the schedule to the service blueprint and outputting the same,
Wherein the user action is an action of at least one member of the household having the home service robot and the home service robot action is a detailed action for performing the function provided by the home service robot, Device.
The method according to claim 1,
The processor comprising:
Wherein the home service robot controls driving of the home service robot so that the home service robot performs a function set according to the schedule.
The method according to claim 1,
And a display unit for outputting a graphical user interface visually displaying the user interface by the processor.
The method according to claim 1,
Further comprising a communication module for transmitting and receiving data with at least one user terminal,
The processor comprising:
Providing the user interface to the user terminal through the communication module,
And provides the user interface through a display unit of the user terminal in the form of a graphical user interface (GUI).
The method according to claim 3 or 4,
The function provided by the home service robot includes:
Wherein the home service robot scheduling device is a current state notification function that photographs the child at any place in the home in a matched condition for the user action included in the schedule and outputs the captured image in real time through the user interface.
The method according to claim 3 or 4,
The function provided by the home service robot includes:
Communicates with another home service robot interlocked with the home service robot in a condition matched with the user action included in the schedule, and requests information that can confirm the current state of the child visited in another home provided with the other home service robot Is a presence notification feature,
And the other home service robot captures or records the child at any place in the other home so as to output at least one of the image and the moving image or the recorded voice in real time through the user interface, Device.
The method according to claim 3 or 4,
The function provided by the home service robot includes:
Wherein at least one of an image and a moving image of a child photographed under conditions matched with the first user action included in the schedule is edited to generate an edited image, And outputting an edited image through the user interface.
The method according to claim 3 or 4,
The function provided by the home service robot includes:
The method comprising the steps of: recording a voice to be read by a user in a matching condition for a first user action according to the schedule to store a sound source; A home service robot scheduling device, which is a book reading function that reproduces stored sound sources.
A home service robot scheduling method based on service blueprint through a home service robot scheduling apparatus,
Providing a user interface for allowing a user to set a schedule of a home service robot using a service blueprint;
Outputting a plurality of user actions and a home service robot behavior modularized so as to be selectable and editable as a component of a service blueprint through the user interface;
Receiving a user action selected by a user and a home service robot action through the user interface;
Mapping the inputted user behavior and home service robot behavior based on a pre-set or user-determined association relationship;
Scheduling a schedule of the home service robot by arranging the mapped user behavior and the home service robot behavior in a time series manner; And
Applying the schedule to a service blueprint and outputting the schedule through the user interface,
Wherein the user action is an action of at least one member of the household having the home service robot and the home service robot action is a detailed action for performing the function provided by the home service robot, Way.
10. The method of claim 9,
After applying the schedule to the service blueprint and outputting the schedule through the user interface,
And controlling the home service robot to perform a function set by the home service robot according to the schedule.
10. The method of claim 9,
Wherein the user interface comprises:
Wherein the home service robot scheduling apparatus outputs the home service robot in the form of a graphical user interface through a display unit of a connected user terminal or a display unit of the home service robot scheduling apparatus.
12. The method of claim 11,
The function provided by the home service robot includes:
A home service robot scheduling method of photographing a child at any place in a home in a matched condition for a user action included in the schedule and outputting the photographed image in real time through the user interface.
12. The method of claim 11,
The function provided by the home service robot includes:
Communicates with another home service robot interlocked with the home service robot in a condition matched with the user action included in the schedule, and requests information that can confirm the current state of the child visited in another home provided with the other home service robot Is a presence notification feature,
And the other home service robot captures or records the child at any place in the other home so as to output at least one of the image and the moving image or the recorded voice in real time through the user interface, Way.
12. The method of claim 11,
The function provided by the home service robot includes:
Wherein at least one of an image and a moving image of a child photographed under conditions matched with the first user action included in the schedule is edited to generate an edited image, And outputting the edited image through the user interface.
12. The method of claim 11,
The function provided by the home service robot includes:
The method comprising the steps of: recording a voice to be read by a user in a matching condition for a first user action according to the schedule to store a sound source; A home service robot scheduling method, which is a book reading function for reproducing a stored sound source.

Images