KR100775006B1 - Terminal apparatus for providing context aware mobile service and method thereof, and server system for providing indoor mobile service in conjunction with the same - Google Patents

Abstract

The present invention relates to a terminal apparatus for providing a context-based mobile service and a method thereof, and a server system for providing an indoor mobile service in cooperation with the terminal apparatus. In particular, the sensor unit of the terminal apparatus includes a plurality of sensors, Outputs sensor data sensed through the plurality of sensors. The situation recognition unit estimates the surrounding environment of the user of the terminal device based on the sensor data output from the sensor unit and outputs corresponding situation information. The user intention setting unit prescribes the user's intention based on the situation information output by the situation recognition unit, and the service creation unit provides the user based on the situation information output from the situation recognition unit and the user intention defined by the user intention setting unit. Select the service to do. The service adaptation unit adjusts the contents of the service selected by the service generation unit according to a specific condition including the condition of the user, and the service execution unit implements the service adjusted by the service adaptation unit. According to the present invention, it is possible to continuously provide a mobile service suitable for the current location and situation of a user automatically without intentional selection of the user in a vehicle, outdoors, and indoors.

Situational awareness, position recognition, acceleration sensor, vibration, noise

Description

A terminal device providing a mobile service based on situational awareness and a method thereof, and a server system for providing an indoor mobile service in cooperation with the mobile terminal device, and a server system for providing indoor mobile service in conjunction with the mobile terminal device and the server system for providing INDOOR MOBILE. SERVICE IN CONJUNCTION WITH THE SAME}

1 is a diagram illustrating continuous mobile service provision using a context-aware mobile service provision terminal according to an embodiment of the present invention.

2 is a block diagram of a terminal providing a context-aware mobile service according to an embodiment of the present invention.

3 is a detailed block diagram of the sensor unit illustrated in FIG. 2.

FIG. 4 is a block diagram of an indoor situation aware server providing indoor mobile services in cooperation with a situation aware mobile service providing terminal according to an embodiment of the present invention.

5 is a flowchart of a context aware based mobile service providing method according to an exemplary embodiment of the present invention.

FIG. 6A illustrates a case in which the user sits in the driver's seat inside the vehicle, and FIG. 6B illustrates a case in which the user sits in the passenger seat or the rear seat inside the vehicle.

FIG. 7A is a diagram illustrating a case where a user is walking and moving outdoors, and (b) is a diagram illustrating a case where the user stops for a predetermined time or more at a specific position in the middle of walking.

8 is a diagram illustrating a method of providing a mobile service to a user by cooperating with a server in a indoor situation when a terminal is located indoors according to an embodiment of the present invention.

The present invention relates to a terminal device capable of providing a service and a method thereof, and more particularly, to a terminal device and a method for providing a mobile service based on a situation detected through a sensor, and to provide an indoor mobile service in cooperation with the terminal device. It relates to a server system.

Recently, the demand for a context-awareness based mobile service and various technologies for coping with such demands have been developed at a rapid pace.

Context-aware services are based on the user's location, the physical, social and psychological environmental requirements and personal preferences of the user, based on the interpretation of the sensor information and the information presented by the user. Refers to automatically selecting and providing services that match the user's environment and intentions. To this end, mobile devices such as PDAs, mobile phones, laptops, etc. are equipped with sensors for situations involving location recognition, and whether the situation is in charge of the actual situation or the engine is placed on its own device or a remote server to extract the necessary situation information. . The selected service based on the extracted situation information is provided to the actual user through personalization or adaptation process if necessary.

Among these scenario-aware mobile service scenarios, services that are typically introduced in real life provide real-time geographic information for driving based on the location identified based on the Global Positioning System (GPS) system attached to the vehicle, for example. Navigation services, museums or galleries recognize passive RFID tags installed in the exhibit itself or adjacent areas with a reader attached to a mobile terminal such as a PDA, so that information on the target exhibits can be read based on the ID of a unique tag. And a mobile exhibition guide service provided to a user through text, an image, or a video.

In addition, services for monitoring or controlling various devices and apparatuses such as lightings, TVs, air conditioners, heaters, refrigerators, etc. in various various situations including a location using a PDA or a mobile phone in a house have been introduced.

However, such a conventional situation-based mobile service is provided only for the same service in a limited area, and does not provide a continuous service when entering a different area out of the corresponding area. There is this. That is, there is a problem that service provision is limited according to physical characteristics of different places such as indoors, outdoors, and inside a car.

Accordingly, an aspect of the present invention is to provide a terminal and a method for providing a situation-based mobile service regardless of physical characteristics of different places such as inside a car, outdoors, and indoors.

In addition, another technical problem of the present invention is to provide a server system for providing a mobile service indoors in cooperation with the terminal.

Terminal device according to a feature of the present invention for solving the above problems,

A terminal device for providing a context-aware mobile service,

A sensor unit including a plurality of sensors and outputting sensor data sensed through the plurality of sensors; A situation recognition unit for estimating and outputting context information of a user of the terminal device by comparing sensor data output from the sensor unit with pre-stored pattern data; A user intention setting unit which defines the intention of the user based on the situation information output by the situation recognition unit; A service generation unit for selecting a service to be provided to the user based on the situation information output from the situation recognition unit and the user intention defined by the user intention setting unit; A service adaptation unit for adjusting contents of a service selected by the service generating unit according to a specific condition including a condition of the user; And a service execution unit for implementing a service adjusted by the service adaptation unit, and capable of automatically providing a corresponding service according to a change in a service environment for the user sensed by the sensor unit and the situation recognition unit. It features.

Here, the terminal device further includes a user response evaluation unit for evaluating the user's response to the service implemented by the service execution unit and reflecting the evaluated result to the user intention setting unit and the service adaptation unit.

Server system according to another aspect of the present invention,

A server system for providing a context-aware mobile service to a user in cooperation with a user's terminal device.

A user recognition unit which receives authentication data transmitted from the terminal device detecting the entry into the indoor space, performs authentication, and recognizes the corresponding user; A location recognizing unit configured to receive and calculate location information of the terminal device output from a location recognizing system that performs location recognition based on a tag attached to the terminal device and output the location of the terminal device; An indoor situation recognition unit extracting context information necessary for selection and operation of an application service to be provided to the terminal device indoors using the location of the user recognized by the location recognition unit; And storing application service programs that can be provided to the terminal device in an executable file format or a Java applet format, and providing the application program to the terminal device when an application program is requested by the indoor situation recognition unit. Contains wealth.

Mobile service providing method according to another aspect of the present invention,

As a method of providing a context-aware mobile service,

a) recognizing a situation around a user by comparing sensor data detected using a plurality of sensors with pre-stored pattern data; b) defining a user intention corresponding to the recognized situation based on user input information stored in advance; c) selecting a service to be provided based on the situation recognized in step a) and the user intention defined in step b); And d) adjusting the contents of the selected service according to the user's profile or preference information and providing the user with the corresponding service, and automatically providing a corresponding service according to a change in the service environment for the user recognized in step a). It can be provided.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, except to exclude other components unless otherwise stated.

In addition, the term module described herein refers to a unit for processing a specific function or operation, which may be implemented in hardware or software, or a combination of hardware and software.

Now, a terminal and a method for providing a context-based mobile service according to an embodiment of the present invention and a server system for providing an indoor mobile service in cooperation with the terminal will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating continuous mobile service provision using a context-aware mobile service provision terminal according to an embodiment of the present invention.

As shown in FIG. 1, after a user having a terminal 100 providing a situation-aware mobile service according to an embodiment of the present invention moves from the inside of the vehicle 200 to the outside of the vehicle, that is, outdoors, The interior of the building 500, that is, indoors again, receives continuous service.

More specifically, first, a situation in which the user carrying the terminal 100 is inside the driving vehicle 200 is recognized through the terminal 100 to switch to the vehicle service mode to provide a service inside the vehicle to the user. . At this time, the user may be a driver of the vehicle 200, or may sit in the passenger seat or the back seat. Such a situation is detected by the terminal 100 to provide various services in the vehicle 200. Among these services, there is a navigation service provided when the user is a driver of the vehicle 200, and the terminal 100 provides a road guidance service using a location signal recognized using the satellite 300 through GPS. In addition, the terminal 100 accesses the Internet 400 and provides various services by reflecting the user's personal profile and preferences.

After that, when the vehicle 200 stops and the user possesses the terminal 100 and moves out of the vehicle 200 and is located outdoors, the situation is recognized by the terminal 100 and the user switches to the outdoor service mode. We provide outdoors service about.

Thereafter, when the user carries the terminal 100 and enters the building 500 and is located indoors, the situation is recognized by the terminal 100 to switch to the indoor service mode to provide indoor services to the user. . At this time, indoors are provided with an indoor situation whether the server 600 to recognize the location of the terminal 100 in the indoor, the indoor situation server 600 is also provided with an indoor location recognition system 700 provided indoors Based on the location of the terminal 100 recognized using the indoor service for the user in cooperation with the terminal 100 and the server 600 whether the indoor situation.

As described above, in the embodiment of the present invention, the continuous location and the situation of the user terminal 100 may be recognized to provide a continuous mobile service regardless of the physical location characteristic of the user.

2 is a block diagram of a terminal providing a context-aware mobile service according to an embodiment of the present invention.

As shown in FIG. 2, the terminal 100 for providing a context-based mobile service according to an embodiment of the present invention may include a sensor unit 110, a situation recognition unit 120, a user intention setting unit 130, The service creation unit 140, the service adaptation unit 150, the user database 160, the service execution unit 170, the user response display unit 180, the wired / wireless communication unit 190, and the user interface unit 195 are included.

The sensor unit 110 detects an external situation or behavior using various sensors and outputs the corresponding sensor data.

The sensor unit 110 includes a camera 111 for capturing and recording an external image, a microphone 112 for sensing external voice and sound, and a position of the terminal 100 outdoors through the satellite 300. Recognizing GPS 113 and the acceleration sensor 114 to detect the dynamic force, such as acceleration, vibration, shock, and the like to instantaneously detect the motion state of the object is included.

In the embodiment of the present invention, the camera 111 is used to perform user authentication by recognizing a user's face and the like indoors. The microphone 112 is used to perform user authentication by recognizing a user's voice and the like indoors, and also generates noise inside the vehicle 200, for example, an engine transmission sound, wind noise, and tires that are mainly transmitted through air. It is used to detect air transmission noise such as noise and intake and exhaust sound. The GPS 113 is used to recognize the location of the terminal 100 outdoors. In addition, the acceleration sensor 114 is used to estimate the situation or behavior of the user, in particular, vibrations inside the vehicle 200, for example, vibration of the engine transmitted through the vehicle body, a structure that occurs between the tire and the road surface while driving Detect solid-type vibration due to the resonance of the. In the embodiment of the present invention is used as the above function, but may be used as a similar function for the situation in other specific areas.

The situation recognition unit 120 estimates the external situation or the user's behavior by comparing the sensor data sensed by the sensor unit 110 with a pattern of reference signals stored in itself. At this time, the situation recognition unit 120 may store pattern data of reference signals corresponding to various situations previously input by the user in a specific pattern database (not shown). In particular, the pattern data pre-input by the user includes the pattern data corresponding to the situation in which the user is sitting in the driver's seat inside the car 200, and the driver is sitting in the passenger seat or the back seat without driving. The pattern data corresponding to the pattern data, the pattern data corresponding to the case of walking and moving outdoors or indoors are included. Of course, pattern data corresponding to the situation in various areas may be further included. Therefore, the situation recognition unit 120 compares the sensor data detected through the sensor unit 110 with the pre-stored pattern data to see if the user is in the driver's seat inside the car 200 or inside the car 200 but the passenger seat or the like. It is possible to estimate the situation or behavior such as being in the back seat or walking indoors or outdoors.

In particular, the situation recognition unit 120 continuously detects the change of the user's situation, even if the service environment, for example, an area such as the inside of the vehicle 200, outdoors, indoors, etc. is changed and is continuously detected in the corresponding area. Provide service.

The user intention setting unit 130 defines the user's intention estimated based on the situation information recognized by the situation recognition unit 120. In this case, the user intention setting unit 130 may define the intention of the user with reference to information previously input and stored by the user. Accordingly, the user intention setting unit 130 may include a user intention information database (not shown) that stores information previously input by the user. The user's intention is set to a rule indicating the type of service to be executed according to the recognized situation. For example, when the user is sitting in the driver's seat inside the car 200, the rules for the navigation service are set to the user's intention.

The service generation unit 140 selects a suitable service based on the situation information recognized by the situation recognition unit 120 and the user intention given from the user intention setting unit 130. At this time, the service generation unit 140 may select a service suitable for the user's intention by referring to the service list stored in advance, and the service list may be previously provided from the user and stored in a specific service list database (not shown). Can be.

The service adaptation unit 160 adjusts the content of the service selected by the service generation unit 140 according to a special condition, a profile of the user, or a preference displayed on the context information. In this case, the service adaptation unit 160 performs service adaptation with reference to the user database 150 that receives and stores information such as a profile and a preference of the user in advance. For example, when a user selects a service such as listening to music while the user is sitting in the passenger seat or the back seat inside the car 200, the user may consider the user's preferences and the situation information such as the situation inside the car 200 or while driving. Provides music listening service adapted to.

The service execution unit 170 executes a service adapted to the user by the service adaptation unit 160 to actually implement the service.

The user response evaluation unit 180 receives a user's response to the service executed by the service execution unit 170 directly from the user or based on the data sensed through the sensor unit 110 and determines the identified user. Evaluate the response and transmits the result to the user intention setting unit 130 and the service adaptation unit 160.

The wired / wireless communication unit 190 communicates with another device or another user including the server 600 whether the indoor situation is indoors using the internet 400 or a wireless network. The wired / wireless communication unit 190 includes a wireless LAN, which is a short-range communication network using a radio wave or an infrared transmission method, and a Bluetooth (Bluetooth), which is a standard for wireless communication at low power at a short distance.

The service execution unit 170 performs wired / wireless communication with the server 600 or other devices through the wired / wireless communication unit 190.

The user interface unit 195 supports interaction with a user. That is, it receives input from the user or displays information to the user. The user interface 195 includes a display as a visual output device, a speaker as an audio output device, a keypad for receiving a user input, a touch pad, and the like.

3 is a detailed block diagram of the sensor unit illustrated in FIG. 2.

Referring to FIG. 3, the sensor unit 110 of the terminal 100 is a scalable sensor interface for various sensors mounted on the terminal 100, and may insert different sensors in a plug-in manner as needed at a physical level. Multi-channel analog input slots 115 and a buffer and function for processing the multi-channel sensor values obtained here as a limited resource of the terminal 100 and delivering them to the upper application program. The queue portion 116 which performs all functions of facilitating the addition or removal of the data and the data transmitted therefrom are interpreted and transmitted to each of the upper application programs, and the application programs mounted on the terminal 100 It manages all processes ranging from 'just-in-time' installation, start-up, and removal of application programs transmitted from the server 600 to the indoor situation. By including a kind of process engine 117, Lha can maintain an extensible structure for onboarding new sensors and applications on mobile devices. At this point, the process engine performs functions such as thread management, parsing, and function calls.

4 is a block diagram of an indoor situation awareness server 600 that provides an indoor mobility service in cooperation with a situation awareness based mobile service provision terminal according to an embodiment of the present invention.

As shown in FIG. 4, the indoor situation awareness server 600 includes a user recognition unit 610, a location recognition unit 620, an indoor situation recognition unit 630, an application program providing unit 640, and a wired / wireless communication unit 650. ).

The user recognition unit 610 receives authentication data transmitted from the user terminal 100 and performs user authentication to recognize the user. In this case, the authentication data includes a character or a symbol corresponding to the identifier of the terminal 100, face image data of the user obtained through the camera 111, and voice data of the user obtained through the microphone 112. Accordingly, the user recognition unit 610 authenticates the user by simply performing a character or symbol identification, a complex face recognition or a voice recognition according to the authentication data transmitted from the terminal 100.

The location recognition unit 620 recognizes the location of the terminal 100 located in the building 500. In this case, the location recognizing unit 620 may use various location recognition systems. Among the location-aware systems, radio-based indoor location-aware systems include infrared or shortwave systems such as 'Active Badge', 'Active Bat', and 'Cricket'. Recently, the position-aware technology that is attracting attention is a method of locating an object within a certain radius using WLAN or Bluetooth. In addition, another location-aware technology that is possible within a few square meters is RFID. RFID can be easily accessed by using a terminal equipped with a reader to locate the location and other information stored in the tag is expanding the application field. In addition, indoor GPS does not operate indoors because the general GPS system is weak in signal strength, but it applies the principle to install GPS-type navigation signal generators that act as a kind of 'Pseudo Satelite'. In addition, a method of receiving and measuring a position of 'Pseudo GPS Receivers' which has been slightly modified to the existing GPS receivers may also be used. Such systems are already well known and detailed descriptions are omitted here.

The location recognizing unit 620 detects the location of the terminal 100 that is detected through the location recognizing system 700 while a location recognizing system 700 capable of recognizing the location of the terminal 100 is installed in the building 500. Receive the information to recognize the current location of the terminal 100. At this time, the terminal 100 is provided with a tag when entering the building 500, the location recognition system 700 may detect the tag to recognize the location of the terminal 100. Such a tag may vary depending on the type or characteristics of the location recognition system 700 installed in the building 500.

The indoor situation recognition unit 630 extracts situation information necessary for selecting and operating an application service to be provided to the terminal 100 in the building 500 using the location information of the user recognized by the location recognition unit 620. .

The application providing unit 640 stores the application service programs that can be provided to the terminal 100 in an executable file format or a Java applet format, and when the application is requested by the indoor situation recognition unit 630, the corresponding application program. Provide to the terminal 100.

The wired / wireless communication unit 650 communicates with other devices including the terminal 100 and the location recognition system 700 using the Internet 400 or a wireless network. The wired / wireless communication unit 650 includes a wireless LAN, which is a short-range communication network using a radio wave or an infrared transmission method, and a Bluetooth, which is a standard for wireless communication at low power at a short distance.

Hereinafter, a context-aware mobile service providing method according to an embodiment of the present invention will be described with reference to the accompanying drawings.

5 is a flowchart of a context aware based mobile service providing method according to an exemplary embodiment of the present invention.

Referring to FIG. 5, first, sensor data sensed and output by the sensor unit 110 is obtained by the situation recognition unit 120 (S1), and used to estimate a user's current situation or behavior to recognize a situation. (S2). More specifically, when the sensor unit 110 detects and outputs an external signal using various sensors, that is, a camera 111, a microphone 112, a GPS 113, an acceleration sensor 114, and the like, a situation recognition unit. The sensor 120 compares the sensor data output from the sensor unit 110 with the previously stored pattern data to estimate and recognize a current situation or behavior of the current user.

Next, the user intention setting unit 130 defines the user's intention based on the situation information recognized by the situation recognition unit 120 (S3). That is, the type of service to be provided to the user is defined according to the recognized situation or behavior information of the user.

Subsequently, the service generation unit 140 selects a suitable service based on the situation information recognized by the situation recognition unit 120 and the user intention defined by the user intention setting unit 130 (S4). The service selected here becomes a specific service intended by the user.

Thereafter, the service adaptation unit 160 adjusts the content of the service selected by the service generation unit 140 according to the user's profile or preference (S6).

The service thus adjusted and adapted to the user is executed in the service execution unit 170 and provided as a direct service to the user (S7).

As described above, the user's response is evaluated based on the sensor data sensed by the sensor unit 110 or the content input by the user while providing a situation-aware service, and the user intention setting unit 130 is evaluated. And it is delivered to the service adaptation unit 160 so that it can be reflected in future service provision (S8).

On the other hand, the step (S2) includes whether the area of the service provided to the user is changed. For example, whether the user's situation is still inside the car 200 or outdoors, or is within the building 500, or has moved outdoors from inside the car 200, or outdoors Recognize the situation, such as moving into the building 500. Since it is possible to provide a corresponding service based on whether the situation is such, the embodiment of the present invention can provide a continuous service in spite of a change in the service environment.

Hereinafter, a case in which a user carries a terminal 100 according to an embodiment of the present invention in a vehicle 200 will be described with reference to FIGS. 6A and 6B.

First, a case in which a user sits in a driver's seat inside an automobile 200 will be described with reference to FIG. 6A.

When the user sits in the driver's seat, the terminal 100 is generally fixed to the cradle or placed on the dashboard. In this case, the acceleration sensor 114 and the microphone 112 of the sensor unit 110 attached to the terminal 100 are unique patterns of vibration and noise generated in the vehicle 200 (vibration pattern 1, FIG. 6A). Sensing), it is inferred that the user is inside the car 200 and also sits in the driver's seat.

In general, the vibration generated in the vehicle 200 is a vibration of the engine transmitted through the vehicle body, or a solid transmission vibration due to the resonance of the structure generated between the tire and the road surface while driving, and the noise is mainly transmitted through the air. There are air transmission noises such as engine permeation, wind noise, tire noise, intake and exhaust noise. Accordingly, the situation recognition unit 120 of the terminal 100 obtains these physical signals through the sensor unit 110, and compares them with patterns of reference signals stored therein to estimate the situation.

Once the situation that the user is inside the car 200 and sitting in the driver's seat is estimated by the situation recognition unit 120, the terminal 100 according to the rules inherent in the user intention setting unit 130, the sensor unit 110. The GPS 113 automatically switches to the navigation mode based on the location information. That is, after the service generation unit 140 selects the navigation service and the service adaptation unit 160 performs adaptation of the selected navigation service, the service execution unit 170 executes the actual navigation service through the GPS 113. To the user.

During driving of the vehicle 200, the approximate speed is calculated based on the correlation between the period in which the position information of the GPS 113 changes and the speed of the vehicle. If necessary, the service adaptation unit 160 automatically adjusts the execution variables of the navigation service if necessary.

As such, when the user is in the driver's seat inside the vehicle 200 and the terminal 100 is mounted on the vehicle 200, such a situation may be recognized and a corresponding service may be provided.

The navigation service is a situation recognition unit 120, the user intention setting unit 130, the service generation unit 140 when the vehicle 200 reaches the destination when the engine is turned off and the noise disappears through the sensor unit 110 is detected. ), The situation is recognized by the service adaptation unit 160 and the service execution unit 170 and terminated automatically, or terminates when the user intentionally stops.

On the other hand, referring to Figure 6 (b), if the user is inside the car 200, but sitting in the passenger seat or the back seat, the terminal 200 is directly carried by the user in the body or bag, and thus the sensor unit 110 ), The acceleration sensor 114 detects indirect shaking rather than detecting direct vibration from the engine of the vehicle body, and the noise pattern is different from the case where the noise is once in contact with the vehicle body in some form (vibration pattern 2, FIG. 6). See (b) of).

The terminal 100 detects such a situation through the sensor unit 110 and the situation recognizing unit 120 and automatically switches to the passenger seat mode. The user intention setting unit 130 allows the user through the user interface unit 195. You will be asked for the desired service. When the user selects one of entertainment services such as listening to music, watching a video, or a digital multimedia broadcasting (DMB) service, or other services such as viewing information, the terminal 100 may display the user's preference and the interior of the vehicle 200. After the adaptation process of the service adaptation unit 160 is considered in consideration of a driving situation, the service execution unit 170 may actually provide a service desired by the user.

If the user records the operation performed in the middle of the execution of the service or the act of changing the type of the service and the like, the user response evaluation unit 180 learns the result and the user intention setting unit 130 inherent in the terminal 100. And it is delivered to the service adaptation unit 160 to be used as a material for improved service provision later.

After that, when the driving stops and the user comes out of the vehicle 200, the situation recognition unit 120 of the terminal 100 includes the microphone 112, the GPS 113, and the acceleration sensor 114 of the sensor unit 110. The user intention setting unit 130 enters the outdoor service mode by detecting the signal based on the signals from the user.

Hereinafter, a case in which the user possesses the terminal 100 according to the embodiment of the present invention outdoors with reference to FIGS. 7A and 7B will be described.

When the user carries the terminal 100 and walks outdoors and moves (see FIG. 7A), the position of the user received through the GPS 113 of the sensor unit 110 attached to the terminal 100. Based on the information and the movement information at the time of walking input from the acceleration sensor 114 to provide an appropriate context-aware service to the user.

The terminal 100 obtains the physical signals from the GPS 113 and the acceleration sensor 114 through the sensor unit 110, and compares them with patterns of reference signals stored in the situation recognition unit 120 by itself. It is estimated that the user is walking outdoors (see vibration pattern 3 shown in Fig. 7A).

Once it is estimated that the user is outdoors and walking, it automatically enters the information viewing mode based on the location information coming through the GPS 113 according to the rules inherent in the user intention setting unit 130 of the terminal 100. Is switched.

When the user stops for a predetermined time or more at a specific position in the middle of walking (see FIG. 7B), the situation recognition unit 120 of the terminal 100 receives the situation through the sensor unit 110. The GPS 113 input signal for the current position and the input value from the acceleration sensor 114 are detected (see vibration pattern 4, FIG. 7B). Subsequently, the terminal 100 remotely accesses the information about the geographical or object related to the specific location through the wireless Internet connection of the wired / wireless communication unit 190 according to the determination of the user intention setting unit 130. Or, it is obtained from an FTP site and delivered to the user through the user interface unit 195, or the user directly asks the type of service desired by the user.

At this time, such determination is, for example, if there is a major feature in the place itself or near the user stops, the service creation unit 140 derives the relevant information browsing service at the current location automatically. It is performed through the adaptation unit 160 and the service execution unit 170, and if a specific feature does not exist at the identified current location, the user intention setting unit 130 directly queries the user with a desired service and is selected. The service is operated in a manner that the service execution unit 170 performs. That is, the terminal 100 detects such a situation through the sensor unit 110 and the situation recognition unit 120, and directly through the user interface unit 195 for a service desired by the user through the user intention setting unit 130. When the user selects one of entertainment services, such as music listening, video viewing, or DMB service, or information viewing services, the terminal 100 estimates the user's preferences and the situation recognition unit 120. In consideration of this, after the service adaptation unit 160 undergoes an adaptation process, the service execution unit 170 actually provides a service desired by the user.

Once the movement of the user is detected through the acceleration sensor 114 while the service is selected and executed, the service adaptation unit 160 automatically adjusts the execution variables of the service using this situation information. For example, it means that the user can pause the playback mode of the content being viewed or listened to, and switch to the buffering mode of the content downloaded or streamed through the wireless Internet.

In addition, the user records the operation performed in the middle of the execution of the service, the act of changing the type of the service, and the like, which is learned by the user response evaluation unit 180, and the result of the user intention setting unit 130 embedded in the terminal 100. ) And the service adaptation unit 160 to be used as data for improving service provision later.

Thereafter, when walking outdoors is terminated and the user enters the interior of the building 500, when the situation recognition unit 120 detects this when the GPS 113 signal measurement value of the sensor unit 110 is disconnected. The terminal 100 enters the indoor service mode.

Hereinafter, a case in which the user possesses the terminal 100 according to an embodiment of the present invention indoors will be described with reference to FIG. 8.

When the user carries the terminal 100 and enters the building 500, the GPS 113 of the sensor unit 110 loses the function for location recognition, so the terminal 100 confirms this, and the corresponding building. In operation 500, the server 600 captures a radio signal transmitted at a predetermined interval, whether the indoor situation is responsible for providing location recognition information, and performs user authentication.

For user authentication, the terminal 100 transmits authentication data necessary for user authentication to the server 600 whether it is indoor (S11). That is, the terminal 100 transmits an identifier of the device as a simple letter or a symbol, a face image of the user obtained through the camera 111, or a voice signal of the user obtained through the microphone 112. Send to 600.

The user recognition unit 610 of the indoor situation server 600 performs authentication using authentication data such as a character, a symbol, a face image, or a voice signal transmitted from the terminal 100 to recognize the corresponding user, and then the authentication result. The data is transmitted to the terminal 100 (S12). At this time, if the user wants to enter the inside of his / her building 500 and use the terminal 100 for the purpose of monitoring or controlling home appliances or apparatuses, the user's personal data necessary for face recognition or voice recognition are stored indoors. The situation may already be stored in a specific database of the server 600. In addition, when the user uses the terminal 100 for the purpose of simply reading related information, such as a museum or an art gallery, the authentication process may be simplified by simply storing the user's identifier in a database.

On the other hand, the indoor location recognition system 700 detects the location information of the terminal 100 through the signal transmitted from the tag 800 attached to the terminal 100 when entering the building 500, the indoor situation server ( The location recognition unit 620 of the 600 receives the location information output from the indoor location recognition system 700 (S13), calculates the current location of the terminal 100, and then determines the current location of the terminal 100. It transmits at a predetermined interval toward (100) (S14). Therefore, the situation recognition unit 120 of the terminal 100 can check its location by receiving the location information transmitted from the indoor location recognition server 600.

Based on the location information and additional contextual information, the indoor context awareness server 600 and the terminal 100 interact with each other to provide an appropriate contextual terminal service to the user. At this time, in order to recognize a user's location indoors through the terminal 100, the user receives a tag 800 or a transceiving device suitable for this according to the technology and characteristics related to the location recognition system 700 installed indoors. To be temporarily attached to the terminal 100 or the user's body. The tag 800 or the moving path of the transmitting and receiving device is automatically sensed by the indoor location recognition system 700 as described above and transmitted to the server 600 to determine whether the indoor situation is the user by the location recognizing unit 620. The current location is determined, and this information is wirelessly transmitted to the terminal 100 through the wired or wireless communication unit 650 of the server 600 whether the indoor situation.

The indoor situation server 600 may be installed indoors in addition to sensor information transmitted through the wired / wireless communication unit 190 of the terminal 100 by mounting a separate server program for estimating a complex situation including a location of a specific user. All information from other sensors can be used to estimate the user's current situation and potential needs for services.

When the user moves indoors, a physical signal from the acceleration sensor 114 installed in the terminal 100 is obtained through the sensor unit 110, and the pattern of reference signals stored by the situation recognition unit 120 itself is stored. It can be estimated that the user is walking indoors as compared to

Once it is estimated that the user is indoors and walking, the terminal 100 receives the location information transmitted to the terminal 100 via the server 600 according to the rules inherent in the user intention setting unit 130. Automatically switch to information viewing mode based on

When the user stops for a predetermined time or more at a specific position in the middle of indoor walking, the situation recognition unit 120 of the terminal 100 recognizes such a situation through an input value from the acceleration sensor 114 and sets user intention. In response to the determination of the unit 130, information about the object related to the specific indoor location is requested to the server 600 whether the indoor situation is mediated by the wired / wireless communication unit 190.

Whether it is indoors or not, the server 600 examines the information about the area or the object related to the current location of the user, and notifies the terminal 100 when special information or application service is found, and sets the user intention of the terminal 100. Based on this information, 130 automatically provides a specific service to the user or allows the user to select a service directly from a series of possible service lists. In this case, as described above, the determination information is automatically related to the current location through interaction with the server 600, for example, a place where the user is standing, or, if there is a special object around it, indoors. The reading service is derived from the service generation unit 140 and performed through the service adaptation unit 160 and the service execution unit 170. However, if a particular object does not exist at the identified current location, the user inquiries of the desired service through the user intention setting unit 130 are directly executed to operate the selected service in the service execution unit 170. That is, the terminal 100 directly asks the user's desired service through the user intention setting unit 130 through the user interface unit 195, and the user can search information services or specific objects of various formats and contents. If one of the control services is selected, the terminal 100 undergoes an adaptation process of the service adaptation unit 160 in consideration of the user's preference and the situation estimated by the server 600, which is an indoor situation. ) Will actually provide the service you want.

The service selected by the system or the user may be uploaded to the terminal 100 through the wired / wireless communication unit 650 in the form of an executable file or a Java applet by the application providing unit 640 of the server 600 in a case of indoor situation. And can be executed there (S15, S16). This is a practical way to provide various and continuous services in a situation where the terminal 100 cannot mount special service programs that can be provided in a specific indoor space in its limited hardware resource in advance. In some cases, some service application programs may be downloaded from a remote web site or an FTP site instead of the application storage unit 640 of the server 600 in the indoor situation, and executed on the terminal 100.

Once the movement of the user is detected through the acceleration sensor 114 while the service is selected and executed, the service adaptation unit 160 automatically adjusts the execution variables of the service using this situation information. For example, it means that the user can pause the playback mode of the content being viewed or listened to, and can switch to the mode of buffering the content downloaded or streamed through the communication with the server 600 or the wireless Internet, whether or not indoors.

In addition, the user records the operation performed in the middle of the execution of the service, the act of changing the type of the service, and the like, which is learned by the user response evaluation unit 180, and the result of the user intention setting unit 130 embedded in the terminal 100. ) And the service adaptation unit 160 to be used as data for improving service provision later.

On the other hand, when the user's behavior indoors and the user exits the building 500, the situation recognition unit 120 of the terminal 100 at the time when the measurement value of the GPS 113 signal of the sensor unit 110 is resumed Detects this, the terminal 100 enters the outdoor service mode again.

On the other hand, in the above described only the limited service environment, such as the inside of the vehicle 200, outdoors, indoors, etc., a service environment that can provide a context-based mobile service through the terminal 100 according to an embodiment of the present invention As described above, it will be readily understood by those skilled in the art that the situation is recognized by the terminal 100 to provide a continuous service.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

According to the present invention, it is possible to continuously provide a mobile service suitable for the current location and situation of a user automatically without intentional selection of the user in a vehicle, outdoors, and indoors.

Claims (14)

A terminal device for providing a context-based mobile service, A sensor unit including a plurality of sensors and outputting sensor data sensed through the plurality of sensors; A situation recognition unit for estimating and outputting context information of a user of the terminal device by comparing sensor data output from the sensor unit with pre-stored pattern data; A user intention setting unit which defines the intention of the user based on the situation information output by the situation recognition unit; A service generation unit for selecting a service to be provided to the user based on the situation information output from the situation recognition unit and the user intention defined by the user intention setting unit; A service adaptation unit for adjusting contents of a service selected by the service generating unit according to a specific condition including a condition of the user; And A service execution unit for implementing a service coordinated by the service adaptation unit Including; It is possible to automatically provide a corresponding service according to the change of the service environment for the user detected by the sensor unit and the situation recognition unit. Terminal device characterized in that. The method of claim 1, A user response evaluator which evaluates the user's response to the service implemented by the service execution unit and reflects the evaluated result to the user intention setting unit and the service adaptation unit. Terminal device further comprising. The method according to claim 1 or 2, In the plurality of sensors, A camera for photographing an external image; A microphone for sensing external voice and sound; Global Positioning System (GPS) for recognizing position through satellites; And Accelerometer that senses dynamic state of an object instantaneously by detecting dynamic force including acceleration, vibration and shock Terminal device characterized in that it is included. delete The method according to claim 1 or 2, And the user intention setting unit prescribes the intention of the user using a user's intention rule which is specified and stored in advance for a specific situation. The method according to claim 1 or 2, The service environment includes a service environment for a driver in an automobile, a service environment for a passenger in a passenger seat or a rear seat inside a vehicle, a service environment for pedestrians outdoors, and a service environment for an indoor user. Terminal device characterized in that. The method according to claim 1 or 2, The sensor unit, A plurality of multichannel analog input slots for allowing the plurality of sensors to be inserted in a plug-in manner; A queue module configured to perform a function of a buffer for transferring sensor data monitored by the plurality of sensors to an upper application program, and a function of facilitating addition or removal of the plurality of sensors; And The process of interpreting data delivered from the queue module and delivering the data to each application program, and managing all processes from just-in-time loading, running, and removal of application programs mounted in the terminal device. engine Including; The queue module further includes a function for facilitating addition or removal of the process engine. Terminal device characterized in that. The method according to claim 1 or 2, When the terminal device is located indoors, a tag used for location recognition by a location recognition system pre-installed indoors is attached, The situation recognition unit receives the position information recognized by the position recognition system based on the tag to recognize the situation of the user. Terminal device characterized in that. The method of claim 3, The acceleration sensor detects the vibration of the engine transmitted through the vehicle body and the solid-state vibration due to the resonance of the structure generated between the tire and the road surface when driving, The microphone detects air transmission noise inside the vehicle, The situation recognition unit acquires a physical signal of vibration detected by the acceleration sensor and noise detected by the microphone to determine a situation in which the user is driving while located in a driver's seat inside the vehicle. Terminal device characterized in that. The method of claim 3, The terminal device, characterized in that for determining the situation in which the user is walking outdoors based on the vibration data sensed by the acceleration sensor. A server system for providing a context-aware mobile service to a user in cooperation with a user's terminal device, A user recognition unit which receives authentication data transmitted from the terminal device detecting the entry into the indoor space, performs authentication, and recognizes the corresponding user; A location recognizing unit configured to receive and calculate location information of the terminal device output from a location recognizing system that performs location recognition based on a tag attached to the terminal device and output the location of the terminal device; An indoor situation recognition unit extracting context information necessary for selection and operation of an application service to be provided to the terminal device indoors using the location of the user recognized by the location recognition unit; And An application program providing unit that stores application service programs that can be provided to the terminal device in an executable file format or a Java applet format, and provides an application program to the terminal device when an application program is requested by the indoor situation recognition unit. Server system comprising a. The method of claim 11, It includes a wired and wireless network connected to an external network to transmit and receive signals. The indoor situation awareness unit periodically transmits a wireless signal through the wired / wireless network, and performs user authentication on the terminal device entering the indoor using authentication data transmitted from the terminal device receiving the transmitted wireless signal. Server system, characterized in that. In the method for providing a context-based mobile service, a) recognizing a situation around a user by comparing sensor data detected using a plurality of sensors with pre-stored pattern data; b) defining a user intention corresponding to the recognized situation based on previously input and stored user intention information; c) selecting a service to be provided based on the situation recognized in step a) and the user intention defined in step b); And d) adjusting the contents of the selected service according to the user's profile or preference information and providing the same to the user Including; It is possible to automatically provide a corresponding service according to a change in service environment for a user recognized in step a). Mobile service providing method, characterized in that. The method of claim 13, After step d), Evaluating the user's response to the service provided in step d) and reflecting the result in steps b) and d).

Images