KR101025251B1 - Process and Location-aware Information Service System - Google Patents

Abstract

The present invention relates to a 'situational awareness-based information providing system' for providing information according to a user's space-time situation through a mobile terminal (mobile phone, PDA, etc.).

In the present invention, as a first aspect, in a space-time situation recognition based information service providing system, a space-time situation recognition based information providing method comprising: a step of receiving a visit purpose of a user; Setting a process which is a service which a user must perform in order to perform the input user purpose; Collecting the user's context information which is event information of the sensor network server 400 and the local information system 300; Determining whether the process extension setting is necessary based on the situation information; Step 5 for recognizing the current spatiotemporal situation of the user through the collected situation information when no extension setting is necessary; Step 6 for guiding location and service information based on the recognized spatiotemporal situation; Disclosed is a space-time situation recognition based information providing method comprising seven steps of determining whether a process is terminated based on event information of a user who responds to the provided location and service information.

As a second aspect, the digital guardian server 100 for understanding the current situation of the user, infer the user situation to provide the necessary information service to the user; A knowledge model 200 in which knowledge related to a location, a process, and a user is expressed; A user device 500 for providing a user with the information service received from the digital guardian server; A sensor network server 400 which transmits event information on a user's location to the digital guardian server 100 through a sensor; An information service providing system based on space-time situation recognition is provided, including a local information system 300 for transmitting process event information about a user to the digital guardian server 100.

Space-time, situational awareness, location, process, event

Description

System for providing information service based on space-time situation recognition {Process and Location-aware Information Service System}

The present invention relates to a 'situational awareness-based information providing system' for providing information according to a user's space-time situation through a mobile terminal (mobile phone, PDA, etc.). More specifically, the digital guardian server 100 for understanding the current situation of the user, infer the user situation to provide the necessary information service to the user; A knowledge model 200 in which knowledge related to a location, a process, and a user is expressed; A user device 500 for providing a user with the information service received from the digital guardian server; A sensor network server 400 which transmits event information about a user's location to the digital guardian server 100 through a sensor; It relates to a space-time situation recognition based information service providing system comprising a local information system 300 for transmitting the process event information for the user to the digital guardian server (100).

When people have to perform complex tasks in public places such as hospitals and government offices, people with disabilities and older people have difficulties such as what services to get and where to go. Especially for the visually impaired, direction signs cannot help you find your way, and even for the hearing impaired or elderly, it may be difficult to recognize information from the language's guidance. Although there are devices or helpers for the convenience of the disabled or the elderly, they are often inconvenient because they only handle limited situations or exist only in limited locations. In addition, even the general public may have difficulty in activities in crowded public places.

To solve this problem, various context-based information provision systems have been developed. Paganelli has developed an informational system for travelers. ETourism is automatically activated when a traveler passes a point of interest with a PDA. It also keeps you updated with a list of nearby attractions from where you are. As another study on providing travel information, Stephanidis proposed a system that uses a portable PC (Palmtop) equipped with GPS to connect to a city guide service when a user connects to the system and recommend the next travel location.

In addition, a context-aware information provision system has been developed for the convenience of hospital workers such as doctors and nurses. Miguel's study presented a study on the sharing of information between a patient's physician, nurse and laboratory staff. When a doctor thinks the patient needs to be tested, he asks the laboratory for a drug response test, and the laboratory staff knows this request with his handheld and conducts a drug test. The result is then automatically delivered to the next worker of the patient. This study will save hospital workers a lot of time by sharing rotation information of people in charge of one patient and real-time information through the terminal. In another study of hospitals, Mikael presented a system for electronically managing patient records. The system allows nurses to see which patients need what tests and whether they are in the room right now. And by electronically storing patient records, all workers can share information about patients to reduce mistakes.

Such existing situation-aware systems can provide fragmented information and services at specific locations, but there are limitations in guiding tasks with complex procedures. This is because there is no procedural informational guide on what users should do next and how to do it. Therefore, it is necessary to provide appropriate information in time and space where the user is located, instead of providing fragmentary information corresponding to the location considering the user's location and process at the same time. In addition, considering the characteristics of the disabled and senior citizens, it is necessary to convert and provide the information customized for each individual. In addition to identifying the existing inherent limitations, the present invention will introduce a context-aware based information service providing system that guides the disabled and the elderly to handle complex procedures without difficulty.

Performing complex tasks tailored to the public in public places such as government offices, banks and hospitals is a difficult task for people with disabilities and the elderly. This requires a service that guides you through the complex process. In addition, in order to guide information appropriate to the current situation of the user in a form that can be easily understood, it should be a customized guide considering the user type. To do this, we need a service that provides content suitable for each user type by inferring the time-space situation based on the knowledge model of process (time) and location (space).

The present invention provides a service for guiding the work to be done and the place to go according to the user's purpose in a public place unfamiliar to the user. Spatial information through various sensors and temporal information through process analysis are interpreted based on the knowledge model to recognize the user situation and provide information (location guide, service guide, situation information guide, etc.) suitable for the user through the terminal.

Existing situation-based systems can be divided into two types. First, there is a location-based service system. The system is capable of providing fragmented information and services at specific locations, but has limitations in guiding tasks with complex procedures. That's because there's no procedural informational guide on what to do next, where to go, and how to do it. Second, there is an online guide system. The system provides guides such as help as the process progresses in certain environments, such as PCs. However, the online guide system only considers the limited situation of online space. It does not have a framework to cope with various situational changes as in the real living space.

An object of the present invention is to provide a location guide and a service guide to enable a user to handle complex tasks based on situational awareness of location information (space) and process (time). Based on the knowledge model expressing the relationship between the user's purpose, process, and location, it recognizes the spatiotemporal situation and provides information services such as the work to be done, the location to be taken, and how to go.

As a technical idea for achieving the above object, the present invention provides a method of providing information based on space-time situation recognition in an information service providing system based on space-time situation recognition, comprising: a first step of receiving a visit purpose of a user; Setting a process which is a service which a user must perform in order to perform the input user purpose; Collecting the user's context information which is event information of the sensor network server 400 and the local information system 300; Determining whether the process extension setting is necessary based on the situation information; Step 5 for recognizing the current spatiotemporal situation of the user through the collected situation information when no extension setting is necessary; Step 6 for guiding location and service information based on the recognized spatiotemporal situation; Disclosed is a space-time situation recognition based information providing method comprising seven steps of determining whether a process is terminated based on event information of a user who responds to the provided location and service information.

In the first aspect,

As a result of the determination in step 4, if the extension setting is necessary, the process further includes setting step 8 and proceeding to step 5;

In the first aspect,

As a result of the determination in step 7, if the process is not terminated, the sensor network server 400 and the local information system 300 further comprises a nine step of delivering the user event information to the digital guardian server,

In the first aspect,

The location and service information provided to the user may be provided by converting the information according to the cognitive ability of the user.

As a second aspect, the digital guardian server 100 for understanding the current situation of the user, infer the user situation to provide the necessary information service to the user; A knowledge model 200 in which knowledge related to a location, a process, and a user is expressed; A user device 500 for providing a user with the information service received from the digital guardian server; A sensor network server 400 which transmits event information about a user's location to the digital guardian server 100 through a sensor; An information service providing system based on space-time situation recognition is provided, including a local information system 300 for transmitting process event information about a user to the digital guardian server 100.

In the second aspect,

The digital guardian server 100,

A communication manager 140 for providing the situation manager 120 with the location and process event information received from the local information system 300 and the sensor network server 400; A situation manager 120 for interpreting the location and process event information received from the communication manager 140 through the knowledge model 200 to define a situation of a current user; A knowledge manager 130 for searching and inferring knowledge information from the knowledge model 200 and providing the knowledge information to the situation manager 120; Characterized in that it consists of a task manager 110 for determining and providing the information necessary for the user based on the user situation received from the situation manager 120,

In the second aspect,

The user device 500,

A user interface manager 510 for expressing and transmitting information determined from the digital guardian server 100 in a form suitable for a user according to a user model; Characterized in that it comprises a user device communication manager 520 receives the information determined from the work manager 110 of the digital guardian server 100 and delivers it to the user interface manager 510,

In the second aspect,

The user device 500, characterized in that for providing information services provided to the user by converting the information in accordance with the user's cognitive ability,

In the second aspect,

The user device 500 is characterized in that the mobile device, such as PDA, mobile phone,

In the second aspect,

The sensor is characterized in that the position recognition sensor, such as RFID.

The present invention helps to perform a complex task more easily by guiding a user through a personal terminal the place to go, the task to be done and the method according to the user's purpose in handling a complex task in an unfamiliar place. It works.

In particular, in the case of a lack of recognition and cognitive ability, such as disabled people and the elderly, the system has the effect of supplementing the information that is insufficient to perform the same tasks as the general public.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, configurations and operations of embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 illustrates a space-time situation recognition based information providing method in the space-time situation recognition system.

When a user enters a specific institution or place, an information service providing system based on space-time situation recognition recognizes whether the user is admitted through a sensor and presents tasks (purposes) that the user can perform on the terminal screen. The user selects the purpose of visit (S110). Next, an information service providing system based on space-time situation recognition sets an order (or service) to be performed by a user in order to perform a set user purpose (S120). Information about user objectives and processes is defined in the knowledge model and retrieved to set up the process. Based on the events of the sensor network server 400 and the local information system 300 collects the user's situation information (S130). Based on the collected situation information, it is determined whether a process extension setting is necessary (S140). If process extension setting is necessary, process extension setting is made (S180). If the process expansion setting is not necessary, the user's spatiotemporal situation is interpreted based on the collected knowledge of the user's context. It is determined at what point in the process steps to be performed by the user and in what position (S150). Next, the information service providing system based on the space-time situation recognition guides the next service, the route to the next destination, the current location information, the user's work, etc. based on the determined time-space situation. ). Next, it is determined whether the process is terminated based on the user event information (S170). If the process is not terminated, the user event information is transmitted to the digital guardian server (S190).

Information for guidance is included in the knowledge model, and the method of utilizing this information (algorithm) can be applied to various domains. For example, if a user is performing task 1 at position a, and then needs to move to position b to perform task 2, an information service providing system based on space-time situation recognition indicates that the user's position is currently a. Based on the local information system 300 to find out that the task 1 is being performed. When the user completes task 1, the event is transmitted to the digital guardian server 100. Therefore, even if the sensor information of the user's location does not change, the digital guardian server 100 performs the task 2 to the user. It can provide information on how to move to.

As a key method for context recognition, information retrieval and inference in this time-space situation recognition system, the knowledge model expressing the relationship between location and process is used. First, in order to properly recognize the space-time situation, the user's purpose must be known and the process set up accordingly. And it analyzes the context information collected on the basis of the knowledge model expressing the relation between service and location and recognizes the current time and space context. Figure 13 shows a knowledge model showing the relationship between process and location. Based on this, the information service providing system based on space-time situational awareness can complete the whole process quickly and conveniently, while providing comprehensive information services such as work to be done, location to go and how to go. Help

In detail, the situation information of the user is formed based on event information acquired through the sensor network server 400 and the local information system 300, and the formed situation information analyzes the user's spatiotemporal situation based on the knowledge model 200. Done. For example, the user purpose and the resulting process are inferred by the predefined knowledge model 200, and the basic process is set with the inference value. This allows you to determine where and at what point in the process steps the user should perform. The system that recognizes the current user with the spatiotemporal situation information will guide the next service that the user wants to know, the route to the next destination, the current location information, and the user's work. In this case, the information corresponding to each service level is provided as a level of content suitable for the user.

Basically, when a user enters a specific institution or place, an information service providing system based on space and time situation recognition recognizes whether or not the position is entered through the sensor and presents various process information that the user can perform on the terminal screen. do. The user selects an original process suitable for the purpose of the visit.

Next, the system sets the order in which the user must do or receive the services to perform the set user purpose. The entire process is set up in stages based on user context information collected in real time. However, the default process initially set up may change in part as the user's space-time situation changes. For example, the reception and the medical treatment of the hospital medical treatment shown in FIG. 2 are basically processes. However, depending on the results of the medical treatment, services such as 'examination' or 'hospitalization' may be added before receiving. In addition, tasks such as 'toilet' and 'rest' may be added by changing the current situation according to the user's desire or situation during the 'care' or 'movement'.

Of course, not only 'hospital care' but also the high adaptability and flexibility of these processes in general user guidance services are necessary. This is because a system based on space-time situation recognition should reflect the convenience of the user at the present time. In addition, it is necessary to provide user-centered service rather than forcing basic location or service movement according to the existing determined process. Figure 3 illustrates the high suitability of the process according to the user space time situation.

4 is a conceptual comparison of a knowledge structure for providing a location-based information service and a knowledge structure for simultaneously considering a process together with a location. In the existing knowledge structure for providing location-based information services (left), a relationship between each location and each service is defined, and if a user exists at the location, services related to the location can be provided. In contrast, the knowledge model that considers the location and process at the same time can provide a service that meets the user's purpose (process) among the services that can be provided at the user's current location. do.

Figure 5 shows an example of a service that is possible through a knowledge model that simultaneously considers the process with location. A of FIG. 5 shows that the process information can be used to explain a method of guiding and navigating a user's location. B shows that even in the presence of the user, other information can be guided according to the user's purpose and process progress. For example, if the user who is heading for 302 is in 301, the user can be informed that it is now 301 and the next room is 302, and the user whose destination is 301 can be notified that he has arrived at destination 301. .

6 shows a system configuration of the digital guardian server 100. The digital guardian server 100 receives the situation information from the external sensor network server 400 and the local information system 300, understands the current situation of the user, infers the user situation, and provides information necessary for the user through the user device 500. Provide service.

The digital guardian server 100 is composed of a communication manager 140, knowledge manager 130, situation manager 120, task manager 110. The communication manager 140 receives sensor data and event information from the local information system 300 and the sensor network server 400. It also requests the information at the request of the user. Provide the received sensor data and event information to the situation manager 120.

The situation manager 120 analyzes sensor data and event information received from the communication manager 140 through the knowledge model 200 to define the situation of the current user. In particular, according to the user's purpose and current location information, the user's work and where to go to infer through the knowledge model (200).

The knowledge manager 130 searches for and infers knowledge information from the knowledge model 200 and provides the information requested by the situation manager 120.

The task manager 110 determines and provides information necessary for the user based on the user situation received from the situation manager 120. It guides you where to go based on your current location, and provides a description of your current location (location guide). It informs you of the current user's progress and guides you to the future tasks according to your purpose (service guide). It provides specific business guidance (how to use, etc.) that a user must do in order to receive a specific service, and provides the current surrounding situation information such as waiting time.

The knowledge model 200 expresses knowledge related to a location, a process, and a user so that the user's situation can be understood. In particular, it defines the relationship between location and process, making it possible to consider the situation at the same time. As shown in FIG. 13, the knowledge model is divided into a location, a service, and a user so that the system can understand the user's situation.

The user device 500 such as a PDA or a smart phone provides a user with location and service guidance. As in the example of guiding text to the visually impaired, the information is converted and provided according to the cognitive ability of the disabled and the elderly. The user device 500 is composed of a user interface manager 510 and a user device communication manager 520. The user interface manager 510 uses information (content) determined from the work manager 110 to determine a user model (age, gender). , The degree of disability, etc.) to express and deliver in a form suitable for the user. The user device communication manager 520 receives the determined information from the task manager 110 of the digital guardian server 100 and transmits the determined information to the user interface manager 510.

The sensor network server 400 transmits event information about a user's location to the digital guardian server 100 through a sensor such as RFID. Sensor network server 400 is composed of a sensor and the middleware. The sensor disposed in the agency detects information regarding a user's location or behavior, and the detected sensor data is converted into information through middleware and transmitted to the digital guardian server 100.

In addition, the local information system 300 transmits process event (eg, reception completion, storage completion, etc.) information about the user to the digital guardian server 100. Local information system is an information system of each agency and has basic location and process information for providing information service to user. For example, the position information includes a layout of a building, information related to sensor arrangement, and the like. Process information includes information such as the type of work performed in each section and the work flow managed by the agency. In addition, the local information system 300 standardizes the location information, the process information, and the event information of the user generated in various tasks managed by the agency in the form of XML and delivers it to the digital guardian server 100. Such information is stored in the knowledge model 200 and is converted by the knowledge manager 130 and distributed to the business manager 110 and the situation manager 120. This transformed and distributed information enables the user to be closely aware of the user's situation and to efficiently arrange and modify tasks at the end of the process.

Looking at the present invention through a specific situation, in the case of a patient who visited the hospital for the first time after making a telephone reservation, the sensor network server 400 recognizes that the user has entered the hospital through a sensor, such as RFID, through the network. The digital guardian server 100 transmits the position (location), and the digital guardian server 100 checks whether or not the user is reserved through the local information system 300 (process). The information thus formed is organized into contextual information through the knowledge model 200. Organized contextual information provides accurate answers to the questions where users are located and how far is the process going? The user who made a reservation can be recognized that they have come to receive medical treatment by being located in the hospital. On the other hand, the user who is in the hospital can be recognized as a reserved patient because of the appointment. Therefore, it is necessary to know where the user is located and to understand all the processes at this stage so that a clear user situation can be defined.

An information service providing system based on space-time situation recognition must first properly recognize the space-time situation of the user. To this end, as shown in FIG. 7, the spatiotemporal situation is recognized based on the knowledge model 200 expressing a relation between a user's purpose, a process, and a location. 7 illustrates a process of generating space-time situation information.

And the information service providing system based on space-time situation recognition infers user's task and path from space-time situation. Based on this, the process to the point of inference can be specified, and in particular, the process at the present stage is clarified. Finally, the information service providing system based on space-time situation recognition provides customized content suitable for the type and grade of the user as shown in FIG. 8. 8 is a diagram illustrating content of providing customized content according to a user type.

Next, let's look at an embodiment. Among the various public institutions that can apply this time and space situation-based information service provision system, we set up a scenario in which a user who completed treatment moves to the next laboratory for blood collection, targeting a hospital with a complex structure and process. The user requests and is provided with necessary information while moving from the medical office to the next service, which is a test. At this time, as shown in Fig. 9, four situations are proposed according to the subject (system or user) causing the event and the kind of information (location or process).

① First situation: Immediately after the user exits medical treatment, the system provides the user with information to the next service zone, the laboratory (blood collection room).

② Second situation: The user was wondering where he is on the way to the laboratory. The mobile device requests and receives information about the current location and the remaining route.

③ Third situation: The user will go to the laboratory and ask for the information about the service and receive the relevant information.

④ Fourth Situation: After the user arrives at the laboratory, the system will identify the waiting personnel and deliver a message about the waiting or entry.

The scenario analyzed above is shown as a sequence diagram of UML (Unified Modeling Language). 10 illustrates the icons used in the sequence diagram. 11 shows a sequence diagram of the analyzed scenario.

Referring to the sequence diagram of FIG. 11, the sensor network recognizes that the user's location changes from the office to the corridor as the user exits the medical treatment. The information is immediately moved to the server D.G.Server to update the user's location information. The server then retrieves information about the user's next service. Thus, the next service information of the user who received the input from the hospital client (Hospital Client) is called, and the contents are transferred from the hospital server. With this information, the server infers where the next service location is and how to get there. The generated route information is provided by the user as appropriate content from the mobile device.

You can develop an application based on the scenario mentioned earlier. First, we analyze the process and structure of the hospital and develop a knowledge model using ontology. Next, the system was designed using UML, and a system prototype with servers and mobile devices was developed. The UI of the application implemented in FIG. 12 is shown below. The left screen of the above figure shows your current location and the path you need to travel to get the service. The user who wants to get information about the current location or the next place to go can get the information through the location and route displayed on the central map, and present the guide to the user by displaying the minimum process information by the icon at the bottom of the screen. If the user wants to know useful information such as detailed process information or waiting arguments, the user can switch to the screen as shown on the right to obtain detailed information.

Such a user interface may be provided in a variety of forms when it is intended for a hearing impaired person who is unfamiliar with text information, or when a user needs to enlarge a screen or convert visual information, such as a low vision person or a blind person.

Although the embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may be embodied in other specific forms without changing the technical spirit or essential features of the present invention. You will understand that. Accordingly, the embodiments described above are exemplary in all respects and not restrictive.

1 illustrates a space-time situation recognition based information providing method in the space-time situation recognition system.

Figure 3 illustrates the high suitability of the process according to the user space time situation.

4 is a conceptual comparison of a knowledge structure for providing a location-based information service and a knowledge structure for simultaneously considering a process together with a location.

Figure 5 shows an example of a service that is possible through a knowledge model that simultaneously considers the process with location.

6 shows a system configuration of the digital guardian server 100.

7 illustrates a process of generating space-time situation information.

8 is a diagram illustrating content of providing customized content according to a user type.

FIG. 9 shows four situations depending on the subject (system or user) causing the event and the type of information (location or process).

10 illustrates the icons used in the sequence diagram.

11 shows a sequence diagram of the analyzed scenario.

12 illustrates a UI of an application implemented in FIG. 12.

Figure 13 shows a knowledge model showing the relationship between process and location.

<Description of Major Symbols in Drawing>

100: digital guardian server 110: task manager

120: situation manager 130: knowledge manager

140: communication manager 200: knowledge model

300: local information system 400: sensor network server

500: user device 510: user interface manager

520: user device communication manager

Claims (10)

In the space-time situation recognition based information service providing system, Step 1 of receiving a visit purpose of the user; Setting a process which is a service which a user must perform in order to perform the input user purpose; Collecting user context information which is event information of the sensor network server and the local information system; Determining whether the process extension setting is necessary based on the situation information; Step 5 for recognizing the current spatiotemporal situation of the user through the collected situation information when no extension setting is necessary; Step 6 for guiding location and service information based on the recognized spatiotemporal situation; Space-time situation recognition based information providing method comprising the step of determining whether the process is terminated based on the event information of the user in response to the provided location, service information. The method according to claim 1, As a result of the determination in step 4, when the expansion setting is necessary, the process of setting the expansion and further comprising the eight steps of proceeding to the step 5, the space-time situation recognition based information providing method. The method according to claim 1 or 2, As a result of the determination in step 7, if the process is not terminated, the sensor network server and the local information system further comprises nine steps of delivering the user event information to the digital guardian server, the space-time situation recognition based information providing Way. The method according to claim 1 or 2, The location and service information provided to the user may be provided by different information content, form, and expression method provided according to the user type. A digital guardian server that understands the current situation of the user and infers the user's situation to provide the necessary information service to the user; A knowledge model representing knowledge related to location, process, and user; A user device for providing a user with the information service received from the digital guardian server; A sensor network server transmitting event information on a location of a user through a sensor to the digital guardian server; Space-time situation recognition based information service providing system comprising a local information system for transmitting the process event information for the user to the digital guardian server. The method according to claim 5, The digital guardian server, A communication manager for providing a situation manager with location and process event information received from the local information system and sensor network server; A situation manager defining a situation of a current user by interpreting the location and process event information received from the communication manager through the knowledge model; A knowledge manager for searching and inferring knowledge information from the knowledge model and providing the information to the situation manager; Space-time situation recognition based information service providing system, characterized in that consisting of a task manager to determine and provide the information necessary for the user based on the user situation received from the situation manager. The method according to claim 5 or 6, The user device, A user interface manager for delivering the information determined from the digital guardian server to a user; Space-time situation recognition based information service providing system comprising a user device communication manager for receiving the information determined from the task manager of the digital guardian server and delivers it to the user interface manager. The method according to claim 5 or 6, The user device, An information service providing system based on space-time situation recognition, characterized by providing information service provided to the user by converting the information according to the user's cognitive ability. The method according to claim 5 or 6, The user device, Space and time situation-based information service providing system, characterized in that the mobile device such as PDA, mobile phone. The method according to claim 5 or 6, The sensor, An information service providing system based on space-time situation recognition, characterized in that the position recognition sensor that is a short-range wireless communication means such as RFID.

Images