KR101719934B1 - Integrating mobile devices into a fixed communication infrastructure - Google Patents

Abstract

The fixed communications infrastructure includes a plurality of fixed information technology devices coupled to at least one device server and at least one device server. A mobile communication device is coupled to a fixed communication infrastructure by a wireless communication link. The locations of each of the fixed IT devices are recorded by the device server. The mobile communication device requests the device server via the wireless communication link for identification information of at least one fixed IT device located in its vicinity. The mobile communication device receives the requested identification information from the device server. The mobile communication device sends the request to the fixed IT device identified by the device server, and the fixed IT device processes the request.

Description

[0001] INTEGRATING MOBILE DEVICES INTO A FIXED COMMUNICATION INFRASTRUCTURE [0002]

The present invention relates to the field of communications technology. More particularly, the present invention relates to integrating mobile communication devices into a conventional fixed communication environment.

Several types of communication networks are known. For example, typical local area networks are based on fixed communications infrastructure such as static workstations, servers, and cable connections. Mobile networks, such as networks according to GSM, UMTS or LTE specifications, enable mobile communication using mobile communication devices. For example, wireless communication infrastructures implementing the IEEE 802.11 specification facilitate short-range mobile communications.

Several methods have been used to integrate these different types of communication networks.

For example, WO 2009/098712 A2 describes a generally fixed communication system for managing and distributing air travel traveler information. The system includes a Departure Control System, a Passenger Information Delivery and Display System Server, and a respective client as well as a communication network interconnecting these elements. The system also includes computing devices located in the vehicle, such as airships, in which passenger information is distributed by air interfaces.

WO 2010/133420 A1 describes an airport communication network having static elements such as departure control systems, workstations and self service printers. The airport communication network may interact with the customer ' s mobile devices. In accordance with the message flow, the customer receives the electronic document from his departure control system to his mobile device and connects his mobile device to the static printer via short-range wireless communication to print the document. Thus, a fixed network infrastructure can be used between the origin control system and the self service printers.

According to the present invention, a method of utilizing a mobile communication device in a fixed communication infrastructure is provided. The fixed communications infrastructure includes a plurality of fixed information technology (IT) devices coupled with at least one device server and at least one device server. A mobile communication device is coupled to a fixed communication infrastructure by a wireless communication link. The locations of each of the fixed IT devices are recorded by the device server. The current location of the mobile communication device is determined. The mobile communication device requests identification of the at least one fixed IT device located in its vicinity from the device server via the wireless communication link. Then, the mobile communication device receives the requested identification information from the device server. The mobile communication device then sends the request to the fixed IT device identified by the device server, and the fixed IT device processes the request.

This allows the mobile communication device to gain knowledge of the fixed IT devices in its vicinity and utilize the infrastructure of the fixed communication network.

According to another aspect, a corresponding heterogeneous information technology network is provided.

Further optional aspects are configured in the dependent claims.

The present invention will be described with reference to the accompanying drawings. In general, like reference numerals designate like or functionally similar elements.
1 is an example of an architecture of the present communication system.
Figures 2a and 2b are exemplary message sequence charts of fixed device location registration.
3 is an exemplary message sequence in which a mobile communication device utilizes a fixed device.
4 is an exemplary message sequence for registering a mobile communication device;
5 is an exemplary message sequence for tracking registered mobile communication devices.
6A and 6B show an example in which a mobile communication device utilizes a fixed device using a map.
7 is an example of supporting navigation of a mobile communication device using a map.
Figures 8a and 8b illustrate an exemplary personnel management use case using a map.
9A and 9B are exemplary information presentations for a supervisory mobile communication device.
10A and 10B are visualization examples of supporting the operation of a mobile communication device using augmented reality mechanisms.
11A and 11B illustrate an information presentation to a mobile communication device using "augmented reality" mechanisms.
Figure 12 is an exemplary conceptual illustration of the internal architecture of a mobile communication device or a fixed device.
The description of the drawings and the drawings is an example of the invention and not of the invention itself.

Before starting the detailed description based on the drawings, several more general aspects will be described first.

So far, fixed communication networks and mobile communication networks are basically two separate worlds. On the other hand, fixed communications networks, including static workstations and fixed infrastructures such as servers and cable connections, may be used by corporations, offices, public institutions or buildings that are used by the public or can be accessed by customers In the form of a local area network (LAN). Employees, staff members, agents and other workers usually work in a static manner using static computer workstations at specific locations. However, in some types of such fixed and operable communication networks, there is a growing need for users to accomplish their tasks in a manner that is mobile, independent of the static workplace. For example, staff members responding to customers in very large building complexes, such as airports, railway stations, shopping malls, and public institutions, or in different locations throughout the area, are increasingly required to access information during mission .

On the other hand, public wireless communication networks that comply with GSM, UMTS or LTE standards or other wireless communication networks such as WLAN / Wi-Fi networks, for example, support communication of mobile devices. However, these networks are generally not integrated with a corporate, office or institutional LAN. Thus, typically, the interaction between one mobile communication device and the servers of the local fixed communication network and the static workstations is not supported either by the infrastructure of the mobile communication network or by the infrastructure of the fixed communication networks .

Thus, there is a need to systematically integrate these types of networks so that users can execute their workflows separately from static workplaces.

The present invention proposes to combine mobile communication devices with a fixed communication network. The mobile communication devices may be tablet computers, mobile terminals, smart phones, laptops / notebooks or any other suitable type of mobile devices. A fixed communications network includes a plurality of fixed IT devices, such as at least one device server and a workstation, a printer, a scanner, a barcode reader, an information display, a facsimile device, a copier, a self service customer station, The device server is arranged to record the locations of the fixed IT devices and thus maintains a inventory of static elements of the fixed communications network. Mobile communication devices can receive any kind of services running on a given fixed IT device in the following manner, thus benefiting from this list as they pass through the area in which the fixed communication infrastructure is deployed.

The current location of the particular mobile communication device is determined. For example, the mobile communication device itself determines its current location. This determination is performed by localization techniques implemented in mobile or wireless communication systems, such as triangulation, for example using a system such as GPS or when satellite coverage in buildings is not effective. In another embodiment, the location of the mobile station is determined by other systems, e.g., mobile communication network infrastructure, using, for example, mobile phone tracking techniques. In this case, the information about the location of the mobile communication device may be stored in a network where the mobile communication device can request this information. The mobile communication device requests the identities of one or more fixed IT devices in the vicinity. The request may or may not include the location of the mobile communication device (e.g., depending on whether the location of the mobile communication device is available in the network). This request may be limited to certain types of fixed IT devices, such as workstations or printers.

Communication between the mobile communication device and the device server is performed by a wireless link, for example, using a Wi-Fi or 2G / 3G / 4G connection. Thus, the area in which the fixed communication network is located also has a wireless or mobile communication infrastructure such as Wi-Fi access points or 2G / 3G / 4G base stations (the latter being Vodafone, Orange, - Microcells / picocells / femtocells operated by base stations of public network operators such as mobile (T-Mobile), Telefonica, AT & T and Verizon, or operators of regional fixed communications networks . The mobile communication infrastructure is coupled with a fixed communication infrastructure to enable communication between mobile communication devices, device servers, and other entities of a fixed communication network.

In response to a request from the mobile communication device to identify a fixed IT device in the vicinity (i.e., close to the mobile communication device), the device server transmits the requested identification information to the mobile communication device. The identification information includes, for example, the device ID and the location of at least one fixed IT device. After receiving the identification information, the identification information is preferably presented to a human user of the mobile communication device. When the device server returns the identification information for one or more fixed IT devices, one of the human user or mobile communication device automatically selects one preferred fixed IT device. The criteria for automatic selection may be, for example, the distance from the mobile communication device to the fixed IT device, i.e., the closest fixed IT device is selected.

After a particular fixed IT device is identified, the mobile communication device sends a request to the fixed IT device. Similar to the communication with the device server, the communication with the fixed IT device is also performed via the wireless communication link. A request to print a specific document (in this case, the request is forwarded to a print driver or a network printer of a workstation having a peripheral printer), a request to process and return information, a request to print a fixed IT device The request may be any kind of request to process the service, including a request to display the information to the user of the service (in this case, the request includes the transmission of the message to be displayed). After receiving the request, the fixed IT device processes it. For example, in the case of a print request, each document is printed. The user of the mobile communication device then physically walks to the fixed IT device to obtain the paper version of the printed document.

Thus, the list of device servers and their fixed IT devices allows a mobile communication device to utilize fixed IT devices.

Optionally, the fixed communications network has a location server that tracks the (current) locations of the mobile communication devices in the area. This supports more workflows and use cases, such as supervision of staff personnel with mobile communication devices. Location tracking by the location server includes identification and optionally a mobile communication device registering itself with the location server to its current location. Registration occurs after the mobile device is activated, after the user logs in to the operating system, after the wireless communication link is activated, or after the application or service that connects the mobile device to the fixed communication infrastructure is started. The mobile communication device updates its location with the location server whenever its location changes to at least a predetermined range. Detection of such a severe location change can be performed locally in a mobile communication system, for example, by a location tracking application installed locally to monitor movement of the mobile communication device (commercially available tablets and smart phones are typically Or these applications can be purchased at each application store for download and installation). Additionally or alternatively, the mobile communication device uses 2G / 3G / 4G location aware mechanisms such as GPS and / or triangulation or Observed Time Difference techniques to track their position changes. In another embodiment, location tracking is performed by a network, e.g., periodically triangulating mobile communication devices.

Optionally, one or more mobile communication devices may act as a supervisory station. Additionally or alternatively, the supervisor may also use a fixed IT device, such as a workstation. By integrating mobile communication devices into a fixed communications network, a supervisor provided with respective permission rights can monitor and direct (not supervise) mobile communication devices. To this end, the supervisory station requests the location of mobile communication devices registered with the location server. This request is forwarded to the location server and includes the location or identity of the particular mobile communication device to be tracked. In the case of a request involving a location, the location server may return a list of mobile communication devices located at or near the specified location. If the request includes the identity of the mobile communication device, the location server will return the location of the particular mobile communication device. After ascertaining the mobile communication device (s) and their / their location (s), the supervisor may send subsequent operational flows to the identified mobile communication devices, such as sending messages to them, Can be executed.

According to one optional arrangement, the fixed communication network is a Departure Control System implemented at the airport. In this environment, airport or airline staff members traveling at the airport or at various locations, such as check-in windows, security checkpoints, boarding areas, information desks, etc., are equipped with tablet computers or smart phones as mobile communication devices. Constraints bound to fixed IT infrastructures in their respective places, such as workstations and printers of gates and desks, are reduced or overcome by the methodologies presented herein. For example, airline employees can access DCS information such as customer lists, flights and boarding status on the go to print documents such as new boarding passes and provide useful information to passengers. From the standpoint of the supervisor, it is possible to efficiently arrange, supervise and direct the staff members.

However, the present invention is not limited to employment at an airport. Rather, there are many other infrastructure, such as railway or bus terminals, shopping infrastructure such as shopping malls or supermarkets, public buildings such as government agencies or ministries, hotels, corporate networks, college campuses, schools, It is possible to implement this in an environment.

Improving the information presentation at the mobile communication device adds more value to the user. Alternatively, two sophisticated information presentation methods, also referred to as "augmented reality" are discussed herein. The map-based approach displays an environmental map that includes locations of fixed IT devices, other mobile communication devices and other points of interest nearby. In this case, the location server maintains maps of the area and is arranged to respond by sending map data to queries by mobile communication devices. The camera-based approach allows a virtual layer of information to be placed on a photograph created by a camera of the mobile communication device. Both approaches can be implemented without the device server.

According to the MAP based augmented reality approach, identification and selection of fixed IT devices and transmission of requests to selected fixed IT devices can be made more user friendly. The mobile communication device sends its current location, its current location and the location of at least one fixed IT device identified by the device server to the location server. The location server responds with map information about the at least one fixed IT device identified by the mobile communication device and the device server. With this information, the mobile communication device can display the location of at least one fixed IT device identified by its current location and / or the device server and / or the location of other mobile communication devices at or near the particular location Can be displayed. For example, map representations allow a user of a mobile communication device to conveniently select a particular fixed IT device and issue a transmission of a request to a specific fixed IT device.

Furthermore, a MAP based augmented reality approach can be used to provide navigation means to navigate within the area or to support the operation of customers. The mobile communication device sends a request for operation from its current location to the point of interest to the location server. The location server computes a travel itinerary that includes midpoints to the destination and walking / driving time information. The location server returns the requested driving information and the respective map information to the mobile communication device displaying the map to the user. The map displays additional information such as the current location of the mobile communication device, optionally the location of any fixed IT devices, the location of the point of interest (i.e., destination), and walking directions and times.

To support the camera based augmented reality approach, the mobile communication device is equipped with a camera. The camera-based approach not only provides information to the user, but also assists the operation.

According to one optional workflow, the mobile communication device activates its camera and then transmits its current location and its current orientation to the location server. The location server returns location information about one or more points of interest, i.e., their distances and directions from the current location of the mobile communication device. The mobile communication device displays a still or video image photographed by its camera and superimposes a virtual representation of the location information about the points of interest received from the location server. The user can combine the camera image with the overlapped information layer to conveniently navigate to each point of interest.

Similarly, a camera-based augmented reality approach is useful for presenting information specific to a place to a user. Location-specific information may be stored, for example, on a content management server that is part of a fixed IT network infrastructure. The mobile communication device activates its camera and then points to a particular point of interest. The mobile communication device then requests the content management server for content information related to the point of interest. The content management server returns the requested content information to the mobile communication device. The mobile communication device superimposes a virtual representation of the content information at a point of interest represented by a portion of a still or video image photographed by a camera of the mobile communication device.

A user, such as an employee of an airline or a handler, an agent, or other member of a staff of work, can thus perform his / her duties irrespective of fixed communications. The functions and techniques presented here, for example, support the following workflows and activities.

The user collects a mobile communication device, e.g., a tablet computer, at the start of his business hours.

- the user logs in to the network, which, in accordance with her / his profile, allows access to the location server via a wireless connection and access to other functions or services provided by the network (e.g., via database, e-mail, Access).

- The user performs activities related to her / his work processes while roaming the area covered by the wireless infrastructure of the network, for example, an airport, a train station, a public institution, a supermarket, a restaurant,

   o The user can select the printer manually through the GUI of her / his mobile communication device, scan the bar code attached to the printer, or select the most convenient Print documents through automatic selection of printer.

   Through the location sensing by the mobile communication device and / or the augmented reality function of the mobile communication device, the user is presented with the situations and activities according to her / his location. For example, an airline supervisor who manages multiple flights will automatically receive and be presented with information relating to flight A when she / he is near the assigned boarding point of flight A.

   o The user uses a barcode reading function and an NFC reader on her / his tablet computer to scan documents, products, and data sources such as supermarket products, boarding passes, menu items on a restaurant menu card, .

   o The user registers the location of a fixed IT device such as a printer by inputting a detailed position or scanning a barcode attached to a fixed IT device.

Turning now to the more detailed description, FIG. 1 shows an example of a schematic diagram of an integrated communication system. In the example of Figure 1, the mobile communication device 1 is a tablet computer considered as the mobile part of the Departure Control System (DCS) implemented at the airport. The mobile communication device 1 becomes able to access the fixed part of the network, in particular the device server 2, the location server 5 and the customer management server 6, using the application installed in itself designated as "roaming DCS" . This allows a staff member with the mobile communication device 1 to "roam " within the airport. Of course, the mobile communication device may be another type of "smart" mobile terminal such as a smart phone, a laptop / laptop, a netbook, Preferably, but not necessarily, the mobile communication device is equipped with features such as azimuth determination and camera to support augmented reality services (this is described in more detail below).

By being connected to a short-range wireless communication system such as a Wi-Fi network 9 and / or a mobile communication network such as a GSM, UMTS or LTE network (not shown) by at least one air interface, And can communicate with the fixed part. Message flows for integrating the mobile communication device 1 into a fixed DCS will be described in detail below.

In addition, these air interfaces and location systems, such as GPS, enable the mobile communication device 1 and / or the Wi-Fi network 9 or the mobile communication network to determine the location of the mobile communication device 1. In order to determine the location of the mobile communication device 1 using GPS, the mobile communication device 1 establishes a connection with the GPS satellite, transmits a location request to the satellite, And a GPS module adapted to receive the GPS signal. Location determination based on the WiFi network 9 or mobile communication network is performed using triangulation techniques such as the Observed Time Difference method or similar to GPS. In some embodiments, the location determination is network-initiated and network-centric. In these embodiments, the network looks for mobile communication device 1, for example by GSM mobile phone tracking. The location tracking is performed periodically, and the determined location of the mobile communication device 1 is stored in the network, for example, as described below in the location server 5. In another embodiment, the network-based location determination is initiated by the mobile communication device 1. That is, if the mobile communication device 1 sends a location request to the access point (s) and / or the base station (s) and (if the access point (s) and / or base station (s) As shown in FIG. In these embodiments, the mobile communication device stores the determined location. Combinations of these techniques are also possible. For example, the mobile communication device 1 requests its location to the network, which location is stored in both the mobile communication device 1 and the network.

The fixed portion of the network shown by Figure 1 comprises at least one device server 2, at least one location server 5 and a customer management server 6, an inventory management entity 7, Lt; RTI ID = 0.0 > 8 < / RTI > The device server 2 is a personal computer capable of providing a Journey Front-End (JFE) that can operate on a fixed IT device, in particular a COTS operating system, and manages user interfaces for static staff, And the like. Peripheral devices 3 connected to workstations such as printers, scanners, screens and other devices, in particular monitors separate from workstations such as barcode and passport readers, self-service printers, self-service screens, The same airport and boarding equipment are also considered fixed IT devices. In particular, the device server 2 maintains a list of fixed IT devices 3 and 4 of the DCS including identification information and their location in the airport area. More specifically, the location information

Airport location identifiers (thus corresponding to 'symbolic locations' used in passanger operations) that use natural language descriptors to classify locations, for example, the first level of descriptors (E.g., "London Heathrow" or "LHR"), a terminal or building at a second level, a location category (eg, gate, check-in area) at a third level;

- three dimensional geospatial coordinates;

For example, workstation IDs (e.g., "A / LHR / R / I / CKI / 5/3") that match the three level hierarchy.

The device server 2 is arranged to manage the list of fixed IT devices 3 and 4. [ That is, it is arranged to include the new devices in the list, update the location of the existing devices 3 and 4 (if the device is moved to another location), and delete the device from the list. If the infrastructure of the fixed part of the DCS is generally constructed, the list of device servers 2 is usually rather static. In particular, the device server 2 is arranged to respond to the request of the mobile communication device 1 regarding the location of the fixed IT devices 3 and 4, as will be described in more detail below. If there is an asset database of a fixed network (such as a directory server, domain controller, etc.), the device server 2 will be connected and synchronized to it.

On the other hand, the location server 5 manages the current locations of the mobile communication devices 1 "circulating" the airport area. Similar to the device server 2, it maintains a list of mobile communication devices including at least respective identification information and their current locations. However, compared with the fixed IT device list of the device server 2, registration of the location is generally more dynamic because registration changes and location updates of the mobile communication devices 1 occur more frequently. The locations of the mobile communication devices 1 may be located in a network-centric manner (e.g., periodic network-initiated location tracking) or mobile communication devices 1 (e.g., GPS or mobile Triangulation < / RTI > initiated by the communication device).

On the other hand, the location server 5 can maintain a repository of maps of the area where the fixed network is located and the mobile communication devices 1 are roaming. In this example of the airport DCS, the location server 5 thus comprises maps of points of interest such as airports, airports buildings and zones, and check-in desks, self-service check-in kiosks, boarding passes, transfer desks, keep it. Maps may be created exclusively and may be obtained from third parties (e.g., from Google) or purchased in advance from the fixed network's own operators (i.e., in this example, from the airport operator). In the latter case, synchronizing to a source of a third party or operator is desirable to keep the maps up-to-date.

The location server 5 is arranged to calculate the location of the circulation personnel with the mobile communication devices 1 and display them on a map. It also

- ID and mission of the agent;

A mobile communication device ID;

- current area;

- Keeps information about the location of moving personnel, such as three-dimensional geospatial coordinates.

The customer management server 6 provides a back-end of the customer management application. Which processes user queries and provides interfaces with more services and products, such as inventory 7 and reservations 8.

In addition to the location management of the mobile communication devices 1, in order to integrate mobile and static components of the network shown by Figure 1, a location repository for each of the fixed IT devices is required. Contrary to mobile communication devices 1 that typically provide interfaces based on triangulation of Wi-Fi / GSM UMTS / LTE signal strength from GPS services or in buildings to access spatial locations, fixed IT devices It is usually not equipped with such a position determination function. Accordingly, methods for recording the locations of fixed IT devices have been sought. Figure 2 shows two different methods of registering locations of such fixed IT devices.

According to a first variant (FIG. 2) suitable for workstations 4 and connected devices 3, the location of a given fixed IT device may be determined by its print emulator configuration or other software routine (Manually). When the print emulator on the workstation 4 is started, it detects connected devices in step 20. In step 21, it reads the locations of the connected devices 3 from the print emulator configuration file, if their workstation ID, their location, and the location of the peripheral devices 3 are different. At step 22, it sends these locations to the device server 2 to register itself and the peripheral devices 3.

Another option (Figure 2B) is to register the fixed IT device using the mobile communication device 1. [ In order to do this, the traveling user physically moves towards the fixed IT device being inquired. In step 23, the user is prompted to enter full identity information and / or location (e.g., QF / A / SYD / T / I / GTE / 1/1), or by reading it electronically using, for example, The device is identified. The user then uses the location determination function of her / his mobile communication device 1 to obtain her / his current location in the form of geospatial coordinates at step 24. And at step 25 she / he sends the fixed IT device ID, location and possibly other data, such as the airport zone, to the device server 2 to access the fixed IT device (and possibly even the connected peripheral device 3) And registers it in the device server 2.

The modifications to the location awareness and registration presented by FIGS. 2A and 2B establish a complete repository of fixed IT devices in the device server 2. Since the location of the fixed IT devices is stored by the device server 2, the fixed IT devices can be used by her on-the-go personnel using her / his mobile communication device (1). For example, an agent might need to print a document using a static printer nearby to reprint a customer's boarding pass standing in front of the agent. She / he can find the printer nearest her / his current location, print the boarding pass, and quickly deliver it to the customer. The message flow of this operation (see FIG. 3) determines its current location and then sends its location to the device server 2 and sends a request for the nearest fixed IT device, and more specifically, (30). ≪ / RTI > In some embodiments, the request 30 does not include the location of the mobile communication device 1, since the recent location is already known in the network. As already outlined above, in these embodiments, the location of the mobile communication device 1 is judged, for example, regularly and stored in a network, for example in the location server 5. Regular position determination is performed by the mobile communication device 1 updating the position in the network or alternatively by a network, for example by triangulating the mobile communication device 1.

In step 31, the device server 2 returns a list of printers in the vicinity of the requested mobile communication device 1. If the list includes more than one fixed IT devices, then at step 32 the agent (or mobile communication device 1) automatically selects one. In step 33, a printout request is sent to the printer selected by the person in the mobile communication device 1, and more particularly to the print emulator of the printer. Finally, at step 34, the print emulator of the fixed IT device initiates printing of the requested document, and the document is printed. The agent can physically go to the printer and obtain the document and deliver it to the customer. Note that this operation does not require any form of mobility management for mobile communication devices. Of course, a similar message flow is applied to any other type of processing request by the mobile communication device 1, which is executed by a fixed IT device in the vicinity of the mobile communication device 1. [ Such other processing requests may include, for example, sending messages, such as e-mail, to a given workstation 4, displaying information on a specific information display, requesting any kind of information to a given workstation 4, . ≪ / RTI >

In some embodiments, as already described above in connection with Figure 1, the location server 5 maintains a location list of mobile communication devices 1 traversing the area (Figure 4). After activation, boot or login (at step 40), the mobile communication device 1 registers itself with the location server at step 41. Along with the registration message, the user and / or device ID and the first current location of the mobile communication device 1 are transmitted to the location server. Every time a serious location change is detected, the mobile communication device 1 updates its location to the location server 5 in step 43. [ Classifying a change of location as critical is a matter of configuration or configuration. For example, a predetermined distance may be configured or set in advance. Accordingly, the mobile communication devices 1 continuously or regularly monitor their current location and compare the location change of a predetermined distance, e.g., 10 or 20 meters, with a previously registered location to a "serious" As shown in FIG. As smartphones as well as today's tablet computers and devices usually have position tracking sensors, such a significant position change is preferably detected using these motion sensors of the mobile communication device 1. [ This increases the battery life of the mobile communication devices 1 compared to the position change determination by continuously tracking their position through GPS or Wi-Fi / GSM / UMTS / LTE triangulation. As a side effect, it also protects the privacy of the agent since her / his location is not continuously or very precisely recorded by the location server 5. If the agent leaves the DCS application running in the mobile communication device 1 and logs off at the mobile communication device 1 and / or the device 1 ends at step 44, Step 45 occurs.

The mobility management provided by the location server 5 can be used to easily manage or direct circulating staff or staff members. For example, as shown in FIG. 5,

- the location of a particular agent / staff member;

- a list of members / staff members at or near a particular location; or

- You can ask for members / staff members who are currently located in a specific area.

The request includes a specific location in the form of a user or mobile communication device ID or three-dimensional geospatial coordinates and a fixed IT device ID or point of interest. The supervisor can use her / himself on the mobile communication device 1 and can tour the area. Alternatively, the supervisor can also utilize the static workstation 4 for her / his request. In response to the request, the location server 5 returns in step 51 an appropriate response indicating the location (s) of each of the agent (s) / staff member (s).

(Fig. 2) for recording the locations of the fixed IT devices to the device server 2 and the location management of the mobile communication devices 1 by the location server 5 4), the mobile communication device 1 interacts with a nearby fixed IT device (Fig. 3) and the supervisor recognizes the location of the mobile communication devices 1 (Fig. 5) Without concentrating on presenting them to the user on the communication device 1. You can think of a few variations of the presentation. The usual approach for a presentation, for example, a text-based, in the form of a list, agent or supervisor can select the desired fixed or IT device discovery agent (located agent) here. An improved approach to providing increased value to users is map-based presentations. This will be described in more detail below with reference to FIGS. 6-8. Moreover, the mobility of the mobile communication device 1 and the popular availability of various equipment and sensors (such as cameras and position and orientation sensors) enable generation of augmented reality content. A third approach to combining reality with virtual reality is camera-based presentations that will be concentrated in conjunction with Figures 9 and 10.

According to the map-based approach, a map is displayed on the screen of the mobile communication device to show the user's current location and orientation as well as the location of other devices (FIG. 6). The map-based presentation can be used in conjunction with FIG. 3 to support interaction between the mobile communication device 1 and fixed IT devices, as described above. For example, this may provide the user with a more friendly way of selecting the printer she / he wants to print the document or helping her / him to find the way to the selected printer to grasp the printed documents. Map generation at the mobile communication device 1 is supported by the location server 5, which includes a map of the airports at which points of interest are indicated, as outlined above.

6A, the agent, i.e., the mobile communication device 1, sends a query to the device server 2 requesting an overview of the appropriate fixed IT devices near its current location. The device server 2 accordingly responds with a list of fixed IT devices and their locations at step 61. The mobile communication device 1 then passes this information along with the message 62 to the location server 5. In response, at step 63, the location server 5 returns map data showing locations of the agent / mobile communication device 1 and fixed IT devices. The mobile communication device 1 displays a map on the display. The agent can then select a particular fixed IT device and concurrently click on the map at step 65 to send the request to the selected fixed IT device at step 65. [ Since the example of Fig. 6A refers to the print request, the request 65 will be sent specifically to the print emulator of the fixed IT device. Finally, the request is handled by the fixed IT device at step 66. That is, the print emulator starts the print process for the printer. Optionally, the fixed IT device may return an indication of positive acknowledgment or, in exceptional cases of failure, a failure to the mobile communication device (not shown in FIG. 6A).

An exemplary resemblance of a corresponding map 67 including an agent 68 and a visualization of her / his position and orientation and visualization of peripheral printers and other points of interest including the selected printer 69 is shown in FIG. do.

Another application of the map-based approach allows (airline) agents to show their customers how to get to their boarding gate (Figure 7). Airports usually provide passengers with information about the minimum connection time between two flights based on the arrival gate of the first flight and the departure gate of the second flight. Using her / his map on his mobile communication device 1, oncoming agents can provide this information to moving customers and show passengers how to proceed.

In step 70 of Figure 7, the mobile communication device 1 sends a request for walking directions from its current location to a particular point of interest. Alternatively, the mobile communication device 1 may include some other place in the request. Such alternate locations may be described as three-dimensional geospatial coordinates or points of interest. For example, such an alternative location may be entered manually by a user of the mobile communication device 1, for example by way of putting or typing a place on a map. The request 70 includes identification information of the inquired point of interest and, preferably, but not necessarily, the current location of the mobile communication device 1 as a starting point of service (alternatively, Using the last known known location as the starting point). Then, the location server calculates the route from the starting point to the destination together with the corresponding walking times at step 71, returns the corresponding driving and map data to the mobile communication device 1 at step 72, and the mobile communication device 1 The map is displayed accordingly.

Another use case of the map-based approach is the supervision of personnel by the supervisor already described in connection with Fig. Since the location server 5 tracks the locations of the mobile communication devices 1, their location on the supervisor's own mobile communication device 1 or workstation 4 with respective rights is displayed using the map .

To set up such a map, the supervisory device sends a request (80) to the location server (5) for a list of agents at or near the location of the particular agent. The location server 5 returns each map data in step 81. [ The supervisor's device (1 or 4) creates a map.

An exemplary result of such a map 82 is shown by Fig. 8b. This visualizes points of interest such as the supervisor 86 itself, the specific agent 85, the agents 83 and 84 near the supervisor, and the gate, telephone cell, toilet,

Another use case for a map-based presentation approach involves a supervisor who manages a variety of information that can be presented to her / him on the map. In the case of this airport, an example would be a supervisor who manages several flights. These Supervisors may subscribe to messenger notices and individual flight data for these flights managed by her / him. The supervisor's mobile communication device (1) is provided to obtain location data relating to the same flights as the respective boarding passes. And she / he can use the locations of the boarding passes to display location related notifications on the map. In other words, flight information, such as the boarding gate from which flights depart, is presented at the correct location on the map. Using her / his current location additionally, she / he can see which is closest to her / him and what is the best way to go there.

Each message flow for this use case is illustrated by Figure 9A. A supervisor subscribes to a messaging application running on a server of a fixed portion of the network. Through the messages 90 and 91, the mobile communication device 1 (or workstation 4) of the supervisor can communicate with the mobile communication device 1 (or workstation 4) B < / RTI > These messages are periodically pushed to the supervisor's device or pulled by the supervisor's device. To ensure proper location information for flights A and B, the mobile communication device 1 communicates with a customer management server 6 (referred to as "CM" in FIG. 9A) having a flight list containing assigned boarding passes . After transmitting the respective requests 92 to the customer management server 6, the customer management server 6 returns the requested location information at step 93. [ In order to receive the appropriate map data, the mobile communication device 1 finally communicates with the location server 5. The request 94 includes flight-related information such as the current location of the supervisor, the contents of the delays and cancellations, and identification information of the boarding passes. Based on this information, the location server 5 generates and returns map data including content information located at a suitable place of the map in step 95, and the supervisory device displays the map. Alternatively, the request 94 does not include navigation related information, but it is included in the map data received locally at the location server 5 in the mobile communication device 1. [

An example of a map is shown in FIG. 9B. This includes a visualization of the on-board supervisor 97 and a notification 96 indicating that the planned flight 6X5 to depart from gate 4 has been canceled.

Now, back to the camera-based augmented reality technologies, a level of information can be superimposed on the images captured by the camera of the mobile communication device 1 with a virtual overlay. This feature offers the possibility of reaching a preferred location in a more interesting, innovative and user-friendly way. For example, instead of locating the facilities on a standard two-dimensional map, the user / agent may determine the direction and distance between her / his location and the point of interest or destination with a photograph taken by the camera of her / his mobile device 1 Can be seen directly from. When the camera of the mobile communication device 1 is pointed at the point of interest, appropriate available information is superimposed on the picture captured in the camera (Fig. 10).

Similar to the map-based presentation, the location server 5 provides virtual overlay data to the mobile communication device 1 (FIG. 10A). In a first step (100), the user activates the camera of the mobile communication device (1). In step 101, the mobile communication device 1 sends its current location and orientation to the location server 5 and requests the virtual overlay information. In step 102, the location server 5 returns the location and overlay content for the closest points of interest. The content information is stored in the location server 5 itself or alternatively in the customer management server 6. In the latter case, the mobile communication device 1 or the location server 5 requests the respective data to the customer management server 6 (not shown in Fig. 10A). Finally, the mobile communication device 1 creates an overlay layer according to its position and orientation, and presents the camera picture with the overlay to the agent.

An example of a camera photo 103 superimposed on additional virtual content 104 is illustrated by FIG. 10b. In this example, a virtual information bulletin board 104 indicating the direction and distance to the intended BA lounge is superimposed. The virtual overlay modus is displayed to the user by the radar at the bottom right of the screen.

Another use case of a camera-based presentation allows the agent to superimpose information such as flight information by directing his camera to a point of interest, such as a boarding gate for which a particular flight is departing (FIG. 11).

Steps 110 to 112 in FIG. 11A are consistent with steps 100 to 102 in FIG. 10A. The camera of the mobile communication device 1 is activated in step 110 and the mobile communication device 1 transmits its current position and orientation to the position server 5 in step 111 and the position server 5 in step 112 And returns a visible point of interest, for example gate 3. The mobile communication device 1 communicates with the customer management server 6 in order to secure the flight information associated with the current gate 3. In step 113, the mobile communication device 1 requests the customer management server 6 for the content information related to the gate 3. In step 114, the customer management server 6 returns the requested information. Finally, in step 115, the mobile communication device 1 superimposes the content information on the camera picture as a virtual overlay.

FIG. 11B shows an exemplary camera photograph 116 with overlay layer 117. FIG. The camera of the mobile communication device 1 is directed to the gate A11 of the London Heathrow Airport and the appropriate information connected to this gate, i.e. the flight 6X12 allocated to the gate A11, is scheduled for Nice at 10:20 of the boarding time, It appears more and more clearly as virtual information at the location of the information screen.

Finally, Fig. 12 is a schematic representation of the internal structure of the mobile communication device 1. Fig. The mobile communication device 1 is arranged to execute a set of directives to perform any of the methodologies discussed herein. The mobile communication device includes a processor 121, a main memory 122 and a wireless network interface 123 and / or a 2G / 3G / 4G mobile network interface device (not shown) (such as a Wi-Fi and / , All of which communicate with each other via bus 124. The mobile communication device further includes a static memory 125, e.g., a non-removable flash or solid state drive or a removable micro or mini SD card, which allows the mobile communication device 1 to communicate with the fixed IT devices and the network static portion ≪ / RTI > permanently stores software to communicate with servers of the DCS in the examples of FIGS. 1-11. Further, it includes a display 127, preferably a touch screen, a user interface (touch screen) control module 129 and optionally additional (non-parametric) alphanumeric and cursor input devices 128. The wireless network interface device 123 connects the mobile communication device 1 to the fixed IT devices and the servers of the network static portion (DCS in the example of FIGS. 1 to 11). The optional GPS transceiver 126 provides additional possibilities for position determination. A set of directives (i.e., software) 130 that implements any or all of the above described methodologies stays completely or at least partially in the static memory 125. When executed, each of the directives and / or data remains in the main memory 122 and / or the processor 121. The software 130 may be further transmitted from the network shown in Figure 1 or a server in the Internet to the server via the wireless network interface device 123 or the 2G / 3G / 4G mobile network interface in the form of a propagated signal 132 Lt; / RTI >

The device server 2, location server 5 and workstations 4 are constructed in a similar manner, except that they can not have any wireless network interfaces and GPS modules.

Although certain products and methods in accordance with the teachings of the present invention have been described herein, the scope of coverage of the present invention is not limited thereto. On the contrary, the present patent application includes all embodiments in accordance with the teachings of the present invention which fall within the scope of the appended claims literally or equivalently.

Claims (27)

CLAIMS What is claimed is: 1. A method for combining a mobile communication device with a fixed communication network, the fixed communication network comprising a device server and a plurality of information technology (IT) devices, The method comprising the steps of:
Determining a current location of the mobile communication device;
Sending from the mobile communication device, via a wireless communication link with the fixed communication network, a request from the device server to the identification information of the IT devices and the current location of the mobile communication device;
Receiving, from the device server, identification information of one or more IT devices of the IT devices at the mobile communication device via a wireless communication link with the fixed communication network; And
Transmitting a service request from the mobile communication device to the IT device of the received identification information among the IT devices via a wireless communication link with the fixed communication network based on the received identification information
Wherein the mobile communication device is a mobile communication device. The method according to claim 1,
Wherein the mobile communication device is a first mobile communication device,
The method comprises:
Registering the identification information of the first mobile communication device and the current location of the first mobile communication device in a location server of the fixed communication network; And
Updating the current location of the first mobile communication device at the location server in response to a change in the current location of the first mobile communication device
The method further comprising the step of: 3. The method of claim 2,
Communicating, via the wireless communication link with the fixed communication network, a first request from the first mobile communication device to the current location of a second mobile communication device registered in the fixed communication network to the location server ; And
Receiving, in the first mobile communication device, a current location of the second mobile communication device from the location server, via a wireless communication link with the fixed communication network, in response to the first request
The method further comprising the step of: 3. The method of claim 2,
The location information of each of the IT devices is registered in the location server,
The method comprises:
Transmitting a current location of the first mobile communication device and a current orientation of the first mobile communication device to the location server via a wireless communication link with the fixed communication network; And
Receiving, at the first mobile communication device, location information regarding at least one IT device of the IT devices from the location server via a wireless communication link with the fixed communication network
The method further comprising the step of: 5. The method of claim 4,
Wherein the first mobile communication device comprises a camera,
The method comprises:
Displaying an image photographed by the camera on the first mobile communication device; And
Overlaying a virtual representation of the location information of at least one of the IT devices on the image,
The method further comprising the step of: 5. The method of claim 4,
Wherein the fixed communication network further comprises a content management server, content information regarding at least one of the IT devices is registered with the location server,
The method comprises:
Transferring, via a wireless communication link with the fixed communication network, a second request from the first mobile communication device for content information about at least one IT device of the IT devices to the content management server; And
In response to the second request, receiving, at the first mobile communication device, the content information from the content management server via a wireless communication link with the fixed communication network
The method further comprising the step of: The method according to claim 6,
Wherein the first mobile communication device comprises a camera,
The method comprises:
Displaying an image photographed by the camera on the first mobile communication device; And
Superimposing, on the image, the location information of at least one of the IT devices and a virtual representation of the content information,
The method further comprising the step of: The method according to claim 1,
Wherein the identification information of each of the IT devices includes a location of the IT device,
The method comprises:
Receiving, at the mobile communication device, a location of each of the IT devices from the device server via a wireless communication link with the fixed communication network; And
The location of the mobile communication device, the current orientation of the mobile communication device, and the location of each of the IT devices from the mobile communication device via a wireless communication link with the fixed communication network, ≪ / RTI >
The method further comprising the step of: 9. The method of claim 8,
Receiving, in the mobile communication device, map information about each of the IT devices and the mobile communication device from the location server via a wireless communication link with the fixed communication network; And
Displaying on the mobile communication device a map representation based on the map information indicative of a current location of the mobile communication device and a location of one or more IT devices of the IT devices;
The method further comprising the step of: 10. The method of claim 9,
Selecting one of the IT devices from the map representation
The method further comprising the step of: The method according to claim 1,
Allowing the IT device, which has received the transmitted service request, to service the service request
The method further comprising the step of: The method according to claim 1,
Registering the identification information of the mobile communication device and the current location of the mobile communication device in a location server of the fixed communication network;
Transmitting a navigation request from the mobile communication device for navigation information from the current location to a destination to the location server via a wireless communication link with the fixed communication network;
Calculating the navigation information at the location server;
Transferring the navigation information from the location server to the mobile communication device via a wireless communication link with the fixed communication network; And
Displaying on the mobile communication device a map representation representing the current location, the destination, and the navigation information
The method further comprising the step of: A computer-readable recording medium storing a computer program,
The computer program comprising:
Computer-executable instructions configured to perform the method of claim 1 upon execution
Readable recording medium. An apparatus for use with a fixed communications network, the fixed communications network comprising a device server and a plurality of IT devices, each of the IT devices having identification information registered with the device server,
A mobile communication device coupled to the fixed communication network by a wireless communication link
Wherein the mobile communication device comprises at least one processor and a memory coupled to the at least one processor, the memory including instructions, wherein the instructions, when executed by the at least one processor, For example,
Determine a current location of the mobile communication device;
Sending a request for identification information of the IT devices and a current location of the mobile communication device to the device server via a wireless communication link with the fixed communication network;
Receiving, from the device server, identification information of one or more IT devices of the IT devices via a wireless communication link with the fixed communication network;
And to transmit, based on the received identification information, a service request to an IT device of the received identification information among the IT devices via a wireless communication link with the fixed communication network . 15. The method of claim 14,
Wherein the mobile communication device is a first mobile communication device and the instructions further cause, when executed by the at least one processor,
Registering the identification information of the first mobile communication device and the current location of the first mobile communication device in a location server of the fixed communication network;
In response to a change in the current location of the first mobile communication device, to update the current location of the first mobile communication device at the location server. 16. The method of claim 15,
Wherein the instructions further cause, when executed by the at least one processor,
Delivering to the location server, via the wireless communication link with the fixed communication network, a first request from the first mobile communication device for a current location of a second mobile communication device registered in the fixed communication network;
In response to the first request, cause the first mobile communication device to receive, via a wireless communication link with the fixed communication network, a current location of the second mobile communication device from the location server, Apparatus for use with a network. 16. The method of claim 15,
Wherein the instructions further cause, when executed by the at least one processor,
Registering the identification information of the first mobile communication device and the current location of the first mobile communication device in the location server;
Transmit the current location of the first mobile communication device and the current orientation of the first mobile communication device to the location server via a wireless communication link with the fixed communication network;
In the first mobile communication device, via a wireless communication link with the fixed communication network, to receive location information regarding at least one IT device of the IT devices from the location server. Apparatus for use. 18. The method of claim 17,
Wherein the first mobile communication device comprises a camera and wherein the instructions further cause, when executed by the at least one processor,
Displaying an image photographed by the camera on the first mobile communication device;
And superimpose, on the image, a virtual representation of the location information of at least one IT device of the IT devices. 18. The method of claim 17,
Wherein the fixed communications network further comprises a content management server, wherein the instructions further cause, when executed by the at least one processor,
Deliver, via the wireless communication link with the fixed communication network, a second request from the first mobile communication device to the content management server for content information about at least one IT device of the IT devices;
In response to the second request, cause the first mobile communication device to receive the content information from the content management server via a wireless communication link with the fixed communication network. . 20. The method of claim 19,
Wherein the first mobile communication device comprises a camera and wherein the instructions further cause, when executed by the at least one processor,
Displaying an image photographed by the camera on the first mobile communication device;
And causes a superimposition of the content information and a virtual representation of location information of at least one IT device of the IT devices on the video. 15. The method of claim 14,
Wherein the IT device comprises a workstation, a printer, a scanner, an information display, a copier or a fax machine. 15. The method of claim 14,
Wherein the mobile communication device comprises a mobile phone, a smartphone, a notebook or a tablet computer. 15. The method of claim 14,
Wherein the IT device comprises a printer and the service request is a print request. 15. The method of claim 14,
Wherein the fixed communications network comprises a departure control system implemented at an airport. 15. The method of claim 14,
Wherein the instructions further cause, when executed by the at least one processor,
Via the wireless communication link with the fixed communication network, in the mobile communication device, receiving the location of each of the IT devices from the device server;
Causing the current location of the mobile communication device, the current orientation of the mobile communication device, and the location of each of the IT devices to be communicated to a location server of the fixed communication network via a wireless communication link with the fixed communication network For use with a fixed communications network. 26. The method of claim 25,
Wherein the instructions further cause, when executed by the at least one processor,
Receiving, at the mobile communication device, map information about each of the IT devices and the mobile communication device from the location server via a wireless communication link with the fixed communication network;
And display, on the mobile communication device, a map representation representing the current location of the mobile communication device and the location of one or more IT devices of the IT devices based on the map information. Lt; / RTI > 27. The method of claim 26,
Wherein the mobile communication device is configured to select the IT device from the map representation.

Images