JP5591796B2 - File creation method and system - Google Patents

Description

  The present invention relates to a file creation method, and more particularly to stamping position information on file contents.

  The Global Positioning System is being used in an increasing number of portable home products. However, the GPS system requires significant processing functions within the portable device. In addition, in a standing area, there are many cases where the sky view is poor, and GPS signals cannot always be acquired.

  It is known to supplement the GPS data with data from other location systems so that the overall reliability can be improved. For example, in order to make the GPS system more robust, triangulation based on mobile phone base station signals can be employed as a temporary location system that is slightly less accurate.

  It has already been proposed to provide a location beacon database that functions as a location system. If the beacon is a WiFi access point (AP), such a database will have their MAC address, the calculated AP's estimated location, and possibly their power profile, i.e. various This includes how much signal strength can be expected at a location. Usually, this database is derived by so-called war drive.

  Such a database is used when the user requests location, especially when alternative means such as GPS are not available.

  In some applications, location is desired, not for real-time location identification, but for recording the location where a particular event occurred. One major example of this is the so-called photographic “geotag”. This is used to allow associating location identification information to an image file. Of course, this is most important for portable cameras, such as being able to record the location where the photo was taken. However, the associated processing can significantly increase the price and power consumption of the camera, and there is a need to address these issues.

According to the present invention, in the file creation method,
Creating a file content using a portable device at a specific location and time;
Obtaining data from a wireless communication device detectable by the portable device at the specific location and time, thereby obtaining a set of data, wherein the set of data Identifying or enabling identification; and
A method is provided that includes associating the collection of data and time with the file content to allow subsequent analysis to determine the particular location using a time-dependent database.

  The method uses a portable device to simply record data from a detectable wireless communication device, and this data can be used later to derive a current location. Thereby, it is possible to provide a low-cost position specifying system that requires only low processing power for the portable device itself.

  The time dependent database enables the communication device.

  The wireless communication device is a ground device, preferably a device with a short range, i.e., a range of less than 500 meters, more typically less than 200 meters.

  The set of data may include, for example, a set of device identification information (for example, MAC addresses) of detected wireless communication devices. Alternatively, the set of data may include data that can be analyzed to identify a set of detected device identification information for the wireless communication device. This may be recording IF (intermediate frequency) data of the communication device without having to read the MAC address from the data in the portable device.

  Creation of file content includes, for example, capturing an image and saving a corresponding image file. This may include photos or video clips. However, the present invention can be applied to non-image files such as document files. For example, the location where another update was performed may be important.

  The method can further include recording the time and date and associating them with the file contents. In addition, one or more of the signal strength, signal-to-noise ratio, Doppler, and error rate of the wireless communication device transmission can be recorded and associated with the file content. Thereby, it is possible to specify the position more accurately in the subsequent stage.

The present invention is a position stamp method comprising:
Creating a file using the method according to any one of claims 1 to 7;
Analyzing the associated identification information using a time-dependent database to derive a position based on the associated identification information at the time associated with the file content; and Also included is a step of creating a file including the derived position.

  The method converts a set of associated identification information into a location for attachment to a file. This analysis can be done on a home PC, server, or even a portable device, but need not be done while the portable device is powered by a battery.

The present invention relates to a file creation system,
A portable device for creating file contents at a specific location;
A wireless receiver for detecting a wireless communication signal and obtaining data from a wireless communication device detectable by the portable device at the specific location, thereby obtaining a set of data, A wireless receiver wherein the set identifies or enables identification of the wireless communication device;
A system is also provided that includes a processor for associating the collection of data and time with the file contents to allow subsequent analysis to determine the particular location using a time-dependent database.

  This system implements the file creation method. The portable device may include a camera and the file content includes an image or an image sequence.

The present invention is a position stamp system comprising:
A file creation system of the present invention, and a processor for the same,
Analyzing the associated identification information using a time-dependent database to derive a location based on the identification information at the time associated with the file content;
A system is also provided that includes a processor for creating a file that includes the file contents and the derived location.

  One variation is a portable device (or second portable device) that periodically performs sounding (i.e., a scan for beacons, recording the detected beacons and the time and date of the scans). . This allows any time stamped event, such as a file creation, to be matched to a sounding that is close in time to that event.

  Next, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

It is a figure which shows an example of the system of this invention.

  The present invention records wireless communication device identification information (or other information that can be used to derive the identification information) that can be detected by the portable device and identifies them to determine their location. Provides a file creation method in which information is used later.

  FIG. 1 shows the system of the present invention. The portable device shown as camera 10 has a wireless reception function and is surrounded by four APs in transmission areas 14a to 14d. The communication devices in the ranges 14b and 14d can be detected by the portable device at that position, and they form one set of device identification information. The database is provided as a remote server 12 in this embodiment, and stores identification information (and optionally other information) regarding the wireless communication device. This information can identify a device that is known to be detectable from a defined reference location or other location, and can store other information about the device.

  The server implements an algorithm for analyzing the set of identification information using the contents of the database to determine the location of the portable device.

  As mentioned above, a WiFi AP database can be used to obtain location. Usually, the process of finding a position is as follows.

(I) scan for observable access points;
(Ii) retrieve reference data for those APs in the database; and (iii) derive AP position data by combining AP position data, eg, by triangulation.

  This method of using scan data can also be employed in the system of the present invention.

  An alternative method has been proposed (but not published) by the applicant. This involves analyzing one set of identification information using a database that stores identification information of wireless communication devices that can be detected from a plurality of reference locations. The database contains wardrive observations as in the prior art method. However, the position of the portable device is derived based on the analysis and processing of the reference position (i.e., the position where the war drive reading was taken), not the inferred position of the detected beacon.

  Another way is to collect reference information before the system is operational. In one embodiment, an auxiliary location function is used during the war drive to obtain beacon observations. Observation time and date, latitude, longitude, altitude, MAC address, signal strength, signal-to-noise ratio, signal error rate, signal Doppler (a large Doppler shift is in a passing mobile router, eg a passing train Various data items are recorded, such as indicating a router or indicating the possibility that the user is on the train. The location can be known from the following items.

(I) GPS-based localization obtained during normal use of the device by the user;
(Ii) GPS-based localization from a dedicated “war drive”;
(Iii) user input,
(Iv) locating from already identified beacon observations,
(V) Interference from other information, such as distance and direction from a known location.

  The database can include one or more sources of data, ie, which of the above methods was used to collect reference information. Optionally, the uncertainty of the estimated position may be estimated and recorded. The uncertainty may be small in the case of GPS location or greater than another method of position estimation.

  A database is generated from the reference information, but again uncertainty information is optionally added. This database may be derived from its own scan results within the portable device itself, or (preferably) the database information is shared with the database on the server as in the above embodiment. This process can likewise be performed on the device or on the server.

  The reference information can optionally be compressed before or after the database is formed.

  When the user is at an unknown or uncertain location, he simply performs a scan to operate the system to observe the beacon. Observed communication device (“beacon”) data is checked against a database.

  Various algorithms are possible. However, all algorithms specific to this disclosure indicate location as location, typically latitude, longitude, and altitude, but optionally an estimate of uncertainty is added to it. Optionally, multiple outputs may be provided with a wider area, for example, with the most suitable location and with increased confidence that the search location is identified.

  In a first example, the algorithm finds one or more locations or location areas where the beacons observed by the device correspond to the beacons observed from the reference scan (ie, war drive). Thus, the location is selected based on a reference location having the same set of beacon identification information. Since beacons are not always active, an exact match is not essential for location success. Thus, the matching algorithm can perform a more intelligent comparison between devices observed from a reference location in the database and devices observed by scanning.

  Photos can be submitted for geotagging for weeks or months after filming. In such a case, the WiFi landscape is not as interesting as it is at the latest time, not at the historical time, like the landscape at the previous epoch. One option is to use a derived database that covers beacon reference data about the epoch where the picture was taken. Any beacons that appear in later scenes, or any beacons that have disappeared or moved from later scenes, do not help get location, get location It may be counterproductive to the process and is removed in this way. Another option is to consider out-of-epoch beacon data in a limited way in the location algorithm. Off-epoch beacon data regarding beacons that are not observed by the portable device can be ignored. The non-epoch beacon data for beacons observed by portable devices must be well matched with the in-epoch data so that they are not rejected as well. Occurs when the switch is turned on when taking a picture and is not turned on when the portable device supplied to the database is placed. When such a case is identified, the out-of-epoch beacon extends its lifetime in the database to cover the previous epoch.

  The present invention provides this time dependency in the database, allowing for later analysis to determine a particular location using the beacon data as well as the time at which the data was captured.

  There are several ways in which a position can be presented to the user once it has been determined. Location can be provided to an application or a user. In the server implementation, the location will be returned from the server to the device or communicated to another service. This in turn leads to displaying the location on, for example, a map, satellite photograph, terrain model, or other location information service.

  The user or application can interact with the location to refine the location or to change the location in light of additional information. Such changes can optionally be reported back to the processor database.

  Any additional information and observations can optionally be added to the database after location (and after any updates by the user or application), but at this point, the location of the search is known, This result can be regarded as a useful beacon scan. Thus, the database is dynamically kept up to date.

  In order to associate position information with a photo (or video), the above positioning method can be used in the camera. There is growing interest in geotagging in this photo. Currently, many photos are manually tagged by photographers who know where they were taken. Other methods involve performing GPS localization either locally within the camera or later from stored IF data.

  The above method can be used to attach a location stamp to an image file or photo clip, but does not require a GPS system. Rather than using a GPS antenna and GPS RF front end, the method of the present invention (but not excluding the use of GPS equipment) is equipped with a camera to detect WiFi access points and / or other beacon radio signals. Require only to do. It will be appreciated that this provides an alternative way of providing location.

  In the above embodiment, the portable device performs both file creation and beacon data capture. Rather, the file creation device (eg, camera) only needs to store time and data, and a separate device can perform the only function of periodically storing beacon data. This separate device therefore performs periodic sounding (ie, scanning for beacons, recording the detected beacons and the time and date of the scans). This makes it possible to match any time stamped event, such as a file created by a camera, with a sounding that is close in time to that event.

  As mentioned above, GPS signals do not always have sufficient quality. Indoors, depending on the wall thickness and the material used (fully non-conductive metal), the GPS signal is weak or almost equal. Some signals may enter through a reflection path that degrades localization quality.

  In an urban environment, the sky view may be very limited and not enough satellites may be recognized. Signals from some satellites may be present due to reflection, possibly via several paths. All this hinders the ability to obtain (reliable) localization. However, if GPS location is difficult or impossible, beacon signals such as beacon signals from WiFi access points may be abundant. In some cases, a WiFi interface is standard on digital cameras, in which case no special hardware is required. Using the method described above, the energy consumption can be reduced compared to the GPS method, especially when the location is performed in the camera or accessory.

  Thus, it will be appreciated that the present invention can also be used to enhance a GPS system by providing location based on access point detection when GPS location is difficult.

  When the user is taking a picture, an image file including the picture is created. A scan is performed for the router's MAC address (and optionally other relevant data), which are stored and linked to the image file of the associated photo. Time and date can also be recorded.

  The above method obtains a specific position attached to an image file. This method is equally applicable to alternative radio / microwave beacons with video clips and unique identification information.

  Regarding the above general example, the processing of the MAC address (and / or GPS IF data) can be performed locally in the camera if a local database is available, and the database is used locally on the PC. It can be run on a home PC if possible, or on a home PC if connected to a server. Rather, the process may be performed entirely remotely at the server, for example by a camera that connects directly to the server using WiFi access.

  In a system that combines GPS and short-range beacon scanning, scanning for beacons can be performed at exactly the same time as the start of IF GPS acquisition. Some beacons can provide accurate timing information that may then be useful as a GPS location aid.

  Location information may be shared to improve robustness. For example, Photo 1 can prompt the provision of a GPS specific location and the detection of a MAC address that is otherwise unknown in the MAC address reference database. If the next photo 2 cannot obtain the GPS specific location, but the GPS specific location or a part of the same MAC address of the photo 1 is confirmed, the information of the photo 1 can assist in the process. As already explained, the MAC address reference database can be updated with the MAC address from Photo 1, but this update may be another nightly batch process. However, when processing a group of photos from one user, the new MAC address can be used for local processing and locating for the provided photo 2. Photos that cannot be identified in the first pass can be passed again even if other photos are processed, so this can be done regardless of the order of the presented photos.

  This concept can be used on a PC to locate a user when the user is indoors. Indeed, the present invention can be applied to any situation where a user has a device that can detect beacons in situations where localization is required, and that can process observations against accessible databases. Users can include pedestrians, joggers, and the like.

  As mentioned above, beacon-based location systems use terrestrial beacons rather than satellite beacons. The preferred embodiment uses short range beacons such as WiFi nodes (ie, APs), but these beacons may be in any form. In general, beacons in the range shorter than 200 meters are used in home environments, and beacons in ranges shorter than 100 meters, and in some cases shorter than 50 meters, are used in building environments. In a narrow geographic area, many such beacons may be found that support the matching process of the present invention.

  Although the preferred embodiment uses those short-range beacons, the principles of the present invention include mobile phone cells (with identification information in the form of cell IDs), radio / TV mast signals, DAB signals, WiMax (Worldwide Interoperability for The present invention can be applied to other types of communication devices such as a Microwave Access) signal, a Bluetooth signal, and a Zigbee signal. Although wireless communication devices are typically rf devices, the principles of the present invention can again be applied to other types of signals such as IR signals and sonic signals. All of these are intended to be included in the term “wireless” which simply indicates that the signal can be received by the portable device without requiring a physical (ie, wired) connection to the transmitting communication device.

  The present invention can be practiced with a mixture of other types of devices, ie, the other types of devices outlined above.

  Various variations will be apparent to those skilled in the art.

Claims (12)

In the position stamp method,
A portable device creating file contents at a specific location and time; and a wireless receiver obtains data from a wireless communication device detectable by the portable device at the specific location and time, thereby Obtaining a collection of data that identifies or enables identification of the wireless communication device;
A first processor associating the collection of data and the time with the file content;
Later, a second processor analyzes the set of data and the time using a time-dependent database to determine the specific location; and the second processor determines the file contents and the determination. Generating a file including the determined position;
Including
The time-dependent database stores reference data, and the reference data includes identification information of the wireless communication device, a reference position related to observation of the wireless communication device, time and data related to the observation,
The method of determining the specific location based on the reference data in the time-dependent database at a time that is generally associated with the file content. Said set of data, The method of claim 1 comprising a set of device identification information of the detectable wireless communication devices. Said set of data, The method of claim 1 including data that can be analyzed to determine a set of device identification information of the detectable wireless communication devices.   4. A method according to any one of claims 1 to 3, wherein the step of creating the file content includes capturing an image and saving a corresponding image file.   The method according to claim 1, wherein the time associated with the file content includes a time and a date.   The method according to any one of claims 1 to 5, wherein the set of data further includes signal strength, signal to noise ratio, Doppler, and error rate of transmission of the wireless communication device.   7. A method as claimed in any preceding claim, wherein associating the collection of data with the file content includes embedding the data in a file structure.   The method according to any one of claims 1 to 7, wherein the step of obtaining data from a wireless communication device detectable by the portable device is performed by a second portable device. The analysis is
9. The method of claim 1 to 8 executed by the portable device at another time to obtain the collection of data or on a computer system in which the file contents and associated information are provided. The method according to any one of the above. In the position stamp system,
A portable device for creating file contents at a specific location and time;
A collection of data that detects a wireless communication signal and obtains data from a wireless communication device that is detectable by the portable device at the specific location, thereby identifying or enabling identification of the wireless communication device A wireless receiver for obtaining,
A first processor for associating the collection of data and the time with the file content;
A second processor, which uses a time-dependent database to later determine the specific location, analyzes the set of data and the time, and generates a file including the file contents and the determined location; With
The time-dependent database stores reference data, and the reference data includes identification information of the wireless communication device, a reference position related to observation of the wireless communication device, time and data related to the observation,
The particular location is determined based on reference data in the time-dependent database at a time that is generally associated with the file content.   The system of claim 10, wherein the portable device includes a camera and the file content includes an image or an image sequence.   12. A system according to claim 10 or 11, wherein the wireless receiver is part of a second portable device, the first portable device providing time information along with the file contents.

Images