WO2016195545A1 - Authentification de dispositifs d'enregistrement de données - Google Patents

Authentification de dispositifs d'enregistrement de données Download PDF

Info

Publication number
WO2016195545A1
WO2016195545A1 PCT/SE2015/050619 SE2015050619W WO2016195545A1 WO 2016195545 A1 WO2016195545 A1 WO 2016195545A1 SE 2015050619 W SE2015050619 W SE 2015050619W WO 2016195545 A1 WO2016195545 A1 WO 2016195545A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
recording device
features
data recording
time interval
Prior art date
Application number
PCT/SE2015/050619
Other languages
English (en)
Inventor
Debmalya BISWAS
Lars Andersson
Matthew John LAWRENSON
Original Assignee
Telefonaktiebolaget Lm Ericsson (Publ)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonaktiebolaget Lm Ericsson (Publ) filed Critical Telefonaktiebolaget Lm Ericsson (Publ)
Priority to PCT/SE2015/050619 priority Critical patent/WO2016195545A1/fr
Publication of WO2016195545A1 publication Critical patent/WO2016195545A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/06—Authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/10—Network architectures or network communication protocols for network security for controlling access to devices or network resources
    • H04L63/107—Network architectures or network communication protocols for network security for controlling access to devices or network resources wherein the security policies are location-dependent, e.g. entities privileges depend on current location or allowing specific operations only from locally connected terminals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/04—Protocols specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/52—Network services specially adapted for the location of the user terminal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/023—Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/30—Security of mobile devices; Security of mobile applications
    • H04W12/33—Security of mobile devices; Security of mobile applications using wearable devices, e.g. using a smartwatch or smart-glasses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/60—Context-dependent security
    • H04W12/63—Location-dependent; Proximity-dependent

Definitions

  • the invention relates to a method of authenticating a first data recording device and/or a second data recording device, a first data recording device for authenticating a second data recording device, a data collecting device for authenticating a first data recording device and a second data recording device, and corresponding computer programs and computer program products.
  • Lifelogging is a growing trend, where people use phones, wearables, and dedicated lifeloggers, to document aspects of their daily lives. Lifelogging objectives include memory augmentation, reliving old memories in vivid detail, and optimizing one's daily routines.
  • Future lifelogging scenarios are expected to include devices not only worn by the user, but recordings will be sourced from multiple devices, such as devices at the user's home or office, or devices in environments which the user frequently visits, e.g., a friend's home. A majority of these devices is expected to provide wireless connectivity for accessing or retrieving data recorded by the devices. This will allow devices to collaborate, often in an ad- hoc fashion, to capture a more multi-dimensional log of the user's daily life.
  • lifelogging devices are now capable of recording a diverse range of user data, ranging from health attributes, such as physiological data, to location traces by means of position data, to prevailing environmental conditions, e.g., pollution or temperature, to more traditional audio/video recording of the user's activities. It is expected that multiple devices belonging to, or available to the user, including wearables, phones, tablets, Internet-of-Things (loT) devices in the user's home, office, etc., are involved in the recording process. Accordingly, the number of devices recording data is expected to increase manifold.
  • health attributes such as physiological data
  • location traces by means of position data
  • prevailing environmental conditions e.g., pollution or temperature
  • While the devices can independently and autonomously record data representing different aspects of the user's life, there is a need to pair lifelogging devices, or associate lifelogging devices with each other, for the purpose of syncing or sharing recorded data, fusing recorded data, or coordinating devices to optimize the recording process. Paring of lifelogging devices, herein referred to as data recording devices, necessitates the need for such devices to authenticate each other, or authenticate themselves to a third device or party, e.g., a network storage or a cloud (storage) provider, a computer used for collecting and possibly analyzing recorded data, or the like.
  • a third device or party e.g., a network storage or a cloud (storage) provider, a computer used for collecting and possibly analyzing recorded data, or the like.
  • a method of authenticating a first data recording device and/or a second data recording device comprises acquiring first data, acquiring second data, determining an overlap strength between the first data and the second data, and authenticating the first data recording device and/or the second data recording device if the determined overlap strength fulfills an authentication condition.
  • the first data is recorded by the first data recording device during at least one first time interval
  • the second data is recorded by the second data recording device during at least one second time interval.
  • the overlap strength is determined based on one or more features of the first data and one or more features of the second data.
  • a computer program comprises computer-executable instructions
  • a computer program product comprises a computer- readable storage medium which has the computer program according to the second aspect of the invention embodied therein.
  • a first data recording device for authenticating a second data recording device comprises at least one sensor, a data storage, a communication interface, and processing means.
  • the at least one sensor is configured for recording first data during at least one first time interval.
  • the at least one sensor may, e.g., be at least one of a camera, a microphone, a positioning device, a pulse sensor, a heart-rate sensor, a thermometer, or a barometer.
  • the data storage is configured for storing the first data.
  • the communication interface is configured for communicating with the second data recording device.
  • the processing means is operative to acquire first data, acquire second data, determine an overlap strength between the first data and the second data, and authenticate the second data recording device if the determined overlap strength fulfills an authentication condition.
  • the first data is acquired from the data storage.
  • the second data is recorded by the second data recording device during at least one second time interval, and is acquired via the communication interface.
  • the overlap strength is determined based on one or more features of the first data and one or more features of the second data.
  • a data collecting device for authenticating a first data recording device and a second data recording device.
  • the data collecting device comprises a communication interface and processing means.
  • the communication interface is configured for communicating with the first data recording device and the second data recording device.
  • the processing means is operative to acquire first data, acquire second data, determine an overlap strength between the first data and the second data, and authenticate the first data recording device and the second data recording device if the determined overlap strength fulfills an authentication condition.
  • the first data is recorded by the first data recording device during at least one first time interval and acquired via the
  • the second data is recorded by the second data recording device during at least one second time interval and acquired via the communication interface.
  • the overlap strength is determined based on one or more features of the first data and one or more features of the second data.
  • a data recording device herein also referred to as lifelogger or lifelogging device, may, e.g., be a dedicated device configured for capturing audio and/or video, a smartphone, a mobile terminal, digital cameras, webcams, surveillance cameras, a Machine-to-Machine (M2M) or loT-type of device, a smart watch, a wearable device or wearable, and so forth.
  • M2M Machine-to-Machine
  • the proposed authentication scheme is based on the idea that data recorded by two different data recording devices, herein referred to as first data and second data, share common features which represent an event or an object which both data recording devices have captured. Based on a comparison of the two data sets, an assessment can be made as to whether the two data recording devices have a common past, i.e., have both been in proximity to each other and to a captured event or object during the time of recording the data.
  • the at least one first time interval and the at least one second time interval preferably overlap during at least one common time interval, during which both data recording devices have captured an event or an object by recording data.
  • the at least one first time interval and the at least one second time interval may be substantially consecutive. This may be the case for lifeloggers which periodically capture still images, e.g., every 30 seconds, but not simultaneously.
  • the first time interval and the second time interval are the respective shutter times used for capturing the images. If the two time intervals do not overlap, an assessment of whether the two data recording devices share a common past may still be made depending on the time which has lapsed between the non-overlapping first time interval and the second time interval, as well as the nature of the captured event or object. For instance, the second data recording device may capture an image shortly after the first data recording device, such that the same event or object is visible in both captured images.
  • the authentication scheme proposed herein advantageously relies on preferably unique features of the first data and the second data, i.e., subsets of the recorded data which represent an event or object which is identifiable by analyzing the recorded data, such as image processing or audio processing.
  • Embodiments of the invention may utilize any suitable type of recorded data, e.g., video data, image data, audio data, position data, environmental data, or physiological data.
  • two data recording devices recording video or periodically captured images and being located in proximity to each other, such as two people sitting in a restaurant, each having a camera lifelogger.
  • the two data sets recorded by these lifeloggers contain common features, representative of events or objects which both lifeloggers have captured. This may, e.g., be a third person passing through the restaurant and being captured by both lifeloggers.
  • both lifeloggers may capture a certain object, such as a third person sitting in the restaurant, a distinct piece of furniture, or the like.
  • time stamps which facilitate synchronization of the two different data sets, it can be established that the two lifeloggers have been in proximity at the time when a certain event or object was captured. That is, they share a common past.
  • embodiments of the invention may rely on fuzzy rather than exact matches between features of the first data and the second data, with respect to scene characteristics, objects in the scene, appearance or disappearance of an object at the same instant from the scene, and so forth.
  • the two lifeloggers may also capture different types of data, e.g., video and audio, respectively.
  • the common past i.e., a proximity of the two lifeloggers during a time period in the past, can be established based on an event which is
  • the video lifelogger may capture video footage of a closing door, whereas the audio lifelogger captures a distinct sound made by the closing door. That is, corresponding features are common features present in sets of recorded data having different types.
  • an overlap strength is calculated as a measure of a likelihood that the first data recording device and the second data recording device share a common past.
  • the overlap strength increases with a number of features which are common to both data sets, the presence of a common feature which is particularly unique, an increased correlation between the two data sets, or the length of a time period during which the two data sets are in satisfactory agreement with each other.
  • authentication condition may, e.g., be considered fulfilled if the overlap strength is above a threshold value, or if a certain number of common features are identified.
  • the threshold value based on which authentication commences, may be adjusted such that a desired confidence level indicative of a common past is achieved.
  • Embodiments of the invention are advantageous in that authentication of lifelogging data recording device is simplified.
  • the proposed solution does not require passwords, PIN codes, or similar, which are tedious to enter, in particular on lifeloggers of small size which are typically provided with only few buttons and lack a display.
  • the overlap strength is determined by calculating a correlation between the first data and the second data. That is, a mathematical correlation function is used for evaluating the statistical correlation between two random variables, such as the first data and the second data, or variables derived from the first data and the second data, e.g., the time-dependent brightness of a video sequence or the time- dependent audio level of an audio recording.
  • a mathematical correlation function is used for evaluating the statistical correlation between two random variables, such as the first data and the second data, or variables derived from the first data and the second data, e.g., the time-dependent brightness of a video sequence or the time- dependent audio level of an audio recording.
  • Different types of mathematical correlation functions such as cross correlation and auto correlation, are known in the art. In this case, the overlap strength increases with increasing value of the correlation function.
  • the determining an overlap strength comprises identifying one or more corresponding features of the features of the first data and the features of the second data, and determining the overlap strength based on a number of the corresponding features in relation to a number of the features of the first data, a number of the features of the second data, or a combination thereof.
  • lifeloggers recording different types of data may be authenticated based on corresponding features, such as video footage capturing a closing door and an audio recording capturing the sound made by a closing door.
  • the overlap strength increases with the number of identified corresponding features.
  • the determining an overlap strength comprises generating a challenge based on the features of the first data, determining a response to the challenge based on the features of the second data, and verifying whether the response matches the challenge.
  • the authentication condition is fulfilled if the response matches the challenge, i.e., if the compared features are in fact
  • the first lifelogger may pose an authentication challenge to the second lifelogger, requesting the second lifelogger to respond with the time when the third person passes.
  • the second lifelogger analyzes its recorded time-stamped video, finds the third person by means of image recognition, and responds with the time when the third person passes.
  • the first lifelogger may detect that the third person wears a clothing of a distinct color, and challenges the second lifelogger to respond with the color of the clothing, which can be determined by means of image analysis.
  • the overlap strength between the first data and the second data is determined based on a part of the first data and a part of the second data, wherein the part of the first data and the part of the second data are selected based on a uniqueness of the part of the first data and/or a uniqueness of the part of the second data.
  • the part of the first data and the part of the second data may be selected based on a proximity of the first data recording device and the second data recording device during recording of the part of the first data and the part of the second data, respectively, i.e., when the data recording devices were close to each other.
  • the proximity of the two data recording devices may, e.g., be determined based on position information received from a Global Positioning System (GPS) module, or the like, which the data recording devices may optionally be provided with.
  • GPS Global Positioning System
  • their recorded data may be tagged with positioning information.
  • Whether the two data recording devices are considered to be in proximity of each other depends not only on the absolute distance between the devices, but also on the devices' location and the type of data they record. For instance, the two data recording devices may be considered in proximity of each other is they are in the same room.
  • the overlap strength between the first data and the second data is determined based on a part of the features of the first data and/or a part of the features of the second data, wherein the part of the features of the first data and/or the part of the features of the second data are selected based on a uniqueness of the features.
  • the part of the features of the first data and/or the part of the features of the second data may be selected based on a proximity of the first data recording device and the second data recording device during recording of a part of the first data associated with the selected features of the first data and a part of the second data associated with the selected features of the second data, respectively, i.e., when the data recording devices were close to each other, as was discussed hereinbefore.
  • the first data recording devices attempts to authenticate the second data recording device.
  • the first data is acquired from a data storage accessible by the first data recording device, such as an internal or external memory, hard drive, or the like
  • the second data is acquired by receiving the second data from the second data recording device, e.g., via a wired or wireless
  • the second data recording device may subsequently authenticate the first data recording device, resulting in a mutual authentication of the two data recording devices.
  • a data collecting device i.e., a third device which is different from the first data recording device and the second data recording device, attempts to authenticate the first data recording device and the second data recording device.
  • This may, e.g., be a smartphone, a computer, a tablet, a cloud storage, or the like, which a user of the lifeloggers utilizes for collecting, analyzing, or fusing, recorded data.
  • the first data is acquired by receiving the first data from the first data recording device
  • the second data is acquired by receiving the second data from the second data recording device, e.g., via wired or wireless communication links.
  • Fig. 1 illustrates an exemplifying scenario for usage of data recording devices (lifeloggers), in accordance with embodiments of the invention.
  • Fig. 2 illustrates time periods during which data recording devices in accordance with embodiments of the invention capture an event or an object.
  • Fig. 3 shows a flow chart for a method of authenticating a first data recording device and/or a second data recording device, in accordance with an embodiment of the invention.
  • Fig. 4 shows a sequence diagram illustrating authentication of a data recording device, in accordance with an embodiment of the invention.
  • Fig. 5 shows a sequence diagram illustrating authentication of two data recording devices, in accordance with another embodiment of the invention.
  • Fig. 6 shows a data recording device, in accordance with an embodiment of the invention.
  • Fig. 7 shows a data collecting device, in accordance with an embodiment of the invention.
  • Fig. 8 shows a data recording device, in accordance with another embodiment of the invention.
  • Fig. 9 shows a data collecting device, in accordance with another embodiment of the invention.
  • FIG. 1 an exemplifying scenario for usage, in particular
  • a first data recording device 1 10 travels along a route 1 1 1 into a location 101 , such as a room, a restaurant, or the like.
  • First data recording device 1 10 may, e.g., be carried by a user, and may be any one of a lifelogger capturing images or video, a mobile phone or smartphone capturing images, video, or audio.
  • route 1 1 1 is illustrated as having two legs, a first leg 1 1 1 A along which first data recording device 1 10 travels before entering location 101 , and a second leg 1 1 1 B along which first data recording device 1 10 travels after entering location 101 .
  • a second data recording device 120 travelling along a route 121 which is, similar to route 1 1 1 , illustrated as having two legs 121 A and 121 B.
  • Second data recording device 120 may be of the same or similar type as first data recording device 1 10, or of a different type.
  • the two data recording devices 1 10 and 120 are in Fig. 1 illustrated as coming to rest in proximity to each other. This may, e.g., be the case if the two users carrying data recording devices 1 10 and 120, respectively, sit down at a table 102.
  • the users, as well as data recording devices 1 10 and 120 share a common past. For instance, if the two users simultaneously arrive at entrance 104 of location 101 , e.g., because they have agreed to meet outside restaurant 101 , the two data recording devices share a common past starting at entrance 101 and extending along their respective routes 1 1 1 B and 121 B as long as they stay in proximity of each other.
  • the users' common past is reflected by data recorded at each of the data recording devices 1 10 and 120, first data recorded by first data recording device 1 10 and second data recorded by second data recording device 120.
  • the first data and the second data may be of the same type or of different types.
  • Types of first and second data include, but are not limited to, video data, image data, audio data, position data, environmental data, physiological data, and the like.
  • the first data is recorded during at least a first time interval. It may be recorded continuously, during successive time intervals or periodic time intervals, recording may be switched on and off by the user, and so forth. This is illustrated in Fig. 2, where recording the first data 21 1 is exemplified. For instance, recording first data 21 1 may start at time and stop at time fe- It may continue between t c and t D , when recording stops before it is continued at f E and stops at f F - Thus, first data 21 1 is in Fig. 2 illustrated as being recorded during three successive time intervals. The second data 212 is recorded correspondingly, in Fig. 2 illustrated as being recorded during two time intervals.
  • the at least one first time interval and the at least one second time interval at least partially overlap during at least one common time interval, illustrated by means of a diagonal pattern.
  • Authentication of first 1 10 and/or second 120 data recording device in accordance with embodiments of the invention may be performed based on data recorded during the at least one common time interval. This is the case since data recorded simultaneously at both data recording devices 1 10 and 120 may represent a common past, i.e., representing one or more events or objects captured by both data recording devices 1 10 and 120, if in proximity to each other when capturing the event(s) or object(s).
  • authentication of first 1 10 and/or second 120 data recording device in accordance with embodiments of the invention may be performed based on data recorded during respective time intervals which are substantially consecutive, as is illustrated in the lower part of Fig. 2. This may, e.g., be the case if data recording devices 1 10 and 120 record data discontinuously, e.g., periodically capturing still images.
  • the first data and the second data may still be used for the purpose of authentication, if it can be determined that the two data recording devices share a common past. This is the case if the first data and the second data represent an event or object which has been captured by both data recording devices. For instance, with reference to Fig.
  • both data recording devices 1 10 and 120 may capture an event, such as a person 130 passing along route 131 , if second data recording device 120 captures an image shortly after first data recording device 1 10, such that person 130 is visible in both captured images.
  • both data recording devices 1 10 and 120 may capture images of an object, such as a piece of furniture or the like.
  • One of the data recording devices 1 10 or 120 may also capture the other data recording device in an image or a video.
  • Fig. 3 shows a flow chart for an embodiment 300 of a method of the invention.
  • Method 300 is initiated by a request 301 for authenticating first data recording device 1 10, second data recording device 120, or both.
  • Authentication may be initiated by a user, in response to interconnecting or pairing the two data recording devices 1 10 and 120 with each other or with a third device for collecting data, as is described further below, in response to detecting a proximity of the first data recording device 1 10 and the second data recording device 120 to each other or to the third device, or the like.
  • Method 300 comprises acquiring 302 the first data recorded by first data recording device 1 10 during at least one first time interval, acquiring 303 the second data recorded by second data recording device 120 during at least one second time interval, determining 305 an overlap strength between the first data and the second data based on one or more features of the first data and one or more features of the second data, and authenticating 307 first data recording device 1 10 and/or second data recording device 120 if the determined overlap strength fulfills an authentication condition 306. If authentication condition 306 is not fulfilled, authentication is rejected 308.
  • Determining 305 the overlap strength aims at quantifying the shared knowledge of the common past of the two data recording devices, which shared knowledge is represented by the recorded data. Based on that quantification, authentication 307 is performed if the authentication condition 306 is fulfilled. It will be appreciated that the level of security may be adjusted by selecting the authentication condition accordingly, such that a desired level of confidence indicative of a common past is achieved. That is, if a higher level of security is required, a more stringent authentication condition is selected, whereas a more lenient authentication condition is selected if a lower level of security is required.
  • the relation between quantifying the overlap and the authentication condition is exemplified in further detail below.
  • first data recording device 1 may be performed by first data recording device 1 10, as is further illustrated in Fig. 4.
  • the first data is acquired 302 from a data storage accessible by first data recording device 1 10, e.g., an internal or external storage such as a computer memory, hard drive, memory stick, Random Access Memory (RAM), or Flash memory, where data is stored after being captured by a suitable sensor, such as a camera, a microphone, a positioning module, or the like.
  • a suitable sensor such as a camera, a microphone, a positioning module, or the like.
  • the second data is acquired 303 by receiving the second data from second data recording device 120, e.g., by means of a wired or a wireless communication link such as Universal Serial Bus (USB), FireWire, Thunderbolt, Ethernet, Wireless Local Area Network (WLAN)/WiFi, Bluetooth, a cellular network such as a Global System for Mobile Communications (GSM) network, an Universal Mobile Telecommunications System (UMTS) network, or a Long Term Evolution (GSM) network, an Universal Mobile Telecommunications System (UMTS) network, or a Long Term
  • the second data may be made available to first data recording device 1 10 by transferring 303 the data using a memory stick or the like.
  • first data recording device 1 10 such as a smartphone or tablet
  • second data recording device 120 may also authenticate second data recording device 120 for the purpose of coordinating capturing or recording of data.
  • a master data recording device such as a smartphone
  • Such a master data recording device may, e.g., control other data recording devices to start and stop recording of data depending on the location of the user in relation to the other data recording devices. This is advantageous for data recording devices which are not carried by the user but which are deployed in the user's home, office, or the like.
  • first data recording device 1 10 and second data recording device 120 may prepare or arbitrate 401 authentication.
  • Arbitrating 401 authentication may, e.g., include transmitting a request for authentication or pairing, exchanging information pertaining to the second data recorded by second data recording device 120, e.g., time periods during which the second data has been recorded, or position information indicating at which location or locations the second data has been recorded, and so forth. Based on such information, parts of the first data and parts of the second data which are used for quantifying the shared knowledge of the two data recording devices about their common past may be selected 304, as is described further below. It will be appreciated that such selection 304 may be performed prior to acquiring the first data and/or the second data, i.e., as part of the arbitration 401 indicated in Fig. 4, or after, as is indicated in Fig. 3.
  • first data recording device 1 10 may acquire only parts of the first data which were recorded during the at least one common time interval, and/or when first data recording device 1 10 and second data recording device 120 were in proximity to each other. As a consequence, the amount of data which is transferred between devices is reduced, thereby preserving battery power.
  • first data recording device 1 10 may perform further processing 409 after successful authentication, such as analyzing, storing, or fusing, the first and/or the second data. Furthermore, first data recording device 1 10 may also engage in further
  • communications 410 with second data recording device 120 after successful authentication e.g., for the purpose of coordinating recording of data, as was described hereinbefore.
  • method 300 may be performed by a data collecting device (not shown in Fig. 1 ) which is separate from first data recording device 1 10 and second data recording device 120, as is illustrated in Fig. 5.
  • the data collecting device 140 may, e.g., be a smartphone, a tablet, a computer, a cloud storage, or the like, which is used for collecting, analyzing, or fusing, data recorded by at least two data recording devices, such as first data recording device 1 10 and second data recording
  • the first data is acquired 302 by receiving the first data from first data recording device 1 10, and the second data is
  • the first and the second data may, e.g., be received by means of a wired or a wireless communication link, similar to what is described above.
  • the first data and the second data may be made available to data collecting device 140 by transferring the data using a memory stick or the like.
  • data collecting device 140 may also
  • data collecting device 140 may have the role of a master data recording device, such as a smartphone of the user, for controlling capturing of data by other data recording devices.
  • a master data recording device may, e.g., control other data recording devices to start and stop recording of data depending on the location of the user in relation to the other data recording devices. This is advantageous for data recording devices which are not carried by the user but which are deployed in the user's home, office, or the like.
  • first data recording device 1 10 and second data recording device 120 may prepare or arbitrate 501 authentication.
  • Arbitration 501 authentication may, e.g., include transmitting a request for authentication or pairing, exchanging information pertaining to the first data recorded by first data recording device 1 10 and second data recorded by second data recording device 120, e.g., respective time periods during which the first and the second data have been recorded, or position information indicating at which respective location or locations the first data and the second data have been recorded, and so forth. Based on such information, parts of the first data and parts of the second data which are used for quantifying the shared knowledge of the two data recording device may be selected 304, as is described further below. It will be appreciated that such selection 304 may be performed prior to acquiring the first data and/or the second data, i.e., as part of the arbitration 501 indicated in Fig.
  • data collecting device 140 may acquire only parts of the first data and/or the second data which were recorded during the at least one common time interval, and/or when first data recording device 1 10 and second data recording device 120 were in proximity to each other. As a consequence, the amount of data which is transferred between devices is reduced, thereby preserving battery power.
  • data collecting device 140 may perform further processing 509 after successful authentication, such as analyzing, storing, or fusing, the first and/or the second data. Furthermore, data collecting device 140 may also engage in further communications 510 with first data recording device 1 10 and/or second data recording device 120 after successful authentication, e.g., for the purpose of coordinating recording of data, as was described hereinbefore.
  • the overlap strength between the first data and the second data may be determined 305 based on any method suitable for assessing whether data recording devices 1 10 and 120 share a common past. This is achieved by quantifying the similarity of the first data and the second data, or the amount of common features, i.e., features which are present in the first data and the second data.
  • the overlap strength may be determined 305 by calculating a correlation between the first data and the second data. That is, using a correlation function the statistical correlation between the first data and the second data, which are random variables, is evaluated.
  • a correlation function the statistical correlation between the first data and the second data, which are random variables, is evaluated.
  • Different types of correlation functions are known in the art.
  • an autocorrelation function may be used for evaluating the statistical correlation, i.e., the overlap, between random variables representing the same quantity measured at two different locations. This is the case if the first data and the second data are of the same type, e.g., video footage captured by the two data recording devices, such as video lifeloggers.
  • a cross correlation function may be used for evaluating the statistical correlation, and hence the overlap strength, between the first data and the second data.
  • Correlations functions may be used both on scalar-valued data, such as temperature, brightness of a video sequence, or level of an audio recording, and non-scalar data, such as video. It will also be appreciated that the statistical correlation may be evaluated between variables derived from the first data or the second data, respectively. For instance, one may envisage embodiments of the invention performing authentication based on determining the overlap strength between the time-dependent brightness of a video sequence, the first data, recorded by the first data recording device 1 10 and the time-dependent brightness of a video sequence, the second data, recorded by the second data recording device 120.
  • authenticating the first and/or the second data recording device based on the brightness of recorded video may be sufficient if the two data recording devices have recorded data during a sufficiently long common time interval, and/or if the respective data sets comprise sufficient unique or distinct features. This may, e.g., be the case if the two data recording devices 1 10 and 120 have travelled together for an extended period of time in an environment of varying illumination, resulting in sufficient variations in the derived brightness.
  • the correlation function used for determining 305 the overlap strength may be normalized such that a perfect correlation, i.e., the first data and the second data being identical, yields a value of unity, or any other desired maximum value.
  • the authentication condition 306 may be considered fulfilled if the overlap strength is above a threshold value, e.g., 80% of the maximum value or a value of 0.8 in case unity is used for perfect correlation. It will be appreciated that any suitable value may be used, where an increased threshold value is associated with an increased level security level of the authentication.
  • An alternative method for determining 305 the overlap strength between the first data and the second data comprises identifying one or more corresponding features of the features of the first data and the features of the second data, and determining the overlap strength based on a number of the corresponding features in relation to a number of the features of the first data, a number of the features of the second data, or a combination thereof.
  • data recording devices 1 10 and 120 may record different types of data, such as video and audio, respectively.
  • the overlap strength may be determined 305 based on corresponding features, i.e., common features of the first data and of the second data which represent events or objects captured by both data recording devices, albeit with different types of data.
  • first data recording device 1 10 may be a video lifelogger capturing the closing of door 103 after person 130 has entered location 101
  • second data recording device 120 may be a smartphone recording audio and capturing the sound of closing door 103.
  • the overlap strength increases with the number of identified corresponding features in relation to the number of identified features in one of the first data or the second data, or the total number of features in the first data and the second data.
  • determining 305 the overlap strength between the first data and the second data may comprise generating an authentication challenge based on one or more features of the first data, determining a response to the challenge based on the features of the second data, and verifying whether the response matches the challenge, i.e., whether the respective features of the first data and the second data are in fact common features.
  • the authentication condition is fulfilled if the response matches the challenge.
  • the authentication condition may be
  • first data recording device 1 10 may analyze its recorded first data to identify a suitable feature, i.e., a captured person, object, or event, for posing a challenge.
  • first data recording device 1 10 may determine, by image processing its recorded video data (the first data), that third
  • First data recording device may then determine a color of the clothing of third person 130, by analyzing the pixels of an image capturing third person 130 when passing. Based on this analysis, first data recording device 1 10 may then send a challenge to second data recording device 120, such as a request to determine the color of a person or an object which passes at a certain point in time, or within a short time interval around that point in time.
  • second data recording device 120 analyzes its recorded video data (the second data) at the specified point in time and determines a color of a person or object which passes.
  • the determined color is sent to first data recording device 1 10, using any suitable means of color coding known in the art, such as HTML color codes, RGB color codes, or the like.
  • First data recording device 1 10 compares the color received in the response from second data recording device 120 and authenticates second data recording device 120 if the color determined by second data recording device 120 matches the color determined by first data recording device 1 10.
  • the color of a person, clothing of a person, object, or the like may, e.g., be determined as a dominating color of the person or object under
  • the dominating color is to be understood as the most prominent color value of a set of pixels of an image or a video frame which captures the person or object under consideration.
  • first data recording device 1 10 may also send an image or a video frame capturing person 130 to second data recording device 120, challenging second data recording device 120 to respond with the time when person 130 passes.
  • Second data recording device 120 identifies, by analyzing its recorded second data using image recognition techniques, a video frame of the second data capturing person 130 and responds with the time when person 130 passes, based on a time tag stored with the video data.
  • data collecting device 140 may derive an authentication- challenge based on the first data acquired from first data recording device 1 10, and transmit the challenge to second data recording device 120, as is described hereinbefore.
  • data collecting device 140 may authenticate both first data recording device 1 10 and second data recording device 120.
  • data collecting device 140 may acquire both the first data and the second data and perform the process of generating an authentication-challenge based on the first data, generating a response to the challenge based on the second data, and comparing the response with the challenge locally, rather than transmitting the challenge to second data recording device 120.
  • method 300 may optionally comprise selecting 304 data, i.e., a part of the first data and/or a part of the second data, for the purpose of authenticating first data recording device 1 10 and/or second data recording device 120.
  • the overlap strength between the first data and the second data is determined based on a part of the first data and a part of the second data.
  • the part of the first data and the part of the second data may, e.g., selected 304 based on a uniqueness of the part of the first data and/or a uniqueness of the part of the second data.
  • a feature of data is considered to be unique if a subset of the recorded data corresponding to the feature represents an event or object which is uniquely identifiable by analyzing the recorded data.
  • the part of the first data and the part of the second data may be selected 303 based on a proximity of first data recording device 1 10 and second data recording device 120 during recording of the part of the first data and the part of the second data, respectively. That is, only those parts of the first data and the second data are considered for determining 305 an overlap strength which were recorded when the two data recording devices 1 10 and 120 where in proximity of each other, and accordingly share a common past.
  • the overlap strength between the first data and the second data may be determined 305 based on a part of the features of the first data and/or a part of the features of the second data.
  • the part of the features of the first data and/or the part of the features of the second data may be selected based on a uniqueness of the features.
  • the features of the first data and/or a part of the features of the second data may be selected based on a proximity of first data recording device 1 10 and second data recording device 120 during recording of a part of the first data which is associated with the selected features of the first data and a part of the second data which is associated with the selected features of the second data, respectively. In other words, features are selected which were recorded when the two data recording devices were in proximity of each other.
  • Data recording device 600 comprises at least one sensor 601 configured for recording first data during at least one first time interval, a data storage, such as a memory 602, configured for storing the first data 606, a communication interface 605 configured for communicating with another data recording device, and processing means.
  • Communication interface 605 may utilize any wired or wireless technology known in the art, e.g., Ethernet, USB, FireWire, Thunderbolt, Bluetooth, WLAN/WiFi, or a cellular mobile network.
  • the processing means may, e.g., comprise a processor 604 and computer- executable instructions 603, stored in a memory 602, for causing data recording device 600 to perform an embodiment of the method described hereinbefore, when the computer-executable instructions are executed on processor 604.
  • Data recording device 600 may, e.g., be a lifelogging device, a smartphone, a mobile terminal, a digital camera, a webcam, a surveillance camera, an M2M or loT-type of device, a smart watch, a wearable device, or the like.
  • Sensor 601 may, e.g., be a camera, a microphone, a positioning device, a pulse sensor, a heart-rate sensor, a thermometer, or a barometer, and so forth.
  • the processing means is operative to acquire the first data from data storage 603, acquire, via communication interface 605, second data recorded by the second data recording device during at least one second time interval, determine an overlap strength between the first data and the second data based on one or more features of the first data and one or more features of the second data, and authenticate the second data recording device if the determined overlap strength fulfills an authentication condition.
  • the second data is acquired by receiving the second data from the second data recording device, via communication
  • the second data may be acquired by transferring the second data via an external memory, such as a USB memory stick which is connected to communication interface 605.
  • the second data may optionally be stored in data recording device 600, e.g., in memory 602.
  • FIG. 7 an embodiment of the data collecting device, such as data collecting device 140, is illustrated.
  • Data collecting device 700 comprises a communication interface 705 configured for communicating with a first data recording device and a second data recording device, such as data recording devices 1 10 and 120, and processing means.
  • Communication interface 705 may utilize any wired or wireless technology known in the art, e.g., Ethernet, USB, FireWire,
  • the processing means may, e.g., comprise a processor 704 and computer- executable instructions 703, stored in a memory 702, for causing data collecting device 700 to perform an embodiment of the method described hereinbefore, when the computer-executable instructions are executed on processor 704.
  • Data collecting device 700 may, e.g., be a smartphone, a computer, a tablet, a network storage, a cloud storage, or the like.
  • the processing means is operative to acquire, via communication interface 705, first data recorded by the first data recording device during at least one first time interval, acquire, via communication interface 705, second data recorded by the second data recording device during at least one second time interval, determine an overlap strength between the first data and the second data based on one or more features of the first data and one or more features of the second data, and authenticate the first data recording device and the second data recording device if the determined overlap strength fulfills an authentication condition.
  • the first data is acquired by receiving the first data from the first data recording device
  • the second data is acquired by receiving the second data from the second data recording device.
  • the first data and/or the second data may be acquired by transferring the first and/or second data via an external memory, such as a USB memory stick which is connected to communication interface 705.
  • the first data and/or the second data may optionally be stored in data collecting device 700, e.g., in memory 702.
  • data recording device 600 and data collecting device 700 are described.
  • the at least one first time interval and the at least one second time interval may be at least partially overlap during at least one common time interval.
  • the at least one first time interval and the at least one second time interval are substantially consecutive.
  • the processing means may be operative to determine the overlap strength by calculating a correlation between the first data and the second data.
  • the processing means may be operative to determine the overlap strength by identifying one or more corresponding features of the features of the first data and the features of the second data, and determine the overlap strength based on a number of the corresponding features in relation to a number of the features of the first data, a number of the features of the second data, or a combination thereof.
  • the processing means may be operative to determine the overlap strength by generating a challenge based on the features of the first data, determine a response to the challenge based on the features of the second data, and verify whether the response matches the challenge, wherein the authentication condition is fulfilled if the response matches the challenge.
  • the overlap strength between the first data and the second data may be determined based on a part of the first data and a part of the second data.
  • the part of the first data and the part of the second data may be selected based on a uniqueness of the part of the first data and/or a uniqueness of the part of the second data.
  • the part of the first data and the part of the second data may be selected based on a proximity of the first data recording device and the second data recording device during recording of the part of the first data and the part of the second data, respectively.
  • data recording device 600 may comprise means for determining a position of data recording device 600, such as a GPS module (not shown in Fig. 6).
  • the position of data recording device 600 may be determined utilizing WLAN/WiFi or cellular technology.
  • positioning information is stored with the first and the second data, e.g., as meta data or as additional data.
  • the overlap strength between the first data and the second data may be determined based on a part of the features of the first data and/or a part of the features of the second data.
  • the part of the features of the first data and/or the part of the features of the second data may be selected based on a uniqueness of the features.
  • the overlap strength between the first data and the second data may be determined based on a part of the features of the first data and/or a part of the features of the second data, wherein the part of the features of the first data and/or the part of the features of the second data is/are selected based on a proximity of the first data recording device and the second data recording device during recording of a part of the first data associated with the selected features of the first data and a part of the second data associated with the selected features of the second data, respectively.
  • Data recording device 600 and data collecting device 700 may comprise additional features and/or may additionally be configured to perform in accordance with what is described hereinbefore, in particular with reference to Figs. 1 to 5.
  • Data recording device 800 comprises a sensor unit 801 comprising at least one sensor and being configured for recording first data during at least one first time interval, a data storage unit 802 configured for storing the first data, a communication interface 803 configured for communicating with a second data recording device, an overlap strength unit 804, and an authentication unit 805.
  • Overlap strength unit 804 is configured for acquiring the first data from data storage unit 802, acquiring, via communication interface 803, second data recorded by the second data recording device during at least one second time interval, and determining an overlap strength between the first data and the second data based on one or more features of the first data and one or more features of the second data.
  • Authentication unit 805 is configured for authenticating the second data recording device if the determined overlap strength fulfills an authentication condition.
  • data storage unit 802 may be configured for string the second data.
  • Data recording device 800 may comprise additional units and/or may additionally be configured to perform in accordance with what is described hereinbefore, in particular with reference to Figs. 1 to 6.
  • Data collecting device 900 comprises a communication interface 803 configured for communicating with a first data recording device and a second data recording device, an overlap strength unit 904 and an authentication unit 905.
  • Overlap strength unit 904 is configured for acquiring, via
  • Authentication unit 905 is configured for authenticating the first data recording device and the second data recording device if the determined overlap strength fulfills an authentication condition.
  • data collecting device 900 may further comprise a storage unit 902 which is configured for storing the first data and/or the second data.
  • Data collecting device 900 may comprise additional units and/or may additionally be configured to perform in accordance with what is described hereinbefore, in particular with reference to Figs. 1 to 5, and Fig. 7.
  • embodiments of data recording device 600 and 800, and data collecting device 700 and 900 may be implemented by means of any suitable combination of software, executed on a processor, or hardware, such as analog or digital electronics, Integrated Circuits (ICs), Application Specific ICs (ASICs), and the like.
  • ICs Integrated Circuits
  • ASICs Application Specific ICs
  • the specific functional units, or modules, illustrated in Figs. 6 to 9 only serve as an example, and embodiments of the data recording device or the data collecting device may use any suitable combination of functional units other than those described herein and illustrated in Figs. 6 to 9.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

L'invention concerne une solution destinée à authentifier un premier dispositif d'enregistrement de données et/ou un deuxième dispositif d'enregistrement de données, par exemple un premier et un deuxième moyen d'archivage de vie. La solution est basée sur les étapes consistant à acquérir (302) des premières données enregistrées par le premier dispositif d'enregistrement de données pendant au moins un premier intervalle de temps, acquérir (303) des deuxièmes données enregistrées par le deuxième dispositif d'enregistrement de données pendant au moins un deuxième intervalle de temps, déterminer (305) une intensité de recouvrement entre les premières données et les deuxièmes données, et authentifier (307) le premier dispositif d'enregistrement de données et/ou le deuxième dispositif d'enregistrement de données si l'intensité de recouvrement déterminée remplit une condition d'authentification (306). L'intensité de recouvrement est déterminée d'après une ou plusieurs caractéristiques des premières et deuxièmes données, et quantifie les connaissances partagées concernant un passé commun des deux dispositifs d'enregistrement de données, tel que capturé par les premières données et les deuxièmes données.
PCT/SE2015/050619 2015-05-29 2015-05-29 Authentification de dispositifs d'enregistrement de données WO2016195545A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/SE2015/050619 WO2016195545A1 (fr) 2015-05-29 2015-05-29 Authentification de dispositifs d'enregistrement de données

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SE2015/050619 WO2016195545A1 (fr) 2015-05-29 2015-05-29 Authentification de dispositifs d'enregistrement de données

Publications (1)

Publication Number Publication Date
WO2016195545A1 true WO2016195545A1 (fr) 2016-12-08

Family

ID=53488419

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2015/050619 WO2016195545A1 (fr) 2015-05-29 2015-05-29 Authentification de dispositifs d'enregistrement de données

Country Status (1)

Country Link
WO (1) WO2016195545A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3477982A1 (fr) * 2017-10-30 2019-05-01 Hewlett-Packard Development Company, L.P. Authentification basée sur la localisation
EP3554052A1 (fr) * 2018-04-10 2019-10-16 Rolls-Royce plc Gestion de réseau de capteurs de machine
FR3116982A1 (fr) * 2020-12-01 2022-06-03 Orange Procédé et système de corrélation d’événements

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130127591A1 (en) * 2011-11-20 2013-05-23 International Business Machines Corporation Secure facilities access
EP2683147A1 (fr) * 2012-07-03 2014-01-08 Samsung Electronics Co., Ltd Procédé et appareil pour le pairage entre dispositifs utilisateurs utilisant la voix
EP2731371A2 (fr) * 2012-11-07 2014-05-14 Samsung Electronics Co., Ltd Procédé et dispositif d'appairage de terminaux utilisateurs
US20140324591A1 (en) * 2013-04-29 2014-10-30 Qualcomm Incorporated Selectively authenticating a group of devices as being in a shared environment based on locally captured ambient sound

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130127591A1 (en) * 2011-11-20 2013-05-23 International Business Machines Corporation Secure facilities access
EP2683147A1 (fr) * 2012-07-03 2014-01-08 Samsung Electronics Co., Ltd Procédé et appareil pour le pairage entre dispositifs utilisateurs utilisant la voix
EP2731371A2 (fr) * 2012-11-07 2014-05-14 Samsung Electronics Co., Ltd Procédé et dispositif d'appairage de terminaux utilisateurs
US20140324591A1 (en) * 2013-04-29 2014-10-30 Qualcomm Incorporated Selectively authenticating a group of devices as being in a shared environment based on locally captured ambient sound

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
REZA RAWASSIZADEH ET AL: "Securing Shareable Life-logs", SOCIAL COMPUTING (SOCIALCOM), 2010 IEEE SECOND INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 20 August 2010 (2010-08-20), pages 1105 - 1110, XP031766974, ISBN: 978-1-4244-8439-3 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3477982A1 (fr) * 2017-10-30 2019-05-01 Hewlett-Packard Development Company, L.P. Authentification basée sur la localisation
EP3554052A1 (fr) * 2018-04-10 2019-10-16 Rolls-Royce plc Gestion de réseau de capteurs de machine
FR3116982A1 (fr) * 2020-12-01 2022-06-03 Orange Procédé et système de corrélation d’événements
WO2022117946A1 (fr) * 2020-12-01 2022-06-09 Orange Procédé et système de corrélation d'événements

Similar Documents

Publication Publication Date Title
US10506406B2 (en) Building network hub with occupancy awareness
US11381668B2 (en) Methods, devices, and systems for determining a subset for autonomous sharing of digital media
US10506054B2 (en) Building occupancy sensor network
CN107065586B (zh) 交互式智能家庭服务系统及方法
AU2019204810A1 (en) Digital fingerprint tracking
US11700071B2 (en) Method, device, system, and storage medium for live broadcast detection and data processing
CN104537746A (zh) 智能电子门控制方法、系统及设备
US20170262706A1 (en) Smart tracking video recorder
US9792488B2 (en) Adjacent person specifying apparatus, adjacent person specifying method, adjacent person specifying program, and adjacent person specifying system
AU2019295856A1 (en) Object tracking using disparate monitoring systems
CN104933791A (zh) 智能安防控制方法及设备
CN108429745A (zh) 登录的认证方法和认证系统、网页登录方法和系统
CN108363939B (zh) 特征图像的获取方法及获取装置、用户认证方法
CN108932760A (zh) 基于人脸识别的考勤方法及终端
WO2016195545A1 (fr) Authentification de dispositifs d'enregistrement de données
US20160048722A1 (en) Embedding Biometric Data From a Wearable Computing Device in Metadata of a Recorded Image
CN106464812A (zh) 生活记录摄像头和根据活动转变控制生活记录摄像头的方法
JPWO2013069565A1 (ja) 撮影記録装置
JP2015233204A (ja) 画像記録装置及び画像記録方法
WO2016035632A1 (fr) Dispositif de traitement de données, système de traitement de données, procédé de traitement de données et programme
KR101732379B1 (ko) 얼굴 인식을 통한 사용자 인증 방법
JP2020113109A (ja) 撮像システム
CN111127704A (zh) 数据关联方法及装置
Singh et al. Detecting Multiple People with Low-Resolution Thermal Sensors in Smart Spaces
Constantino Best Effort Identification

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15731738

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15731738

Country of ref document: EP

Kind code of ref document: A1