EP2679067B1 - Method and apparatus for using out-band information to improve wireless communications - Google Patents

Method and apparatus for using out-band information to improve wireless communications Download PDF

Info

Publication number
EP2679067B1
EP2679067B1 EP11859429.0A EP11859429A EP2679067B1 EP 2679067 B1 EP2679067 B1 EP 2679067B1 EP 11859429 A EP11859429 A EP 11859429A EP 2679067 B1 EP2679067 B1 EP 2679067B1
Authority
EP
European Patent Office
Prior art keywords
propagation channel
parameter
examples
environment
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP11859429.0A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2679067A4 (en
EP2679067A1 (en
Inventor
Xuefeng Yin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Empire Technology Development LLC
Original Assignee
Empire Technology Development LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Empire Technology Development LLC filed Critical Empire Technology Development LLC
Publication of EP2679067A1 publication Critical patent/EP2679067A1/en
Publication of EP2679067A4 publication Critical patent/EP2679067A4/en
Application granted granted Critical
Publication of EP2679067B1 publication Critical patent/EP2679067B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B17/00—Monitoring; Testing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B17/00—Monitoring; Testing
    • H04B17/10—Monitoring; Testing of transmitters
    • H04B17/15—Performance testing
    • H04B17/19—Self-testing arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B17/00—Monitoring; Testing
    • H04B17/20—Monitoring; Testing of receivers
    • H04B17/27—Monitoring; Testing of receivers for locating or positioning the transmitter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B17/00—Monitoring; Testing
    • H04B17/30—Monitoring; Testing of propagation channels
    • H04B17/309—Measuring or estimating channel quality parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B17/00—Monitoring; Testing
    • H04B17/30—Monitoring; Testing of propagation channels
    • H04B17/391—Modelling the propagation channel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
    • H04M1/6008—Substation equipment, e.g. for use by subscribers including speech amplifiers in the transmitter circuit
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00326—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a data reading, recognizing or recording apparatus, e.g. with a bar-code apparatus
    • H04N1/00328—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a data reading, recognizing or recording apparatus, e.g. with a bar-code apparatus with an apparatus processing optically-read information
    • H04N1/00336—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a data reading, recognizing or recording apparatus, e.g. with a bar-code apparatus with an apparatus processing optically-read information with an apparatus performing pattern recognition, e.g. of a face or a geographic feature
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/0077—Types of the still picture apparatus
    • H04N2201/0084—Digital still camera

Definitions

  • transmission techniques may be used to overcome communications problems such as, for example, fast fading due to multipath effects or interference among multiple users.
  • To employ such transmission techniques it may be useful to estimate characteristics of the wireless channel.
  • in-band sensing techniques may be used to estimate the wireless channel characteristics.
  • such in-band techniques may require a large computational overhead, additional devices to be added to the wireless device, and other difficulties.
  • a machine readable non-transitory medium and apparatus are respectively defined in claims 4 and 9.
  • This disclosure is drawn, inter alia, to methods, apparatuses, systems and computer readable media related to using out-band information to adapt communication settings in wireless devices.
  • Various transmission techniques may be used to overcome wireless communications problems. To advantageously implement such techniques, it may be useful to estimate characteristics of a wireless communications channel being used by a wireless device. Based on channel characteristics, a physical layer setting or settings may be adjusted in the wireless device to improve communications.
  • out-band information may be used to adapt settings in a wireless device.
  • data may be obtained at a sensor included in the wireless device.
  • the sensor may be a camera or a microphone and the obtained data may be image data or sound data, respectively.
  • the obtained data may be received, for example, at a processing portion of the wireless device or at a remote computing device.
  • the received data may be processed using a variety of techniques discussed further herein to generate an environment parameter or indicator that may characterize and be related to an environment around the wireless device. Based at least in part on the environment parameter or indicator, a propagation channel characteristic for the wireless device may be determined.
  • a physical layer setting for the wireless device may be determined and the setting may be asserted or implemented at the wireless device.
  • the environment parameter or indicator, the channel characteristic and the physical layer setting may be determined at the wireless device. In other examples, any of those may be determined at a remote computing device and transmitted to the wireless device.
  • Fig. 1 is an illustration of a flow chart of an example method 100 for adapting communication settings in a wireless device.
  • Method 100 may include one or more functions, operations or actions as illustrated by one or more of blocks 110, 120, 130, 140 and/or 150.
  • method 100 may be implemented at a wireless device such as, for example, a cellular phone. The process of method 100 may begin at block 110.
  • a sensor provided in a wireless device may be activated.
  • the sensor may obtain or detect out-band information for use in adapting communication settings in the wireless device.
  • the sensor may be a device embedded in the wireless device.
  • the sensor may be a camera.
  • the sensor may be a camera installed on the back of the wireless device such that as the user makes a call and holds the device, the camera may face and be exposed to the environment around the wireless device.
  • the sensor may be a microphone.
  • the activation may occur based on a criteria such as, for example, a wireless communication event (i.e., a phone call, receiving or sending a message, web browsing) or at regular time intervals.
  • a wireless communication event i.e., a phone call, receiving or sending a message, web browsing
  • the activation of the sensor may not be related to an immediate output for the user. For example, no visual output may be provided to the user upon activation of the camera. The process may continue at block 120.
  • data from the sensor may be received.
  • data may be received at a processing portion of the wireless device.
  • a processing portion may include logic or a microprocessor and/or memory.
  • data obtained at a sensor in a wireless may be sent from the wireless device and received at a remote device such as, for example, a server or a computer, for processing.
  • the received data may be in any format recognizable by a processing portion of a device such as, for example, a data file, a data packet, or the like.
  • the device may be a camera and the data may include image data or a series of image data.
  • the device may be a microphone and the data may include audio data.
  • the process may continue at block 130.
  • the received data may be processed to generate an environment parameter or parameters related to the environment around the wireless device.
  • image data from a camera may be processed to provide an environment parameter.
  • audio data from a microphone may be processed to provide an environment parameter.
  • both image data from a camera and audio data from a microphone may be used to provide an environment parameter.
  • the processing may be performed at the wireless device. In other examples, the processing may be performed at a remote device.
  • the environment parameter may include any parameter, parameters, indications or characterizations that may be related to an environment around the wireless device.
  • the environment parameter may include a numerical indication or rating of the density or types of objects in the environment.
  • the environment parameter may include a categorization of the type of environment around the wireless device.
  • the environment parameter may include an indication such as, for example, one of the following: an indoor indication, an outdoor indication, an urban indication, a suburban indication, a rural indication, a corridor indication, a cafeteria indication, a confined room indication, a stationary indication, a vehicular motion indication, a nomadic indication, a plant-rich indication, an open area indication, or a closed area indication.
  • an indication such as, for example, one of the following: an indoor indication, an outdoor indication, an urban indication, a suburban indication, a rural indication, a corridor indication, a cafeteria indication, a confined room indication, a stationary indication, a vehicular motion indication, a nomadic indication, a plant-rich indication, an open area indication, or a closed area indication.
  • Other categories and indications may be available.
  • an environment parameter may include an indoor indication and one of a corridor, a cafeteria, a hall, or an enclosed room indication as a more detailed description of the indoor indication.
  • a variety of combinations of categories and indications may be used to characterize the environment around the wireless device.
  • the environment indications may be related to a best approximation of the category of the environment around the wireless device.
  • the environment parameter may be encoded in any suitable manner, such as, for example, encoding into a data file, a packet, a message or the like.
  • the environment parameter may include detailed information regarding the environment around the wireless device. The process may continue at block 140.
  • a propagation channel characteristic may be determined based at least in part on the environment parameter.
  • the determined propagation channel characteristic may include the channel coefficients of the propagation channel.
  • the determined propagation channel characteristic may include the channel status information of the propagation channel.
  • the determined propagation channel characteristic may include, for example, a time-variability of the propagation channel, a fading characteristics of the propagation channel, a power delay profile of the propagation channel, a Doppler frequency spectrum of the propagation channel, a temporal auto-correlation of the propagation channel, a spatial auto-correlation of the propagation channel, a frequency auto-correlation of the propagation channel, a coherent distance of the propagation channel, a coherent time of the propagation channel, a coherent frequency of the propagation channel, a rank information of the propagation channel, a shadowing of the propagation channel, a multi-path propagation phenomenon of the propagation channel, a reflection of the propagation channel, a refraction of the propagation channel, a diffraction of the propagation channel, a diffuse scattering of the propagation channel, a selectivity of the propagation channel in angles (e.g., azimuth and elevation), a polarization status of the propagation channel, a frame length, a
  • the determined propagation channel characteristics may be based on the environment parameter. In some examples, the determined propagation channel characteristics may be determined based on a look-up table such that the environment parameters may be used to find corresponding characteristics in the look up table. In some examples, the characteristics may be determined using an algorithm or algorithms. In some examples, the environment parameters or objects may be used to determine the channel characteristics using ray tracing techniques. In some examples, the environment parameters or objects may be used to simulate the general profile of the channel using simulation techniques. In some examples, the environment parameters or objects may be used to determine the channel characteristics using ray launching techniques. As discussed, in some examples, the processing may be performed at the wireless device while in other examples, the processing may be performed at a remote device.
  • the propagation channel characteristic may be encoded in any suitable manner, such as, for example, encoding into a data file, a packet, a message or the like. In some examples, As is discussed in further detail below, a variety of propagation channel characteristics may be determined. The process may continue at block 150.
  • a physical layer setting in the wireless device may be adjusted.
  • the physical layer setting may include a variety of settings or parameters.
  • the physical layer setting may include, for example, adiversity scheme selection parameter, a signal-to-noise ratio prediction parameter, an adaptive modulation parameter, a data rate adaption parameter, a Doppler frequency setting, a polarization setting, a direction of departure adaption parameter, a direction of arrival adaption parameter, a coherent frequency adaption parameter, a coherent distance adaption parameter, a coherent time adaption parameter, or a channel status information feedback scheme parameter.
  • a variety of physical layer settings may be available.
  • the environment parameter, the propagation channel and the physical layer setting may be determined and implemented at the wireless device. In other examples, one or more of the environment parameter, the propagation channel or the physical layer setting may be determined at a remote device and transmitted to the wireless device, such that a physical layer setting may be ultimately applied or adjusted at the wireless device.
  • a sensor in a wireless device may be employed to obtain data for use in adjusting a physical layer setting in the wireless device.
  • the sensor may be a camera and the obtained data may be image data that may represent an image or a series of image data that may represent a series of images.
  • image data may be processed by, for example, detecting an edge, determining an edge orientation and a length of the edge, detecting a surface, determining areas of uniform color, determining sharp changes in color, detecting a human face, detecting a human body, detecting a traffic lane, detecting an object, recognizing a shape, modeling an object, or the like.
  • the object detection may include computer aided design (CAD) type object modeling.
  • the image data processing may be used to determine an environment parameter or parameters as discussed above with respect to Fig. 1 .
  • Figs. 2A and 2B are illustrations of an example environment and example object recognition in the environment.
  • Fig. 2A illustrates an example environment 210.
  • a camera in a wireless device may obtain image data representative of environment 210 during an activation event at the wireless device.
  • the image of Fig. 2A is meant to be illustrative, in the discussed examples, the obtained image data may not be displayed in visual form to a user.
  • the image data may be processed to evaluate or identify objects in environment 210.
  • the image data may be processed using edge detection techniques, edge orientation determination techniques, surface detection techniques, color evaluation techniques, color contrast detection techniques, object detection, modeling techniques or any of the techniques discussed herein.
  • Fig. 2B is an illustration of example of object recognition and expected propagation paths based on environment 210.As shown in Fig. 2B , building surfaces 220, 230 and trees 240, 250, 260 may be recognized based on processing the image data related to environment 210.
  • the image illustrated in Fig. 2B may be represented as a data set or a data file, for example.
  • the objects and information based on the processing may be used to determine an environment parameter related to environment 210, as discussed above with respect to Fig. 1 .
  • environment 210 may be determined to be an outdoor environment and the environment parameter may include an outdoor indication.
  • the environment parameter may include an indication of the amount or density of foliage.
  • the environment parameter may include a detailed mapping of object locations in the outdoor environment including tree locations and/or building locations, or the like.
  • the processed data may be used to determine propagation channel characteristics.
  • the processed image data may be used to determine propagation channel characteristics.
  • the recognized objects, and their related details i.e., sizes, orientations, locations, roughness, and the like
  • the propagation channel characteristics may include, for example, a fading characteristics of the propagation channel, a Doppler frequency spectrum of the propagation channel, a temporal auto-correlation of the propagation channel, a spatial auto-correlation of the propagation channel.
  • the propagation channel characteristics may include a channel profile.
  • typical channel path distributions may be expected at, for example, a location 270 between tree 250 and building surface 230, a location 272 between tree 240 and tree 250, a location 274 just to the left of tree 260 and above building surface 240, at a location 276 along building surface 230, and a location 278 along building surface 240.
  • propagation paths may not be expected in some locations such as, for example, through tree 240 or tree 250. Thereby, predicted propagation arrival paths, both in the azimuth and the elevation, may be determined.
  • the detected edges, corners, surfaces of buildings, or detected objects may provide an approximation of a composition of the channel.
  • edges may be a source of electromagnetic wave radiation.
  • surfaces may influence the channel by adding spread in delay, angles and polarization.
  • objects in the environment may cause signal attenuation and fading in the signal power of a propagation channel. Such details may be determined from the environment parameter or parameters to characterize the propagation channel.
  • the propagation channel characteristic may be used to determine and adjust a physical layer setting in the wireless device.
  • the method may include a user operating a mobile device to make a phone call.
  • a camera embedded in the mobile device may be activated.
  • the activated camera may obtain image data representative of environment 210.
  • the image data may be received from the sensor, and the received data may be processed to generate an environment parameter or parameters indicating, for example, that environment 210 may be an outdoor environment.
  • a propagation channel characteristic or characteristics such as, for example, any of those listed herein, may be determined based on the environment parameter or parameters.
  • the propagation channel characteristic or characteristics may be used to adjust a physical layer setting in the wireless device. Thereby, advantageous transmission techniques may be used in the wireless device based on the environment around the device.
  • Figs. 3A and 3B are illustrations of an example environment and example object recognition in the environment.
  • Fig. 3A illustrates an example environment 310.
  • a camera in a wireless device may obtain image data representative of environment 310 during an activation event at the wireless device.
  • the image of Fig. 3A is meant to be illustrative, in the discussed examples, the obtained image data may not be displayed in visual form to a user.
  • the image data may be processed to evaluate or identify objects in environment 310.
  • the image data may be processed using edge detection techniques, edge orientation determination techniques, surface detection techniques, surface roughness detection techniques, color evaluation techniques, color contrast detection techniques, object detection, modeling techniques or any of the techniques discussed herein.
  • Fig. 3B is an illustration of example of object recognition and expected propagation paths based on environment 310.
  • surfaces 320, 330, 340, clutter 370 and edges 350, 360 may be recognized based on processing the image data related to environment 310.
  • the image illustrated in Fig. 3B may be represented as a data set or a data file, for example.
  • the objects and information based on the processing may be used to determine an environment parameter related to environment 310, as discussed above with respect to Fig. 1 .
  • environment 310 may be determined to be an indoor environment and the environment parameter may include an indoor indication.
  • the environment parameter may include an indication of the amount or density of objects in the indoor environment.
  • a detailed mapping of the indoor environment including object types and locations, or the like.
  • the processed data may be used to determine propagation channel characteristics.
  • the processed image data may be used to determine propagation channel characteristics.
  • the recognized objects, and their related details i.e., sizes, orientations, locations, and the like may be used to determine propagation channel characteristics.
  • the propagation channel characteristics may include, for example, a Doppler frequency spectrum of the propagation channel, a temporal auto-correlation of the propagation channel, a shadowing of the propagation channel, a multi-path propagation phenomenon of the propagation channel, a reflection of the propagation channel, a refraction of the propagation channel, a diffraction of the propagation channel, a diffuse scattering of the propagation channel, a frame length, a symbol length, a multipath severity of the propagation channel, or the like.
  • the propagation channel characteristics may include a channel profile.
  • channel path distributions may be expected at, for example, a location 381 between edges 350, 360, a location 382 between edge 360 and surface 320, a location 383 at surface 320, a location 384 at surface 330, a location 385 at surface 340, and a location 386 at clutter 370.
  • predicted propagation arrival paths both in the azimuth and the elevation, may be determined.
  • the detected edges, corners, surfaces of buildings, or detected objects may be used to provide an approximation of a composition of the channel.
  • edges may be a source of electromagnetic wave radiation.
  • surfaces may influence the channel by adding spread in delay, angles and polarization.
  • objects in the environment may cause signal attenuation and fading in the signal power of a propagation channel. Such details may be determined from the environment parameter or parameters to characterize the propagation channel.
  • the propagation channel characteristic may be used to determine and adjust a physical layer setting in the wireless device.
  • the method may include a user operating a mobile device to make a phone call.
  • a camera embedded in the mobile device may be activated.
  • the activated camera may obtain image data representative of environment 310.
  • the image data may be received from the sensor, and the received data may be processed to generate an environment parameter or parameters indicating, for example, that environment 310 may be an indoor enclosed environment.
  • a propagation channel characteristic or characteristics such as, for example, any of those listed herein, may be determined based on the environment parameter or parameters.
  • the propagation channel characteristic or characteristics may be used to adjust a physical layer setting in the wireless device. Thereby, advantageous transmission techniques may be used in the wireless device based on the environment around the device.
  • Figs. 4A and 4B are illustrations of an example environment and example object recognition in the environment.
  • Fig. 4A illustrates an example environment 410.
  • a camera in a wireless device may obtain image data representative of environment 410 during an activation event at the wireless device.
  • the image of Fig. 4A is meant to be illustrative, in the discussed examples, the obtained image data may not be displayed in visual form to a user.
  • the image data may be processed to evaluate or identify objects in environment 410.
  • the image data may be processed using edge detection techniques, edge orientation determination techniques, surface detection techniques, surface roughness detection techniques, color evaluation techniques, color contrast detection techniques, object detection, modeling techniques or any of the techniques discussed herein.
  • Fig. 4B is an illustration of example of object recognition based on environment 410.
  • surfaces 420, 430, 440, clutter 470, edges 450, 454, 458, tree 480, and face 460 may be recognized based on processing the image data related to environment 410.
  • the image illustrated in Fig. 4B may be represented as a data set or a data file, for example.
  • the objects and information based on the processing may be used to determine an environment parameter related to environment 410, as discussed above with respect to Fig. 1 .
  • environment 410 may be determined to be an indoor corridor environment and the environment parameter may include an indoor corridor indication.
  • the environment parameter may include an indication of the amount or density of objects in the indoor corridor environment.
  • the processed data may be used to determine propagation channel characteristics.
  • the processed image data may be used to determine propagation channel characteristics.
  • the recognized objects, and their related details i.e., sizes, orientations, locations, and the like may be used to determine propagation channel characteristics.
  • the propagation channel characteristics may include, for example, a Doppler frequency spectrum of the propagation channel, a temporal auto-correlation of the propagation channel, a shadowing of the propagation channel, a multi-path propagation phenomenon of the propagation channel, a reflection of the propagation channel, a refraction of the propagation channel, a diffraction of the propagation channel, a diffuse scattering of the propagation channel, a frame length, a symbol length, a multipath severity of the propagation channel, or the like.
  • the propagation channel characteristics may include a channel profile.
  • typical channel path distributions may be expected at, for example, a location 492 at surface 420, a location 494 at surface 430, at a location 496atsurface 470, at locations around tree 480, and at locations between edges 450, 454, 458.
  • the locations around tree 480 and between edges 450, 454, 458 are not shown for the sake of clarity of presentation. Thereby, predicted propagation arrival paths, both in the azimuth and the elevation, may be determined.
  • the detected edges, corners, surfaces of buildings, or detected objects may provide an approximation of a composition of the channel.
  • edges may be a source of electromagnetic wave radiation.
  • surfaces may influence the channel by adding spread in delay, angles and polarization.
  • objects in the environment may cause signal attenuation and fading in the signal power of a propagation channel. Such details may be determined from the environment parameter or parameters to characterize the propagation channel.
  • the propagation channel characteristic may be used to determine and adjust a physical layer setting in the wireless device.
  • the method may include a user operating a mobile device to make a phone call.
  • a camera embedded in the mobile device may be activated.
  • the activated camera may obtain image data representative of environment 410.
  • the image data may be received from the sensor, and the received data may be processed to generate an environment parameter or parameters indicating, for example, that environment 410 may be an indoor corridor environment.
  • a propagation channel characteristic or characteristics such as, for example, any of those listed herein, may be determined based on the environment parameter or parameters.
  • the propagation channel characteristic or characteristics may be used to adjust a physical layer setting in the wireless device. Thereby, advantageous transmission techniques may be used in the wireless device based on the environment around the device.
  • environmental details may be used to determine channel characteristics.
  • the objects in the environment provided via environment parameters may be linked to channel characteristics using ray tracing techniques.
  • the objects in the environment provided via environment parameters may be linked to channel characteristics using ray launching techniques.
  • the objects in the environment provided via environment parameters may be linked to channel characteristics using channel simulation techniques.
  • the moving status of objects along with the sizes of the objects may be used to reconstruct or approximate a Doppler frequency spectrum, which may be used to determine the time variability of the channel, fading statistics of the channel, or temporal auto-correlation of the channel.
  • buildings, trees, or large objects may be used to determine the status of shadowing in the propagation channel, which may be used to adjust a power allocation physical setting in the mobile device.
  • the details of the environment may be used to approximate a number of independent paths existing in a propagation channel and the multiple-input and multiple-output (MIMO) rank of the channel, which may be used to approximate the number of antennas required to transmit at a predefined data rate.
  • MIMO multiple-input and multiple-output
  • the environment parameters or details may be used to determine a richness or quality of channel multipaths.
  • the quality may be quantified using an indicator such as a poor indicator, a moderate indicator or a good indicator.
  • a physical setting may be applied to the mobile device. For example, in a corridor environment path, the quality may be defined as poor when several propagation paths may be concentrated due to corridor walls and physical settings that require uncorrelation among antennas and beam forming techniques may be applied.
  • the channel characteristics may include a deterministic part and a random part of the channel impulse responses, and the ratio of the two may be used to determine if the channel is in a line of sight scenario such that a channel K factor may be determined.
  • the K factor may be used to predict a bit error rate in the channel, which may be used to determine a variety of physical layer settings for the wireless device.
  • any of the environment parameters may be used in conjunction to determine propagation channel characteristics.
  • any of the channel characteristics may be used in conjunction to determine physical layer settings for the wireless device.
  • the determined channel characteristics may be used to select physical layer settings. In such examples, the characteristics may be balanced against each other to determine the applied physical layer settings.
  • an environment parameter or parameters may be determined based on image data received from a camera being processed.
  • the image data processing may be broken into stages.
  • a first stage of processing may include determining areas in the image with uniform color and sharp changes in color. Such processing may determine edge locations and orientations. Such processing may be used to determine the discussed environment parameters, channel characteristics, and physical layer settings. Such first stage processing may be sufficient for some applications or it may be used as a first pass to determine settings quickly. Changes may be made based on the first stage of processing and changed or refined later, for example.
  • a second stage of processing may include the determination of clutter objects in the environment. The discussed environment parameters, channel characteristics, and physical layer settings may be determined based on the second stage to refine the settings.
  • a third stage may include determining more detailed objects in the environment such as buildings, trees and humans. The discussed environment parameters, channel characteristics, and physical layer settings may be determined based on the third stage to refine the settings.
  • the environment parameter may include an indication describing a movement of the mobile device.
  • the movement may include the mobile device moving.
  • the movement may include the objects around the mobile device moving while the mobile device is relatively fixed.
  • both the mobile device and the surrounding objects may be moving.
  • the environment parameter may include an indication of an approximation of which situation the movement may relate to, such as, for example, a mobile device moving indicator, a fixed mobile device moving object indicator, or a moving mobile device and moving object indicator.
  • the environment parameter may be used to determine propagation channel characteristics.
  • the determined channel characteristic may include channel fading rate.
  • a record of the motion of the objects and the mobile device based on a series of images obtained at a camera may be used to predict a trend in the channel fading characteristics.
  • a sensor in a wireless device may be employed to obtain data for use in adjusting a physical layer setting in the wireless device.
  • the sensor may be a microphone and the obtained data may be audio data that may represent an audio recording.
  • the recorded audio may include the voice of the user, the resonance of the user's voice generated by reflections in the environment, or sounds directly from the environment.
  • the obtained data may be received and processed to determine an environment parameter.
  • the audio data processing may include resonance detection.
  • audio resonance detection may include analyzing audio data to determine a tendency of the audio data to oscillate at certain frequencies.
  • any of the environment parameters discussed herein may be determined using such techniques.
  • audio resonance detection at certain frequencies may be related to the mobile device being in an indoor environment.
  • the audio data processing may include audio echo detection.
  • audio echo detection may include analyzing the audio data to determine certain frequencies may have been reflected back to the mobile device from an object or a surface, for example.
  • any of the environment parameters discussed herein may be determined using such techniques.
  • audio echo detection may be related to walls being near the mobile device and the determined environment parameter may include an indoor indication.
  • audio echo detection may be related to hard outdoor surfaces such as mountains or privacy fences and the determined environment parameter may include an outdoor indication.
  • the audio echo detection may include an evaluation of the intensity of the echo to determine the related environment parameter.
  • the sensor may include a camera and the data processed to determine an environment parameter, a propagation channel characteristic and a physical layer setting for the wireless device may include image data or a series of image data.
  • the sensor may include a microphone and the data may include audio data.
  • both a camera and a microphone may be used together to determine an environment parameter, a propagation channel characteristic and a physical layer. Both image data and sound data may be received and processed to generate an environment parameter as discussed herein.
  • a propagation channel characteristic may be determined based on the environment parameter and a physical layer setting in a wireless device may be adjusted based on the propagation channel characteristic.
  • the camera and microphone may be used contemporaneously.
  • the camera may be used to obtain image data and microphone may be used to obtain audio data at different, but similar, times such that the data may be representative of a same or similar environment around the wireless device.
  • out-band information may be used to adapt communication settings in wireless devices.
  • the out-band information such as, for example, information discussed with respect to Fig. 1 herein, may be used with in-band information and corresponding techniques to adapt communications settings.
  • in-band techniques may include in-band channel sensing and channel estimation, determining composite channel coefficients, determining channel status information, determining delay taps, determining frequency response, determining optimum direction of departure, determining optimum direction of arrival, or the like.
  • one or more of those techniques may be used with the out-band techniques discussed herein to, for example, determine propagation channel characteristics or to determine and adjust physical layer settings in a wireless device.
  • in-band techniques may be implemented in the physical layer and the implementation of the in-band and out-band settings may be implemented in the physical layer of the wireless device.
  • sensor activation may occur at a wireless communication event or at regular time intervals. In general, sensor activation may occur at any time or event such that useful environment information may be obtained. In some examples, the activation may occur at start-up of the mobile device. In some examples, the activation may occur at the command of the user of the mobile device. In some examples, the activation may occur when the wireless device is handed off between cellular stations.
  • sensors in wireless devices may be processed to generate parameters that may represent an environment around the mobile device.
  • the environment parameters may be used to determine propagation channel characteristics.
  • the characteristics may be used to adjust physical layer settings in the mobile device.
  • the characteristics may be used to adjust physical layer settings at a base station related to the mobile device.
  • the processing of the data obtained at the sensor in the wireless device may be processed at the wireless device or at a remote server or computer.
  • the data or portions of the data obtained at the sensor may be transmitted to a remote server or computer.
  • the remote server or computer may process the received data to determine parameters that may represent an environment around the mobile device and determine propagation channel characteristics using any of the techniques discussed herein.
  • the server or computer may determine physical layer settings for a base station. Those settings may be transmitted to the base station for implementation. In other examples, the server or computer may determine physical layer settings for the mobile device. Those settings may be transmitted to the wireless device for implementation.
  • Fig. 5 illustrates an example computer program product 500 arranged in accordance with at least some embodiments of the present disclosure.
  • Computer program product 500 may include a signal bearing medium 502.
  • Signal bearing medium 502 may include one or more machine-readable instructions 504, which, when executed by one or more processors, may operatively enable a computing device to provide the functionality described herein.
  • some or all of the machine-readable instructions may be used by the devices discussed herein.
  • signal bearing medium 502 may encompass a computer-readable medium 505, such as, but not limited to, a hard disk drive, a Compact Disc (CD), a Digital Versatile Disk (DVD), a digital tape, memory, etc.
  • signal bearing medium 502 may encompass a recordable medium 508, such as, but not limited to, memory, read/write (R/W) CDs, R/W DVDs, etc.
  • signal bearing medium 502 may encompass a communications medium 510, such as, but not limited to, a digital and/or an analog communication medium (e.g., a fiber optic cable, a waveguide, a wired communication link, a wireless communication link, etc.).
  • signal bearing medium 502 may encompass a machine readable non-transitory medium.
  • Fig. 6 is a block diagram illustrating an example computing device 600 arranged in accordance with at least some embodiments of the present disclosure.
  • computing device 600 may be configured to provide the operations discussed herein.
  • the devices discussed with respect to Fig. 6 may be provided as a part of computing device 600.
  • computing device 600 may include one or more processors 610 and system memory 620.
  • a memory bus 630 can be used for communicating between the processor 610 and the system memory 620.
  • processor 610 may be of any type including but not limited to a microprocessor ( ⁇ P), a microcontroller ( ⁇ C), a digital signal processor (DSP), or any combination thereof.
  • Processor 610 can include one or more levels of caching, such as a level one cache 611 and a level two cache 612, a processor core 613, and registers 614.
  • the processor core 613 can include an arithmetic logic unit (ALU), a floating point unit (FPU), a digital signal processing core (DSP Core), or any combination thereof.
  • a memory controller 615 can also be used with the processor 610, or in some implementations the memory controller 615 can be an internal part of the processor 610.
  • system memory 620 may be of any type including but not limited to volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.) or any combination thereof.
  • System memory 620 may include an operating system 621, one or more applications 622, and program data 624.
  • Application 622 may include channel charecterization application 623 that can be arranged to perform the functions, actions, and/or operations as described herein including the functional blocks, actions, and/or operations described herein.
  • Program Data 624 may include process unit data 625 for use with process unit control application 623.
  • application 622 may be arranged to operate with program data 624 on an operating system 621. This described basic configuration is illustrated in Fig. 6 by those components within dashed line 601.
  • Computing device 600 may have additional features or functionality, and additional interfaces to facilitate communications between the basic configuration 601 and any required devices and interfaces.
  • a bus/interface controller 640 may be used to facilitate communications between the basic configuration 601 and one or more data storage devices 650 via a storage interface bus 641.
  • the data storage devices 650 may be removable storage devices 651, non-removable storage devices 652, or a combination thereof.
  • removable storage and non-removable storage devices include magnetic disk devices such as flexible disk drives and hard-disk drives (HDD), optical disk drives such as compact disk (CD) drives or digital versatile disk (DVD) drives, solid state drives (SSD), and tape drives to name a few.
  • Example computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which may be used to store the desired information and which may be accessed by computing device 600. Any such computer storage media may be part of device 600.
  • Computing device 600 may also include an interface bus 642 for facilitating communication from various interface devices (e.g., output interfaces, peripheral interfaces, and communication interfaces) to the basic configuration 601 via the bus/interface controller 640.
  • Example output interfaces 660 may include a graphics processing unit 661 and an audio processing unit 662, which may be configured to communicate to various external devices such as a display or speakers via one or more A/V ports 663.
  • Example peripheral interfaces 680 may include a serial interface controller 681 or a parallel interface controller 682, which may be configured to communicate with external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device, etc.) or other peripheral devices (e.g., printer, scanner, etc.) via one or more I/O ports 683.
  • An example communication interface 680 includes a network controller 681, which may be arranged to facilitate communications with one or more other computing devices 683 over a network communication via one or more communication ports 682.
  • a communication connection is one example of a communication media.
  • Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and may include any information delivery media.
  • a "modulated data signal" may be a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
  • communication media may include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency (RF), infrared (IR) and other wireless media.
  • RF radio frequency
  • IR infrared
  • the term computer readable media as used herein may include both storage media and communication media.
  • Computing device 600 may be implemented as a portion of a small-form factor portable (or mobile) electronic device such as a cell phone, a personal data assistant (PDA), a personal media player device, a wireless web-watch device, a personal headset device, an application specific device, or a hybrid device that includes any of the above functions.
  • Computing device 600 may also be implemented as a personal computer including both laptop computer and non-laptop computer configurations.
  • computing device 600 may be implemented as part of a wireless base station or other wireless system or device.
  • Examples of a signal bearing medium include, but are not limited to, the following: a recordable type medium such as a flexible disk, a hard disk drive (HDD), a Compact Disc (CD), a Digital Versatile Disk (DVD), a digital tape, a computer memory, etc.; and a transmission type medium such as a digital and/or an analog communication medium (e.g., a fiber optic cable, a waveguide, a wired communication link, a wireless communication link, etc.).
  • a recordable type medium such as a flexible disk, a hard disk drive (HDD), a Compact Disc (CD), a Digital Versatile Disk (DVD), a digital tape, a computer memory, etc.
  • a transmission type medium such as a digital and/or an analog communication medium (e.g., a fiber optic cable, a waveguide, a wired communication link, a wireless communication link, etc.).
  • any two components so associated can also be viewed as being “operably connected”, or “operably coupled”, to each other to achieve the desired functionality, and any two components capable of being so associated can also be viewed as being “operably couplable”, to each other to achieve the desired functionality.
  • operably couplable include but are not limited to physically mateable and/or physically interacting components and/or wirelessly interactable and/or wirelessly interacting components and/or logically interacting and/or logically interactable components.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Quality & Reliability (AREA)
  • Environmental & Geological Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
EP11859429.0A 2011-02-21 2011-02-21 Method and apparatus for using out-band information to improve wireless communications Not-in-force EP2679067B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/071124 WO2012113132A1 (en) 2011-02-21 2011-02-21 Using out-band information to improve wireless communications

Publications (3)

Publication Number Publication Date
EP2679067A1 EP2679067A1 (en) 2014-01-01
EP2679067A4 EP2679067A4 (en) 2017-01-04
EP2679067B1 true EP2679067B1 (en) 2018-12-12

Family

ID=46720078

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11859429.0A Not-in-force EP2679067B1 (en) 2011-02-21 2011-02-21 Method and apparatus for using out-band information to improve wireless communications

Country Status (6)

Country Link
US (1) US8903325B2 (ko)
EP (1) EP2679067B1 (ko)
JP (1) JP6002157B2 (ko)
KR (1) KR101472702B1 (ko)
CN (1) CN103430604B (ko)
WO (1) WO2012113132A1 (ko)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9203530B2 (en) * 2011-10-13 2015-12-01 Telefonaktiebolaget L M Ericsson (Publ) Method and apparatus for determining statistics for direction of departure
US9020169B2 (en) * 2012-05-15 2015-04-28 Cochlear Limited Adaptive data rate for a bilateral hearing prosthesis system
WO2016005977A1 (en) * 2014-07-08 2016-01-14 Trekeye Systems Ltd. A method and system for detection of changes in a defined surveyed area
US9460338B2 (en) * 2014-12-10 2016-10-04 Intel Corporation Face detection method and apparatus with lookup table
CN104507039B (zh) 2014-12-27 2019-03-01 北京智谷睿拓技术服务有限公司 通信方法及用户设备
US9820232B2 (en) * 2015-05-12 2017-11-14 Qualcomm Incorporated Power delay profile based indoor outdoor detection
CN106375041B (zh) * 2016-08-25 2018-10-23 合肥工业大学 用于无线通信信道特征参数提取的便携式装置
CN109416726A (zh) * 2016-09-29 2019-03-01 惠普发展公司，有限责任合伙企业 基于位置调整计算设备的设置
US9912373B1 (en) * 2016-10-19 2018-03-06 Whatsapp Inc. Techniques to detect echoes using audio fingerprinting
US10429926B2 (en) * 2017-03-15 2019-10-01 International Business Machines Corporation Physical object addition and removal based on affordance and view
WO2019032605A1 (en) * 2017-08-11 2019-02-14 Cohere Technologies RADIATION TRACING TECHNIQUE FOR WIRELESS CHANNEL MEASUREMENTS
KR102442410B1 (ko) * 2017-12-18 2022-09-14 삼성전자 주식회사 이동 가능 물체를 고려한 통신 환경 분석 및 망 설계를 위한 방법 및 장치

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4380807A (en) 1979-10-03 1983-04-19 Polaroid Corporation Echo recognition system
CA2186793C (en) * 1995-11-13 2000-12-19 Vijitha Weerackody Method and apparatus to implement antenna diversity for direct sequence spread spectrum receivers
US6148078A (en) 1998-01-09 2000-11-14 Ericsson Inc. Methods and apparatus for controlling echo suppression in communications systems
JP3513058B2 (ja) * 1999-09-30 2004-03-31 株式会社東芝 携帯端末装置
JP2001358984A (ja) * 2000-06-15 2001-12-26 Mitsubishi Heavy Ind Ltd 動画像処理カメラ
US7139336B2 (en) * 2002-04-05 2006-11-21 Nokia Corporation Method and system for channel estimation using iterative estimation and detection
US7421276B2 (en) * 2003-04-09 2008-09-02 Nortel Networks Limited Method, apparatus and system of configuring a wireless device based on location
US7583645B2 (en) * 2004-09-01 2009-09-01 Intel Corporation Adaptive MAC architecture for wireless networks
JP4759304B2 (ja) * 2005-04-07 2011-08-31 オリンパス株式会社 情報表示システム
JP2007259445A (ja) * 2006-03-20 2007-10-04 Fujitsu Ltd Ｏｆｄｍ通信システムにおける送信装置及び方法
CA2667026C (en) * 2006-10-05 2015-12-01 Cohda Wireless Pty Ltd Improving receiver performance in a communication network
US7796948B2 (en) * 2006-12-13 2010-09-14 Motorola, Inc. Method and apparatus for optimizing radio performance through inferred knowledge of indoor-outdoor radio status
US7646297B2 (en) * 2006-12-15 2010-01-12 At&T Intellectual Property I, L.P. Context-detected auto-mode switching
US7801079B2 (en) * 2007-03-02 2010-09-21 Motorola, Inc. Method and apparatus for battery-aware dynamic bandwidth allocation for groups of wireless sensor nodes in a wireless sensor network
CN101904149B (zh) 2007-07-05 2015-09-09 相干逻辑公司 用于在移动设备上接收和呈现视听流的方法、设备和系统
CN101779109A (zh) * 2007-07-25 2010-07-14 Nxp股份有限公司 室内/室外检测
CN101478352B (zh) 2009-01-19 2014-01-08 北京邮电大学 一种认知无线网络系统和认知网元设备
WO2010085237A1 (en) * 2009-01-20 2010-07-29 Hewlett-Packard Development Company, L.P. Image processing
KR101584058B1 (ko) * 2009-08-07 2016-01-12 삼성전자주식회사 현재 상황에 적합한 사용 환경을 제공하는 휴대 단말기 및 이의 운용 방법
CN101668070A (zh) 2009-08-14 2010-03-10 惠州Tcl移动通信有限公司 移动通信终端及其自适应射频参数配置方法
US20110084868A1 (en) * 2009-10-08 2011-04-14 Brijot Imaging Systems, Inc. Variable range millimeter wave method and system
US20120050570A1 (en) * 2010-08-26 2012-03-01 Jasinski David W Audio processing based on scene type
US8812014B2 (en) * 2010-08-30 2014-08-19 Qualcomm Incorporated Audio-based environment awareness

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
KR20130108474A (ko) 2013-10-02
KR101472702B1 (ko) 2014-12-12
EP2679067A4 (en) 2017-01-04
EP2679067A1 (en) 2014-01-01
CN103430604A (zh) 2013-12-04
JP2014506089A (ja) 2014-03-06
JP6002157B2 (ja) 2016-10-05
US8903325B2 (en) 2014-12-02
US20130005285A1 (en) 2013-01-03
WO2012113132A1 (en) 2012-08-30
CN103430604B (zh) 2017-04-19

Similar Documents

Publication Publication Date Title
EP2679067B1 (en) Method and apparatus for using out-band information to improve wireless communications
JP7265549B2 (ja) 双方向チャネルサウンディングに基づく動き検出及び位置特定
US9971414B2 (en) Devices, systems, and methods for detecting gestures using wireless communication signals
Matolak et al. Worse-than-Rayleigh fading: Experimental results and theoretical models
Bouvet et al. Capacity analysis of underwater acoustic MIMO communications
US9270357B2 (en) Method and apparatus for selecting multi-antenna transmission mode in electronic device
Poutanen et al. Multi-link MIMO channel modeling using geometry-based approach
CN101478351B (zh) 自适应地控制感测参考电平的感知无线电通信设备和方法
WO2009061971A3 (en) Embedded module receiver noise profiling
US9712979B2 (en) Determining the position of a mobile device in an indoor environment
TW201228267A (en) Mechanism for proximity detection based on Wi-Fi signals
Munasinghe et al. EM‐based high speed wireless sensor networks for underwater surveillance and target tracking
WO2015167506A1 (en) Wireless signal identification
CN107371228B (zh) 调整无线路由设备的发射参数的方法和电子设备
JP2006523397A (ja) 多入力多出力通信システム
CN115149989A (zh) 用于探测间隔自适应的方法和装置
KR101242650B1 (ko) 무선 통신 시스템에서 공간-시간 확산을 이용하여 전송된 데이터 디코딩
Jelitto et al. A vector channel model with stochastic fading simulation
WO2023179664A1 (zh) 信道信息的传输方法、装置及通信设备
Pande et al. Underwater Communication with IDMA Scheme
WO2023125997A1 (zh) 定位方法、装置及通信设备
WO2023125986A1 (zh) 定位方法、装置及通信设备
Suga et al. On hyperparameter determination for GPR-based channel prediction in IRS-assisted wireless communication systems
Schmitz et al. Channel modeling
JP5847951B2 (ja) 少なくとも一部は送信電力に基づいたユーザの向きの変更

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130729

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20161202

RIC1 Information provided on ipc code assigned before grant

Ipc: H04B 17/309 20150101AFI20161125BHEP

Ipc: H04B 17/391 20150101ALI20161125BHEP

Ipc: H04B 17/19 20150101ALI20161125BHEP

Ipc: H04B 17/27 20150101ALI20161125BHEP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602011054854

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04W0072000000

Ipc: H04B0017309000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04M 1/725 20060101ALI20180601BHEP

Ipc: H04B 17/27 20150101ALI20180601BHEP

Ipc: H04B 17/391 20150101ALI20180601BHEP

Ipc: H04B 17/309 20150101AFI20180601BHEP

Ipc: H04B 17/19 20150101ALI20180601BHEP

INTG Intention to grant announced

Effective date: 20180629

INTG Intention to grant announced

Effective date: 20180629

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1077379

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181215

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011054854

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20181212

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190312

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190312

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20190320

Year of fee payment: 9

Ref country code: DE

Payment date: 20190319

Year of fee payment: 9

Ref country code: FR

Payment date: 20190327

Year of fee payment: 10

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1077379

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190313

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190412

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190412

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602011054854

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190221

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

26N No opposition filed

Effective date: 20190913

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190221

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602011054854

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20200221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200901

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20110221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181212