WO2025002825A1 - Method for establishing communication with a target device having wireless connectivity capability - Google Patents

Method for establishing communication with a target device having wireless connectivity capability Download PDF

Info

Publication number
WO2025002825A1
WO2025002825A1 PCT/EP2024/066350 EP2024066350W WO2025002825A1 WO 2025002825 A1 WO2025002825 A1 WO 2025002825A1 EP 2024066350 W EP2024066350 W EP 2024066350W WO 2025002825 A1 WO2025002825 A1 WO 2025002825A1
Authority
WO
WIPO (PCT)
Prior art keywords
target device
augmented reality
user
software
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2024/066350
Other languages
French (fr)
Inventor
Govind Narayan
Bartel Marinus Van De Sluis
Matthias Wendt
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Signify Holding BV
Original Assignee
Signify Holding BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Signify Holding BV filed Critical Signify Holding BV
Publication of WO2025002825A1 publication Critical patent/WO2025002825A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/023—Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/10—Controlling the light source
    • H05B47/175—Controlling the light source by remote control
    • H05B47/19—Controlling the light source by remote control via wireless transmission
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/20—Responsive to malfunctions or to light source life; for protection
    • H05B47/21—Responsive to malfunctions or to light source life; for protection of two or more light sources connected in parallel
    • H05B47/22—Responsive to malfunctions or to light source life; for protection of two or more light sources connected in parallel with communication between the lamps and a central unit
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/20—Responsive to malfunctions or to light source life; for protection
    • H05B47/23—Responsive to malfunctions or to light source life; for protection of two or more light sources connected in series
    • H05B47/235—Responsive to malfunctions or to light source life; for protection of two or more light sources connected in series with communication between the lamps and a central unit
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02—Terminal devices
    • H04W88/04—Terminal devices adapted for relaying to or from another terminal or user

Definitions

  • the present invention relates to service and/or maintenance of devices having wireless connectivity, in particular but not exclusively illumination devices such as light poles.
  • Outdoor lighting systems may include smartpoles. That is inter alia to say light poles with wireless communication capabilities, e.g., using GSM, LTE or the like, and are permanently connected to the cloud or standalone light poles that operate and communicate independently.
  • cloud connected outdoor lighting poles can malfunction and lose their backend cloud connectivity. Troubleshooting or configuring of these luminaires are done by sending technicians to the site of light poles which is both expensive and time consuming. That is to say, if communication is lost a technician may need to visit the light poles just for reinitializing communication, or to collect debug logs or configure them with certain parameters such as scheduling information or light level.
  • visual inspection is needed to check if there are any damages to the light poles or if new light points are to be installed to cover the street with optimal light levels.
  • this and other objects are achieved by a method for establishing communication between an augmented reality device and a target device having wireless connectivity capability within a limited communication range, wherein the target device is a lighting device, wherein the augmented reality device having a digital data processing capability and a wireless connectivity capability, the wireless connectivity capability being compatible with the wireless connectivity capability of the target device, the method comprising: executing on the augmented reality device an augmented reality software, prompting, using the augmented reality software, the user of the augmented reality device to approach the target device, and establishing, once the augmented reality device is within the limited communication range of the target device, a communication connection between the augmented reality device and the target device, and when the communication connection is established, exchanging service data for the target device between the user device and the target device via the established communication connection, wherein said service data comprises one or more of types of data selected from a group comprising:
  • an augmented reality device for establishing communication with a target device having wireless connectivity capability within a limited communication range, wherein the target device is a lighting device
  • the augmented reality device comprising: digital data processing hardware and circuitry providing wireless connectivity capability, the wireless connectivity capability being adapted to be compatible with the wireless connectivity capability of the target device, an augmented reality software adapted to be executed by the digital data processing hardware, the augmented reality software being adapted to, when executed on the digital data processing hardware, prompting a user of the augmented reality device to approach the target device, once the augmented reality device is within the limited communication range of the target device establishing a communication connection between the augmented reality device and the target device, and when the communication connection is established, exchanging service data for the target device between the user device and the target device via the established communication connection, wherein said service data comprises one or more of types of data selected from a group comprising:
  • a system comprising a target device having wireless connectivity capability within a limited communication range, and a device according to the second aspect of the invention.
  • this and other objects are achieved by the use of a device according to the second aspect of the invention for at least one of exchanging service data with a target device having wireless connectivity capability within a limited communication range, recording data about the target device, and recording data about the area around the target device.
  • this may obviate the need to send a technician to check or service the target device.
  • the user of the augmented reality device may be prompted to visit the location of the target, thereby allowing the communication capability to temporarily substitute the lost communication of the target device, and in turn allowing service of the target device via the augmented reality user device.
  • This can be performed by any user of the augmented reality user device irrespective of the user’s technical knowledge about the target device, and in fact without the user being aware of it.
  • the method further comprises exchanging service data for the target device between the user device and the target device via the established communication connection once the communication connection is established. This allows the exchange with the target device via the augmented reality device even when the target device has lost its main communication connection to the cloud.
  • the user device is a portable user device.
  • a portable user device is advantageous because it has a high mobility, that is to say can be quickly and almost unrestrictedly be held in any desired orientation and position in the vicinity of the target device.
  • portable devices such as smart phones are almost ubiquitous in large parts of the world.
  • the user device comprises location determination capabilities providing current location data
  • the augmented reality software uses the current location data to prompt the user to approach the target device. This allows the augmented reality software on any one of multiple augmented reality devices within reasonable distance from the target device to be prompted to approach the target device, and hence increases the chances of establishing communication.
  • the augmented reality software further prompts the user to remain within the limited communication range of the target device for a time period sufficient to exchange the service data. This increases the chances that communication is completed and accordingly that the actions needed for the target device to resume proper operation will be completed too.
  • a "shared" gamification experience is created with multiple users around such that they interact/play with each other via the same augmented reality content.
  • the servicing of the target device is parallelized across multiple users to speed up the process.
  • the augmented reality software prompts the user to record data about one or more of the target device and the area around the target device. This allows a higher level of maintenance or service than simply restart, upgrade, update or the like of the target device, e.g., checking that the target device fulfils its desired purpose, e.g., that a smart light pole illuminates the surroundings in the desired manner.
  • the augmented reality software further prompts the user to follow a pre-defined path within the limited communication range of the target device for a time period sufficient to record the data. This may ensure that the entire target device or the area around it is properly surveyed, e.g., that a smart light pole is fully checked for damage, or that the illumination of the entire area around it is checked.
  • the augmented reality software is further adapted to prompt the user to remain within the limited communication range of the target device for a time period sufficient to exchange the service data.
  • the augmented reality software prompts the user to record data about one or more of the target device and the area around the target device. This allows a higher level of maintenance or service than simply restart, upgrade, update or the like of the target device, e.g., checking that the target device fulfils its desired purpose, e.g., that a smart light pole illuminates the surroundings in the desired manner.
  • the augmented reality software further adapted to prompt the user to follow a pre-defined path within the limited communication range of the target device for a time period sufficient to record the data. This may ensure that the entire target device or the area around it is properly surveyed, e.g., that a smart light pole is fully checked for damage, or that the illumination of the entire area around it is checked.
  • Fig. 1 shows an embodiment of the invention implemented in a smart phone.
  • a target device 1 exemplified by smart light pole is shown next to a road 2 illuminating a local area 3 such as the vicinity of a bus stop 4.
  • the target device 1 is equipped with connectivity hardware and software for long range data communication 5 such as GSM or LTE or other 3G 4G or 5G communication, that will allow communication beyond a local radius of e.g., half a kilometer to in principle anywhere in the world, i.e., an unlimited range for any practical purpose.
  • the target device 1 is also equipped with connectivity hardware and software for short or limited range data communication 6, such as Bluetooth®, Zigbee, Wi-Fi, that will allow at best communication over a few hundred meters and no more than half a kilometer.
  • an augmented reality device 8 capable of both long- range data communication 5’ and limited range data communication 6 may be used to substitute the failed normal long-distance communication 5 between the target device and the control centre 7.
  • the augmented reality device 8 may be any kind of augmented reality device 8 with appropriate communication capabilities, but currently a smart phone executing appropriate software. Smart phones are light, hand-held, highly mobile, ubiquitous among people in large parts of the world.
  • smartphones typically comprise the necessary communication capabilities for long range communication 5’ and limited range communication 6, a Global Navigation Satellite System (GNSS) receiver, a camera or even other recording devices such as LIDAR.
  • GNSS Global Navigation Satellite System
  • the problem with the target device 1 is one that can be resolved if an augmented reality device 8 can be brought into the area of limited range communication of the target device area, the need to send a technician may be obviated, even if the user of the augmented reality device 8 has no technical skills. That is to say by just about anyone having a smartphone executing an appropriate software, if the user of the smartphone can be nudged towards visiting the target device 1. This can be achieved by gamification, that is to say, the augmented reality software is so presented to the user that the user has a reason to install and run the software and the software then prompts the user to perform certain acts as part of a game or other delectation.
  • Prompting in this sense meaning any kind of information presented to the user in order to trigger the performance of a desired action.
  • Prompting may include audible signaling, e.g., for indicating that a game is available, written instructions for specific actions, and the presentation of virtual objects on the display for the user to interact with in an intuitive manner.
  • a reason to install the augmented reality software could be rewards obtained for the user for playing the game and performing certain acts. This need not be direct economic benefits in the form of credits or shopping discounts but could in remote areas without an electricity grid be the right to charge the batteries of the augmented reality device from the target device, e.g., charging a smartphone from a stand-alone smart light pole equipped with photovoltaic cells and battery for nighttime illumination.
  • a way of drawing the user’s intention to the existence of the augmented reality software in the first place could be easy to scan QR codes on the target devices 1 or elsewhere e.g. on stickers.
  • the control centre 7 may notify the users of augmented reality devices 8 in reasonable distance of the target device 1, but still outside the range of the limited range data communication 6 that a game is about to begin.
  • the location of the target device 1 may be broadcast to all augmented reality devices running the software, and the software may then determine whether the augmented reality device is in reasonable distance from the target device 1 and prompt the user to start the game.
  • the location information may be provided by a built-in GNSS, the current cell of a cellular communication system, signal strength or triangulation using base stations in the long-range communication system, known Wi-Fi network locations etc.
  • Privacy issues are a matter of consent by the user, and at least for the use necessary for carrying out the invention, the user will have given consent in advance to the use of the augmented reality device 8, e.g., when installing the software on a smartphone.
  • the augmented reality software on the augmented reality device will prompt the user to approach the target device 1, e.g., by using a marker on a map or a beacon overlay generated on an image recorded by a camera of the augmented reality device 8.
  • the beacon may e.g., be an animal or airplane to track or follow and eventually catch or shoot down at the target location. Alternatively, it is just a beacon until the user arrives in the vicinity of the target device, the game then changes to another character.
  • the augmented reality software may unbeknown to the user establish limited range data communication 6 with the target device 1.
  • This allows the target device 1 to communicate with the control centre 7 via the augmented reality device 8 using the established limited range data communication 6 from the target device 1 to the augmented reality device 8 and the long-range communication 5’ from the augmented reality device 8 to the control centre 7, or vice versa.
  • the gaming may change for this, e.g., by increasing difficulty or by introduction of a new game or game phase, so as to ensure that the user stays in the vicinity of the target device 1 for a time period sufficient for completing the communication, and exchange of whatever service data are necessary between the control centre 7 and the target device 1.
  • service data is to be understood broadly and may include:
  • configuration data for configuring the operation of the target device 1 e.g., lighting control data or lighting control routines when the target device is a lighting device
  • auxiliary data such as rain measurements, traffic statistics, sunshine statistics, battery health data for photovoltaic stand-alone light poles, time of recording etc.
  • the user could be simply informed to remain static from the moment that a stable connection on the limited range communication 6 is detected (e.g., “remain at your position to receive extra credits or game points” in writing or audio).
  • This change of gameplay could involve presenting moving or stationary virtual object on or around the target device 1 to be shot down or captured by tapping or swiping on the display if the display is a touch screen.
  • the augmented reality software may prompt the user to aim the augmented reality device 8 in different directions and move around the target device 1 to e.g., acquire images from may angles thereof, or of the vicinity thereof, and send them to the control centre 7.
  • Images are to be understood not only as visual images, but may include, e.g., LIDAR scans and other virtual images. All such images may also be considered service data in the sense of the present application.
  • an augmented reality device 8 comprises a display 10 for rendering a virtual environment comprising one or more virtual objects 9.
  • the display 10 may be a (semi-) transparent see-through display, wherein the user can see the physical environment through the display 10, and wherein the display 10 is configured to render the virtual environment comprising one or more virtual objects 9 as an overlay on the physical environment.
  • the display 10 may be integrated in the (semi-) transparent see-through display, or the virtual environment may be projected on the display 10.
  • augmented reality device 8 may comprise a camera configured to continuously capture images of the physical environment and render the images on the display 10, while rendering the virtual environment and/or the virtual objects 9 as an overlay on the images.
  • the augmented reality device 8 need not be handheld but could be part of a vehicle with a display, e.g., a vehicle with a Head Up Display (HUD).
  • HUD Head Up Display
  • the changes in difficulty and/or gameplay could be gradual depending on the progress in analysis of the data received at the control centre 7.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

A method for establishing communication (6) with a target device (1) having wireless connectivity capability within a limited communication range using an augmented reality user device (8). The target device is a lighting device. The method comprises executing on the user device an augmented reality software, the augmented reality software prompting the user of the augmented reality user device (8) to approach the target device (1), and establishing, once the augmented reality user device (8) is within the limited communication range of the target device (1), a communication connection (6) between the user device (8) and the target device (1); then, when the communication connection is established, exchanging service data for the target device between the user device and the target device via the established communication connection, wherein said service data comprises one or more of types of data selected from a group comprising: - instructions to connect the target device to a target network, - a software image for maintenance of the software of the target device, and - configuration data for configuring the operation of the target device.

Description

Method for establishing communication with a target device having wireless connectivity capability
FIELD OF THE INVENTION
The present invention relates to service and/or maintenance of devices having wireless connectivity, in particular but not exclusively illumination devices such as light poles.
BACKGROUND OF THE INVENTION
Outdoor lighting systems may include smartpoles. That is inter alia to say light poles with wireless communication capabilities, e.g., using GSM, LTE or the like, and are permanently connected to the cloud or standalone light poles that operate and communicate independently. There can be situations in which cloud connected outdoor lighting poles can malfunction and lose their backend cloud connectivity. Troubleshooting or configuring of these luminaires are done by sending technicians to the site of light poles which is both expensive and time consuming. That is to say, if communication is lost a technician may need to visit the light poles just for reinitializing communication, or to collect debug logs or configure them with certain parameters such as scheduling information or light level. Also, visual inspection is needed to check if there are any damages to the light poles or if new light points are to be installed to cover the street with optimal light levels.
If the light pole is in a remote location this may be rather time consuming for the technician and therefore costly for the operator of the light-poles.
In connection with lighting, it is known to use augmented reality when configuring or servicing electrical installations in buildings. In this respect US2020/0265647 discloses a system for determining the location of lighting and other parts of an electrical installation and labeling them in the augmented reality for easy identification during configuration or service. This is a mere labeling for identification at a known location once the technician has arrived there, so the problem of the costs of the technician going there remains. SUMMARY OF THE INVENTION
It is an object of the present invention to overcome this problem, and to provide a method and a device allowing the maintenance of light poles without a technician visiting them at their location.
According to a first aspect of the invention, this and other objects are achieved by a method for establishing communication between an augmented reality device and a target device having wireless connectivity capability within a limited communication range, wherein the target device is a lighting device, wherein the augmented reality device having a digital data processing capability and a wireless connectivity capability, the wireless connectivity capability being compatible with the wireless connectivity capability of the target device, the method comprising: executing on the augmented reality device an augmented reality software, prompting, using the augmented reality software, the user of the augmented reality device to approach the target device, and establishing, once the augmented reality device is within the limited communication range of the target device, a communication connection between the augmented reality device and the target device, and when the communication connection is established, exchanging service data for the target device between the user device and the target device via the established communication connection, wherein said service data comprises one or more of types of data selected from a group comprising:
- instructions to connect the target device to a target network,
- a software image for maintenance of the software of the target device, and
- configuration data for configuring the operation of the target device.
According to a second aspect of the invention, this and other objects are achieved by an augmented reality device for establishing communication with a target device having wireless connectivity capability within a limited communication range, wherein the target device is a lighting device, the augmented reality device comprising: digital data processing hardware and circuitry providing wireless connectivity capability, the wireless connectivity capability being adapted to be compatible with the wireless connectivity capability of the target device, an augmented reality software adapted to be executed by the digital data processing hardware, the augmented reality software being adapted to, when executed on the digital data processing hardware, prompting a user of the augmented reality device to approach the target device, once the augmented reality device is within the limited communication range of the target device establishing a communication connection between the augmented reality device and the target device, and when the communication connection is established, exchanging service data for the target device between the user device and the target device via the established communication connection, wherein said service data comprises one or more of types of data selected from a group comprising:
- instructions to connect the target device to a target network,
- a software image for maintenance of the software of the target device, and
- configuration data for configuring the operation of the target device.
According to a third aspect of the invention, this and other objects are achieved by a system comprising a target device having wireless connectivity capability within a limited communication range, and a device according to the second aspect of the invention.
According to a fourth aspect of the invention, this and other objects are achieved by the use of a device according to the second aspect of the invention for at least one of exchanging service data with a target device having wireless connectivity capability within a limited communication range, recording data about the target device, and recording data about the area around the target device.
In all aspects of the invention this may obviate the need to send a technician to check or service the target device. Instead, the user of the augmented reality device may be prompted to visit the location of the target, thereby allowing the communication capability to temporarily substitute the lost communication of the target device, and in turn allowing service of the target device via the augmented reality user device. This can be performed by any user of the augmented reality user device irrespective of the user’s technical knowledge about the target device, and in fact without the user being aware of it.
The method further comprises exchanging service data for the target device between the user device and the target device via the established communication connection once the communication connection is established. This allows the exchange with the target device via the augmented reality device even when the target device has lost its main communication connection to the cloud.
In an embodiment of the first aspect of the invention the user device is a portable user device. A portable user device is advantageous because it has a high mobility, that is to say can be quickly and almost unrestrictedly be held in any desired orientation and position in the vicinity of the target device. Moreover, portable devices such as smart phones are almost ubiquitous in large parts of the world.
In an embodiment of the first aspect of the invention the user device comprises location determination capabilities providing current location data, and the augmented reality software uses the current location data to prompt the user to approach the target device. This allows the augmented reality software on any one of multiple augmented reality devices within reasonable distance from the target device to be prompted to approach the target device, and hence increases the chances of establishing communication.
In an embodiment of the first aspect of the invention the augmented reality software further prompts the user to remain within the limited communication range of the target device for a time period sufficient to exchange the service data. This increases the chances that communication is completed and accordingly that the actions needed for the target device to resume proper operation will be completed too.
In another embodiment, if the time required to service a target device is large, multiple users are prompted to approach the target device location. A "shared" gamification experience is created with multiple users around such that they interact/play with each other via the same augmented reality content. The servicing of the target device is parallelized across multiple users to speed up the process.
In an embodiment of the first aspect of the invention the augmented reality software prompts the user to record data about one or more of the target device and the area around the target device. This allows a higher level of maintenance or service than simply restart, upgrade, update or the like of the target device, e.g., checking that the target device fulfils its desired purpose, e.g., that a smart light pole illuminates the surroundings in the desired manner.
In an embodiment of the first aspect of the invention the augmented reality software further prompts the user to follow a pre-defined path within the limited communication range of the target device for a time period sufficient to record the data. This may ensure that the entire target device or the area around it is properly surveyed, e.g., that a smart light pole is fully checked for damage, or that the illumination of the entire area around it is checked.
In an embodiment of the first aspect of the invention the service data comprises one or more of types of data selected from a group comprising:
- instructions to connect the target device to a target network,
- a software image for maintenance of the software of the target device,
- configuration data for configuring the operation of the target device.
In an embodiment of the second aspect of the invention, the augmented reality software is further adapted to prompt the user to remain within the limited communication range of the target device for a time period sufficient to exchange the service data.
In an embodiment of the second aspect of the invention the augmented reality software prompts the user to record data about one or more of the target device and the area around the target device. This allows a higher level of maintenance or service than simply restart, upgrade, update or the like of the target device, e.g., checking that the target device fulfils its desired purpose, e.g., that a smart light pole illuminates the surroundings in the desired manner.
In an embodiment of the second aspect of the invention the augmented reality software further adapted to prompt the user to follow a pre-defined path within the limited communication range of the target device for a time period sufficient to record the data. This may ensure that the entire target device or the area around it is properly surveyed, e.g., that a smart light pole is fully checked for damage, or that the illumination of the entire area around it is checked.
It is noted that the invention relates to all possible combinations of features recited in the claims.
BRIEF DESCRIPTION OF THE DRAWINGS
This and other aspects of the present invention will now be described in more detail, with reference to the appended drawings showing embodiment(s) of the invention.
Fig. 1 shows an embodiment of the invention implemented in a smart phone.
As illustrated in the figures, the sizes of layers and regions are exaggerated for illustrative purposes and, thus, are provided to illustrate the general structures of embodiments of the present invention. Like reference numerals refer to like elements throughout. DETAILED DESCRIPTION
The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which currently preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided for thoroughness and completeness, and fully convey the scope of the invention to the skilled person.
Turning first to Fig. 1 a target device 1 exemplified by smart light pole is shown next to a road 2 illuminating a local area 3 such as the vicinity of a bus stop 4. The target device 1 is equipped with connectivity hardware and software for long range data communication 5 such as GSM or LTE or other 3G 4G or 5G communication, that will allow communication beyond a local radius of e.g., half a kilometer to in principle anywhere in the world, i.e., an unlimited range for any practical purpose. The target device 1 is also equipped with connectivity hardware and software for short or limited range data communication 6, such as Bluetooth®, Zigbee, Wi-Fi, that will allow at best communication over a few hundred meters and no more than half a kilometer.
Under normal circumstances communication will take place between a control centre 7 and the target device via the long-range data communication 5. This allows service, maintenance, updates, direct control, etc. of the target device 1. However, if for some reason the long-range data communication 5 fails (as indicated by the dashed line in Fig.1) and this connectivity is lost, these are no longer possible and the target device 1 needs to be visited, even if it is for a simple restart of the communication software of the target device 1.
However, as illustrated an augmented reality device 8 capable of both long- range data communication 5’ and limited range data communication 6 may be used to substitute the failed normal long-distance communication 5 between the target device and the control centre 7. The augmented reality device 8 may be any kind of augmented reality device 8 with appropriate communication capabilities, but currently a smart phone executing appropriate software. Smart phones are light, hand-held, highly mobile, ubiquitous among people in large parts of the world. Moreover, smartphones typically comprise the necessary communication capabilities for long range communication 5’ and limited range communication 6, a Global Navigation Satellite System (GNSS) receiver, a camera or even other recording devices such as LIDAR. If the problem with the target device 1 is one that can be resolved if an augmented reality device 8 can be brought into the area of limited range communication of the target device area, the need to send a technician may be obviated, even if the user of the augmented reality device 8 has no technical skills. That is to say by just about anyone having a smartphone executing an appropriate software, if the user of the smartphone can be nudged towards visiting the target device 1. This can be achieved by gamification, that is to say, the augmented reality software is so presented to the user that the user has a reason to install and run the software and the software then prompts the user to perform certain acts as part of a game or other delectation. Prompting in this sense meaning any kind of information presented to the user in order to trigger the performance of a desired action. Prompting, may include audible signaling, e.g., for indicating that a game is available, written instructions for specific actions, and the presentation of virtual objects on the display for the user to interact with in an intuitive manner.
A reason to install the augmented reality software could be rewards obtained for the user for playing the game and performing certain acts. This need not be direct economic benefits in the form of credits or shopping discounts but could in remote areas without an electricity grid be the right to charge the batteries of the augmented reality device from the target device, e.g., charging a smartphone from a stand-alone smart light pole equipped with photovoltaic cells and battery for nighttime illumination.
A way of drawing the user’s intention to the existence of the augmented reality software in the first place could be easy to scan QR codes on the target devices 1 or elsewhere e.g. on stickers.
Assuming that the control centre 7 becomes aware of failed long-distance communication 5 with a target at a given known location and one or more users have an augmented reality device running the augmented reality software these users may be called to assistance. That is to say based, e.g., on current information sent to the control centre 7 about the position of augmented reality devices 8 running the augmented reality software, the control center 7 may notify the users of augmented reality devices 8 in reasonable distance of the target device 1, but still outside the range of the limited range data communication 6 that a game is about to begin. Alternatively, for more privacy, the location of the target device 1 may be broadcast to all augmented reality devices running the software, and the software may then determine whether the augmented reality device is in reasonable distance from the target device 1 and prompt the user to start the game. The location information may be provided by a built-in GNSS, the current cell of a cellular communication system, signal strength or triangulation using base stations in the long-range communication system, known Wi-Fi network locations etc. Privacy issues are a matter of consent by the user, and at least for the use necessary for carrying out the invention, the user will have given consent in advance to the use of the augmented reality device 8, e.g., when installing the software on a smartphone.
If the user responds, the augmented reality software on the augmented reality device will prompt the user to approach the target device 1, e.g., by using a marker on a map or a beacon overlay generated on an image recorded by a camera of the augmented reality device 8. The beacon may e.g., be an animal or airplane to track or follow and eventually catch or shoot down at the target location. Alternatively, it is just a beacon until the user arrives in the vicinity of the target device, the game then changes to another character.
If the user successfully tracks or follows the beacon and arrives within the range of the limited range data communication 6 of the target device 1 the augmented reality software may unbeknown to the user establish limited range data communication 6 with the target device 1. This allows the target device 1 to communicate with the control centre 7 via the augmented reality device 8 using the established limited range data communication 6 from the target device 1 to the augmented reality device 8 and the long-range communication 5’ from the augmented reality device 8 to the control centre 7, or vice versa. The gaming may change for this, e.g., by increasing difficulty or by introduction of a new game or game phase, so as to ensure that the user stays in the vicinity of the target device 1 for a time period sufficient for completing the communication, and exchange of whatever service data are necessary between the control centre 7 and the target device 1. Such service data is to be understood broadly and may include:
- instructions to connect the target device 1 to a target (wireless) network,
- a software image for maintenance of the software of the target device 1, e.g., for updating or upgrading the software of the target device 1,
- configuration data for configuring the operation of the target device 1 (e.g., lighting control data or lighting control routines when the target device is a lighting device),
- instructions for software reset or restart and/or self-test to the target device 1,
- auxiliary data such as rain measurements, traffic statistics, sunshine statistics, battery health data for photovoltaic stand-alone light poles, time of recording etc.
Alternatively, the user could be simply informed to remain static from the moment that a stable connection on the limited range communication 6 is detected (e.g., “remain at your position to receive extra credits or game points” in writing or audio).
In another alternative, if the time required to service a target device 1 is large, multiple users 11 are prompted to approach the target device location. A "shared" gamification experience is created with multiple users 11 around such that they interact/play with each other via the same augmented reality content. The servicing of the target device 1 is parallelized across multiple users 11 to speed up the process.
This change of gameplay could involve presenting moving or stationary virtual object on or around the target device 1 to be shot down or captured by tapping or swiping on the display if the display is a touch screen.
Having prompted the user to approach the target device and establish a communication connection, it may be advantageous to further prompt the user to perform further actions even if these require a prolonged stay. This could involve changing the game further, e.g., increasing difficulty even further or by the introduction of a new game or game phase. In such a new game phase the augmented reality software may prompt the user to aim the augmented reality device 8 in different directions and move around the target device 1 to e.g., acquire images from may angles thereof, or of the vicinity thereof, and send them to the control centre 7. Images are to be understood not only as visual images, but may include, e.g., LIDAR scans and other virtual images. All such images may also be considered service data in the sense of the present application. This could be done by moving an animated figure, such as the aforementioned animal or airplane animation around on the display of the augmented reality device in a manner prompting the user to follow a predetermined path, so as to ensure that every detail is covered. This will allow inspection of the target device 1 for physical damage at the control centre 7. It will also be possible to assess whether, e.g., the illumination 3 from a smart light pole is suitable, sufficient and in accordance with the purpose, e.g., properly illuminates the waiting passengers at a bus stop 4 and their surroundings.
Although, in the present description the augmented reality device 8 has been exemplified by as smartphone, it should be understood that such augmented reality devices are known in the art, and not be discussed in much further detail. In general, an augmented reality device 8 comprises a display 10 for rendering a virtual environment comprising one or more virtual objects 9. The display 10 may be a (semi-) transparent see-through display, wherein the user can see the physical environment through the display 10, and wherein the display 10 is configured to render the virtual environment comprising one or more virtual objects 9 as an overlay on the physical environment. The display 10 may be integrated in the (semi-) transparent see-through display, or the virtual environment may be projected on the display 10. Alternatively, augmented reality device 8 may comprise a camera configured to continuously capture images of the physical environment and render the images on the display 10, while rendering the virtual environment and/or the virtual objects 9 as an overlay on the images.
The person skilled in the art realizes that the present invention by no means is limited to the preferred embodiments described above. On the contrary, many modifications and variations are possible within the scope of the appended claims. For example, the augmented reality device 8 need not be handheld but could be part of a vehicle with a display, e.g., a vehicle with a Head Up Display (HUD). Also, the changes in difficulty and/or gameplay could be gradual depending on the progress in analysis of the data received at the control centre 7. Additionally, variations to the disclosed embodiments can be understood and effected by the skilled person in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measured cannot be used to advantage.

Claims

CLAIMS:
1. A method for establishing communication between an augmented reality device and a target device having wireless connectivity capability within a limited communication range, wherein the target device is a lighting device, wherein the augmented reality device having a digital data processing capability and a wireless connectivity capability, the wireless connectivity capability being compatible with the wireless connectivity capability of the target device, the method comprising: executing on the augmented reality device an augmented reality software, prompting, using the augmented reality software, the user of the augmented reality device to approach the target device, establishing, once the user device is within the limited communication range of the target device, a communication connection between the augmented reality device and the target device, and when the communication connection is established, exchanging service data for the target device between the user device and the target device via the established communication connection, wherein said service data comprises one or more of types of data selected from a group comprising:
- instructions to connect the target device to a target network,
- a software image for maintenance of the software of the target device, and
- configuration data for configuring the operation of the target device.
2. A method according to claim 1, wherein the augmented reality device is a portable augmented reality device.
3. A method according to any one of the preceding claims, wherein the augmented reality device comprises location determination capabilities providing current location data, and wherein the augmented reality software uses the current location data to prompt the user to approach the target device.
4. A method according to any one of the preceding claims, wherein the augmented reality software further prompts the user to remain within the limited communication range of the target device for a time period sufficient to exchange the service data.
5. Method according to any one of the preceding claims, wherein the augmented reality software prompts the user to record data about one or more of the target device and the area around the target device.
6. A method according to claim 5, wherein the augmented reality software further prompts the user to follow a predefined path within the limited communication range of the target device for a time period sufficient to record the data.
7. An augmented reality device for establishing communication with a target device having wireless connectivity capability within a limited communication range, wherein the target device is a lighting device, the augmented reality device comprising: digital data processing hardware and circuitry providing wireless connectivity capability, the wireless connectivity capability being adapted to be compatible with the wireless connectivity capability of the target device, an augmented reality software adapted to be executed by the digital data processing hardware, the augmented reality software being adapted to, when executed on the digital data processing hardware, prompting a user of the augmented reality device to approach the target device, once the augmented reality device is within the limited communication range of the target device establishing a communication connection between the augmented reality device and the target device, and when the communication connection is established, exchanging service data for the target device between the user device and the target device via the established communication connection, wherein said service data comprises one or more of types of data selected from a group comprising:
- instructions to connect the target device to a target network,
- a software image for maintenance of the software of the target device, and
- configuration data for configuring the operation of the target device.
8. A device according to claim 7, wherein the augmented reality software is further adapted to prompt the user to remain within the limited communication range of the target device for a time period sufficient to exchange the service data.
9. A device according to any one of claims 7 or 8, wherein the augmented reality software prompts the user to record data about one or more of the target device and the area around the target device.
10. A device according to claim 9, wherein the augmented reality software further adapted to prompt the user to follow a pre-defined path within the limited communication range of the target device for a time period sufficient to record the data.
11. A system comprising a target device having wireless connectivity capability within a limited communication range, and a device according to any one of claims 7 to 10.
12. The use of a device according to any one of claims 7 to 10 for at least one of exchanging service data with a target device having wireless connectivity capability within a limited communication range, recording data about the target device, and recording data about the area around the target device.
PCT/EP2024/066350 2023-06-26 2024-06-13 Method for establishing communication with a target device having wireless connectivity capability Ceased WO2025002825A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP23181340.3 2023-06-26
EP23181340 2023-06-26

Publications (1)

Publication Number Publication Date
WO2025002825A1 true WO2025002825A1 (en) 2025-01-02

Family

ID=87047818

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2024/066350 Ceased WO2025002825A1 (en) 2023-06-26 2024-06-13 Method for establishing communication with a target device having wireless connectivity capability

Country Status (1)

Country Link
WO (1) WO2025002825A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200265647A1 (en) 2019-02-18 2020-08-20 Eaton Intelligent Power Limited Augmented Reality-Based Lighting System Design And Commissioning
US20220407666A1 (en) * 2020-08-04 2022-12-22 Samsung Electronics Co., Ltd. Method and apparatus for finding lost device using uwb and ar apparatus

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200265647A1 (en) 2019-02-18 2020-08-20 Eaton Intelligent Power Limited Augmented Reality-Based Lighting System Design And Commissioning
US20220407666A1 (en) * 2020-08-04 2022-12-22 Samsung Electronics Co., Ltd. Method and apparatus for finding lost device using uwb and ar apparatus

Similar Documents

Publication Publication Date Title
CN106803355B (en) A control system and control method for a shared bicycle
CN105719499B (en) Traffic Sign Recognition test method and device
KR102512969B1 (en) Control method, control device and storage medium of unmanned guided vehicle
KR101196532B1 (en) Method for Location Determination of the Wireless device
US20210285782A1 (en) Method, Device and System for Processing Positioning Information
CN105338476A (en) Cloud-computing-based portable travelling terminal realization method
CN104619013A (en) Trapped person cellphone searching locating method
BR112019016562A2 (en) DRONE USER EQUIPMENT INDICATION
US10306559B2 (en) Power management of a global navigation satellite system (GNSS) receiver in a traffic tunnel
CN105357627A (en) Cloud computing based portable tourism terminal and service method therefor
KR20130124530A (en) Camera enabled headset for navigation
CN109409301B (en) Information acquisition method and device of traffic signal lamp and storage medium
EP3140808B1 (en) Determining an orientation of a mobile device
US20120150444A1 (en) Apparatuses for managing, determining, and verifying navigation route for mobile terminal, navigation service provision system, and method of managing navigation route for mobile terminal
CN102821461A (en) Method and system for position judgment and corresponding mobile terminals
KR20140078639A (en) Method for accessing augmented reality user context
CN109040968A (en) Road conditions based reminding method, mobile terminal and computer readable storage medium
US20140049654A1 (en) Information providing system, information providing device, image capture device, and computer program
JP2021190951A (en) System, unmanned aircraft, management device, program and management method
CN105867366A (en) Method for full-automatic smart routing inspection of electrical equipment in substation
CN106872996B (en) Method and device for optimizing performance of positioning system and mobile terminal
KR20160105628A (en) Distance and position measurement method with beacon and acceleration sensor and indoor positioning system using the same
CN104661179B (en) Location data sharing method and system
CN110177259A (en) Underground parking navigation system and method
CN105044755A (en) A method and system for seamless switching of indoor and outdoor positioning

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24732309

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 24732309

Country of ref document: EP

Kind code of ref document: A1