IT202300009600A1 - Method for tracking and creating interactive multi-channel and multimedia points of interest via a transportable and reprogrammable device - Google Patents

Description

DESCRIPTION

Of the patent for industrial invention entitled: ?Method for tracking and creating interactive multi-channel and multimedia points of interest via a transportable and reprogrammable device?.

Field of technique

This patent application for invention refers in general to the sector of information to be given in real time to users. In the tourism sector, logistics management or other sectors in which it may be useful to track, advertise and/or interact with real objects (or points of interest) by adding virtual information to them.

For example, when you want to have more knowledge of an artistic work or any cultural sector or store as much information as possible on a single identifier, URL (Web Page), etc. Or, when you want to locate and track the position of vehicles in a very large car park, assigning the vehicles in the area a uniquely traceable identifier. This information can be stored or viewed by any user. The invention, in particular, unifies the writing of NFC, Bluetooth beacon (BLE) and other communication technologies for the configuration of the device via smartphone, thus saving time, since it is not essential to use a PC. In addition, a display is used to print summary information and display the status of the device, e.g., images or even QR-code.

The device has a state that is stored in memory in the device itself (e.g., status=xxlonxxlat). The state can be represented by a string, vector or other data structures.

The device status is also initially updated based on the setup, and the status can be updated autonomously by the device itself. The device performs these updates in various ways, for example: it updates the status when it moves using GPS or IMU, or another module for managing relative/absolute positioning (e.g., newstatus=yylonyylat, newstatus=xxlonxxlat+klatylon); the device can update not only its own position, but also other status variables. The status update propagates directly to all code dissemination systems, e.g. QR-code/display, bluetooth, NFC, etc.

The device can be programmed to perform a series of operations on the modules that compose it. The various modules can therefore be programmed to activate according to a given sequence, perform specific operations, return output and exchange information useful for their operation. This allows the device itself to be versatile, and to use the device in different operating contexts. The algorithm that establishes the operation and setup of the device can be sent to it via NFC communication, Bluetooth, Wi-Fi, or other connectivity modules. The device has a memory, of a certain size, capable of hosting the device's operating program.

For example, it can be used to record the position based on GPS or IMU (low power consumption). Using GPS, for example, the device can operate in two different modes (option 1, option 2, option 3, option 4). Option 1, when a movement is recorded by the accelerometer, as long as a movement is recorded the GPS is kept running and the real position is updated. This allows us to save energy consumed by the GPS. Alternatively, option 2, when the accelerometer is started the device enters a waiting state, as soon as the device stops the current position is updated via GPS, and the paper displays, BLE and NFC, and others are updated. In this case the GPS can be turned on only when the device stops for a certain time (in this mode we do not record the path taken but only the final position of the device). Option 3 the device starts GPS tracking for an input received from the outside that can come via Bluetooth or NFC. Option 4 Fixed installation of the device to index non-mobile points of interest, for sharing information, in this case you can choose not to use the tracking features but to use its features to calculate only the initial state and not use them by keeping them static in the device.

In all options when the device is stopped it goes into a quiet state to save energy. In all operation options you can also set whether to notify status changes via Lora communication. This shows only one possible example of a program written inside the device. You can easily change the sequence of program steps for other needs.

Known art

As an example application sector for the device, we consider the sector of cultural heritage enhancement. The sector concerning the technological enhancement of the assets and excellence of a territory has very often produced notable results from the point of view of virtualization and multimedia and IT enrichment of the enhanced asset. However, these experiences have the difficulty of being easily searchable and, apart from works of great value, the remaining works falling within the category of "cultural heritage" do not have meritorious representation either virtually via WEB pages or by tourist operators. But not only that, the device is also suitable for cases in which it is necessary to track the position of objects or points of interest that are moved from time to time and for which you want to track the status and associated information to keep them updated and easily accessible through various radio communication technologies, visual codes, such as QR-code or other communication technologies. The device can be equipped with a GPS positioning module or with an inertial measurement unit (IMU).

In the automotive sector one of the main problems is the localization of vehicles within large parking lots. The solutions adopted are often very expensive with high energy consumption technologies and also require subscriptions for data exchange via Usim.

On the other hand, recent technological and "cultural" innovations in the field of multimedia dissemination and fruition allow a sophisticated representation of reality with three-dimensional reconstruction techniques, combined with powerful visualization software, interaction interfaces and internet networks, allowing the user the sensation of living in a recreated and artificially enriched reality, with different degrees of realism and involvement. For this reason, an information vehicle is needed that can offer and provide the user (tourist) the possibility of better knowing and discovering the work of art in front of him. Obviously, today's market offers the tourist who finds himself in front of any cultural asset (for example a statue) different ways to obtain more information on the asset: 1) pay a guide or 2) if he knows the name of the work, type it into Google. Both solutions are not immediate and can also be very dispersive. In the first case, you should find a guide and trust him; in the second case, the information is distributed across many URLs (websites) on the internet. This invention, through a special device, allows to store as much information as possible on a single URL (Web Page). This information can be stored or viewed by any user. To solve the problem of the immediacy of access to the information, it is necessary at this point to provide the URL of the web page (to our hypothetical tourist or writer).

Therefore, at the moment in the known art there is no global technical solution that can overcome the aforementioned problems. In this sense there are patent applications that deal with the topic of better conveying information for the user such as ?Intelligent tourist guide system and method - CN101488308B? or ?SYSTEM FOR TRANSMISSION AND REPRODUCTION OF INFORMATION DATA - 102010901809215? and other similar ones that however, while dealing with the topic of ?cultural heritage? and/or more information for the tourist, are different from the present invention.

It follows that the aim of the invention compared to the prior art is to identify and amalgamate in a single standardized method, enabling technologies such as systems oriented to the enhancement and multimedia promotion of the artistic and historical heritage and in general of everything that falls within the definition of "cultural asset". To do this, an electronic device is available that can communicate with the user with a smartphone for the exchange of the relative URL so that the "modus operandi" for the technical advantages brought about compared to the prior art, differs significantly, is explained below.

General description

About Device Programming

The device has a command memory where the execution "program" is saved. The programming language used is text-based.

Allowed commands (programming language syntax):

identifier forms and declarations

G = GPS module

L = Lora / wifi module

P = Display Paper

I = motion sensor

B = BLE

N = NFC

To declare the use of a module, simply indicate its identifier in the program text. Each module has its own default behavior.

Module behaviors:

G = takes a text type value as input starts the GPS connection waits for the coordinates and returns them in the following format ?lat=###.######&lng###.##### concatenated to the input text message in case of failed connection returns ?lat=0&lng=0

L= takes as input a text type value that includes the message to send and the sending destination (e.g. "the vehicle has moved: 192.168.14.23") and returns the input value if the communication was successful or if the communication failed.

P= takes as input a text type value that includes the message to display and the display mode (e.g. ?www.guides4you.it:QR?). The display modes can be different, QR transforms the message into QR-code format, TX keeps the message in its original format, CB transforms it into a barcode message. The message transformation types can also be extended. The module returns as output the text message of the input (excluding the value of the display mode)

B= takes a text value as input and propagates it as advertising. Returns 0 in case of error the input value if the process was successful.

N= Takes a text value as input and stores it in its memory and returns the stored message

I= This module is used to record movements and consequently receives a message and a behavior string as input and does not output the message. It is used to stop or start the program upon receiving a movement. The behavior message is made up of a character that can assume the value Q or the value S and a number that expresses the waiting time in seconds. If the number has the value 0 the waiting time will be infinite. Once the movement has been recorded or the waiting time has expired the module will simply pass the message received as input to the next module in the program. The value Q indicates that the module must provide the output if it does not record movements for the waiting time, while the value S indicates that the module must provide the output if it records a movement within the waiting time.

The proposed programming language provides that each program can be written on a single line of programming where input is expected that each module necessarily has an input that is written before its identifier and has an output that can in turn be read by a new module. Inputs and outputs can be concatenated with strings by a single operator identified by the character . Strings are delimited by single quotes.

Program example

?hello world?NGB+?:QR?P+?Q30?I:?192.168.1.1?L

In this example the program executes:

1.? the NFC module takes the string ?hello world? as input

2.? The GPS module takes as input the string ?hello world? returned by the NFC module, obtains the coordinates from the satellite and concatenates them to the input string

3.? The BLE module receives the string ?hello world?lat=##.###&lng=##.###? propagates it in advertising mode

4.? The Paper module receives as input the string ?hello world?lat=##.###&lng=##.###? concatenated with the value ?:QR? transforms the message into a QRCODE and displays it on the display

5.? The IMU module waits 30 seconds with no movement

6.? The LORA/WIFI module receives the string ?hello world?lat=##.###&lng=##.###:192.168.1.1? as input and sends the notification to the address

7.? The device must be set to Quiet state

Second Program Example

?www.guides4you.it?NB+?:QR?P

In this example the program executes:

1.? The NFC module takes the string ?www.guuides4you.it? as input.

2.? The BLE module receives the string ?www.guides4you.it? and propagates it in advertising

3.? The Paper module converts the string ?www.guides4you.it? into a QRCODE and draws it on the display

4.? device should be set to Quiet state

In the second program example, some modules do not enter into operation. In the quiet state, only the BLE module will remain active in advertising and will be the only one that needs to be powered.

The start and start write commands can be activated in the device by switches or possibly by sensors connected to other external events. Other start commands can also be sent to the microcontroller by the internal components of the device itself, such as an intercepted motion event, or by the voltage variation read on the solar panel.

Detailed description of the invention

The purpose of the present invention is to follow a method that has the purpose of integrating, among themselves, the new technologies used separately to index fixed and mobile points of interest, as examples can be considered the valorization of cultural heritage, tracking of objects and/or vehicles. In detail, for a correct and fast use of the contents, the present invention provides for the creation of an innovative integrated device, of proximity communication, that can index all the POIs in a harmonized way, exploiting applications already integrated in many smartphones. The device, thanks to existing and daily used technologies such as NFC, QR-CODE and BLUETOOTH, has the task of facilitating access to the contents of the single POI. In the case of mobile POIs, the device, through a GPS module and a motion sensor (IMU), updates the positioning and possibly notifies the new position through a Wifi or Lora module.

The timing of how the individual components should interact with each other can be programmed externally by writing to a dedicated internal memory. Writing access to the internal memory can be done by communicating with the device via smartphone via NFC or Bluetooth.

Among the possible uses, we think of all those cases in which it is important to find information in a simple and fast way on points of interest of various kinds. Think of the cars present in a parking lot and ready for sale, of considerable importance to obtain as much information as possible on the car and also in case of use of the same, as in the case of test drives, it is very useful to notify that the car has been moved and upon its return to notify the new position. This same use can also be thought of in open-air exhibitions of vintage cars.

As regards fixed points of interest, reference can be made to works of art, monuments, landscapes and places of historical and cultural interest.

An innovative musealization, therefore, with the visitor at the center protagonist of the cultural experience, and no longer a passive spectator, who can enjoy a multiplicity of contents always updated, varied in content and in the way of fruition, and become a creator himself, telling his own cultural tourist experience or simply creating a new digital content on a specific work. The new languages of multimedia have in fact a revolutionary impact, thanks to the unlimited potential not only in documenting and creating digital archives, but in telling stories, reconstructing worlds and objects now lost, in an engaging and exciting way.

The present invention intends to create content containers accessible to users who can be configured as creators of digital content, thus feeding the state of knowledge of each POI.

The final goal is to build and promote an alternative fruition model compared to the web search for a POI but through an immediate and physical indexing of the point itself to obtain specific information without carrying out searches.

For example, different contents can be created and then used on the same artistic work: from the narrative of the art expert, to the historical or ironic story of the common user (tourist) which can however generate a lot of social feedback (for example a high number of views on the app). The service will in fact exploit the potential offered by portable devices such as smartphones / tablets for the use of additional contents, glossaries, audio-video insights and also any advanced visualization systems to encourage an immersive and multifocal approach in the public.

The visitor will be able to use his/her smartphone to download the specific Application of the present invention or use any other APP that is able to communicate with the content indexing device and can thus access various types of content that are always updated in a simple and fast way.

The device can also be queried to obtain information such as unique identifier, name, coordinates, type, status, information that can be used to create future uses such as smartphone apps dedicated to various uses. For example, by querying the device, an IT company or a programmer could be interested in creating apps for the blind to give the visually impaired the ability to obtain information on the poi in a simple and innovative way.

Some of the hardware modules integrated within the proposed device are:

-? Battery and charging module with solar panel (alternatively modules that exploit other renewable energy sources are available, e.g. wind),

-? Positioning module (e.g. GPS, IMU, etc),

-? Bluetooth communication module, BLE,

-? NFC Read/Write Module,

-? Communication module with LoRa antenna,

-? and/or Wi-Fi module or other wireless protocol, for peer-to-peer, peer-to-network transmissions;

-? Display (e.g., paper display, or other low-power displays)

The internal modules of the device are connected to each other and managed by a microcontroller. The microcontroller, to manage the operation and coordination of the individual modules, reads the programming algorithm on internal memory and executes it. All internal modules in the initial configuration are configured in quiet mode to reduce their consumption.

Description of the figures

In figure 1, 100, the device comprising: Ble, NFC, display, lora/wifi, IMU, GPS. All components are connected to a microcontroller and are powered by a battery or alternatively a capacitor which in turn are recharged by a mini-photovoltaic panel for power supply. All electronic devices are connected to obtain a single device that can be used for various purposes. This device initially has no information stored inside it. Before using it, it is necessary to store at least one piece of information and a program to execute.

The initial information will be shared, and possibly updated, by all the modules inside the device. The program stored on the device will be executed at each start of the device. Both the information and the program can be transmitted to the device via nfc or bluetooth with the help of a smartphone or a computer.

In fig. 2, 200, you can see the operating states of the device in graphics. If the device is in a quiet state, the modules are generally turned off or in standby, however one or more modules could be running in quiet mode, if this operation has been provided in the execution program: quiet, execution and waiting for programming.

The present invention has been described for illustrative but not limitative purposes, according to its preferred embodiments, but it is to be understood that variations and/or modifications may be made by those skilled in the art without departing from the relative scope of protection, as defined by the attached claims.

Claims (8)

Claims 1. Method for tracking and creating interactive multi-channel and multimedia points of interest via a transportable and reprogrammable device (100,200) characterised by: a. Ability to start the device in multi-mode, in fact, for example, the device can be started via a switch, a start sensor or other possible interrupt generated by internal modules; b. Ability of the device to write information, which is then shared, through the concatenation of results from various modules and through the execution of the program to be executed, writing can occur by communicating with the device via NFC, contact between smartphone and device, or Bluetooth/wifi, Bluetooth or wifi connection to the device; c. Module management program startup system and automatic execution at its startup; d. Function for optimizing the energy consumed by the various modules; once the program has finished running, the device reduces its consumption to a minimum; e. Information sharing and display system between the various modules, the information is made available by querying the device on the display in the format decided during the programming phase, on the BLE and on the NFC or on other modules that may be programmed; f. If the device is moved, and the program provides for it, the move and any updates to the shared information can be notified to central reference stations. 2. Method according to claim 1. Characterized by single-line text programming, i.e. the device is programmed through a programming language designed specifically for the device, which includes a specific syntax for reporting errors on the same internal modules of the device, such language is designed in such a way as to save memory for storing the program on the device. 3. Method according to claim no. 1 and no. 2 characterised by: - The language identifies modules using a single character, - The language requires that a module always has an input and an output parameter, - The input is indicated immediately before the module identifier, - The output is indicated immediately after the module identifier, - Modules can be chained together, allowing the output of one to flow into the input of the other, - Input and output can be concatenated with additional text via the ?+? operator. 4. Method according to previous claims characterized by a method of interpretation, by the microcontroller, of the single-line text programming language: - The microcontroller reads the program from memory - The microcontroller, in addition to the memory where the program is written, uses two dedicated registers to store two variables, V1 and V2. The variable V1 is always used to read the input to be passed to the modules. - To interpret the program in memory the microcontroller iteratively reads the entire program in memory character by character. - If the character read is a superscript ???, then it identifies the beginning of a text and the device continues reading all the following characters storing them in a variable until the next superscript character ??? is read which concludes the reading of the entire text - If the character read identifies a module, the device uses the input variable V1 to execute the module with the input parameter, then it waits for the result from the module and will store it in the variable V1 or V2 replacing the previous value - If the character read is the ?+? operator, the device uses the variable V2 to store the string expected after the operator. The string could be: the output of a form or a text delimited by quotes ? ? ?. Once the text is obtained, the device will concatenate it with the value already present in the variable V1, updating its value. - Any errors immediately block the interpretation and execution of the program and will be reported on the display paper with the following error code, which is not exhaustive: o E1 = variable to be stored too large o E2 = Invalid input or E3 = time out o E4 = the module is not responding 5. Method according to previous claims characterized by the possibility of programming the device with the program ?input?N+?:broadcast?L: - The program initializes the device with a value passed to the NFC module via smartphone which is stored in memory, - The stored message is transmitted by the dedicated LORA module to a central receiving station. 6. Method according to previous claims characterized by the possibility of programming the device with the program ?https://maps.google.it/?q=?N+G+?:QR?P: - The program initializes the device with a web address that displays the geolocation of points on the map; - GPS, via satellite communication, returns the geographic coordinates of the device's position; - The received coordinates are concatenated with the web address and are passed to the display paper which transforms the text into a QRCODE by drawing it on the display; - By scanning the QRCODE produced on the display with a smartphone equipped with a camera, you will be redirected to the website which will display the correct position of the device on a map; 7. Method according to previous claims characterized by the possibility of programming the device with the program ?the device has moved :S0?I+?:broadcast?L; - The program initializes the device by storing a message and waits for a movement; - As soon as the device is moved, the stored message is transmitted by the dedicated LORA module to a central receiving station. 8. Method according to previous claims characterized in that the user, via a smartphone equipped with an APP with NFC reader/writer, includes the following phases: - by contacting the NFC device, the information is stored on the NFC module; - A runtime program is stored at the same time, which can use modules at will for various purposes; - The device starts up and checks the execution of the stored program.