GB2594937A

GB2594937A - A method for pairing a first computing device with at least a second computing device by an assistance system, as well as an assistance system

Info

Publication number: GB2594937A
Application number: GB2006851.6A
Authority: GB
Inventors: Antonescu Mihai
Original assignee: Daimler AG
Current assignee: Mercedes Benz Group AG
Priority date: 2020-05-08
Filing date: 2020-05-08
Publication date: 2021-11-17
Also published as: GB202006851D0

Abstract

The invention relates to a method for pairing a first device 12 with a second device 14. The first device transmits a “data-over-sound” pairing signal 18 to the second device, which may lead to pairing of the devices. The sound signal is transmitted via a speaker of the first device and is received via a microphone of the second device. The first and second devices are described as “computing devices” but the first device is preferably a smartphone and the second device a head-unit of a car. The invention is said to relate to an “assistance system”. The first and second devices may each be configured as artificial intelligence voice systems. The first device may be connected to a network 10 (e.g. a Wi-Fi (RTM) network) and the pairing signal may be used to pair the second device to the network. The pairing signal my include a pairing identifier, transmitted as a random hex number. The second device may respond with its own sound signal, including a capability list 20. After pairing, a configuration signal 22 may be transmitted from the first device to the second device using a sound signal.

Description

Intellectual Property Office Application No. GII2006851.6 RTM Date:23 October 2020 The following terms are registered trade marks and should be read as such wherever they occur in this document: Wi-Fi and Bluetooth Intellectual Property Office is an operating name of the Patent Office www.gov.uk/ipo A METHOD FOR PAIRING A FIRST COMPUTING DEVICE WITH AT LEAST A SECOND COMPUTING DEVICE BY AN ASSISTANCE SYSTEM, AS WELL AS AN ASSISTANCE SYSTEM

FIELD OF THE INVENTION

[0001] The present disclosure relates to the field of automobiles. More particularly, but not specifically, the present disclosure relates to a method for pairing a first computing device with at least a second computing device by an assistance system.

BACKGROUND INFORMATION

[0002] From the state of the art, there are artificial intelligence voice assistants known, which are becoming more and more common. For example, the artificial intelligence voice assistants are provided in smartphones, in homes as well as in cars. There is an added benefit when using artificial intelligence voice assistants since a person can converse with them like with any other person and achieve things which in the past required multi-step processes and a specific graphical user interface.

[0003] In order for artificial intelligence voice assistants to be aware of the user's preferences or settings, like an email address or Wi-Fi network, a multi-step process in a graphical user interface needs to be followed. This needs to be repeated for every new device that is added to the network system, a process which is becoming an unnecessary overhead to customers who quickly want to converse with the new assistant and expect to be aware of their personal preferences.

[0004] US 2016/0366713 Al discloses a method for pairing devices in a communication network using a cue signal which may include receiving by a first computing device in a communication network, a cue signal. The cue signal is matched with a pre-determined cue signal. A listening window can be opened upon successful matching of the received cue signal with a pre-determined signal. A device identifier broadcast associated with the second computing device within the communication network may be detected during the listening window. The device identifier may be broadcast in response to the cue signal. Pairing may be initiated with the second computing device. The listening window may be of a fixed duration whilst an identifier may be detected prior to exploration of the fixed duration.

SUMMARY OF THE INVENTION

[0005] It is an object of the invention to provide a method and an assistance system, by which a step reduced pairing for a first computing device and a second computing device by the user can be realized.

[0006] This object is solved by a method and an assistance system according to the pending claims. Advantageous embodiments are disclosed in dependent claims.

[0007] One aspect of the invention relates to a method for pairing a first computing device with at least a second computing device by an assistance system, by which the first computing device is transmitting a pairing signal to the second computing device and depending on the received pairing signal the pairing is provided.

[0008] It is provided that the pairing signal is a Data-Over-Sound signal and the DataOver-Sound signal is transmitted via a speaker device of the first computing device and the transmitted Data-Over-Sound signal is received via a microphone device of the second computing device.

[0009] For that it is facilitated that using the Data-Over-Sound technology the need of users following multi-step processes is removed in order to set up the second computing device. Instead, once one of the computing devices is configured, the others may be configured automatically by being in a nearby environment since they will exchange the configuration and preferences using the predefined Data-Over-Sound communication protocol that is spoken-language agnostic.

[0010] The Data-Over-Sound technology enables audio data transfer. Any type of data format can be sent. For example, it is possible to transmit strings or hex values. DataOver-Sound is a technology that may be comparable to Bluetooth or Wi-Fi technologies.

The Data-Over-Sound technology uses a regular audio speaker to emit the sound and a microphone to receive it. Possible frequencies for the audio signal may be between 20 Hz up to 20 kHz.

[0011] System pairing allows two or more systems/devices to exchange information after a following process that makes the involved system aware of each other creating a communication system. For example, it is possible to pair a smartphone as a first computing device with a head-unit of a car as a second computing device. The process for pairing usually involves an emitter or one or multiple receivers. The emitter communicates over a channel in a technology stack a network that can be joined. The receiver is usually listening in a selected channel and if it detects an emitter it requests to join the network. Once the two or more devices are paired they exchange information.

[0012] It has turned out to be advantageous if the first computing device is connected to a network system and the pairing signal comprises network data to pair the second computing device with the network system. For that, it is possible that for example, passwords for the network system can be transmitted via the pairing signal, so the second computing device can automatically join the network system. In more detail, it is possible that the user of the first computing device and the second computing device just have to configure the first computing device in the network system and the first computing device is then transmitting all necessary configuration data to the second computing device so that the second computing device may automatically pair with the network system. In this way, it can be facilitated that a step reduced method for pairing a second computing device with the network system (such as a Wi-Fi network) can be realized.

[0013] In an embodiment, the pairing signal may comprise of a pairing identifier of the first computing device. For example, a user can initiate the pairing process in his already pre-configured first computing device. In more details, the pre-configured first computing device will broadcast its pairing identifier with the second computing device in order for the user to take advantage of the pre-configured setting save on the first computing device.

[0014] In a detailed embodiment, the pairing identifier may be transmitted as a random hex number. It is possible that the random hex number can be transmitted as the DataOver-Sound signal. Hex numbers have turned out to be advantageous in the Data-Over-Sound technology for pairing of the first computing device with the second computing device.

[0015] Furthermore, it has turned out to be advantageous that for initiating the pairing process, the second computing device is searching for a pairing identifier. In particular, the second computing device is constantly searching for the pairing identifier at the moment it is turned on. Also, if the second computing device is connected to the network system, it may take advantage of a cloud natural language understanding engine. As soon as the second computing device discovers the pairing identifier, it will respond with the same, for example, an identification and its capabilities. In a specific embodiment, the pairing process between the first computing device and the second computing device may be done automatically.

[0016] In an advantageous form of configuration after the pairing process, a capability list of the second computing device is transmitted to the first computing device. This configuration is advantageous as the first computing device gets the capability list and can determine the capabilities of the second computing device. For example, the capability list may comprise of applications which can be provided by the second computing device. In a specific embodiment, it may be possible that more information can be transmitted from the first computing device to the second computing device in order to automatically configure the second computing device.

[0017] In an embodiment, the first computing device and the at least second computing device are configured as artificial intelligence voice assistants. For example, the first computing device can be a smartphone with an artificial intelligence voice assistant and the second computing device can be an in-car computing device, for example, a head-unit of the car, which also comprises an artificial intelligence voice assistant. In particular, the artificial intelligence voice assistants are using natural language understanding (NLU), so a user of the artificial intelligence voice assistant can communicate with the artificial intelligence voice assistant like talking to another person or system. This has the advantage that an intuitive operating of the first computing device and the second computing device can be realized.

[0018] In an embodiment, after the pairing process a configuration signal is transmitted as a Data-Over-Sound signal from the first computing device to the second computing device. For example, as the configuration signal passwords for applications of the second computing device can be transmitted via the first computing device. Furthermore, user credentials can be transmitted from the first computing device to the second computing device. For that, it is possible that the step reduced configuration of the second computing device computed.

[0019] In an embodiment, after the pairing process an acoustic information signal for a user is computed by the second computing device and/or the first computing device. In particular, the acoustic configuration signal can be computed by the second computing device, that the configuration was implemented. The user then knows that the second computing device is ready to start, and the user can use the second computing device. Furthermore, it is possible that the first computing device also computes an acoustic configuration signal in order to inform the user that the configuration of the second computing device is finished. In particular, if the first computing device and the second computing device are configured as artificial intelligence voice assistants, there is no need for a special microphone device, as the artificial intelligence voice assistants already are comprising at least a microphone.

[0020] Further advantages, features, and details of the invention derive from the following description of preferred embodiments as well as from the drawings. The features and feature combinations previously mentioned in the description as well as the features and feature combinations mentioned in the following description of the figures and/or shown in the figures alone can be employed not only in the respectively indicated combination but also in any other combination or taken alone without leaving the scope of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The novel features and characteristic of the disclosure are set forth in the appended claims. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and together with the description, serve to explain the disclosed principles. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same numbers are used throughout the figures to reference like features and components. Some embodiments of system and/or methods in accordance with embodiments of the present subject matter are now described below, by way of example only, and with reference to the accompanying figures.

[0022] The drawing shows in: [0023] Fig. 1 a schematic flow chart of an embodiment of the invention; and [0024] Fig. 2 another schematic flow chart of another embodiment of the invention.

[0025] In the figures the same elements or elements having the same function are indicated by the same reference signs.

DETAILED DESCRIPTION

[0026] In the present document, the word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any embodiment or implementation of the present subject matter described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

[0027] While the disclosure is susceptible to various modifications and alternative forms, specific embodiment thereof has been shown by way of example in the drawings and will be described in detail below. It should be understood, however that it is not intended to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.

[0028] The terms "comprises'', "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a setup, device or method that comprises a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus proceeded by "comprises.., a" does not, without more constraints, preclude the existence of other elements or additional elements in the system or method.

[0029] In the following detailed description of the embodiments of the disclosure, reference is made to the accompanying drawings that form a part hereof, and in which are shown by way of illustration specific embodiments in which the disclosure may be practiced. These embodiments are described in sufficient details to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the present disclosure. The following description is, therefore, not to be taken in a limiting sense.

[0030] Fig. 1 shows a schematic flow chart of an embodiment of the invention. Fig. 1 shows a user 10 which wants to pair a first computing device 12 with a second computing device 14. In particular, the first computing device 12 is already configured.

[0031] According to a first aspect of the invention, a method for pairing the first computing device 12 with the at least second computing device 14 by an assistance system 16 is provided, wherein the first computing device 12 is transmitting a pairing signal 18 to the second computing device 14 and depending on the received pairing signal 18 the pairing is provided.

[0032] It is provided that the pairing signal 18 is a Data-Over-Sound signal. The DataOver-Sound (DOS) signal is transmitted via a speaker device of the first computing device 12 and the transmitted Data-Over-Sound signal is received via a microphone device of the second computing device 14.

[0033] According to the embodiment which is shown in Fig. 1 the first computing device 12 can be connected to a network system 28. Following the connection between the first computing device 12 and the networ system 28, the pairing signal 18 from the first computing device might be transmitted to the second computing device 14 in order to connect the second computing device with the network system 28. The pairing signal 18 may comprise a pairing identifier ID of the first computing device 12. Specifically, the pairing identifier ID may be transmitted as a random hex number or any equivalent thereof.

[0034] In particular, it can be provided that for initiating the pairing process, the second computing device 14 is searching for a pairing identifier ID, in particular in the embodiment of the pairing identifier ID of the first computing device 12.

[0035] Furthermore, Fig. 1 shows that after the pairing process a configuration signal 22 is transmitted as a Data-Over-Sound signal from the first computing device 12 to the second computing device 14. Furthermore, it is shown that after the pairing process an acoustic configuration signal 24 for the user 10 is computed by the second computing

S

device 14 and/or the first computing device 12 Indicative of the completion of the pairing process.

[0036] In particular, Fig. 1 shows that Data-Over-Sound creates a communication system between artificial intelligence voice assistants as language agnostic and uses the exact inputs and outputs that are required for regular communication between the user 10 and the artificial intelligence voice assistants, in particular the microphone and the audio speaker. The algorithm behind the Data-Over-Sound technology does not require multiple computing resources against to what the natural language understanding of the artificial intelligence voice assistant system would need in terms of hardware resources making it excellent for running embedded in the devices that serve the artificial intelligence voice assistants to its small foot print.

[0037] According to Fig. 1, the user 10 would initiate the pairing process in his already the pre-configured first computing device 12 in a first step Si. In a second step S2, the pre-configured first computing device 12 will broadcast its pairing identifier ID, which is in this case a random hex number. The unconfigured second computing device 14 is constantly searching for pairing identifiers ID at the moment it is turned on. In the step 53, as soon as it discovers the pairing identifier ID from the first computing device 12 it will respond with the same identification and its capabilities. After the confirmation including the capability lists 20, a fourth step S4 is initiated which mau include reading out capability options. In a sixth step S6, the pairing between the first computing device 12 and the second computing device 14 using the Data-Over-Sound is performed. In the seventh step S7, a configuration transfer from the first computing device 12 to the second computing device 14 can be initiated. The configuration will be sent using Data-OverSound in an eighth step S8. In a ninth step S9, the confirmation that the configuration is set in the second computing device 14 will be sent back using Data-Over-Sound as well. In a tenth step S10, the first computing device 12 can confirm that the configuration transfer has been successfully done.

[0038] Fig. 2 shows in another schematic view a flow chart of another embodiment of the invention. Fig. 2 shows that the setup of new artificial intelligence voice assistants is not only a use-case that can be achieved with this pairing method. For example, when the user 10 travels and encounters an artificial intelligence voice assistant that is set in a different language, it cannot directly interact with it due to the language barrier. Most of the users 10 will travel with a smartphone, in this case the first computing device 12, which comes with multiple voice assistants encapsulated in applications.

[0039] Since the pairing method is agnostic to the language spoken, the user 10 can initiate the pairing on the first computing device 12. Using the Data-Over-Sound pairing method, the first computing device 12 is requesting pairing with the second computing device 14 set in a different language. Once the pairing is done, and confirmed by the user 10, the first computing device 12 can request a list of capabilities 20 from the second computing device 14 using the Data-Over-Sound communication system. This could include actions, for example, like message readouts, control car functions, navigation, increasing cabin temperature and so on. Furthermore, it can include control smart home appliances, for example, turn on bedroom lights or start coffee machine.

[0040] The user 10 can select a capability from the list and ask the first computing device 12 to perform the action. For example, as shown in Fig. 2, the user 10 can talk to a taxi driver 26 in a different language using the Data-Over-Sound communication system between the first computing device 12 and the second computing device 14. For example, the user 10 is speaking English with the first computing device 12 which is shown in the eleventh step S11. The user 10 initiates the pairing process in a twelfth step S12. In a thirteens step S13, broadcasting pairing identifier ID using the Data-Over-Sound technology is provided. For example, the second computing device 14 and the taxi driver 26 are talking German in a fourteenth step S14. In a fifteenth step S15, a permission using in-car infotainment screen can be requested. In a sixteenth step 516, the request is accepted by the taxi driver 26. In a seventeenth step S17, a confirmation about the pairing using the Data-Over-Sound including the capability list 20 is performed. This can be displayed or read out in an eighteenth step S18 from the first computing device 12 for the user 10. In a nineteenth step S19, the pairing between the first computing device 12 and the second computing device 14 using Data-Over-Sound is completed. A communication between the user 10 and the taxi driver 26 can be initiated. In a twentieth step S20, the user 10 can request to send a message. In a twenty-first step S21, the first computing device 12 sends a message, for example, in English using the Data-OverSound. In a twenty-second step S22, the second computing device 14 translates the message into German and reads it out for the taxi driver 26. The taxi driver 26 can request to send a response message in a twenty-third step S23. The second computing device 14 sends the message back to the first computing device 12 using the Data-Over-Sound technology in a twenty-fourth step S24. The translated message in English can be read out by the first computing device 12 in a twenty-fifth step S25.

[0041] The figures show pairing artificial intelligence voice assistants using data over audio.

Reference list user 12 first computing device 14 second computing device 16 assistance system 18 pairing signal capability list 22 configuration signal 24 acoustic configuration signal 26 taxi driver Si first step S2 second step S3 third step S4 fourth step 56 sixth step 37 seventh step 58 eighth step 59 ninth step S10 tenth step S11 eleventh step S12 twelfth step 513 thirteenth step 514 fourteenth step S15 fifteenth step 616 sixteenth step 317 seventeenth step 318 eighteenth step 319 nineteenth step S20 twentieth step S21 twenty-first step S22 twenty-second step S23 twenty-third step S24 twenty-fourth step 325 twenty-fifth step

Claims

CLAIMS1. A method for pairing a first computing device (12) with at least a second computing device (14) by an assistance system (16), by which the first computing device (12) is transmitting a pairing signal (18) to the second computing device (14) and depending on the received pairing signal (18) the pairing is provided, characterized in that the pairing signal (18) is a Data-Over-Sound signal and the Data-Over-Sound signal is transmitted via a speaker device of the first computing device (12) and the transmitted Data-Over-Sound signal is received via a microphone device of the second computing device (14).
2. The method according to claim 1, characterized in that the first computing device (12) is connected to a network system (28) and the pairing signal (18) comprises network data in order to pair the second computing device (14) with the network system (28).
3. The method according to claim 1 or 2, characterized in that the pairing signal (18) comprises a pairing identifier (ID) of the first computing device (12).
4. The method according to claim 3, characterized in that the pairing identifier (ID) is transmitted as a random hex number.
5. The method according to any one of claims 1 to 4, characterized in that for initiating the pairing process the second computing device (14) is searching for a pairing identifier (ID).
6. The method according to any one of claims 1 to 5 characterized in that after the pairing process a capability list (20) of the second computing device (14) is transmitted to the first computing device (12) using a Data-Over-Sound signal.
7. The method according to any one of claims 1 to 6, characterized in that the first computing device (12) and the at least second computing device (14) are configured as artificial intelligence voice assistants.
8. The method according to any one of claims 1 to 7, characterized in that after the pairing process a configuration signal (22) is transmitted as a Data-OverSound signal from the first computing device (12) to the second computing device (14).
9. The method according to any one of claims 1 to 8, characterized in that after the pairing process an acoustic confirmation signal (24) for a user (10) is computed by the second computing device (14) and/or the first computing device (12).
10. An assistance system (16) for pairing a first computing device (12) with at least a second computing device (14), wherein the assistance system (16) is configured to provide a method according to any of the claims 1 to 9.