RU199712U1 - DEVICE FOR STREAMING AUDIO BROADCASTING TO SMARTPHONES - Google Patents

Abstract

The utility model relates to the field of radio engineering, in particular to technologies for building wireless self-organizing communication networks in public systems containing subscriber, base, switching stations. The device contains a unit for displaying and recognizing a video image and a unit for receiving and transmitting data connected to it, and the unit for displaying and recognizing video data is connected to a display and a video camera of a smartphone and is configured to display a QR code on the display or recognize a QR code, decipher the information contained therein and transmission to the block of data reception and transmission. The unit for receiving and transmitting data is connected to the receiving and transmitting antenna, speaker and microphone of the smartphone and is configured to process information received from the display unit and video image recognition, on the basis of which data packets are received and transmitted to other network devices containing at least , audio data and time codes, and output of audio data to the smartphone speaker. The solution allows you to organize streaming audio broadcasting to users' smartphones without an Internet connection.

Description

The field of technology.

The utility model relates to the field of radio engineering, in particular to technologies for building wireless self-organizing communication networks in public systems containing subscriber, base, switching stations.

State of the art.

The following applications are known in the prior art: FireChat is an instant messaging client for Android and iOS that works offline. Bluetooth and WiFi wireless networks are used to transfer text messages and images, devices with FireChat installed can detect each other within a radius of 60 meters. Source: https://www.opengarden.com/firechat/. This service is not intended for real-time audio streaming.

Intercom, Serval, Bridgefy - communication services based on the transmission of data over a mesh network also do not imply the interface of various platforms (iOS and Android) and do not set themselves the task of streaming audio in real time.

Technical result.

The technical problem to be solved relates to the development of a hardware solution that allows organizing audio streaming to smartphones of users (visitors of international events, tourists, fans, etc.) without an Internet connection. The audio stream must be transmitted without distortion to an unlimited number of devices with the possibility of simultaneous broadcasting to one or several different channels and with a delay of no more than 2 seconds.

The technical result coincides with the technical problem. An additional technical result consists in expanding the functionality of the claimed device.

These technical results are achieved by creating a device for streaming to smartphones, which contains:

a unit for displaying and recognizing a video image and a unit for receiving and transmitting data connected to it, wherein the unit for displaying and recognizing video data is connected to a display and a video camera of a smartphone and is configured to display a QR code on the display or recognize a QR code, decrypt the information contained therein and transmit into the data receiving and transmitting unit, while the data receiving and transmitting unit is connected to the receiving and transmitting antenna, speaker and microphone of the smartphone and is configured to process information received from the display and video image recognition unit, on the basis of which it is received and transmitted to other devices a network of data packets containing at least audio data and time codes, as well as outputting audio data to a smartphone speaker.

Brief description of images.

The basic user connection diagram is shown in FIG. 1.

The topology of the considered network is shown in FIG. 2.

The general scheme for generating a time frame is shown in FIG. 3.

The essence of the utility model.

The disadvantage of the previously mentioned methods of constructing a peer connection is a high probability of transmission failure due to the failure of one of the network devices to receive requests to continue transmission.

The proposed technical solution significantly expands the functionality of wireless access to network services and allows you to implement access points with a coverage and bandwidth reduction threshold that is an order of magnitude higher than that of a common one-to-many connection, which has a positive effect on the latencies and maximum network bandwidth. Thanks to the ability to provide secure wireless coverage in streets, urban areas or in large towns and areas, the network can be used for rapid deployment, in particular communication networks for internal security purposes or in cases of emergencies in the city.

In a network, each element is connected to several other elements of the same network, which makes it possible to achieve the ability to vary routes through segments with better connectivity. The topology of the considered network is shown in FIG. 2.

If the nearest access point is overloaded, then the data is redirected to the nearest unloaded node due to the data transmission and reception unit. The data block continues to move from one node to another until it reaches its destination.

The key functional is the self-organization functional, i.e. the failure of intermediate nodes or the addition of new nodes to the network will not lead to the destruction of the network, but will only reduce (or increase) its coverage area and throughput. Due to the peculiarities of the protocol, the deployment time of this network is limited only by the speed of distribution of access points over the area of the planned coverage.

The claimed device interacts over the network with the following elements: equipment for creating an information environment (client devices based on iOS and Android operating systems), information and communication portals. It should also be noted that the claimed device has the ability to combine with the above elements, forming a complex.

The information portal is designed to coordinate network connectivity and carries service information. It is a web resource that is automatically accessed by any device through a machine-readable programming interface that works on the principles of presentation state transfer (REST API).

The communication portal is designed for communication between network participants and beyond, built on the principle of client-client communication. The portal provides voice as well as text communication in real time based on the exchange of information through time slots. These technologies are fairly common and are natively supported by most devices. However, to unify the access system, it is possible to access these services using a special application developed for the main operating systems of smartphones: Android and iOS. You can download such an application from the information portal and start using it without additional settings. To connect to the information portal, the subscriber must first scan the QR code containing the encryption keys for the information transmitted in the network. This stage is carried out by the device through a display and video data recognition unit.

The use of the Nearby Connections and Multipeer Connectivity frameworks made it possible to transfer data between devices via Bluetooth with a delay of no more than 1.5 seconds.

For the initial creation of a network, it is necessary to transfer the subscriber device, which is an audio broadcaster, to the mode of forming a mesh network. In this mode, the device displays a QR code containing information encrypted in accordance with the base64 standard. The subscriber device connected to the network as a listener, due to the display and recognition unit of the video image, is transferred to the scanning mode of the specified code, and after detecting such a code in the field of view of the camera, it is recognized and read out, after which the procedure for connecting to the network takes place. If the subscriber device operates on the Android OS, the module for searching for the nearest connections is activated, which works according to the Nearby Connections standard, which allows detecting mesh networks in the communication radius and logging into them using the previously transmitted keys. If the subscriber device operates on the basis of the iOS OS, the module for searching for the nearest connections is activated, which works according to the Multipeer Connectivity standard, which allows you to connect to the mesh network within the communication range formed by other iOS devices and log in to them using the keys transferred earlier, and It also searches for networks using WiFi Aware technology, which allows you to authorize an iOS device in the network formed by subscriber Android devices. After authorization in the network, the subscriber device polls other devices authorized in the network to identify the device that is the source of the audio signal, as well as to identify two devices with the maximum level of connectivity with this device to form an internal network topology, built in the form of a graph, which is necessary to avoid disconnection in the event of a sudden disconnection from the network of one of its other participants. In the process of polling devices, the current time code is also synchronized, which is necessary for further transmission and playback of streaming audio broadcasting. Broadcasting is carried out from one device, the audio stream on which is converted using the h.256 codec into a bit-by-bit set of information, which is then split into separate packets, which also include the checksum and time code of the recording fragment; broadcasting in packets is performed over the network to all subscriber devices. Devices whose connected nodes are devices other than the broadcaster's device request information from the devices connected to them and thus also have access to the transmitted information. Due to the checksum, it is possible to avoid the situation of duplication of the received packets, and the information on the time code makes it possible to recover the audio stream from the digital information, which is then reproduced on the subscriber device.

In a similar way, service and user text information is transmitted over the network due to the block of data transmission and reception, but instead of the h.256 codec, which is not suitable for processing this type of data, encryption is used using the base64 algorithm, which reduces the load on the network by reducing volume of transmitted information.

One of the subscribers in the network is assigned to work as the central (base) station. With the help of the central station, access control to the channel is carried out for the rest of the network subscribers, which are subscriber stations. In this case, radio traffic between subscriber stations is carried out through the central station using the time division multiple access (TDMA) method: the communication channel is divided into time frames, which, in turn, are divided into time intervals (slots), where network stations are allowed to transmit and receive information ... The time frame is formed at the central station. The general scheme of this algorithm is shown in Fig. 3.

The central station periodically polls the registered subscriber stations. The polling procedure is that the central station opens service channels for registered subscriber stations and waits for responses to polling service packets. If the subscriber station has information for transmission (requests for opening a channel from equipment connected to the subscriber station, etc.), it transmits them in an open service channel before responding to the service polling packet. If the subscriber station has no information to transmit, it transmits a poll response packet to the central station.

Claims (1)

A device for streaming to smartphones, comprising a video image display and recognition unit and a data transmission receiving unit connected to it, wherein the video data display and recognition unit is connected to the display and a video camera of the smartphone and is configured to output a QR code to the display or to recognize a QR code, decryption of the information contained in it and transmission to the data reception and transmission unit, while the data transmission and reception unit is connected to the receiving and transmitting antenna, speaker and microphone of the smartphone and is configured to process information received from the video display and recognition unit, on the basis of which data packets containing at least audio data and time codes are received and transmitted to other network devices, as well as audio data output to the smartphone speaker.

Images