KR102656973B1 - Targeted fingerprinting of radio broadcast audio - Google Patents

Abstract

The system includes an intermediate communications platform that provides an interface to the Internet network; and a first server, the first server comprising a port operably coupled to the intermediate communication platform, processing circuitry, and a service application for execution by the processor. The service application is configured to receive geo-location information of the radio receiver via an intermediate communication platform; allowing the radio receiver to determine one or more available radio stations according to geo-location information; and transmit metadata about the radio broadcast, the metadata including an indication of whether the content of the radio broadcast is suitable for the audio fingerprinting process, to the radio receiver via the intermediate communication platform.

Description

Targeted fingerprinting of radio broadcast audio

The technology described in this patent document relates to systems and methods for providing supplementary data (e.g., metadata) associated with an over-the-air radio broadcast signal.

Over-the-air radio broadcast signals are used to convey various programming content (eg, audio, etc.) to radio receiver systems. Such over-the-air radio broadcast signals may include conventional amplitude modulation (AM) and frequency modulation (FM) analog broadcast signals, digital radio broadcast signals, hybrid analog and digital broadcast signals, or other broadcast signals. . Hybrid radio broadcasting technology and digital radio broadcasting technology can deliver audio and data services to mobile, portable and fixed receivers.

Service data including multimedia programming may be included with the radio broadcast. The broadcast of service data may be contracted by the company to include multimedia content related to the main or main radio program content.

However, service data may not always be available in radio broadcasts. In this case, it may be desirable to identify the audio content that is being broadcast and match service data to the audio content. Some current broadcast radio content information systems rely on digital "fingerprinting" of audio content. However, the audio fingerprinting process can consume a lot of memory of the radio receiver and identification services for fingerprinting can be expensive, both in terms of cost and in terms of resources such as memory resources and processing resources of the radio receiver. .

This summary is provided to introduce in a simplified form selected concepts that are further explained in the Detailed Description below. This Summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

In general, embodiments of radio broadcast metadata distribution systems and methods determine whether received audio is suitable for fingerprinting before fingerprinting is used to obtain audio metadata associated with a radio broadcast. An exemplary radio system includes an intermediate communication platform providing an interface to an Internet network, and a first server, the first server comprising: a port operably coupled to the intermediate communication platform, processing circuitry ( circuitry), and service applications for execution by the processing circuitry. The service application is: to receive geo-location information of the radio receiver via an intermediate communication platform, to determine one or more radio broadcasts available to the radio receiver according to the geo-location information, and metadata about the radio broadcast - the metadata refers to the radio broadcast. Containing an indication of whether the content of is suitable for the audio fingerprinting process - is configured to transmit to a radio receiver via an intermediate communication platform.

An exemplary radio receiver includes radio frequency (RF) receiver circuitry, an Internet network interface, a display, processing circuitry, and a client application program that includes instructions for execution by the processing circuitry. The RF circuitry is configured to receive radio broadcast signals. The client application program transmits geolocation information to the audio metadata service application via the Internet network interface and, via the Internet network interface, metadata about the radio broadcast available to the radio receiver - the metadata refers to the content of the radio broadcast. - Contains an indication of whether it is suitable for an audio fingerprinting process.

It should be noted that alternative embodiments are possible, and steps and elements discussed herein may be modified, added, or removed, depending on the particular embodiment. These alternative embodiments include alternative steps and alternative elements that may be used, and structural changes that may be made without departing from the scope of the present invention.

In drawings that are not necessarily drawn to scale, similar reference numbers may describe similar components in different drawings. Similar numbers with different letter suffixes may represent different instances of similar components. The drawings generally illustrate, by way of example and not by way of limitation, various embodiments discussed in this document.
1 is a block diagram illustrating an overview of an embodiment of a radio system.
Figure 2 is a block diagram of an example of a server for providing an Internet Protocol stream to a radio receiver.
3 is a flow diagram of an example of a method for distributing metadata to a radio receiver.
4 is a block diagram of part of an example radio receiver.

In the following description of embodiments of a radio broadcast metadata distribution system, reference is made to the accompanying drawings. These figures illustrate, by way of example, specific examples of how embodiments of a metadata distribution system may be practiced. It is understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the claimed subject matter.

Over-the-air radio broadcast signals are commonly used to convey various programming content (eg, audio, etc.) to radio receiver systems. Main program service (MPS) data and supplemental program service (SPS) data may be provided to a radio broadcast receiver system. Metadata related to programming content may be delivered in MPS data or SPS data through over-the-air radio broadcast signals. Metadata may be included in the subcarrier of the main radio signal. In IBOC radio, the radio broadcast may be a hybrid radio signal that may include streamed analog broadcast and digital audio broadcast. The subcarrier of the main channel broadcast may include digital information such as text or numeric information, and metadata may be included in the digital information of the subcarrier. Accordingly, a hybrid over-the-air radio broadcast may include analog audio broadcast, digital audio broadcast, and other textual and numeric digital information such as metadata that is streamed along with the over-the-air broadcast. Programming content may be compliant with the DAB standard, the digital radio mondiale (DRM) standard, the radio data system (RDS) protocol, the radio broadcast data system (RBDS) protocol, or high definition. definition; HD) may be broadcast according to the IBOC radio protocol.

Metadata may include both “static” metadata and “dynamic” metadata. Static metadata may or may not change infrequently. Static metadata may include the radio station's call sign, name, logo (e.g., higher or lower logo resolution), slogan, station format, station genre, language, and web page uniform resource locator. ; URL), URL for social media (e.g., Facebook, Twitter), phone number, short message service (SMS) number, SMS short code, program identification; PI) code, country, or other information may be included.

Dynamic metadata changes relatively frequently. Dynamic metadata may include song titles, artist names, album names, album images, artist images (e.g., related to content currently playing on air), advertisements, and enhanced advertisements (e.g., titles, tag lines, images, etc.). It may include phone number, SMS number, URL, search term), program schedule (image, time slot, title, artist name, DJ name, phone number, URL), service following data, or other information. When a radio receiver system is receiving an over-the-air radio broadcast signal from a particular radio station, the receiver system may receive both static and dynamic metadata.

Another approach to providing service data is to combine radio information over-the-air (OTA) with Internet Protocol (IP) delivered content to provide an improved user experience. An example of this type of service is the ^DTS® Connected Radio™ service, which combines OTA analog/digital AM/FM radio with IP delivered content. The combined service receives dynamic metadata (e.g., artist information and song titles, on-air radio program information, and station contact information) directly from local radio stations, which in turn can be used to store IP-delivered content (e.g. For example, metadata) and displayed in the vehicle. DTS Connected Radio service supports all global broadcast standards including analog, DAB, DAB+ and HD Radio™. The vehicle's radio receiver integrates data from Internet services with broadcast audio to create a rich media experience. One of the Internet services provided is information about what radio stations are currently playing and what they have played.

As explained previously herein, service data may not always be available in conjunction with radio broadcasts and may be used to transmit audio fingerprints to identify the content of over-the-air radio broadcasts and to identify radio broadcasts for display to users. It may be desirable to receive metadata about The audio fingerprint may be transmitted from the in-vehicle radio receiver to a server that performs automatic content recognition (ACR) to identify the content of over-the-air radio broadcasts.

However, digital fingerprinting and identification of audio fingerprints can be expensive, both in terms of cost of service and in terms of resources of the radio receiver, such as processor and memory usage. If the broadcast audio being received by the radio receiver is not suitable for the ACR fingerprinting and identification process, these resources may be wasted. For example, if the broadcast audio does not contain music, the ACR process may fail. This may occur if the broadcast audio includes content or advertisements for a talk program. It would be an improvement to verify that the broadcast audio is suitable for ACR fingerprinting and identification before the process begins.

1 is a block diagram illustrating an overview of an embodiment of a radio system. A traditional broadcast radio station 100 transmits an OTA audio signal 105 to the vehicle's radio receiver 110. The OTA audio signal 105 may be an analog audio signal, a digital audio signal, or a hybrid audio signal. The radio service provided is a combined OTA-IP radio service, and the in-vehicle radio receiver 110 is capable of receiving both the OTA audio signal 105 and the IP stream. The IP stream is received from one or more servers 120 via an intermediate communication platform 108. Intermediate communication platform 108 may be a cellular telephone network or a telematics network.

Figure 2 is a block diagram of an example of a radio system server for providing an IP stream to a radio receiver. Server 220 includes processing circuitry 272, memory 274, and a service application 276 or application program interface (API) for execution by processor 272. The service application 276 may include software that operates using the operating system software of the server 220. Server 220 includes a port 270 operably coupled to an interface to an intermediate communications platform 208 that provides IP streams and receives information from a radio receiver.

Returning to Figure 1, to receive metadata for a radio broadcast, in-vehicle radio receiver 110 transmits geographic location information to a service application on server 120. One or more of the servers determine radio broadcasts available to the radio receiver according to the geographical location information, and the service application transmits metadata about the determined radio broadcasts to the radio receiver through an intermediate communication platform. The one or more servers also transmit an indication of the suitability of the content of the radio broadcast for the fingerprinting process. The indication may be included with the metadata (e.g., in a specified field of the metadata). The indication is that the content is either suitable or not suitable for audio fingerprinting. An indication of suitability is transmitted for each radio broadcast of those radio broadcasts for which the radio receiver determines that it is available. The indication of conformity may be a digital code word or a flag stored in memory for radio broadcast. In a variant, an indication of suitability of fingerprinting may be stored in conjunction with metadata for radio broadcast.

If the vehicle's radio receiver 110 is subsequently tuned to a radio broadcast for which the radio receiver 110 does not have metadata (e.g., dynamic metadata), the radio receiver 110 may listen to the radio broadcast for fingerprinting purposes. Check the indication of content suitability. If the indication on the radio broadcast is that the content is suitable for the fingerprinting process, the radio receiver generates an audio fingerprint and transmits the audio fingerprint 130 to the service application. The service application determines the audio metadata of the radio broadcast corresponding to the audio fingerprint and transmits the determined audio metadata 125 to the radio receiver 110. The service application may track radio broadcasts that are being tuned by multiple radio receivers. In response to determining audio metadata from the audio fingerprint provided by the first radio receiver, the service application may transmit the audio metadata to multiple radio receivers receiving the radio broadcast. Audio metadata may be transmitted using an intermediate communication platform 108.

If the indication on the radio broadcast is that the content is not suitable for the fingerprinting process, the radio receiver does not generate an audio fingerprint. The radio receiver 110 may do nothing or may simply transmit an acknowledgment back via the intermediate communication platform 108 according to the communication protocol. Radio receiver 110 may display available metadata (eg, static metadata). The radio receiver's resources are not wasted by generating and transmitting a digital fingerprint that will fail in the ACR fingerprint identification process.

According to some embodiments, to determine audio metadata corresponding to an audio fingerprint it receives, server 120 may store a fingerprint database that stores audio metadata associated with audio fingerprint information in server memory. Includes memory. The service application determines the audio metadata by retrieving the audio metadata from memory using the audio fingerprint.

In some embodiments, the service application receives audio metadata from audio identification source 150. The service application of the first server 120 receives the audio fingerprint 130 from the radio receiver 110 and forwards the audio fingerprint 140 to the audio identification source 150. The first server and the audio identification source may communicate using a communications network. The communication network may be an intermediate communication platform 108 or another communication network. As shown in the example of FIG. 2 , server 220 may include a second port 260 operably coupled to Internet network interface 215 . In certain embodiments, Internet network interface 215 includes an Internet access point (e.g., a modem), and port 260 is (among other options) a COMM port, or a universal serial bus (UTC) port 260. serial bus (USB) port.

Audio identification source 150 is shown in FIG. 1 as residing in the cloud. The term “cloud” is used herein to refer to hardware abstraction. Instead of one dedicated server processing the audio fingerprint and returning audio metadata, sending the audio fingerprint to the cloud may involve sending the audio fingerprint to a data center or processing center. The actual servers used to process audio file content information may be interchangeable in a data center or processing center. Audio identification source 150 may include a second server containing a fingerprint database. Audio identification source 150 may receive audio fingerprint 140 forwarded from the first server, return audio metadata 160 to the first server, and transmit other related metadata to first server 120. . The first server 120 transmits audio metadata 125 onto the radio receiver 110.

3 is a flow diagram of an example of a method 300 of providing metadata to a radio receiver. The method relates to a vehicle being connected to a radio system combining OTA radio broadcasting with IP delivered content, for example a DTS connected radio system. The method may also be performed using a client program of the vehicle's radio receiver. At 305, the in-vehicle radio receiver is tuned to a radio station, and the radio receiver has no dynamic metadata associated with the program currently being broadcast by the radio station. At 310, the radio receiver queried the radio service system for static radio station metadata for the radio broadcast. A radio service system may include an application program interface (API) or service application that runs on a server of the radio service system.

The radio receiver may send geolocation information to the radio system along with the query, and the API sends static metadata for any radio broadcasts available for reception by the radio receiver. The API also includes in the metadata an indication for the radio broadcast whether the content of the radio broadcast is suitable for audio fingerprinting and identification.

At 315, the radio receiver received an indication from the API for the radio broadcast missing dynamic metadata that the radio broadcast is suitable for ACR fingerprinting and identification. For the indication, at 320, the radio receiver generates an audio fingerprint and transmits the audio fingerprint to the API. The ACR fingerprinting process may be performed by a client program or by other software on the radio receiver.

The radio receiver uses an Internet connection to transmit the audio fingerprint to the radio system. The radio system identifies the audio program corresponding to the audio fingerprint and determines audio metadata associated with the audio program. At 325, the API distributes dynamic metadata to a radio receiver and may distribute dynamic metadata to other radio receivers that are receiving the radio broadcast (e.g., via an intermediate communication platform). In some embodiments, dynamic metadata is distributed to a radio receiver capable of receiving a radio broadcast, regardless of the radio station to which the receiver is tuned.

In some embodiments, the radio receiver may store an audio fingerprint database, and prior to transmitting the audio fingerprint to the radio system, at 330, the radio receiver determines whether it is storing the missing dynamic metadata locally. You can decide first whether or not to do so. For example, a radio receiver may store the results of previous audio fingerprinting and check a database to see if the corresponding audio program has previously been identified. When an audio fingerprint is found in the local database, the radio receiver uses the corresponding dynamic metadata for the radio broadcast. This reduces the resources consumed by the radio receiver in determining audio metadata.

At 340, in response to a query for a radio broadcast, the radio receiver receives an indication from the API that the content of the radio broadcast is not suitable for ACR fingerprinting. In this case, at 345, the radio receiver's client program does not consume any resources of the radio receiver, such as processing bandwidth, memory space, or communication time, in generating and transmitting the digital fingerprint of the radio broadcast. The radio receiver may display available metadata (eg, static metadata).

4 is a block diagram of part of an example radio receiver 400. The radio receiver can receive OTA radio broadcasts and can receive IP delivered content. In certain variations, the radio receiver is a DTS connected radio receiver. The radio receiver 400 may be the vehicle radio receiver 110 shown in the example of FIG. 1 . The radio receiver 400 includes a wireless Internet network interface 440 for receiving metadata via wireless IP and other components for receiving over-the-air radio broadcast signals. Internet network interface 440 and receiver controller 430 may be collectively referred to as the wireless Internet Protocol hardware communication module of the radio receiver.

Radio receiver 400 includes radio frequency (RF) receiver circuitry that includes a tuner 456 having an input 452 coupled to an antenna 454. Antenna 454, tuner 456, and baseband processor 451 may be collectively referred to as an over-the-air radio broadcast hardware communication module of a radio receiver. The RF circuitry is configured to receive an audio broadcast signal.

Within the baseband processor 451, the intermediate frequency signal 457 from the tuner 456 is processed by an analog-to-digital converter and a digital to generate a baseband signal at the output 460 containing a series of composite signal samples. Provided as a down converter (458). Signal samples are complex in the sense that each sample contains a “real” component and an “imaginary” component. Analog demodulator 462 demodulates the analog modulated portion of the baseband signal to generate an analog audio signal on line 464. The digitally modulated portion of the sampled baseband signal is subjected to an isolation filter 466 whose passband frequency response includes the collective set of subcarriers (f ₁ -f _n ) present in the received OFDM signal. ) is filtered by. A first adjacent canceller (FAC) 468 suppresses the influence of the first adjacent interferer. Complex signal 469 is routed to the input of acquisition module 470, which acquires or recovers OFDM symbol timing offset/error and carrier frequency offset/error from the received OFDM symbol as represented in received complex signal 469. do. Acquisition module 470 uncovers symbol timing offset (Δt) and carrier frequency offset (Δf), as well as status and control information. The signal is then demodulated (block 472) to demodulate the digitally modulated portion of the baseband signal. The digital signal is deinterleaved by a de-interleaver (474) and decoded by a Viterbi decoder (476). A service demultiplexer 478 separates the main and supplemental program signals from the data signals. Supplementary program signals may also include digital audio files received from the IBOC DAB radio broadcast signal.

Audio processor 480 processes the received signal to generate audio signals on line 482 and MPSD/SPSD 481. In an embodiment, the analog and main digital audio signals are mixed as shown at block 484, or a supplemental program signal is passed through to produce audio output on line 486. Data processor 488 processes the received data signals and generates data output signals on lines 490, 492, and 494. Data lines 490, 492, and 494 may be multiplexed together onto a suitable bus such as I ² C, SPI, UART, or USB. The data signal may include data representing metadata to be rendered, for example, in a radio receiver.

Internet network interface 440 may be managed by receiver controller 430. As illustrated in FIG. 4 , Internet network interface 440 and receiver controller 430 are operably coupled via line 442 and data transmitted between Internet network interface 440 and receiver controller 430 Data is transmitted via this line 442. Selector 420 may be coupled to receiver controller 430 via line 436 to select specific data to be received from Internet network interface 440. The data may include metadata (e.g., text, images, video, etc.) and may be rendered substantially simultaneously with the rendering of primary or secondary programming content received over the air in an IBOC DAB radio signal.

The receiver controller 430 receives and processes the data signal. Receiver controller 430 may include a microcontroller operably coupled to user interface 432 and memory 434. The microcontroller may be an 8-bit RISC microprocessor, an advanced RISC machine 32-bit microprocessor, or any other suitable microprocessor or microcontroller. Additionally, some or all of the functionality of receiver controller 430 may be performed in a baseband processor (e.g., audio processor 480 and/or data processor 488). User interface 432 may include an input/output (I/O) processor that controls display 444, which may be any suitable visual display, such as an LCD or LED display. In certain embodiments, user interface 432 may also control user input components via a touchscreen display. In certain embodiments, user interface 432 may also control user input from a keyboard, dial, knob, or other suitable input. Memory 434 may include any suitable data storage medium, such as RAM, flash ROM (eg, SD memory card), and/or hard disk drive. Radio receiver 400 may also include a global positioning system (GPS) receiver 496 to receive GPS coordinates.

The processing circuitry of the receiver controller 430 is configured to execute instructions included in a client application program or “client” installed in the radio receiver. Client 446 may generate an audio fingerprint from the audio broadcast received through RF receiver circuitry. Client 446 also transmits geolocation information to the audio metadata service application via Internet network interface 440. The radio receiver may include a GPS receiver 496 and the client may transmit GPS coordinates as geographic location information. In response to transmitting geographic information, client 446 receives metadata for any radio broadcasts available to the radio receiver at the radio receiver's indicated geographic location. Included in this metadata is an indication for each radio broadcast whether the content of the radio broadcast is suitable for the ACR fingerprinting and identification process.

As explained previously herein, if audio metadata for the current radio broadcast to which the radio receiver is tuned is missing or unavailable, an indication of that radio broadcast will determine the content of that radio broadcast for the audio fingerprinting process. If appropriate, the client generates an audio fingerprint of the radio broadcast. The client 446 transmits the generated audio fingerprint to the audio metadata service application through the Internet network interface. The audio fingerprint is processed by the service application, and the client 446 receives dynamic metadata associated with the radio broadcast corresponding to the audio fingerprint. Dynamic metadata may also be received over an Internet network. In certain embodiments, dynamic metadata is received on one or more subcarriers of a main channel OTA broadcast. Client 446 displays information included in the received dynamic metadata.

If the indication is that the content of the radio broadcast signal is not suitable for the audio fingerprinting process, the client 446 does not generate an audio fingerprint. Client 446 may do nothing in response to missing audio metadata or may display available metadata (eg, static metadata instead of dynamic metadata).

The described systems, devices, and methods provide metadata to a vehicle's radio receiver. A radio receiver may be capable of performing audio fingerprinting; however, systems, devices, and methods may provide for a radio receiver to perform audio fingerprinting when the content of the radio broadcast is not suitable for the fingerprinting and identification process, and Prevents requests for identification of audio fingerprints. This saves the radio receiver's significant computing resources and communications bandwidth.

Alternative Embodiments and Exemplary Operating Environments

Example 1 includes a subject matter (e.g., a system for providing audio metadata to a radio receiver) that includes an intermediate communications platform providing an interface to an Internet network, and a first server. The first server includes ports operably coupled to an intermediate communications platform, processing circuitry, and service applications for execution by a processor. The service application: to receive geolocation information of the radio receiver via an intermediate communication platform; allowing the radio receiver to determine one or more available radio stations according to geo-location information; And it is configured to transmit metadata about the radio broadcast to the radio receiver through an intermediate communication platform. The metadata includes an indication of whether the content of the radio broadcast is suitable for the audio fingerprinting process.

In Example 2, the subject matter of Example 1 includes, optionally, a server configured to store an indication of the suitability of the audio fingerprinting process for a plurality of radio broadcasts with respect to metadata for the plurality of radio broadcasts, and geolocation information. so that the radio receiver determines all available radio stations according to; and, in response to receiving the geolocation information, a service application configured to transmit metadata for the determined radio broadcast, including an indication of suitability of the audio fingerprinting process for the determined radio broadcast.

In Example 3, the subject matter of one or both Examples 1 and 2 optionally includes a service application configured to: receive an audio fingerprint from a radio receiver via an intermediate communications platform; determine audio metadata of a radio broadcast corresponding to the audio fingerprint; And it is configured to transmit the determined audio metadata to the radio receiver.

In Example 4, the subject matter of one or any combination of Examples 1-3 optionally includes a service application configured to transmit the determined audio metadata to a plurality of radio receivers via an intermediate communication platform.

In Example 5, the subject matter of one or any combination of Examples 1-4 may optionally include a server including a memory configured to store audio metadata associated with audio fingerprint information, and the service application may include: and determine audio metadata by retrieving the audio metadata from memory using the audio fingerprint.

In Example 6, the subject matter of one or any combination of Examples 1-4 includes, optionally, a second server configured to store audio metadata; and a communications network operably coupled to the first and second servers. The service application of the first server is configured to determine audio metadata and receive audio metadata from the second server by forwarding the audio fingerprint to the second server through a communication network.

In Example 7, the subject matter of one or any combination of Examples 1-6 is optionally configured to transmit, together with static metadata, an indication of whether the content of the radio broadcast is suitable for the audio fingerprinting process. Includes a service application configured to receive an audio fingerprint from a radio receiver via, determine dynamic metadata of a radio broadcast corresponding to the audio fingerprint, and transmit the determined dynamic metadata to the radio receiver via an intermediate communication platform. do.

In Example 8, the subject matter of one or any combination of Examples 1-7 includes an intermediate communication platform, optionally a cellular telephone network.

In Example 9, the subject matter of one or any combination of Examples 1-7, optionally, includes an intermediate communication platform that is a telematics network.

Example 10 is a subject matter including radio frequency (RF) receiver circuitry configured to receive a radio broadcast signal, an Internet network interface, a display, processing circuitry, and a client application program including instructions for execution by the processing circuitry (e.g., , radio receiver) or, optionally, combined with one or any combination of Examples 1-9 to include such subject matter. The client application program transmits geolocation information to the audio metadata service application via the Internet network interface and, via the Internet network interface, metadata about the radio broadcast available to the radio receiver - the metadata refers to the content of the radio broadcast. - Contains an indication of whether it is suitable for an audio fingerprinting process.

In Example 11, the subject matter of Example 10 optionally includes an indication that the content of the radio broadcast is an audio finger to determine that dynamic metadata associated with the radio broadcast is not available for presentation using the display. Dynamically associated with a radio broadcast corresponding to an audio fingerprint, to generate an audio fingerprint of the radio broadcast, if appropriate for the printing process, and to transmit the audio fingerprint to an audio metadata service application via an Internet network interface. and a client application program configured to receive metadata and display information included in the dynamic metadata.

In Example 12, the subject matter or one or both of Examples 10 and 11 optionally includes a memory and a client application program wherein dynamic metadata associated with the radio broadcast is displayed using the display. stored in memory using the generated audio fingerprint to generate an audio fingerprint of the radio broadcast if the indication is that the content of the radio broadcast is suitable for the audio fingerprinting process. It is configured to identify metadata and display information included in the identified metadata.

In Example 13, the subject matter of one or any combination of Examples 10-12, optionally, determines that metadata associated with a radio broadcast is not available for presentation using the display, and that the indication is, and a client application program configured not to generate an audio fingerprint of the radio broadcast if the content of the broadcast signal is such that it is not suitable for the audio fingerprinting process.

In Example 14, the subject matter of one or any combination of Examples 10-13 may include, optionally, via an Internet network interface, a radio receiver for geolocation information to receive metadata for all available radio broadcasts; and a client application program configured to receive an indication for each available radio broadcast whether the content of the radio broadcast is suitable for the audio fingerprinting process.

In Example 15, the subject matter of one or any combination of Examples 10-14 includes an Internet network interface, optionally a cellular telephone network.

In Example 16, the subject matter of one or any combination of Examples 10-14 optionally includes an Internet network interface that is a telematics network.

Example 17 may include subject matter such as a computer-readable storage medium containing instructions that, when performed by the processing circuitry of a server, cause the processing circuitry to perform an act, including: Or, optionally, it may be combined with one or any combination of Examples 1-16 to include such subject matter: Receiving geolocation information of a radio receiver via an intermediate communications platform providing an interface to an Internet network. ; Determining available radio broadcasts for a radio receiver based on geolocation information; and transmitting metadata for the radio broadcast, the metadata including an indication of whether the content of the radio broadcast is suitable for the audio fingerprinting process, to a radio receiver via an intermediate communication platform.

In Example 18, the subject matter of Example 17 optionally includes a computer-readable storage medium comprising instructions that cause processing circuitry to perform acts including: utilizing a radio receiver in accordance with geographic location information; determining all possible radio broadcasts; and in response to receiving the geographic location information, transmitting metadata for the determined radio broadcast, including an indication of suitability of the audio fingerprinting process for the determined radio broadcast.

In Example 19, the subject matter of one or both Examples 17 and 18 optionally includes a computer-readable storage medium comprising instructions that cause processing circuitry to perform acts including: radio. receiving an audio fingerprint from a receiver; determining audio metadata of the radio broadcast corresponding to the audio fingerprint; and transmitting the determined audio metadata to the radio receiver.

In Example 20, the subject matter of one or any combination of Examples 17-19, optionally, includes a computer-readable storage medium containing instructions to cause processing circuitry to perform acts including: radio. Transmitting audio metadata determined by the audio fingerprint received from the receiver to multiple other radio receivers via an intermediate communications platform.

These non-limiting examples may be combined in any permutation or combination. Many other variations than those described herein will be apparent from this document. For example, depending on the embodiment, certain acts, events, or functions of any of the methods and algorithms described herein may be performed in a different order, added, merged, or omitted entirely (resulting in , not all described acts or events are required for execution of the methods and algorithms). Additionally, in certain embodiments, acts or events may be performed concurrently, rather than sequentially, such as through multi-threaded processing, interrupt processing, or multiple processors or processor cores or on other parallel architectures. Additionally, different tasks or processes may be performed by different machines and computing systems that may function together.

The various example logical blocks, modules, methods, and algorithmic processes and sequences described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or a combination of both. To clearly illustrate this interchangeability of hardware and software, various example components, blocks, modules, and process actions have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software will depend on the specific application and design constraints imposed on the overall system. The described functionality may be implemented in varying ways for each particular application, but such implementation decisions should not be construed as causing a departure from the scope of this document.

Various example logical blocks and modules described in connection with embodiments disclosed herein include general-purpose processors, processing devices, computing devices having one or more processing devices, digital signal processors (DSPs), and application-specific integrated circuits. (application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware component, or those designed to perform the functions described herein Can be implemented or performed by a machine such as any combination of. General-purpose processors and processing devices may be microprocessors, but in alternatives, the processors may be controllers, microcontrollers, or state machines, combinations thereof, or the like. The processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.

Embodiments of the targeted fingerprinting radio systems and methods described herein operate within various types of general-purpose or special-purpose computing system environments or configurations. Typically, a computing environment is a computer system based on one or more microprocessors, a mainframe computer, a digital signal processor, a portable computing device, a personal organizer, a device controller, and a computational engine within an appliance, to name a few. engine), mobile phones, desktop computers, mobile computers, tablet computers, smartphones, and appliances with embedded computers.

Such computing devices include personal computers, server computers, handheld computing devices, laptops or mobile computers, communication devices such as mobile phones and PDAs, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, and network PCs. , minicomputers, mainframe computers, audio or video media players, and the like. In some embodiments the computing device will include one or more processors. Each processor may be a specialized microprocessor, such as a digital signal processor (DSP), very long instruction word (VLIW), or other microcontroller, or it may be a specialized graphics processing unit of a multicore CPU. It may be a conventional central processing unit (CPU) having one or more processing cores, including a graphics processing unit (GPU)-based core.

The process actions or operations of a method, process, or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in any combination of both. . Software modules may be included in a computer-readable medium that can be accessed by a computing device. Computer-readable media includes both volatile and non-volatile media that may be removable, non-removable, or any combination thereof. Computer-readable media is used to store information such as computer-readable or computer-executable instructions, data structures, program modules, or other data. By way of example, and not limitation, computer-readable media may include computer storage media and communication media.

Computer storage media includes Blu-ray disc (BD), digital versatile disc (DVD), compact disc (CD), floppy disk, tape drive, hard drive, optical drive, and solid-state disk. A state memory device, RAM memory, ROM memory, EPROM memory, EEPROM memory, flash memory or other memory technology, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage device, or may be used to store desired information. Includes, but is not limited to, computer or machine-readable media or storage devices, such as any other device that can be accessed by one or more computing devices.

The software module may include RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of non-transitory computer-readable storage medium known in the art. , media, or physical computer storage. An exemplary storage medium can be coupled to the processor such that the processor can read information from and write information to the storage medium. In an alternative, the storage medium may be integrally molded into the processor. The processor and storage medium may reside in an application specific integrated circuit (ASIC). ASIC may exist in the user terminal. Alternatively, the processor and storage medium may exist as separate components in the user terminal.

As used in this document, the phrase "non-transitory" means "lasting or long-lived." The phrase “non-transitory computer-readable media” includes any and all computer-readable media other than transient radio signals. This includes, by way of example and not limitation, non-transitory computer-readable media such as register memory, processor cache, and random-access memory (RAM). The phrase “audio signal” is a signal that represents physical sound.

Preservation of information such as computer-readable or computer-executable instructions, data structures, program modules, and the like may be performed using various communication media, such as one or more modulated data signals, electromagnetic waves (e.g., carrier waves), or other transmission mechanisms or communications. This can also be achieved by encoding protocols, including any wired or wireless information transfer mechanism. In general, these communication media refer to signals that have been configured or modified in a way that encodes one or more of their characteristics into the signal, such as information or instructions. For example, communication media includes wired media, such as a wired network or direct wired connection, carrying one or more modulated data signals, and acoustics, for transmitting, receiving, or both, one or more modulated data signals or electromagnetic waves. Includes wireless media such as radio frequency (RF), infrared, laser, and other wireless media. Combinations of any of the above should also be included within the scope of communication media.

In addition, one or any combination of software, programs, computer program products, or portions thereof, embody some or all of the various embodiments of the in-vehicle live guide generation systems and methods described herein. The may be stored, received, transmitted, or read from a computer or machine-readable medium or any desired combination of a storage device and a communication medium in the form of computer-executable instructions or other data structures.

Embodiments of the in-vehicle live guide generation systems and methods described herein may be further described in the general context of computer-executable instructions, such as program modules, executed by a computing device. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform specific tasks or implement specific abstract data types. Embodiments described herein may also be practiced in a distributed computing environment where tasks are performed by one or more remote processing devices, or within a cloud of one or more devices that are linked through one or more communication networks. In a distributed computing environment, program modules may be located in both local and remote computer storage media, including media storage devices. Still further, the instructions described above may be implemented, in part or in whole, as hardware logic circuitry, which may or may not include a processor.

Unless specifically stated otherwise, or unless otherwise understood within the context in which it is used, "can," "might," and "may ( Conditional language used herein, such as may)", "for example:, and the like, means that certain embodiments include certain features, elements, and/or states, while other embodiments do not include them. Accordingly, such conditional language means that features, elements, and/or states are in some way required for one or more embodiments, or that these features, elements, and/or states are included. It is generally not intended to imply that one or more embodiments necessarily include logic for determining whether or not to perform a task in any particular embodiment, with or without author input or prompting. The terms “comprising,” “including,” “having,” and the like are synonymous and are used generically in an extensible form to refer to additional elements, features, acts, It does not exclude actions, and etc. Additionally, the term "or" is used in its inclusive sense (rather than its exclusive sense), and as a result, when used, for example, to concatenate a list of elements. , the term “or” means one, some, or all of the elements in the list.

Although the foregoing detailed description illustrates, describes, and points out novel features applicable to various embodiments, various omissions, substitutions, and changes in the form and details of the illustrated devices or algorithms are made without departing from the scope of the present disclosure. It will be understood that this can be done. As will be appreciated, certain embodiments of the invention described herein do not provide all of the features and advantages described herein because some features may be used or practiced independently of others. It can be materialized.

Claims (20)

A system for providing audio metadata to a radio receiver, comprising:
an intermediate communication platform that provides an interface to the Internet network; and
first server
Including,
the first server comprising a port operably coupled to the intermediate communication platform, processing circuitry, and a service application for execution by the processing circuitry;
The service application is,
to receive geographical location information of a radio receiver via the intermediate communication platform;
cause the radio receiver to determine one or more available radio broadcasts according to the geographic location information;
Metadata for the one or more radio broadcasts, wherein the metadata includes an indication of whether the content of the radio broadcast is suitable for an audio fingerprinting process, and wherein the metadata includes an indication of whether the content of the radio broadcast is suitable for the audio fingerprinting process. an indication of suitability for is transmitted together with static metadata - for transmission to the radio receiver via the intermediate communication platform;
receive an audio fingerprint from the radio receiver via the intermediate communication platform;
determine dynamic audio metadata of a radio broadcast corresponding to the audio fingerprint; and
transmit the determined dynamic audio metadata to the radio receiver via the intermediate communication platform.
A system that is composed of something. According to paragraph 1,
the first server is configured to store an indication of suitability of the audio fingerprinting process for a plurality of radio broadcasts in association with metadata for the plurality of radio broadcasts;
The service application is,
cause the radio receiver to determine all available radio broadcasts according to the geographical location information; and
In response to receiving the geographic location information, transmit the metadata for the determined radio broadcast, including an indication of suitability of the audio fingerprinting process for the determined radio broadcast.
A system that is composed of something. According to paragraph 1,
wherein the service application is configured to transmit the determined audio metadata to a plurality of radio receivers via the intermediate communication platform. According to paragraph 1,
The first server includes a memory configured to store the audio metadata in association with audio fingerprint information, and the service application is configured to retrieve the audio metadata from the memory using the audio fingerprint. ), the system configured to determine the audio metadata by. According to paragraph 1,
a second server configured to store the audio metadata; and
a communications network operably coupled to the first and second servers;
Including;
The service application of the first server is configured to determine the audio metadata and receive the audio metadata from the second server by forwarding the audio fingerprint to the second server through the communication network. It is a system that works. According to paragraph 1,
The system of claim 1, wherein the intermediate communication platform is a cellular telephone network. According to paragraph 1,
The system of claim 1, wherein the intermediate communication platform is a telematics network. According to paragraph 1,
The system of claim 1, wherein if the radio broadcast contains music, the indication of whether the content of the radio broadcast is suitable for an audio fingerprinting process is positive. According to paragraph 1,
The system wherein if the radio broadcast includes the content of a talk program or an advertisement, the indication of whether the content of the radio broadcast is suitable for an audio fingerprinting process is negative. As a radio receiver,
Radio frequency (RF) receiver circuitry configured to receive a radio broadcast signal;
Internet network interface;
display;
processing circuitry; and
A client application program including instructions for execution by the processing circuitry.
Including,
The client application program is,
transmit geographical location information to an audio metadata service application through the Internet network interface;
Via the Internet network interface, cause the radio receiver to receive metadata about available radio broadcasts, the metadata including an indication of whether the content of the radio broadcast is suitable for an audio fingerprinting process;
determine that dynamic metadata associated with the radio broadcast is not available for presentation using the display;
if the indication is that the content of the radio broadcast is suitable for the audio fingerprinting process, generate an audio fingerprint of the radio broadcast;
Transmit the audio fingerprint to the audio metadata service application through the Internet network interface and receive dynamic metadata related to the radio broadcast corresponding to the audio fingerprint, or use the generated audio fingerprint to transmit the audio fingerprint to the audio metadata service application. to identify dynamic metadata stored in the receiver's memory; and
to display information contained in the dynamic metadata
Consisting of a radio receiver. According to clause 10,
and wherein if the radio broadcast contains music, the indication of whether the content of the radio broadcast is suitable for an audio fingerprinting process is positive. According to clause 10,
A radio receiver, wherein if the radio broadcast contains the content of a talk program or an advertisement, the indication of whether the content of the radio broadcast is suitable for an audio fingerprinting process is negative. According to clause 10,
The client application program is,
determine that metadata associated with the radio broadcast is not available for presentation using the display; and
not to generate an audio fingerprint of the radio broadcast if the indication is that the content of the radio broadcast signal is not suitable for the audio fingerprinting process.
Consisting of a radio receiver. According to clause 10,
The client application program is,
receive, via the Internet network interface, metadata for all radio broadcasts available to the radio receiver for the geo-location information; and
receive an indication for each available radio broadcast whether the content of the radio broadcast is suitable for the audio fingerprinting process.
Consisting of a radio receiver. According to clause 10,
and wherein the Internet network interface is a cellular telephone network. According to clause 10,
The radio receiver, wherein the Internet network interface is a telematics network. A non-transitory computer-readable storage medium containing instructions,
The command, when executed by the processing circuitry of the server, causes the processing circuitry to:
Receiving geolocation information of the radio receiver via an intermediate communications platform providing an interface to the Internet network;
determining radio broadcasts available to the radio receiver according to the geographic location information;
Metadata for the radio broadcast - the metadata includes an indication of whether the content of the radio broadcast is suitable for the audio fingerprinting process, and an indication of whether the content of the radio broadcast is suitable for the audio fingerprinting process. is transmitted with static metadata - transmitting to the radio receiver via the intermediate communication platform;
receiving an audio fingerprint from the radio receiver via the intermediate communication platform;
determining dynamic audio metadata of a radio broadcast corresponding to the audio fingerprint; and
transmitting the determined dynamic audio metadata to the radio receiver via the intermediate communication platform.
A non-transitory computer-readable storage medium that allows performing an act including. According to clause 17,
The processing circuit unit,
determining all radio broadcasts available to the radio receiver according to the geographic location information; and
In response to receiving the geographic location information, transmitting the metadata for the determined radio broadcast, including the indication of suitability of the audio fingerprinting process for the determined radio broadcast.
A non-transitory computer-readable storage medium that includes instructions for performing an act comprising: According to clause 17,
instructions that cause the processing circuitry to perform an act comprising transmitting the audio metadata determined according to the audio fingerprint received from the radio receiver to a plurality of other radio receivers via the intermediate communication platform. A non-transitory computer-readable storage medium that does. According to clause 17,
The processing circuit unit,
Configuring a memory of the server to store the audio metadata in association with audio fingerprint information, and
determining the audio metadata by retrieving the audio metadata from the memory using the audio fingerprint.
A non-transitory computer-readable storage medium that includes instructions for performing an act comprising: