WO2021015716A1 - Targeted fingerprinting of radio broadcast audio - Google Patents

Targeted fingerprinting of radio broadcast audio Download PDF

Info

Publication number
WO2021015716A1
WO2021015716A1 PCT/US2019/042619 US2019042619W WO2021015716A1 WO 2021015716 A1 WO2021015716 A1 WO 2021015716A1 US 2019042619 W US2019042619 W US 2019042619W WO 2021015716 A1 WO2021015716 A1 WO 2021015716A1
Authority
WO
WIPO (PCT)
Prior art keywords
radio
audio
metadata
radio receiver
radio broadcast
Prior art date
Application number
PCT/US2019/042619
Other languages
English (en)
French (fr)
Inventor
Paul VENEZIA
Original Assignee
Ibiquity Digital Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ibiquity Digital Corporation filed Critical Ibiquity Digital Corporation
Priority to CA3147864A priority Critical patent/CA3147864A1/en
Priority to JP2022503845A priority patent/JP7381712B2/ja
Priority to KR1020227005457A priority patent/KR102656973B1/ko
Priority to MX2022000751A priority patent/MX2022000751A/es
Priority to PCT/US2019/042619 priority patent/WO2021015716A1/en
Priority to AU2019457816A priority patent/AU2019457816A1/en
Priority to CN201980099769.4A priority patent/CN114287113A/zh
Priority to EP19749120.2A priority patent/EP4000192A1/en
Publication of WO2021015716A1 publication Critical patent/WO2021015716A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/68Systems specially adapted for using specific information, e.g. geographical or meteorological information
    • H04H60/73Systems specially adapted for using specific information, e.g. geographical or meteorological information using meta-information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/38Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space
    • H04H60/41Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/49Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying locations
    • H04H60/51Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying locations of receiving stations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/76Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet
    • H04H60/81Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself
    • H04H60/82Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself the transmission system being the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H2201/00Aspects of broadcast communication
    • H04H2201/90Aspects of broadcast communication characterised by the use of signatures

Definitions

  • the technology described in this patent document relates to systems and methods for providing supplemental data (e.g., metadata) that is associated with over- the-air radio broadcast signals.
  • supplemental data e.g., metadata
  • Over-the-air radio broadcast signals are used to deliver a variety of programming content (e.g., audio, etc.) to radio receiver systems.
  • Such over-the-air radio broadcast signals can include conventional AM (amplitude modulation) and FM (frequency modulation) analog broadcast signals, digital radio broadcast signals, hybrid analog and digital broadcast signals, or other broadcast signals.
  • Hybrid radio broadcasting technology and digital radio broadcasting technology can deliver audio and data services to mobile, portable, and fixed receivers.
  • Service data that includes multimedia programming can be included with radio broadcasts.
  • the broadcast of the service data may be contracted by companies to include multimedia content associated with primary or main radio program content.
  • service data may not always be available with the radio broadcast. In this case it may be desirable to identify the audio content being broadcast, and match service data with the audio content.
  • Some current broadcast radio content information systems rely on digital "fingerprinting" of the audio content.
  • the audio fingerprinting process can consume a lot of memory of the radio receiver and the identification service for the fingerprinting can be expensive in terms of cost and in terms of resources such as memory resources and processing resources of the radio receivers.
  • an example radio system includes an intermediate communication platform that provides an interface to an Internet network, and a first server including: a port operatively coupled to the intermediate communication platform, processing circuitry, and a service application for execution by the processing circuitry.
  • the service application is configured to: receive geographic location information of a radio receiver via the intermediate communication platform, determine one or more radio broadcasts available to the radio receiver according to the geographic location information, and send metadata for the radio broadcast to the radio receiver via the intermediate communication platform, the metadata including an indication whether content of the radio broadcast is suitable for an audio fingerprinting process.
  • An example radio receiver includes radio frequency (RF) receiver circuitry, an Internet network interface, a display, processing circuitry, and a client application program that includes instructions for execution by the processing circuitry.
  • the RF circuitry is configured to receive a radio broadcast signal.
  • the client application program is configured to send geographical location information to an audio metadata service application via the Internet network interface, and receive via the Internet network interface, metadata for a radio broadcast available to the radio receiver, the metadata including an indication whether content of the radio broadcast is suitable for an audio fingerprinting process.
  • FIG. 1 is a block diagram illustrating an overview of embodiments of the radio system.
  • FIG. 2 is a block diagram of an example of a server to provide an Internet Protocol stream to radio receivers.
  • FIG. 3 is a flow diagram of an example of a method of distributing metadata to radio receivers.
  • FIG. 4 is a block diagram of portions of an exampl e of a radio receiver.
  • Over-th e-air radio broadcast signals are commonly used to deliver a variety of programming content (e.g., audio, etc.) to radio receiver systems.
  • Main program service (MPS) data and supplemental program service (SPS) data can be provided to radio broadcast receiver systems.
  • Metadata associated with the programming content can be delivered in the MPS data or SPS data via the over-the- air radio broadcast signals.
  • the metadata can be included in a sub-carrier of the main radio signal.
  • the radio broadcast can be a hybrid radio signal that may include a streamed analog broadcast and a digital audio broadcast.
  • Sub-carriers of the main channel broadcast can include digital information such as text or numeric information, and the metadata can be included in the digital information of the sub- carriers.
  • a hybrid over-the-air radio broadcast can include an analog audio broadcast, a digital audio broadcast, and other text and numeric digital information such as metadata streamed with the over-the-air broadcast.
  • the programming content may be broadcast according to the DAB standard, the digital radio management (DRM) standard, radio data system (RDS) protocol, the radio broadcast data system (RBDS) protocol, or a high definition (HD) IBOC radio protocol.
  • DAB digital radio management
  • RDS radio data system
  • RBDS radio broadcast data system
  • HD high definition
  • the metadata can include both“static” metadata and“dynamic” metadata. Static metadata changes infrequently or does not change.
  • the static metadata may include the radio station’s call sign, name, logo (e.g., higher or lower logo resolutions), slogan, station format, station genre, language, web page uniform resource locator (URL), URL for social media (e.g., Facebook, Twitter), phone number, short message service (SMS) number, SMS short code, program
  • PI identification
  • Dynamic metadata changes relatively frequently.
  • the dynamic metadata may include a song name, artist name, album name, album image, artist image (e.g., related to content currently being played on the broadcast), advertisements, enhanced advertisements (e.g., title, tag line, image, phone number, SMS number, URL, search terms), program schedules (image, timeframe, title, artist name, DJ name, phone number, URL), service following data, or other information.
  • the radio receiver system may receive both static metadata and dynamic metadata.
  • Another approach to provide service data is to combine radio information broadcast over-the-air (OTA) with Internet Protocol (IP) delivered content to provide an enhanced user experience.
  • OTA radio information broadcast over-the-air
  • IP Internet Protocol
  • An example of this type of service is DTS ® Connected Radio IM service, which combines OTA analog/digital AM/FM radio with IP delivered content.
  • the combined service receives dynamic metadata (such as artist information and song title, on-air radio program information and station contact information) directly from local radio broadcasters, which is then paired with IP-delivered content (e.g., metadata), and displayed in vehicles.
  • IP-delivered content e.g., metadata
  • the DTS Connected Radio service supports all global broadcast standards including analog, DAB, DAB+ and HD RadioTM.
  • the radio receivers of the vehicles integrate data from Internet services with broadcast audio to create a rich media experience.
  • One of the Internet services provided is information about what the radio stations are currently playing and have played.
  • service data may not always be available with a radio broadcast, and it may be desirable to send an audio fingerprint to identify the content of the over-the-air radio broadcast and receive metadata for the identified radio broadcast for presentation to the user.
  • the audio fingerprint could be transmitted from the in-vehicle radio receiver to a server that performs automatic content recognition (ACR) to identify content of the over-the-air radio broadcast.
  • ACR automatic content recognition
  • the digital fingerprinting and identification of the audio fingerprint can be expensive in terms of cost of the service and in terms of resources of the radio receiver, such as processor and memory use. These resources may be wasted if the broadcast audio being received by the radio receiver is not suitable for the ACR fingerprinting and identification process. For example, if the broadcast audio does not include music, the ACR process may fail. This may happen if the broadcast audio contains content of a talk program or a commercial. An improvement would be to verify that the broadcast audio is suitable for ACR fingerprinting and identification before the process is started.
  • FIG. 1 is a block diagram illustrating an overview of embodiments of the radio system.
  • a traditional broadcast radio station 100 transmits an OTA audio signal 105 to the radio receiver 110 of a vehicle.
  • the OTA audio signal 105 can be an analog audio signal, a digital audio signal, or a hybrid audio signal.
  • the radio service provided is a combined OTA-IP radio service, and the in-vehicle radio receiver 110 can receive both an OTA audio signal 105 and an IP stream.
  • the IP stream is received via an intermediate communication platform 108 from one or more servers 120.
  • the intermediate communication platform 108 may be a cellular phone network or a telematics network.
  • FIG. 2 is a block diagram of an example of a radio system server to provide an IP stream to radio receivers.
  • the server 220 includes a processing circuitry 272, a memory 274, and a service application 276 or application program interface (API) for execution by the processor 272.
  • the service application 276 can comprise software that operates using the operating system software of the server 220.
  • the server 220 includes a port 270 operatively coupled to an interface to the intermediate communication platform 208 that provides the IP stream and receives information from radio receivers.
  • the in- vehicle radio receiver 110 sends geographic location information to the service application of a server 120.
  • One or more of the servers determines the radio broadcasts available to the radio receiver according to the geographic location information, and the service application sends the metadata for the determined radio broadcasts to the radio receiver via the intermediate communication platform.
  • the one or more servers also sends an indication of suitability of the content of radio broadcasts for the fingerprinting process.
  • the indication can be included with the metadata (e.g., in a specified field of the metadata).
  • the indication is that the content is either suitable or not suitable for audio fingerprinting.
  • An indication of suitability is sent for each radio broadcast of those radio broadcasts determined to be available to the radio receiver.
  • the indications of suitability can be a flag or a digital code word stored in memory for radio broadcasts.
  • the indications of suitability of fingerprinting can be stored in association with the metadata for the radio broadcasts.
  • the service application determines audio metadata of a radio broadcast corresponding to the audio fingerprint and sends the determined audio metadata 125 to the radio receiver 110.
  • the service application may track the radio broadcasts being tuned to by multiple radio receivers.
  • the service application may send the audio metadata to multiple radio receivers receiving the radio broadcast.
  • the audio metadata may be sent using the intermediate communication platform 108.
  • the radio receiver 110 may do nothing or may merely send an audio fingerprint.
  • the radio receiver 110 may display the metadata (e g., static metadata) that is available.
  • the resources of the radio receiver are not wasted by generating and sending a digital fingerprint that would fail the ACR fingerprint identification process.
  • the server 120 includes a memory that may store a fingerprint database that stores the audio metadata in association with audio fingerprint information in the server memory.
  • the service application determines the audio metadata by retrieving the audio metadata from the memory using the audio fingerprint.
  • the service application receives the audio metadata from an audio identification source 150.
  • the service application of a first server 120 receives the audio fingerprint 130 from the radio receiver 110 and forwards the audio fingerprint 140 to the audio identification source 150.
  • the first server and the audio identification source may communicate using a communication network.
  • the communication network may be the intermediate communication platform 108 or another communication network.
  • the server 220 can include a second port 260 operatively coupled to an Internet network interface 215.
  • the Internet network interface 215 includes an Internet access point (e.g., a modem), and the port 260 can include (among other options) a communication (COMM) port, or a universal serial bus (USB) port.
  • COMM communication
  • USB universal serial bus
  • the audio identification source 150 is shown as residing in the cloud in FIG. 1.
  • the term“cloud” is used herein to refer to a hardware abstraction. Instead of one dedicated server processing the audio fingerprint and returning the audio metadata, sending the audio fingerprint to the cloud can include sending the audio fingerprint to a data center or processing center.
  • the actual server used to process the audio file content information is interchangeable at the data center or processing center.
  • the audio identification source 150 may include a second server that includes the fingerprint data base.
  • the audio identification source 150 receives the audio fingerprint 140 forwarded from the first server and returns the audio metadata 160 to the first server and may send other associated metadata to the first server 120.
  • the first server 120 sends the audio metadata 125 on to the radio receiver 110.
  • FIG. 3 is a flow diagram of an example of a method 300 of providing metadata to a radio receiver.
  • the method relates to a vehicle that is in contact with a radio system that combines an OTA radio broadcast with IP delivered content, such a DTS Connected Radio system for example.
  • the method may be performed using a client program of the radio receiver of the vehicle.
  • the in-vehicle radio receiver tunes to a radio station, and the radio receiver lacks dynamic metadata associated with a program currently being broadcast by the radio station.
  • the radio receiver has queried the radio service system for static radio station metadata for the radio broadcast.
  • the radio service system may include an application program interface (API) or service application executing on a server of the radio service system.
  • API application program interface
  • the radio receiver may send geographic location information with the query to the radio system, and the API sends static metadata for any radio broadcast that is available for reception by the radio receiver.
  • the API also includes in the metadata an indication for a radio broadcast whether the content of the radio broadcast is suitable for audio fingerprinting and identification.
  • the radio receiver has received an indication from the API for the radio broadcast missing the dynamic metadata that the radio broadcast is suitable for ACR fingerprinting and identification. Because of the indication, at 320 the radio receiver generates an audio fingerprint and sends the audio fingerprint to the API.
  • the ACR fingerprinting process may be performed by the client program or by other software of the radio receiver.
  • the radio receiver sends the audio fingerprint to the radio system using an Internet connection.
  • the radio system identifies the audio program corresponding to the audio fingerprint and determines the audio metadata associated with the audio program.
  • the API distributes the dynamic metadata to the radio receiver and may di stribute the dynamic metadata to other radio receivers that are receiving the radio broadcast (e.g., via the intermediate communication platform).
  • the dynamic metadata is distributed to the radio receivers that are capable of receiving the radio broadcast regardless of the radio station to which the receivers are tuned.
  • the radio receiver may store an audio fingerprint database, and before sending the audio fingerprint to the radio system, at 330 the radio receiver may first determine if it is storing the missing the dynamic metadata locally. For example, the radio receiver may store the results of previous audio fingerprinting and may check the database to see if the corresponding audio program was previously identified. If the audio fingerprint is found in the local database, the radio receiver uses the corresponding dynamic metadata for the radio broadcast. This reduces the resources consumed at the radio receiver in determining the audio metadata.
  • the radio receiver receives an indication from the API that the content of the radio broadcast is not suitable for ACR fingerprinting.
  • the client program of the radio receiver at 345 does not expend any resources of the radio receiver such as processing bandwidth, memory space, or communication time in generating and sending a digital fingerprint of the radio broadcast.
  • the radio receiver may display the metadata (e.g., static metadata) that is available.
  • FIG. 4 is a block diagram of portions of an example of a radio receiver 400.
  • the radio receiver is able to receive an OTA radio broadcast and is able to receive IP delivered content.
  • the radio receiver is a DTS Connected Radio receiver.
  • the radio receiver 400 may be the radio receiver 110 of a vehicle shown in the example of FIG. 1.
  • the radio receiver 400 includes a wireless Internet network interface 440 for receiving metadata via wireless IP and other components for receiving over-the-air radio broadcast signals.
  • the Internet network interface 440 and receiver controller 430 may be collectively referred to as a wireless internet protocol hardware communication module of the radio receiver.
  • the radio receiver 400 includes radio frequency (RF) receiver circuitry including tuner 456 that has an input 452 connected to an antenna 454.
  • the antenna 454, tuner 456, and baseband processor 451 may be collectively referred to as an over- the-air radio broadcast hardware communication module of the radio receiver.
  • the RF circuitry is configured to receive an audio broadcast signal .
  • an intermediate frequency signal 457 from the tuner 456 is provided to an analog-to-digital converter and digital down converter 458 to produce a baseband signal at output 460 comprising a series of complex signal samples.
  • the signal samples are complex in that each sample comprises a“real” component and an“imaginary” component.
  • demodulator 462 demodulates the analog modulated portion of the baseband signal to produce an analog audio signal on line 464.
  • the digitally modulated portion of the sampled baseband signal is filtered by isolation filter 466, which has a pass-band frequency response comprising the collective set of sub carriers fi-f n present in the received OFDM signal.
  • First adjacent canceller (FAC) 468 suppresses the effects of a first-adjacent interferer.
  • Complex signal 469 is routed to the input of acquisition module 470, which acquires or recovers OFDM symbol timing off set/ error and carrier frequency offset/error from the received OFDM symbols as represented in received complex signal 469.
  • Acquisition module 470 develops a symbol timing offset At and carrier frequency offset Af, as well as status and control information.
  • the signal is then demodulated (block 472) to demodulate the digitally modulated portion of the baseband signal.
  • the digital signal is de-interleaved by a de-interleaver 474, and decoded by a Viterbi decoder 476.
  • a service de-multiplexer 478 separates main and supplemental program signals from data signals.
  • the supplemental program signals may include a digital audio file received in an IBOC DAB radio broadcast signal .
  • An audio processor 480 processes received signals to produce an audio signal on line 482 and MPSD/SPSD 481. In embodiments, analog and main digital audio signals are blended as shown in block 484, or the supplemental program signal is passed through, to produce an audio output on line 486.
  • a data processor 488 processes received data signals and produces data output signals on lines 490, 492, and 494.
  • the data lines 490, 492, and 494 may be multiplexed together onto a suitable bus such as an I 2 C, SPI, UART, or USB.
  • the data signals can include, for example, data representing the metadata to be rendered at the radio receiver.
  • the Internet network interface 440 may be managed by the receiver controller 430. As illustrated in FIG. 4, the Internet network interface 440 and the receiver controller 430 are operatively coupled via a line 442, and data transmitted between the Internet network interface 440 and the receiver controller 430 is sent over this line 442.
  • a selector 420 may connect to receiver controller 430 via line 436 to select specific data received from the Internet network interface 440.
  • the data may include metadata (e.g., text, images, video, etc.), and may be rendered at substantially the same time that primary or supplemental programming content received over-the- air in the IBOC DAB radio signal is rendered.
  • the receiver controller 430 receives and processes the data signals.
  • the receiver controller 430 may include a microcontroller that is operatively coupled to the user interface 432 and memory 434.
  • the microcontroller may be an 8-bit RISC microprocessor, an advanced RISC machine 32-bit microprocessor, or any other suitable microprocessor or microcontroller. Additionally, a portion or all of the functions of the receiver controller 430 could be performed in a baseband processor (e.g., the audio processor 480 and/or data processor 488).
  • the user interface 432 may include an input/output (I/O) processor that controls the display 444, which may be any suitable visual display such as an LCD or LED display.
  • I/O input/output
  • the user interface 432 may also control user input components via a touch-screen display. In certain embodiments, the user interface 432 may also control user input from a keyboard, dials, knobs or other suitable inputs.
  • the memory 434 may include any suitable data storage medium such as RAM, Flash ROM (e.g., an SD memory card), and/or a hard disk drive.
  • the radio receiver 400 may also include a global positioning system (GPS) receiver 496 to receive GPS coordinates.
  • GPS global positioning system
  • the processing circuitry of the receiver controller 430 is configured to perform instructions included in a client application program or“client” installed in the radio receiver.
  • the client 446 is able to generate an audio fingerprint from audio broadcasts received via the RF receiver circuitry.
  • the client 446 also sends geographical location information to an audio metadata service application via the Internet network interface 440.
  • the radio receiver may include a GPS receiver 496 and the client may send GPS coordinates as the geographical location information.
  • the client 446 receives metadata for any radio broadcast that is available to the radio receiver at its indicated geographic location. Included in this metadata is an indication for each radio broadcast whether the content of the radio broadcast is suitable for the ACR fingerprinting and identification process.
  • the client when audio metadata is missing or unavailable for the current radio broadcast to which the radio receiver is tuned, the client generates an audio fingerprint of the radio broadcast when the indication for that radio broadcast is that its content is suitable for the audio fingerprinting process.
  • the client 446 sends the generated audio fingerprint to the audio metadata service application via the Internet network interface.
  • the audio fingerprint is processed by the service application, and the client 446 receives dynamic metadata associated with the radio broadcast corresponding to the audio fingerprint.
  • the dynamic metadata may be received via the Internet network.
  • the dynamic metadata is received via one or more sub-carriers of the main channel OTA broadcast.
  • the client 446 displays the information included in the received dynamic metadata.
  • the client 446 does not generate the audio fingerprint.
  • the client 446 may do nothing in response to the missing audio metadata or may display the metadata that is available (e.g., static metadata instead of dynamic metadata).
  • the systems, devices, and methods described provide metadata to a radio receiver of a vehicle.
  • the radio receiver is able to perform audio fingerprinting, but the systems, devices, and methods prevent the radio receiver from performing the audio fingerprinting and requesting identification for the audio fingerprint when the content of a radio broadcast is not suitable for the fingerprinting and identification process. This saves significant computing resources and communication bandwidth of the radio receiver.
  • Example 1 includes subject matter (such as a system to provide audio metadata to a radio receiver) comprising an intermediate communication platform that provides an interface to an Internet network, and a first server.
  • the first server includes a port operatively coupled to the intermediate communication platform, processing circuitry, and a service application for execution by the processor.
  • the service application is configured to: receive geographic location information of a radio receiver via the intermediate communication platform; determine one or more radio broadcasts available to the radio receiver according to the geographic location information; and send metadata for the radio broadcast to the radio receiver via the intermediate communication platform.
  • the metadata includes an indication whether content of the radio broadcast is suitable for an audio fingerprinting process.
  • Example 2 the subject matter of Example 1 optionally includes a server configured to store indications of suitability of the audio fingerprinting process for multiple radio broadcasts in association with metadata for the multiple radio broadcasts, and a service application configured to determine all radio broadcasts available to the radio receiver according to the geographic location information; and send the metadata for the determined radio broadcasts, including the indications of suitability of the audio fingerprinting process for the determined radio broadcasts, in response to receiving the geographic location information.
  • a server configured to store indications of suitability of the audio fingerprinting process for multiple radio broadcasts in association with metadata for the multiple radio broadcasts
  • a service application configured to determine all radio broadcasts available to the radio receiver according to the geographic location information; and send the metadata for the determined radio broadcasts, including the indications of suitability of the audio fingerprinting process for the determined radio broadcasts, in response to receiving the geographic location information.
  • Example 3 the subject matter of one or both Examples 1 and 2 optionally includes a service application configured to: receive an audio fingerprint from the radio receiver via the intermediate communication platform; determine audio metadata of a radio broadcast corresponding to the audio fingerprint; and send the determined audio metadata to the radio receiver.
  • a service application configured to: receive an audio fingerprint from the radio receiver via the intermediate communication platform; determine audio metadata of a radio broadcast corresponding to the audio fingerprint; and send the determined audio metadata to the radio receiver.
  • Example 4 the subject matter of one or any combination of Examples 1-3 optionally includes a service application configured to send the determined audio metadata to multiple radio receivers via the intermediate communication platform.
  • Example 5 the subject matter of one or any combination of Examples 1-4 optionally includes a server including a memory configured to store the audio metadata in association with audio fingerprint information, and the service application is configured to determine the audio metadata by retrieving the audio metadata from the memory using the audio fingerprint.
  • Example 6 the subject matter of one or any combination of Examples 1-4 optionally includes a second server configured to store the audio metadata; and a communication network operatively coupled to the first and second servers.
  • the service application of the first server is configured to determine the audio metadata by forwarding the audio fingerprint to the second server via the communication network and receive the audio metadata from the second server.
  • Example 7 the subject matter of one or any combination of Examples 1-6 optionally includes a service application configured to send the indication whether content of the radio broadcast is suitable for an audio fingerprinting process with static metadata, receive an audio fingerprint from the radio receiver via the intermediate communication platform, determine dynamic metadata of a radio broadcast corresponding to the audio fingerprint, and send the determined dynamic metadata to the radio receiver via the intermediate communication platform.
  • a service application configured to send the indication whether content of the radio broadcast is suitable for an audio fingerprinting process with static metadata, receive an audio fingerprint from the radio receiver via the intermediate communication platform, determine dynamic metadata of a radio broadcast corresponding to the audio fingerprint, and send the determined dynamic metadata to the radio receiver via the intermediate communication platform.
  • Example 8 the subject matter of one or any combination of Examples 1-7 optionally includes the intermediate communication platform being a cellular phone network,
  • Example 9 the subject matter of one or any combination of Examples 1-7 optionally includes the intermediate communication platform being a telematics network.
  • Example 10 can include subject matter (such as a radio receiver) or can optionally be combined with one or any combination of Examples 1-9 to include such subject matter, comprising radio frequency (RF) receiver circuitry configured to receive a radio broadcast signal, an Internet network interface, a display, processing circuitry, and a client application program including instructions for execution by the processing circuitry.
  • RF radio frequency
  • Example 11 the subject matter of Example 10 optionally includes a client application program configured to determine that dynamic metadata associated with the radio broadcast is unavailable for presentation using the display, generate an audio fingerprint of the radio broadcast when the indication is that the content of the radio broadcast is suitable for the audio fingerprinting process, send the audio fingerprint to the audio metadata service application via the Internet network interface, receive dynamic metadata associated with a radio broadcast corresponding to the audio fingerprint, and display information included in the dynamic metadata.
  • a client application program configured to determine that dynamic metadata associated with the radio broadcast is unavailable for presentation using the display, generate an audio fingerprint of the radio broadcast when the indication is that the content of the radio broadcast is suitable for the audio fingerprinting process, send the audio fingerprint to the audio metadata service application via the Internet network interface, receive dynamic metadata associated with a radio broadcast corresponding to the audio fingerprint, and display information included in the dynamic metadata.
  • Example 12 the subject matter or one or both of Examples 10 and 11 optionally includes a memory and a client application program configured to determine that dynamic metadata associated with the radio broadcast is unavailable for presentation using the display, generate an audio fingerprint of the radio broadcast when the indication is that the content of the radio broadcast is suitable for the audio fingerprinting process, identify metadata stored in the memory using the generated audio fingerprint, and display information included in the identified metadata.
  • Example 13 the subject matter of one or any combination of
  • Examples 10-12 optionally includes a client application program configured to determine that metadata associated with the radio broadcast is unavailable for presentation using the display, and not generate an audio fingerprint of the radio broadcast when the indication is that content of the radio broadcast signal is not suitable for the audio fingerprinting process.
  • Example 14 the subject matter of one or any combination of
  • Examples 10-13 optionally includes a client application program configured to receive, via the Internet network interface, metadata for all radio broadcasts available to the radio receiver for the geographical location information; and receive an indication for each available radio broadcast whether content of the radio broadcast is suitable for the audio fingerprinting process.
  • a client application program configured to receive, via the Internet network interface, metadata for all radio broadcasts available to the radio receiver for the geographical location information; and receive an indication for each available radio broadcast whether content of the radio broadcast is suitable for the audio fingerprinting process.
  • Example 15 the subject matter of one or any combination of
  • Examples 10-14 optionally includes an Internet network interface that is a cellular phone network.
  • Example 16 the subject matter of one or any combination of
  • Examples 10-14 optionally includes an Internet network interface that is a telematics network.
  • Example 17 can include subject matter, or can optionally be combined with one or any combination of Examples 1-16 to include such subject matter, such as a computer readable storage medium including instructions that, when performed by processing circuitry of a server, cause the processing circuitry to perform acts comprising: receiving geographic location information of a radio receiver via an intermediate communication platform that provides an interface to an Internet network; determining a radio broadcast available to the radio receiver according to the geographic location information; and sending metadata for the radio broadcast to the radio receiver via the intermediate communication platform, the metadata including an indication whether content of the radio broadcast is suitable for an audio
  • Example 18 the subject matter of Example 17 optionally includes a computer readable storage medium including instructions that cause the processing circuitry to perform acts comprising: determining all radio broadcasts available to the radio receiver according to the geographic location information; and sending the metadata for the determined radio broadcasts, including the indications of suitability of the audio fingerprinting process for the determined radio broadcasts, in response to receiving the geographic location information.
  • Example 19 the subject matter of one or both of Examples 17 and 18 optionally includes a computer readable storage medium including instructions that cause the processing circuitry to perform acts comprising: receiving an audio fingerprint from the radio receiver, determining audio metadata of a radio broadcast corresponding to the audio fingerprint, and sending the determined audio metadata to the radio receiver.
  • Example 20 the subject matter of one or any combination of
  • Examples 17-19 optionally includes a computer readable storage medium including instructions that cause the processing circuitry to perform acts comprising: sending the audio metadata determined according to the audio fingerprint received from the radio receiver to multiple other radio receivers via the intermediate communication platform.
  • a machine such as a general purpose processor, a processing device, a computing device having one or more processing devices, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • a general purpose processor and processing device can be a microprocessor, but in the alternative, the processor can be a controller,
  • a processor can also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such
  • Embodiments of the targeted fingerprinting radio system and method described herein are operational within numerous types of general purpose or speci al purpose computing system environments or configurations.
  • a computing environment can include any type of computer system, including, but not limited to, a computer system based on one or more microprocessors, a mainframe computer, a digital signal processor, a portable computing device, a personal organizer, a device controller, a computational engine within an appliance, a mobile phone, a desktop computer, a mobile computer, a tablet computer, a smartphone, and appliances with an embedded computer, to name a few.
  • Such computing devices can be typically be found in devices having at least some minimum computational capability, including, but not limited to, personal computers, server computers, hand-held computing devices, laptop or mobile computers, communications devices such as cell phones and PDA's, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, audio or video media players, and so forth.
  • the computing devices will include one or more processors.
  • Each processor may be a specialized microprocessor, such as a digital signal processor (DSP), a very long instruction word (VLIW), or other micro controller, or can be conventional central processing units (CPUs) having one or more processing cores, including specialized graphics processing unit (GPU)-based cores in a multi-core CPU.
  • DSP digital signal processor
  • VLIW very long instruction word
  • CPUs central processing units
  • GPU graphics processing unit
  • the process actions or operations of a method, process, or algorithm described in connection with the embodiments disclosed herein can be embodied directly in hardware, in a software module executed by a processor, or in any combination of the two.
  • the software module can be contained in computer-readable media that can be accessed by a computing device.
  • the computer-readabl e media includes both volatile and nonvolatile media that is either removable, non-removable, or some combination thereof.
  • the computer-readable media is used to store information such as computer-readable or computer-executable instructions, data structures, program modules, or other data.
  • computer readable media may comprise computer storage media and communication media.
  • Computer storage media includes, but is not limited to, computer or machine readable media or storage devices such as Blu-ray discs (BD), digital versatile discs (DVDs), compact discs (CDs), floppy disks, tape drives, hard drives, optical drives, solid state memory devices, RAM memory, ROM memory, EPROM memory, EEPROM memory, flash memory or other memory technology, magnetic cassettes, magnetic tapes, magnetic disk storage, or other magnetic storage devices, or any other device which can be used to store the desired information and which can be accessed by one or more computing devices.
  • BD Blu-ray discs
  • DVDs digital versatile discs
  • CDs compact discs
  • CDs compact discs
  • floppy disks tape drives
  • hard drives optical drives
  • solid state memory devices random access memory
  • RAM memory random access memory
  • ROM memory read only memory
  • EPROM memory erasable programmable read-only memory
  • EEPROM memory electrically erasable programmable read-only memory
  • flash memory or other memory technology
  • magnetic cassettes magnetic tapes
  • a software module can reside in the RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of non-transitory computer-readable storage medium, media, or physical computer storage known in the art.
  • An exemplary storage medium can be coupled to the processor such that the processor can read information from, and write information to, the storage medium.
  • the storage medium can be integral to the processor.
  • the processor and the storage medium can reside in an application specific integrated circuit (ASIC).
  • the ASIC can reside in a user terminal.
  • the processor and the storage medium can reside as discrete components in a user terminal.
  • non-transitory as used in this document means “enduring or long-lived”.
  • non-transitory computer-readabl e media includes any and all computer-readable media, with the sole exception of a transitory, propagating signal. This includes, by way of example and not limitation, non-transitory computer- readable media such as register memory, processor cache and random-access memory (RAM).
  • audio signal is a signal that is representative of a physical sound.
  • Retention of information such as computer-readabl e or computer- executable instructions, data structures, program modules, and so forth, can also be accomplished by using a variety of the communication media to encode one or more modulated data signals, electromagnetic waves (such as carrier waves), or other transport mechanisms or communications protocols, and includes any wired or wireless information delivery mechanism.
  • these communication media refer to a signal that has one or more of its characteristics set or changed in such a manner as to encode information or instructions in the signal.
  • communication media includes wired media such as a wired network or direct-wired connection carrying one or more modulated data signals, and wireless media such as acoustic, radio frequency (RF), infrared, laser, and other wireless media for transmitting, receiving, or both, one or more modulated data signals or
  • wired media such as a wired network or direct-wired connection carrying one or more modulated data signals
  • wireless media such as acoustic, radio frequency (RF), infrared, laser, and other wireless media for transmitting, receiving, or both, one or more modulated data signals or
  • RF radio frequency
  • one or any combination of software, programs, computer program products that embody some or all of the various embodiments of the in- vehicle live guide generation system and method described herein, or portions thereof, may be stored, received, transmitted, or read from any desired combination of computer or machine readable media or storage devices and communication media in the form of computer executable instructions or other data structures.
  • Embodiments of the in-vehicle live guide generation system and method described herein may be further described in the general context of computer- executable instructions, such as program modules, being executed by a computing device.
  • program modules include routines, programs, obj ects, components, data structures, and so forth, which perform particular tasks or implement particular abstract data types.
  • the embodiments described herein may also be practiced in distributed computing environments where tasks are performed by one or more remote processing devices, or within a cloud of one or more devices, that are linked through one or more communications networks.
  • program modules may be located in both local and remote computer storage media including media storage devices.
  • the aforementioned instructions may be implemented, in part or in whole, as hardware logic circuits, which may or may not include a processor.
  • Conditional language used herein such as, among others, “can,” “might,” “may,” “e.g.,” and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or states. Thus, such conditional language is not generally intended to imply that features, elements and/or states are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without author input or prompting, whether these features, elements and/or states are included or are to be performed in any particular embodiment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Circuits Of Receivers In General (AREA)
PCT/US2019/042619 2019-07-19 2019-07-19 Targeted fingerprinting of radio broadcast audio WO2021015716A1 (en)

Priority Applications (8)

Application Number Priority Date Filing Date Title
CA3147864A CA3147864A1 (en) 2019-07-19 2019-07-19 Targeted fingerprinting of radio broadcast audio
JP2022503845A JP7381712B2 (ja) 2019-07-19 2019-07-19 対象を定めたラジオ放送音声用フィンガープリント
KR1020227005457A KR102656973B1 (ko) 2019-07-19 2019-07-19 라디오 방송 오디오의 타겟식 핑거프린팅
MX2022000751A MX2022000751A (es) 2019-07-19 2019-07-19 Impresion digital dirigida de audio por difusion radial.
PCT/US2019/042619 WO2021015716A1 (en) 2019-07-19 2019-07-19 Targeted fingerprinting of radio broadcast audio
AU2019457816A AU2019457816A1 (en) 2019-07-19 2019-07-19 Targeted fingerprinting of radio broadcast audio
CN201980099769.4A CN114287113A (zh) 2019-07-19 2019-07-19 无线电广播音频的针对性的指纹处理
EP19749120.2A EP4000192A1 (en) 2019-07-19 2019-07-19 Targeted fingerprinting of radio broadcast audio

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2019/042619 WO2021015716A1 (en) 2019-07-19 2019-07-19 Targeted fingerprinting of radio broadcast audio

Publications (1)

Publication Number Publication Date
WO2021015716A1 true WO2021015716A1 (en) 2021-01-28

Family

ID=67515193

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/042619 WO2021015716A1 (en) 2019-07-19 2019-07-19 Targeted fingerprinting of radio broadcast audio

Country Status (8)

Country Link
EP (1) EP4000192A1 (ja)
JP (1) JP7381712B2 (ja)
KR (1) KR102656973B1 (ja)
CN (1) CN114287113A (ja)
AU (1) AU2019457816A1 (ja)
CA (1) CA3147864A1 (ja)
MX (1) MX2022000751A (ja)
WO (1) WO2021015716A1 (ja)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220094457A1 (en) * 2020-09-19 2022-03-24 Ibiquity Digital Corporation Content Linking Multicast Streaming for Broadcast Radio
US12009909B2 (en) * 2021-09-17 2024-06-11 Ibiquity Digital Corporation Content linking multicast streaming for broadcast radio

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005073875A1 (fr) * 2004-01-16 2005-08-11 Musiwave Sa Systeme et procede de reconnaissance de sequence sonore
EP2070231A1 (en) * 2006-10-03 2009-06-17 Shazam Entertainment, Ltd. Method for high throughput of identification of distributed broadcast content
US20190052387A1 (en) * 2017-08-08 2019-02-14 Ibiquity Digital Corporation Acr-based radio metadata in the cloud

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4575518B1 (ja) 2009-10-30 2010-11-04 Jvc・ケンウッド・ホールディングス株式会社 情報配信管理装置、情報配信管理方法、情報配信管理プログラム、および情報配信システム
JP5859245B2 (ja) 2011-08-11 2016-02-10 株式会社ビデオリサーチ 情報表示システム及び方法、調査システム及び方法
JP5948773B2 (ja) 2011-09-22 2016-07-06 ソニー株式会社 受信装置、受信方法、プログラム、及び情報処理システム
EP3117626A4 (en) 2014-03-13 2017-10-25 Verance Corporation Interactive content acquisition using embedded codes
WO2017184963A1 (en) * 2016-04-22 2017-10-26 Robert Michael Dillon Over-the-air radio broadcast signal metadata

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005073875A1 (fr) * 2004-01-16 2005-08-11 Musiwave Sa Systeme et procede de reconnaissance de sequence sonore
EP2070231A1 (en) * 2006-10-03 2009-06-17 Shazam Entertainment, Ltd. Method for high throughput of identification of distributed broadcast content
US20190052387A1 (en) * 2017-08-08 2019-02-14 Ibiquity Digital Corporation Acr-based radio metadata in the cloud

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220094457A1 (en) * 2020-09-19 2022-03-24 Ibiquity Digital Corporation Content Linking Multicast Streaming for Broadcast Radio
US12009909B2 (en) * 2021-09-17 2024-06-11 Ibiquity Digital Corporation Content linking multicast streaming for broadcast radio

Also Published As

Publication number Publication date
JP7381712B2 (ja) 2023-11-15
CN114287113A (zh) 2022-04-05
JP2022547385A (ja) 2022-11-14
AU2019457816A1 (en) 2022-03-03
KR20220035474A (ko) 2022-03-22
MX2022000751A (es) 2022-03-25
EP4000192A1 (en) 2022-05-25
CA3147864A1 (en) 2021-01-28
KR102656973B1 (ko) 2024-04-11

Similar Documents

Publication Publication Date Title
JP7068187B2 (ja) 無線ラジオ放送信号メタデータ
US8498272B2 (en) Providing signaling information and performing a handover using the signaling information
US11245482B2 (en) ACR-based radio metadata in the cloud
US10924197B2 (en) Advertising measurement and conversion measurement for radio systems
US10868621B1 (en) Connected Radio local, isolated, and hybrid implementation
US10826634B2 (en) System and method for in-vehicle live guide generation
US11817941B2 (en) Targeted fingerprinting of radio broadcast audio
KR102656973B1 (ko) 라디오 방송 오디오의 타겟식 핑거프린팅
JP7490763B2 (ja) コネクテッドラジオの、ローカルな、分離した、およびハイブリッドな実施

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19749120

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3147864

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2022503845

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20227005457

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2019749120

Country of ref document: EP

Effective date: 20220221

ENP Entry into the national phase

Ref document number: 2019457816

Country of ref document: AU

Date of ref document: 20190719

Kind code of ref document: A