EP2928094B1 - Receiving apparatus and method of providing information associated with received broadcast signals - Google Patents

Receiving apparatus and method of providing information associated with received broadcast signals Download PDF

Info

Publication number
EP2928094B1
EP2928094B1 EP14163387.5A EP14163387A EP2928094B1 EP 2928094 B1 EP2928094 B1 EP 2928094B1 EP 14163387 A EP14163387 A EP 14163387A EP 2928094 B1 EP2928094 B1 EP 2928094B1
Authority
EP
European Patent Office
Prior art keywords
data
broadcast
audio content
music
items
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14163387.5A
Other languages
German (de)
French (fr)
Other versions
EP2928094A1 (en
Inventor
Andreas Galos
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alpine Electronics Inc
Original Assignee
Alpine Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alpine Electronics Inc filed Critical Alpine Electronics Inc
Priority to EP14163387.5A priority Critical patent/EP2928094B1/en
Publication of EP2928094A1 publication Critical patent/EP2928094A1/en
Application granted granted Critical
Publication of EP2928094B1 publication Critical patent/EP2928094B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/58Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of audio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/37Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
    • H04H60/372Programme
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/38Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space
    • H04H60/41Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas
    • H04H60/43Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas for identifying broadcast channels
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/38Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space
    • H04H60/41Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas
    • H04H60/44Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas for identifying broadcast stations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/47Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for recognising genres
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/61Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/65Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 for using the result on users' side
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H2201/00Aspects of broadcast communication
    • H04H2201/10Aspects of broadcast communication characterised by the type of broadcast system
    • H04H2201/13Aspects of broadcast communication characterised by the type of broadcast system radio data system/radio broadcast data system [RDS/RBDS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H2201/00Aspects of broadcast communication
    • H04H2201/60Aspects of broadcast communication characterised in that the receiver comprises more than one tuner

Definitions

  • the present invention is related to a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, and to a method of providing information associated with received broadcast signals.
  • a broadcast signal it is relatively common for a broadcast signal to include both an audio signal (either stereo or monophonic) and a RDS signal, where the RDS signal contains information such as the broadcast station name, program type, music information, artist information, and traffic information.
  • These multiplexed broadcast signals are often transmitted from a base or broadcast station to individual receivers via frequency modulation (“FM"), where information is conveyed through variations of the frequency of the transmitted signal, or via amplitude modulation (“AM”), where information is conveyed through variations of the amplitude of the transmitted signal.
  • FM frequency modulation
  • AM amplitude modulation
  • a broadcast signal When a broadcast signal is received by a receiving device, it is typically demodulated by a demodulator circuit and passed to both audio circuitry and RDS receiver circuitry included in the receiving device.
  • the audio circuitry can extract the audio portion of the signal (e.g., music or speech) and prepare it for playback through a speaker or other output device.
  • the RDS receiver circuitry can extract the RDS portion of the signal and prepare it for processing by appropriate data processing circuitry.
  • the data processing circuitry can display part or all of the extracted data to the user as text on a suitable user interface. For example, via the RDS portion a broadcast station can transmit content description for its broadcast station, such as announcing music type (like "pop music” or "classical music” or "talk”). It can also transmit some detailed description via radio text.
  • RDS data is often too general. For example, it is not providing enough information for a user to actually undestand the difference between several broadcast stations. For instance, many broadcast stations are labelling themselves as "pop music", wherein any further distinction is not available and cannot be determined from the RDS data. Moreover, RDS data is often inaccurate, because the content is often provided by the broadcast station for its own advertisement. Furthermore, content information support technologies are limited to specific broadcasting methods, e.g. RDS is only for FM broadcast stations, not on AM. These drawbacks are even more present in an automotive environment, such as in a vehicle where the driver has typically only limited time and attention available for searching for appropriate broadcast stations the driver likes to listen to without compromising driving safety.
  • JP 2001-186429 A discloses a digital broadcast receiver that stores information denoting a broadcast schedule of programs having been acquired before without discarding the information and effectively utilizes the past information for future program retrieval.
  • a storage section stores received information denoting broadcast schedules of past programs whose broadcast is finished without discarding the information. Then the past program is retrieved from information denoting the broadcast schedule of the past program whose broadcast has already been finished, the information denoting the broadcast schedule of the past program can effectively be utilized for the retrieval of a future program in the case of retrieving a program belonging to the same title or the series as that of the retrieved past program from the information denoting the broadcast schedule of a future program going to be broadcast from now.
  • JP 2006-190027 A discloses an information processing device which is configured to show music data by a music recognition means on a display in real time when the music data are included in a content of TV broadcasting and the like.
  • a music data display system extracts information on a characteristic quantity by a characteristic quantity information extracting device from the music information included in a content of TV broadcasting and the like received by a tuner, and transmits the information on a characteristic quantity to a server through the Internet.
  • the server recognizes the music by carrying out the matching of the information on a characteristic quantity and the music data included in a music information database, and transmits information on a music title, information on an artist, and the like corresponding to the music to the characteristic quantity information extracting device as the recognition result.
  • the recognition result received by the characteristic quantity information extracting device is associated with the content including the original music information and recorded in a storage device.
  • the content recorded in the storage device is reproduced, the music is outputted from a speaker, and, at the same time, the recognition result is shown on a display.
  • Further similar content analysing systems are disclosed in the publications EP 2 541 813 A1 US 2012/129476 A1 US 2013/318114 A1 and US 2010/291861 A1 . It is an object of the present invention to provide a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals which is capable of reducing the drawbacks described above with respect to limited capabilities of RDS information and which can improve user operability of such receiving apparatus.
  • the present invention is related to a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals according to the independent claims.
  • a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, a recognition device configured to be coupled with an audio content analysis system and configured to perform an audio content recognition process together with the audio content analysis system, wherein the audio content recognition process is configured to capture audio signal samples transmitted with the broadcast signals repeatedly over time, to analyze the captured audio signal samples, and to provide analyzing data indicative of audio content of the analyzed audio signal samples, the recognition device further configured to extract multiple items of data from the analyzing data over time, a memory adapted to store therein a database containing multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, an analyzing device which is configured to analyze a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and to provide an analyzing result for the at least one broadcast station associated with the analyzed items of data, and an information providing device which is configured to provide information to a user based on the analyzing result for the at least
  • a method of providing information associated with broadcast signals comprising receiving broadcast signals with a receiving device, for example in a vehicle, performing an audio content recognition process which captures audio signal samples transmitted with the broadcast signals repeatedly over time, analyzes the captured audio signal samples, and provides analyzing data indicative of audio content of the analyzed audio signal samples, extracting multiple items of data from the analyzing data over time, storing in a database multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, analyzing a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and providing an analyzing result for the at least one broadcast station associated with the analyzed items of data, and providing information to a user based on the analyzing result for the at least one broadcast station associated with the analyzed items of data.
  • the invention also relates to a vehicle comprising a receiving apparatus according to the invention.
  • a vehicle comprising a receiving apparatus according to the invention.
  • the analyzing result provided by the analyzing device for one or more of the broadcast stations, which may be provided to the user, is a result of a real analysis, not of a broadcast station's own information and/or advertisement.
  • a broadcast station may submit an information like "non-stop best hits" over the RDS portion of the broadcast signals, however a real analysis would show that in fact only some music content is broadcasted by that broadcast station, wherein in fact the station broadcasts a lot of talk in between, contrary to its transmitted RDS information "non-stop best hits".
  • the invention provides the advantage that the typical or average actual content information for each received broadcast station may be communicated to the user, not only the information of, e.g., an individual song which is currently played by a broadcast station, the broadcast signals of which are currently received. The user can then easily select which broadcast station is actually matching his taste or mood for listening because of the provided typical or average actual content information about that broadcast station.
  • the recognition device is configured to perform the audio content recognition process with the audio content analysis system as a permanent background process when receiving the broadcast signals.
  • the recognition device is configured to perform the audio content recognition process with the audio content analysis system for a plurality of broadcast stations, particularly for each available broadcast station.
  • the receiving device comprises a multiple tuner configuration and the recognition device is configured to perform the audio content recognition process using one of the multiple tuners which is not used for current content reproduction.
  • the recognition device is configured to extract at least one of the following items of data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
  • the multiple items of data stored in the database each include at least one of the following: transmission frequency of broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
  • the recognition device is configured to be coupled with the audio content analysis system which is remote from the receiving apparatus.
  • the recognition device is configured to be coupled with the audio content analysis system through a network connection, particularly through the Internet and/or a telecommunications network.
  • an audio content analysis system there may be used a server provider system, as e.g. described in JP 2006-190027 A mentioned above, which recognizes the music contained in the captured audio signal samples by analyzing (e.g. matching) of the captured audio signal samples and any music data included in a music information database, the server provider system has access to.
  • a server provider system as e.g. described in JP 2006-190027 A mentioned above, which recognizes the music contained in the captured audio signal samples by analyzing (e.g. matching) of the captured audio signal samples and any music data included in a music information database, the server provider system has access to.
  • music analysis service systems available to be used as an audio content analysis system in connection with the present invention, such as the known "SHAZAM” music analysis service or similar.
  • Such music analysis service systems can, e.g., identify songs based on short audio signal samples and internet databases.
  • the "SHAZAM” music analysis service is providing detailed information about the content, but it does not track the content history and it does not link the content to an audio source. Therefore, from this music analysis service alone, the user cannot understand which source (e.g. broadcast station) is playing his favourite type of music.
  • the recognition device is configured to capture the audio signal samples transmitted with the broadcast signals repeatedly over time and to send the captured audio signal samples to the audio content analysis system, whereas the audio content analysis system (such as "SHAZAM") is capable of analyzing the captured audio signal samples and providing the analyzing data indicative of audio content of the analyzed audio signal samples back to the recognition device.
  • the recognition device receives the analyzing data indicative of audio content of the analyzed audio signal samples from the audio content analysis system.
  • the receiving device is adapted to receive analyzing data indicative of analyzed audio content information associated with at least one broadcast station from a remote provider for storing in the database.
  • any information which is normally produced by the recognition device and the analyzing device can also be received from a remote provider, so that the database stored in the memory may be supplemented by the analyzing data from the remote provider.
  • the analyzing device is configured to analyze the multiple items of data stored in the database by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.
  • An embodiment according to the invention may additionally comprise storing information in the database which contains or is derived from RDS information transmitted with the broadcast signals.
  • the contents of the database and the analyzing results can be supplemented by RDS information associated with the respective broadcast station.
  • the receiving apparatus according to the invention is an automotive receiving apparatus.
  • Fig. 1 shows a receiving apparatus for receiving broadcast signals according to an exemplary embodiment of the invention in a schematic block diagram.
  • the receiving apparatus 1 is an automotive receiving apparatus, which may be installed in a vehicle, e.g., in a head unit thereof (not shown), receives broadcast signals BS which are broadcast from an exemplary broadcast station 2.
  • the receiving apparatus 1 comprises a receiving device 20 which may be a conventional receiving device as known in the art.
  • the exemplary receiving device 20 (another type thereof can also be used, e.g.
  • the demodulator 21 can demodulate the received broadcast signal BS by a frequency determined by the station or frequency that is being tuned to.
  • the demodulator 21 can be analog, digital, or a combination of the two.
  • the output signal of demodulator 21 can be received by audio circuitry 22, which can extract and decode the audio portion As of the received signal and send it to a speaker circuitry.
  • the output signal of demodulator 21 can also be received by RDS receiver circuitry 23 which can extract and decode the RDS portion Rx of the received signal and send it to any appropriate output circuitry.
  • the extracted RDS data may be displayed to a user via any suitable display circuitry, or may be processed according to embodiments of the invention.
  • the apparatus 1 further comprises a recognition device 30 which is coupled with the receiving device 20 and, in this embodiment, receives the audio portions As output by the receiving device 20 (particularly output by the audio circuitry 22). Further, in this embodiment, it receives the RDS portions Rx output by the receiving device 20 (particularly output by the RDS receiver circuitry 23).
  • a recognition device 30 which is coupled with the receiving device 20 and, in this embodiment, receives the audio portions As output by the receiving device 20 (particularly output by the audio circuitry 22). Further, in this embodiment, it receives the RDS portions Rx output by the receiving device 20 (particularly output by the RDS receiver circuitry 23).
  • the receiving device 20 comprises a multiple tuner configuration (not explicitly shown), which is known in the art, and the recognition device 30 is configured to perform an audio content recognition process, as described herein below, using one of the multiple tuners which is not used for current content reproduction.
  • the recognition device 30 is configured to be coupled with an audio content analysis system 40 (which may be remote from the automotive receiving apparatus 1, such as "SHAZAM” described above provided by a server computer, or may be installed in the vehicle, thus is “on-board”).
  • the recognition device 30 is coupled with the audio content analysis system 40 directly or via a network 80, such as the Internet and/or any other telecommunications network and/or a vehicle communications network bus, like the CAN-bus.
  • the receiving apparatus 1, which may be installed in a vehicle may use any known wired or wireless technology for communication with the audio content analysis system 40 either directly or over the network 80.
  • the audio content analysis system 40 may also be implemented in the vehicle, e.g. in a portion of a head unit with appropriate memory capabilities, or may be a distributed system with parts thereof installed in the vehicle and other parts thereof provided on a remote server computer and accessible via the network 80.
  • the recognition device 30 may be implemented in the vehicle, e.g., by comprising one or more microprocessors, for example installed in the head unit (not shown), wherein the one or more microprocessors have access to a database stored in a memory (e.g., located in the vehicle or on a remote server computer) which are part of or form the audio content analysis system 40.
  • the recognition device 30 and the audio content analysis system 40 may both comprise respective one or more microprocessors, e.g. the recognition device 30 comprising a microprocessor installed in the vehicle and the audio content analysis system 40 comprising a microprocessor installed in a remote server computer, which microprocessors communicate with each other, e.g. over the network 80.
  • a microprocessor of the recognition device 30 provides commands and/or data to the audio content analysis system 40 (e.g. a database or a server computer) when performing the audio content recognition process, and receives data and/or commands therefrom.
  • the audio content analysis system 40 e.g. a microprocessor thereof
  • the recognition device 30 which is configured to receive such commands and/or data for performing the audio content recognition process.
  • the audio content recognition process performed jointly by the recognition device 30 and the audio content analysis system 40 captures audio signal samples As (or audio clips) repeatedly over time, analyzes the captured audio signal samples As, and provides corresponding analyzing data indicative of audio content (such as music content) of the analyzed audio signal samples As repeatedly over time.
  • analyzing the captured audio signal samples may comprise comparing their audio content or parts thereof (such as the music itself) with entries in a database stored in or retrieved by the audio content analysis system 40.
  • the analyzing data may contain information regarding music title, music artist name, and/or genre etc. of the respective analyzed audio signal sample.
  • the analyzing data may contain source information indicative of the broadcast station which is associated with the respective analyzed audio signal sample.
  • the recognition device 30 extracts multiple items of data from the analyzing data over time, which in this embodiment were received from the audio content analysis system 40. For example, the recognition device 30 extracts one or more of the following items of data from the received analyzing data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, and/or music year.
  • the recognition device 30 is configured to capture multiple audio signal samples As received from the audio circuitry 22 repeatedly over time.
  • the audio content analysis system 40 analyzes the captured audio signal samples As and provides the analyzing data indicative of audio content of the analyzed audio signal samples to the recognition device 30.
  • the apparatus 1 further comprises a memory 70 adapted to store therein a database 71.
  • This database 71 contains multiple items of data which were extracted by the recognition device 30 over time and source information (e.g. frequency) indicative of one or more broadcast stations (such as SWR1, Energy, etc. shown in Fig. 2B ) which are associated with the extracted items of data.
  • source information e.g. frequency
  • broadcast stations such as SWR1, Energy, etc. shown in Fig. 2B
  • the multiple items of data stored in the database 71 are items of data which include a transmission frequency of broadcast signals, a broadcast station name, a program name, a content type, a music artist name, a music song genre, a music song chart history, and/or a music year.
  • the apparatus 1 further comprises an analyzing device 50 which analyzes a plurality of the multiple items of data stored in the database 71 for at least one broadcast station (such as SWR1 and/or Energy, etc., shown in Fig. 2B ) which are associated with the analyzed items of data, and it provides an analyzing result for this broadcast station which is associated with the analyzed items of data (such as shown in Fig. 2B for SWR1, Energy, etc.).
  • the analyzing device may comprise a microprocessor, or may be implemented by using the same microprocessor(s) as the recognition device 30.
  • An information providing device 60 such as a display device and/or a loudspeaker or other information providing device, provides information to a user based on the analyzing result provided by the analyzing device 50, i.e. provides information based on the analyzing result for the one or more broadcast stations which are associated with the analyzed items of data (such as for SWR1, Energy, etc. shown in Fig. 2B ). According to the embodiment of Fig. 2B , this information to the user can be provided or divided in multiple portions, such as for speech, music, top artists, etc.
  • the recognition device 30 performs the audio content recognition process with the audio content analysis system 40 as a permanent background process when receiving the broadcast signals by the receiving device 20.
  • the recognition device 30 performs the audio content recognition process with the audio content analysis system 40 for a plurality of broadcast stations 2, particularly for each available broadcast station, i.e. which can currently be received by the receiving device 20.
  • a music analysis service of an audio content analysis system could permanently run as a background process in any radio tuner of a receiving apparatus. It may permanently take short clips (or audio signal samples) of the content of each broadcast station (e.g. audio clips in a double tuner concept, similar to scanning RDS information in the background). Then, the music analysis service may store music information together with the source information and track the history over time. As an analysis result, the analyzing device of the receiving apparatus could provide detailed information about each broadcast station.
  • the described music recognition process is performed repeatedly for building up an information history.
  • the database stored in the memory serves to store the recognition result (in other words, items of data extracted from the analyzing data) for each broadcast station over a period time.
  • the recognition results stored in the database may be analyzed and compared, and a typical and/or average content (not, e.g., a current song only) of each broadcast station may be determined.
  • the determined typical and/or average content information for each broadcast station may be communicated to the user, not only the currently playing song's information (such as is currently available from RDS data). Then the user can easily select which broadcast station is matching his taste or mood for listening.
  • Fig. 2A shows an exemplary display of information, e.g.
  • a broadcast station list with RDS content information as currently available in the prior art.
  • the user sees the currently playing song name and/or a station list, as depicted in Fig. 2A . If the user likes this song, or if the user wants to listen to a pop music station (like SWR1 shown in the first line of the list of Fig. 2A ), the user switches to that broadcast station. But then, it may turn out that the user gets disappointed, because SWR1 is basically a talk radio station, and the played music was the only music played for a long time! The rest of the time turns out to be talk, not music, so that the user may get disappointed.
  • SWR1 is basically a talk radio station
  • FIG. 2B shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with detailed content information according to an embodiment of the invention, which can avoid such a disappointment and help the user to select a better fitting broadcast station to listen to.
  • Fig. 2B more detailed information is shown which has been determined over time according to actually broadcasted and analyzed audio signal samples (i.e. the broadcasted music itself) with particular items of data extracted from the analyzing data over time.
  • SWR1 first line of the list of Fig.
  • an additional benefit for the user is, for example, reduced driver's distraction, because the user is able to select a broadcast station which fits best for a long period of time as a result of the provided analyzing result with content history and up-to-date information, and therefore the user does not need to switch broadcast stations very often.
  • Fig. 3 shows a flowchart diagram of a method for providing information associated with received broadcast signals according to an embodiment of the invention.
  • a tuning step to the next broadcast station is performed, e.g. by actuating a switch by the user at the tuner interface.
  • a new station content snapshot (“SCS") is generated. That is, an audio content recognition process is started by the recognition device 30 for that broadcast station, with multiple items of data to be extracted from analyzing data over time and stored as SCS in the database 71 in the memory 70.
  • SCS may contain multiple data fields, such as program name, content type, music artist name, etc.
  • the program name can be determined from an RDS data portion transmitted with the broadcast signals, or can simply be the frequency of the transmitted broadcast signals.
  • the frequency can be overwritten by the corresponding RDS program station (PS).
  • step S4 a short audio signal sample or audio clip for the broadcast station tuned in step S1 is captured as an input for the audio content recognition process.
  • step S5 the content type is analyzed. If the content type is speech (step S6), this is stored in the database 71 of memory 70 and the process goes on to step S10. If the content type is music, this is stored in the database 71 of memory 70 (step S7) and the process goes on to step S8 which sends the captured audio clip or audio signal sample to the audio content analysis system 40 (here designated as music info service), which may be installed in the vehicle ("on-board"), and/or on a server computer (“web server”), and/or may be formed by SHAZAM, as described above.
  • step S9 the analyzing data provided from the audio content analysis system 40 is received and items of data extracted therefrom (SCS data set containing items of data, such as content type, artist name, song genre, etc.) are stored in the database 71.
  • SCS data set items of data, such as content type, artist name, song genre
  • step S10 it is determined whether a data set associated with the program name (i.e., frequency or RDS PS) is already stored in the database 71 ("RSP-DB"). If not, then a new radio station profile (“RSP") data set is created (step S11), i.e. a new data set which is associated with the broadcast station tuned in step S1. In this new RSP data set, the SCS data set with the items of data according to step S9 is stored. In any further iterations of the process as shown in Fig. 3 , further SCS data sets with items of data according to step S9 will be added to the RSP data set. Thus, over time, a RSP data set contains multiple SCS data sets, thus building a data history associated with the broadcast station over time. A RSP data set may additionally contain some statistics calculated over the several stored SCS data sets, such as percent music versus speech, highest percent of music genre, top decades of music year, a music song chart history, etc. After step S11, the process returns to step S1.
  • RSS radio station
  • step S10 If it is determined in step S10 that a RSP data set for that broadcast station already exists, then the SCS data set with items of data according to step S9 is added to the related RSP data set for further statistical analysis (step S12).
  • step S13 the depth of the RSP data set ("RSP-depth") is increased by 1, and in step S14 the recent SCS data set is deleted, since it is now stored in the associated RSP data set for that broadcast station. Then, the process returns to step S1.
  • RSP-depth the depth of the RSP data set
  • the receiving device 20 or recognition device 30 is adapted to receive analyzing data indicative of already analyzed audio content information associated with at least one broadcast station from a remote provider for storing in the database 71.
  • the receiving device 20 or recognition device 30 may receive over the antenna 24 or network 80 an RSP data set and/or a SCS data set associated with a particular broadcast station from a remote provider (not shown), which may be supplemented in the database 71.
  • Fig. 4 shows an example for interpretation of items of data (such as stored with a SCS data set according to Fig. 3 ) for providing some statistics, and providing analyzing results for broadcast stations according to an embodiment of the invention.
  • RSP data set In the left column, an example of a RSP data set is shown. In the mid column, an exemplary interpretation/calculation formula is listed for a respective RSP data set entry.
  • the respective data fields of multiple RSP data sets, such as program name, content type, etc., are interpreted for statistical purposes according to this interpretation/calculation formula.
  • GUI graphical user interface
  • the multiple items of data stored in the database are analyzed by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Circuits Of Receivers In General (AREA)

Description

  • The present invention is related to a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, and to a method of providing information associated with received broadcast signals.
  • Broadcast signals transmitted by broadcast stations and which can be received by receivers, e.g. installed in a vehicle, often include several components multiplexed together upon transmission. For example, it is relatively common for a broadcast signal to include both an audio signal (either stereo or monophonic) and a RDS signal, where the RDS signal contains information such as the broadcast station name, program type, music information, artist information, and traffic information. These multiplexed broadcast signals are often transmitted from a base or broadcast station to individual receivers via frequency modulation ("FM"), where information is conveyed through variations of the frequency of the transmitted signal, or via amplitude modulation ("AM"), where information is conveyed through variations of the amplitude of the transmitted signal.
  • When a broadcast signal is received by a receiving device, it is typically demodulated by a demodulator circuit and passed to both audio circuitry and RDS receiver circuitry included in the receiving device. The audio circuitry can extract the audio portion of the signal (e.g., music or speech) and prepare it for playback through a speaker or other output device. The RDS receiver circuitry can extract the RDS portion of the signal and prepare it for processing by appropriate data processing circuitry. As an example, the data processing circuitry can display part or all of the extracted data to the user as text on a suitable user interface. For example, via the RDS portion a broadcast station can transmit content description for its broadcast station, such as announcing music type (like "pop music" or "classical music" or "talk"). It can also transmit some detailed description via radio text.
  • In multiple instances, RDS data is often too general. For example, it is not providing enough information for a user to actually undestand the difference between several broadcast stations. For instance, many broadcast stations are labelling themselves as "pop music", wherein any further distinction is not available and cannot be determined from the RDS data. Moreover, RDS data is often inaccurate, because the content is often provided by the broadcast station for its own advertisement. Furthermore, content information support technologies are limited to specific broadcasting methods, e.g. RDS is only for FM broadcast stations, not on AM. These drawbacks are even more present in an automotive environment, such as in a vehicle where the driver has typically only limited time and attention available for searching for appropriate broadcast stations the driver likes to listen to without compromising driving safety.
  • JP 2001-186429 A discloses a digital broadcast receiver that stores information denoting a broadcast schedule of programs having been acquired before without discarding the information and effectively utilizes the past information for future program retrieval. A storage section stores received information denoting broadcast schedules of past programs whose broadcast is finished without discarding the information. Then the past program is retrieved from information denoting the broadcast schedule of the past program whose broadcast has already been finished, the information denoting the broadcast schedule of the past program can effectively be utilized for the retrieval of a future program in the case of retrieving a program belonging to the same title or the series as that of the retrieved past program from the information denoting the broadcast schedule of a future program going to be broadcast from now.
  • JP 2006-190027 A discloses an information processing device which is configured to show music data by a music recognition means on a display in real time when the music data are included in a content of TV broadcasting and the like. A music data display system extracts information on a characteristic quantity by a characteristic quantity information extracting device from the music information included in a content of TV broadcasting and the like received by a tuner, and transmits the information on a characteristic quantity to a server through the Internet. The server recognizes the music by carrying out the matching of the information on a characteristic quantity and the music data included in a music information database, and transmits information on a music title, information on an artist, and the like corresponding to the music to the characteristic quantity information extracting device as the recognition result. The recognition result received by the characteristic quantity information extracting device is associated with the content including the original music information and recorded in a storage device. When the content recorded in the storage device is reproduced, the music is outputted from a speaker, and, at the same time, the recognition result is shown on a display. Further similar content analysing systems are disclosed in the publications EP 2 541 813 A1 US 2012/129476 A1 US 2013/318114 A1 and US 2010/291861 A1 . It is an object of the present invention to provide a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals which is capable of reducing the drawbacks described above with respect to limited capabilities of RDS information and which can improve user operability of such receiving apparatus.
  • The present invention is related to a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals according to the independent claims.
  • According to an aspect of the invention, there is provided a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, a recognition device configured to be coupled with an audio content analysis system and configured to perform an audio content recognition process together with the audio content analysis system, wherein the audio content recognition process is configured to capture audio signal samples transmitted with the broadcast signals repeatedly over time, to analyze the captured audio signal samples, and to provide analyzing data indicative of audio content of the analyzed audio signal samples, the recognition device further configured to extract multiple items of data from the analyzing data over time, a memory adapted to store therein a database containing multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, an analyzing device which is configured to analyze a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and to provide an analyzing result for the at least one broadcast station associated with the analyzed items of data, and an information providing device which is configured to provide information to a user based on the analyzing result for the at least one broadcast station associated with the analyzed items of data.
  • According to another aspect, there is disclosed a method of providing information associated with broadcast signals, for example received in a vehicle, the method comprising receiving broadcast signals with a receiving device, for example in a vehicle, performing an audio content recognition process which captures audio signal samples transmitted with the broadcast signals repeatedly over time, analyzes the captured audio signal samples, and provides analyzing data indicative of audio content of the analyzed audio signal samples, extracting multiple items of data from the analyzing data over time, storing in a database multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, analyzing a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and providing an analyzing result for the at least one broadcast station associated with the analyzed items of data, and providing information to a user based on the analyzing result for the at least one broadcast station associated with the analyzed items of data.
    According to another aspect, the invention also relates to a vehicle comprising a receiving apparatus according to the invention.
    With the present invention, in principle, detailed information regarding the broadcast stations available for the receiving apparatus can be collected, processed and provided to the user, so that is becomes easy for the user to select preferred content of a particular broadcast station. The analyzing result provided by the analyzing device for one or more of the broadcast stations, which may be provided to the user, is a result of a real analysis, not of a broadcast station's own information and/or advertisement. For example, a broadcast station may submit an information like "non-stop best hits" over the RDS portion of the broadcast signals, however a real analysis would show that in fact only some music content is broadcasted by that broadcast station, wherein in fact the station broadcasts a lot of talk in between, contrary to its transmitted RDS information "non-stop best hits". The invention provides the advantage that the typical or average actual content information for each received broadcast station may be communicated to the user, not only the information of, e.g., an individual song which is currently played by a broadcast station, the broadcast signals of which are currently received. The user can then easily select which broadcast station is actually matching his taste or mood for listening because of the provided typical or average actual content information about that broadcast station.
    Advantageously, multiple or all available broadcasting technologies may be used in connection with the present invention, such as FM, AM, DAB, etc. There is no need to switch any broadcasting mode, since, in principle, audio signal samples transmitted with all available broadcasting technologies can be analyzed.
    According to an embodiment, the recognition device is configured to perform the audio content recognition process with the audio content analysis system as a permanent background process when receiving the broadcast signals.
  • According to the invention, the recognition device is configured to perform the audio content recognition process with the audio content analysis system for a plurality of broadcast stations, particularly for each available broadcast station.
  • In a potential implementation, the receiving device comprises a multiple tuner configuration and the recognition device is configured to perform the audio content recognition process using one of the multiple tuners which is not used for current content reproduction.
  • For example, the recognition device is configured to extract at least one of the following items of data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
  • According to a further embodiment, the multiple items of data stored in the database each include at least one of the following: transmission frequency of broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
  • According to an embodiment, the recognition device is configured to be coupled with the audio content analysis system which is remote from the receiving apparatus. For example, the recognition device is configured to be coupled with the audio content analysis system through a network connection, particularly through the Internet and/or a telecommunications network.
  • For example, as an audio content analysis system, there may be used a server provider system, as e.g. described in JP 2006-190027 A mentioned above, which recognizes the music contained in the captured audio signal samples by analyzing (e.g. matching) of the captured audio signal samples and any music data included in a music information database, the server provider system has access to.
  • There are also other potential music analysis service systems available to be used as an audio content analysis system in connection with the present invention, such as the known "SHAZAM" music analysis service or similar. Such music analysis service systems can, e.g., identify songs based on short audio signal samples and internet databases. The "SHAZAM" music analysis service, on the one hand, is providing detailed information about the content, but it does not track the content history and it does not link the content to an audio source. Therefore, from this music analysis service alone, the user cannot understand which source (e.g. broadcast station) is playing his favourite type of music.
  • According to an embodiment, the recognition device is configured to capture the audio signal samples transmitted with the broadcast signals repeatedly over time and to send the captured audio signal samples to the audio content analysis system, whereas the audio content analysis system (such as "SHAZAM") is capable of analyzing the captured audio signal samples and providing the analyzing data indicative of audio content of the analyzed audio signal samples back to the recognition device. As such, the recognition device receives the analyzing data indicative of audio content of the analyzed audio signal samples from the audio content analysis system.
  • According to another embodiment, the receiving device is adapted to receive analyzing data indicative of analyzed audio content information associated with at least one broadcast station from a remote provider for storing in the database. In this embodiment, any information which is normally produced by the recognition device and the analyzing device can also be received from a remote provider, so that the database stored in the memory may be supplemented by the analyzing data from the remote provider.
  • According to a further embodiment, the analyzing device is configured to analyze the multiple items of data stored in the database by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.
  • The embodiments as described above with respect to the receiving apparatus can equally be applied in connection with the method according to the invention.
  • An embodiment according to the invention may additionally comprise storing information in the database which contains or is derived from RDS information transmitted with the broadcast signals. Thus, the contents of the database and the analyzing results can be supplemented by RDS information associated with the respective broadcast station.
  • According to an embodiment of the invention, the receiving apparatus according to the invention is an automotive receiving apparatus.
  • Aspects and embodiments of the invention will now be described with reference to the drawings, in which:
  • Fig. 1
    shows a receiving apparatus for receiving broadcast signals according to an exemplary embodiment of the invention,
    Fig. 2A
    shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with RDS content information as currently available in the prior art,
    Fig. 2B
    shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with detailed content information according to an embodiment of the invention,
    Fig. 3
    shows a flowchart diagram of a method for providing information associated with received broadcast signals according to an embodiment of the invention,
    Fig. 4
    shows an example for interpretation of items of data and providing analyzing results for broadcast stations according to an embodiment of the invention.
  • Fig. 1 shows a receiving apparatus for receiving broadcast signals according to an exemplary embodiment of the invention in a schematic block diagram. In this embodiment, the receiving apparatus 1 is an automotive receiving apparatus, which may be installed in a vehicle, e.g., in a head unit thereof (not shown), receives broadcast signals BS which are broadcast from an exemplary broadcast station 2. The receiving apparatus 1 comprises a receiving device 20 which may be a conventional receiving device as known in the art. The exemplary receiving device 20 (another type thereof can also be used, e.g. when applied to another broadcasting technology) comprises an antenna 24 for receiving the broadcast signals BS, a demodulator 21, an audio circuitry 22 which can extract the audio portion As of the received signal (i.e., music or speech) and prepare it for playback through a speaker or other output device (not shown), and a RDS receiver circuitry 23 which can extract the RDS portion Rx of the received signal and prepare it for processing by appropriate data processing circuitry (not shown). It will be understood that, as used herein, the expression "coupled to" can be used to define either a direct or an indirect connection between elements. When it is referred herein to an installation of any part of the receiving apparatus in a vehicle, it should be understood that the receiving apparatus or any part thereof may also be installed in other installation locations where the receiving apparatus may be used.
  • Particularly, the demodulator 21 can demodulate the received broadcast signal BS by a frequency determined by the station or frequency that is being tuned to. The demodulator 21 can be analog, digital, or a combination of the two. The output signal of demodulator 21 can be received by audio circuitry 22, which can extract and decode the audio portion As of the received signal and send it to a speaker circuitry. The output signal of demodulator 21 can also be received by RDS receiver circuitry 23 which can extract and decode the RDS portion Rx of the received signal and send it to any appropriate output circuitry. For instance, the extracted RDS data may be displayed to a user via any suitable display circuitry, or may be processed according to embodiments of the invention.
  • The apparatus 1 further comprises a recognition device 30 which is coupled with the receiving device 20 and, in this embodiment, receives the audio portions As output by the receiving device 20 (particularly output by the audio circuitry 22). Further, in this embodiment, it receives the RDS portions Rx output by the receiving device 20 (particularly output by the RDS receiver circuitry 23).
  • For example, the receiving device 20 comprises a multiple tuner configuration (not explicitly shown), which is known in the art, and the recognition device 30 is configured to perform an audio content recognition process, as described herein below, using one of the multiple tuners which is not used for current content reproduction.
  • The recognition device 30 is configured to be coupled with an audio content analysis system 40 (which may be remote from the automotive receiving apparatus 1, such as "SHAZAM" described above provided by a server computer, or may be installed in the vehicle, thus is "on-board"). For example, the recognition device 30 is coupled with the audio content analysis system 40 directly or via a network 80, such as the Internet and/or any other telecommunications network and/or a vehicle communications network bus, like the CAN-bus. To this end, the receiving apparatus 1, which may be installed in a vehicle, may use any known wired or wireless technology for communication with the audio content analysis system 40 either directly or over the network 80. According to other embodiments, the audio content analysis system 40 may also be implemented in the vehicle, e.g. in a portion of a head unit with appropriate memory capabilities, or may be a distributed system with parts thereof installed in the vehicle and other parts thereof provided on a remote server computer and accessible via the network 80.
  • According to another embodiment, the recognition device 30 may be implemented in the vehicle, e.g., by comprising one or more microprocessors, for example installed in the head unit (not shown), wherein the one or more microprocessors have access to a database stored in a memory (e.g., located in the vehicle or on a remote server computer) which are part of or form the audio content analysis system 40. According to another embodiment, the recognition device 30 and the audio content analysis system 40 may both comprise respective one or more microprocessors, e.g. the recognition device 30 comprising a microprocessor installed in the vehicle and the audio content analysis system 40 comprising a microprocessor installed in a remote server computer, which microprocessors communicate with each other, e.g. over the network 80.
  • The recognition device 30, when coupled with the audio content analysis system 40, e.g. wirelessly, is configured to perform an audio content recognition process together with the audio content analysis system 40. For example, a microprocessor of the recognition device 30 provides commands and/or data to the audio content analysis system 40 (e.g. a database or a server computer) when performing the audio content recognition process, and receives data and/or commands therefrom. Alternatively or additionally, according to an embodiment, the audio content analysis system 40 (e.g. a microprocessor thereof) provides commands and/or data to the recognition device 30 which is configured to receive such commands and/or data for performing the audio content recognition process.
  • The audio content recognition process performed jointly by the recognition device 30 and the audio content analysis system 40 captures audio signal samples As (or audio clips) repeatedly over time, analyzes the captured audio signal samples As, and provides corresponding analyzing data indicative of audio content (such as music content) of the analyzed audio signal samples As repeatedly over time. For example, analyzing the captured audio signal samples may comprise comparing their audio content or parts thereof (such as the music itself) with entries in a database stored in or retrieved by the audio content analysis system 40.
  • For example, the analyzing data may contain information regarding music title, music artist name, and/or genre etc. of the respective analyzed audio signal sample. Moreover, the analyzing data may contain source information indicative of the broadcast station which is associated with the respective analyzed audio signal sample.
  • The recognition device 30 extracts multiple items of data from the analyzing data over time, which in this embodiment were received from the audio content analysis system 40. For example, the recognition device 30 extracts one or more of the following items of data from the received analyzing data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, and/or music year.
  • According to an embodiment, the recognition device 30 is configured to capture multiple audio signal samples As received from the audio circuitry 22 repeatedly over time. The audio content analysis system 40 analyzes the captured audio signal samples As and provides the analyzing data indicative of audio content of the analyzed audio signal samples to the recognition device 30.
  • The apparatus 1 further comprises a memory 70 adapted to store therein a database 71. This database 71 contains multiple items of data which were extracted by the recognition device 30 over time and source information (e.g. frequency) indicative of one or more broadcast stations (such as SWR1, Energy, etc. shown in Fig. 2B) which are associated with the extracted items of data.
  • For example, the multiple items of data stored in the database 71 are items of data which include a transmission frequency of broadcast signals, a broadcast station name, a program name, a content type, a music artist name, a music song genre, a music song chart history, and/or a music year.
  • The apparatus 1 further comprises an analyzing device 50 which analyzes a plurality of the multiple items of data stored in the database 71 for at least one broadcast station (such as SWR1 and/or Energy, etc., shown in Fig. 2B) which are associated with the analyzed items of data, and it provides an analyzing result for this broadcast station which is associated with the analyzed items of data (such as shown in Fig. 2B for SWR1, Energy, etc.). For example, the analyzing device may comprise a microprocessor, or may be implemented by using the same microprocessor(s) as the recognition device 30.
  • An information providing device 60, such as a display device and/or a loudspeaker or other information providing device, provides information to a user based on the analyzing result provided by the analyzing device 50, i.e. provides information based on the analyzing result for the one or more broadcast stations which are associated with the analyzed items of data (such as for SWR1, Energy, etc. shown in Fig. 2B). According to the embodiment of Fig. 2B, this information to the user can be provided or divided in multiple portions, such as for speech, music, top artists, etc.
  • Preferably, the recognition device 30 performs the audio content recognition process with the audio content analysis system 40 as a permanent background process when receiving the broadcast signals by the receiving device 20. Advantageously, the recognition device 30 performs the audio content recognition process with the audio content analysis system 40 for a plurality of broadcast stations 2, particularly for each available broadcast station, i.e. which can currently be received by the receiving device 20.
    In an advantageous embodiment, a music analysis service of an audio content analysis system (like "SHAZAM", as mentioned above) could permanently run as a background process in any radio tuner of a receiving apparatus. It may permanently take short clips (or audio signal samples) of the content of each broadcast station (e.g. audio clips in a double tuner concept, similar to scanning RDS information in the background). Then, the music analysis service may store music information together with the source information and track the history over time. As an analysis result, the analyzing device of the receiving apparatus could provide detailed information about each broadcast station.
  • The described music recognition process is performed repeatedly for building up an information history. The database stored in the memory serves to store the recognition result (in other words, items of data extracted from the analyzing data) for each broadcast station over a period time. The recognition results stored in the database may be analyzed and compared, and a typical and/or average content (not, e.g., a current song only) of each broadcast station may be determined.
    Advantageously, the determined typical and/or average content information for each broadcast station may be communicated to the user, not only the currently playing song's information (such as is currently available from RDS data). Then the user can easily select which broadcast station is matching his taste or mood for listening.
    Fig. 2A shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with RDS content information as currently available in the prior art. In a common use case, in current radio tuners, the user sees the currently playing song name and/or a station list, as depicted in Fig. 2A. If the user likes this song, or if the user wants to listen to a pop music station (like SWR1 shown in the first line of the list of Fig. 2A), the user switches to that broadcast station. But then, it may turn out that the user gets disappointed, because SWR1 is basically a talk radio station, and the played music was the only music played for a long time! The rest of the time turns out to be talk, not music, so that the user may get disappointed.
    Fig. 2B shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with detailed content information according to an embodiment of the invention, which can avoid such a disappointment and help the user to select a better fitting broadcast station to listen to. Particularly, as shown in Fig. 2B, more detailed information is shown which has been determined over time according to actually broadcasted and analyzed audio signal samples (i.e. the broadcasted music itself) with particular items of data extracted from the analyzing data over time. For example, for the broadcast station SWR1 (first line of the list of Fig. 2B) different portions of an analyzing result as to, e.g., speech, music, top artists, have been determined according to the analyzed items of data stored in the database over time associated with the broadcast station SWR1. Thus, an additional benefit for the user is, for example, reduced driver's distraction, because the user is able to select a broadcast station which fits best for a long period of time as a result of the provided analyzing result with content history and up-to-date information, and therefore the user does not need to switch broadcast stations very often.
  • Fig. 3 shows a flowchart diagram of a method for providing information associated with received broadcast signals according to an embodiment of the invention.
  • In step S1, a tuning step to the next broadcast station is performed, e.g. by actuating a switch by the user at the tuner interface. In step S2, a new station content snapshot ("SCS") is generated. That is, an audio content recognition process is started by the recognition device 30 for that broadcast station, with multiple items of data to be extracted from analyzing data over time and stored as SCS in the database 71 in the memory 70. As shown in Fig. 3, a SCS may contain multiple data fields, such as program name, content type, music artist name, etc. For example, the program name can be determined from an RDS data portion transmitted with the broadcast signals, or can simply be the frequency of the transmitted broadcast signals. In step S3, if such RDS information is available, the frequency can be overwritten by the corresponding RDS program station (PS).
  • In step S4, a short audio signal sample or audio clip for the broadcast station tuned in step S1 is captured as an input for the audio content recognition process. In step S5, the content type is analyzed. If the content type is speech (step S6), this is stored in the database 71 of memory 70 and the process goes on to step S10. If the content type is music, this is stored in the database 71 of memory 70 (step S7) and the process goes on to step S8 which sends the captured audio clip or audio signal sample to the audio content analysis system 40 (here designated as music info service), which may be installed in the vehicle ("on-board"), and/or on a server computer ("web server"), and/or may be formed by SHAZAM, as described above. In step S9, the analyzing data provided from the audio content analysis system 40 is received and items of data extracted therefrom (SCS data set containing items of data, such as content type, artist name, song genre, etc.) are stored in the database 71.
  • In step S10, it is determined whether a data set associated with the program name (i.e., frequency or RDS PS) is already stored in the database 71 ("RSP-DB"). If not, then a new radio station profile ("RSP") data set is created (step S11), i.e. a new data set which is associated with the broadcast station tuned in step S1. In this new RSP data set, the SCS data set with the items of data according to step S9 is stored. In any further iterations of the process as shown in Fig. 3, further SCS data sets with items of data according to step S9 will be added to the RSP data set. Thus, over time, a RSP data set contains multiple SCS data sets, thus building a data history associated with the broadcast station over time. A RSP data set may additionally contain some statistics calculated over the several stored SCS data sets, such as percent music versus speech, highest percent of music genre, top decades of music year, a music song chart history, etc. After step S11, the process returns to step S1.
  • If it is determined in step S10 that a RSP data set for that broadcast station already exists, then the SCS data set with items of data according to step S9 is added to the related RSP data set for further statistical analysis (step S12). In step S13, the depth of the RSP data set ("RSP-depth") is increased by 1, and in step S14 the recent SCS data set is deleted, since it is now stored in the associated RSP data set for that broadcast station. Then, the process returns to step S1.
  • According to an embodiment, the receiving device 20 or recognition device 30 is adapted to receive analyzing data indicative of already analyzed audio content information associated with at least one broadcast station from a remote provider for storing in the database 71. According to the example of Fig. 3, the receiving device 20 or recognition device 30 may receive over the antenna 24 or network 80 an RSP data set and/or a SCS data set associated with a particular broadcast station from a remote provider (not shown), which may be supplemented in the database 71.
  • Fig. 4 shows an example for interpretation of items of data (such as stored with a SCS data set according to Fig. 3) for providing some statistics, and providing analyzing results for broadcast stations according to an embodiment of the invention.
  • In the left column, an example of a RSP data set is shown. In the mid column, an exemplary interpretation/calculation formula is listed for a respective RSP data set entry. The respective data fields of multiple RSP data sets, such as program name, content type, etc., are interpreted for statistical purposes according to this interpretation/calculation formula.
  • In the right column, an example of a graphical user interface ("GUI"), here display, is shown.
  • For example, the multiple items of data stored in the database (in the above example, the multiple items of data of a RSP data set) are analyzed by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.

Claims (14)

  1. A receiving apparatus (1) for receiving broadcast signals, comprising:
    - a receiving device (20) configured to receive broadcast signals (BS),
    - a recognition device (30) configured to be coupled with an audio content analysis system (40) and configured to perform an audio content recognition process together with the audio content analysis system (40) for a plurality of broadcast stations (SWR1, Energy), wherein the audio content recognition process is configured to capture audio signal samples (As) transmitted with the broadcast signals repeatedly over time, to analyze the captured audio signal samples (As), and to provide analyzing data indicative of audio content of the analyzed audio signal samples (As), the recognition device (30) further configured to extract multiple items of data from the analyzing data over time, wherein the audio content recognition process is performed repeatedly for building up an information history,
    - a memory (70) adapted to store therein a database (71) containing the multiple items of data extracted over time for each of the broadcast stations over a period of time and source information indicative of the broadcast stations (SWR1, Energy) associated with the extracted items of data,
    - an analyzing device (50) which is configured to analyze a plurality of the multiple items of data stored in the database (71) for at least one broadcast station (SWR1, Energy) associated with the analyzed items of data and to provide an analyzing result for the at least one broadcast station (SWR1, Energy) associated with the analyzed items of data, and
    - an information providing device (60) which is configured to provide information to a user based on the analyzing result for the at least one broadcast station (SWR1, Energy) associated with the analyzed items of data.
  2. The receiving apparatus according to claim 1, wherein the recognition device (30) is configured to perform the audio content recognition process with the audio content analysis system (40) as a permanent background process when receiving the broadcast signals.
  3. The receiving apparatus according to claim 1 or 2, wherein the recognition device (30) is configured to perform the audio content recognition process with the audio content analysis system (40) for each broadcast station receivable by the receiving device (20).
  4. The receiving apparatus according to one of claims 1 to 3, wherein the receiving device (20) comprises a multiple tuner configuration, and the recognition device (30) is configured to perform the audio content recognition process using one of the multiple tuners which is not used for current content reproduction.
  5. The receiving apparatus according to one of claims 1 to 4,
    wherein the recognition device (30) is configured to extract at least one of the following items of data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
  6. The receiving apparatus according to one of claims 1 to 5,
    wherein the multiple items of data stored in the database (71) each include at least one of the following: transmission frequency of broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
  7. The receiving apparatus according to one of claims 1 to 6,
    wherein the recognition device (30) is configured to be coupled with the audio content analysis system (40) which is remote from the receiving apparatus (1).
  8. The receiving apparatus according to one of claims 1 to 7, wherein the recognition device (30) is configured to be coupled with the audio content analysis system (40) through a network (80), particularly through the Internet and/or a telecommunications network.
  9. The receiving apparatus according to one of claims 1 to 8, wherein the recognition device (30) is configured to capture the audio signal samples (As) transmitted with the broadcast signals repeatedly over time, and the audio content analysis system (40) is configured to analyze the captured audio signal samples and to provide the analyzing data indicative of audio content of the analyzed audio signal samples to the recognition device (30).
  10. The receiving apparatus according to one of claims 1 to 9, wherein the receiving device (20) or the recognition device (30) is adapted to receive analyzing data indicative of analyzed audio content information associated with at least one broadcast station (SWR1, Energy) from a remote provider for storing in the database (71).
  11. The receiving apparatus according to one of claims 1 to 10, wherein the analyzing device (50) is configured to analyze the multiple items of data stored in the database (71) by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.
  12. A method of providing information associated with broadcast signals, the method comprising:
    - receiving broadcast signals (BS) with a receiving device (20),
    - performing an audio content recognition process for a plurality of broadcast stations (SWR1, Energy) which captures audio signal samples (As) transmitted with the broadcast signals (BS) repeatedly over time, analyzes the captured audio signal samples (As), and provides analyzing data indicative of audio content of the analyzed audio signal samples (As),
    - extracting multiple items of data from the analyzing data over time, wherein the audio content recognition process is performed repeatedly for building up an information history,
    - storing in a database (71) multiple items of data extracted over time for each of the broadcast stations over a period of time and source information indicative of the broadcast stations (SWR1, Energy) associated with the extracted items of data,
    - analyzing a plurality of the multiple items of data stored in the database (71) for at least one broadcast station (SWR1, Energy) associated with the analyzed items of data and providing an analyzing result for the at least one broadcast station (SWR1, Energy) associated with the analyzed items of data, and
    - providing information to a user based on the analyzing result for the at least one broadcast station (SWR1, Energy) associated with the analyzed items of data.
  13. The method according to claim 12, wherein the method additionally comprises storing information in the database (71) which contains or is derived from RDS information (Rx) transmitted with the broadcast signals (BS).
  14. A vehicle comprising a receiving apparatus (1) according to one of claims 1 to 11.
EP14163387.5A 2014-04-03 2014-04-03 Receiving apparatus and method of providing information associated with received broadcast signals Active EP2928094B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP14163387.5A EP2928094B1 (en) 2014-04-03 2014-04-03 Receiving apparatus and method of providing information associated with received broadcast signals

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14163387.5A EP2928094B1 (en) 2014-04-03 2014-04-03 Receiving apparatus and method of providing information associated with received broadcast signals

Publications (2)

Publication Number Publication Date
EP2928094A1 EP2928094A1 (en) 2015-10-07
EP2928094B1 true EP2928094B1 (en) 2018-05-30

Family

ID=50478719

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14163387.5A Active EP2928094B1 (en) 2014-04-03 2014-04-03 Receiving apparatus and method of providing information associated with received broadcast signals

Country Status (1)

Country Link
EP (1) EP2928094B1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016221910A1 (en) * 2016-11-08 2018-05-09 Volkswagen Aktiengesellschaft A method, apparatus and computer readable storage medium having instructions for acquiring data to a radio station
DE102017009206B3 (en) 2017-09-30 2019-02-14 Preh Car Connect Gmbh Processing a broadcast signal

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1197020B2 (en) * 1999-03-29 2011-04-13 Gotuit Media Corp. Electronic music and programme storage, comprising the recognition of programme segments, such as recorded musical performances and system for the management and playback of these programme segments
JP4427146B2 (en) 1999-12-27 2010-03-03 株式会社東芝 Digital broadcast receiving apparatus and control method thereof
JP4933899B2 (en) * 2004-02-19 2012-05-16 ランドマーク、ディジタル、サーヴィセズ、エルエルシー Method and apparatus for broadcast source identification
JP2006190027A (en) 2005-01-05 2006-07-20 Sharp Corp Information processing device
ES2433966T3 (en) * 2006-10-03 2013-12-13 Shazam Entertainment, Ltd. Method for high flow rate of distributed broadcast content identification
DE102007009730A1 (en) * 2007-02-28 2008-09-18 Continental Automotive Gmbh Method and device for providing information on radio broadcasts
US8331966B2 (en) * 2009-05-15 2012-12-11 Apple Inc. Content selection based on simulcast data
US20120129476A1 (en) * 2010-11-24 2012-05-24 Visteon Global Technologies, Inc. Radio system including terrestrial and internet radio
EP2541813A1 (en) * 2011-06-29 2013-01-02 Harman Becker Automotive Systems GmbH Device and method for controlling audio reproduction
US20130318114A1 (en) * 2012-05-13 2013-11-28 Harry E. Emerson, III Discovery of music artist and title by broadcast radio receivers

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
EP2928094A1 (en) 2015-10-07

Similar Documents

Publication Publication Date Title
US7643807B2 (en) Methods for using broadcast media content information and related broadcast media receivers/playback devices
US9563699B1 (en) System and method for matching a query against a broadcast stream
US20070281606A1 (en) Systems and methods for acquiring songs or products associated with radio broadcasts
US9159076B2 (en) User answer collection server, user answer collection system, broadcast reception apparatus and control method
EP2928094B1 (en) Receiving apparatus and method of providing information associated with received broadcast signals
WO2020142426A1 (en) Generation of media station previews using a secondary tuner
WO2020142339A1 (en) Generation of media station previews using a reference database
EP1380126B1 (en) Entertainment device with a search function for data similar in type to instantaneously reproduced data
US20120117044A1 (en) Music providing system and apparatus using music broadcasting and music providing method using the same
EP3160067A1 (en) Automotive broadcast receiving apparatus and method of providing at least one channel list of broadcast channels therein
KR20050085829A (en) Audio signal identification method and system
US20100159860A1 (en) Method for displaying other stations now playing list
CN102055541B (en) Multiplexing radio receiver
CN105577305B (en) Multiplexed data broadcast receiver and its control method
JP3636419B2 (en) Digital audio broadcast receiver
JP2709588B2 (en) Digital data multiplexing system receiving method
JPH11122204A (en) Broadcasting recognition system using sound signal, sound element generation device used for the same and broadcasting recognition device
KR20170008092A (en) Method for switching variety audio broadcasting
JP3968541B2 (en) Digital audio broadcast receiver
JP2694770B2 (en) Digital data multiplexing system receiving method
US10528957B2 (en) Systems and methods for providing broadcast data analysis
US20240039651A1 (en) Radio tuner system using metadata and method thereof
JP4136986B2 (en) Digital music broadcast receiver
WO2019008612A1 (en) Method for access to additional internet content associated with a radio and/or television program
RU2307472C2 (en) Method for identification of changes in broadcasted database

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150325

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17Q First examination report despatched

Effective date: 20160712

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180103

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1004697

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014026072

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20180530

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180830

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180830

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180831

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1004697

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014026072

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20190301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20140403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240419

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240418

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240425

Year of fee payment: 11