EP2928094B1 - Empfangsvorrichtung und Verfahren zur Bereitstellung von Informationen im Zusammenhang mit empfangenen Rundfunksignalen - Google Patents

Empfangsvorrichtung und Verfahren zur Bereitstellung von Informationen im Zusammenhang mit empfangenen Rundfunksignalen Download PDF

Info

Publication number
EP2928094B1
EP2928094B1 EP14163387.5A EP14163387A EP2928094B1 EP 2928094 B1 EP2928094 B1 EP 2928094B1 EP 14163387 A EP14163387 A EP 14163387A EP 2928094 B1 EP2928094 B1 EP 2928094B1
Authority
EP
European Patent Office
Prior art keywords
data
broadcast
audio content
music
items
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14163387.5A
Other languages
English (en)
French (fr)
Other versions
EP2928094A1 (de
Inventor
Andreas Galos
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alpine Electronics Inc
Original Assignee
Alpine Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alpine Electronics Inc filed Critical Alpine Electronics Inc
Priority to EP14163387.5A priority Critical patent/EP2928094B1/de
Publication of EP2928094A1 publication Critical patent/EP2928094A1/de
Application granted granted Critical
Publication of EP2928094B1 publication Critical patent/EP2928094B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/58—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of audio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/37—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
    • H04H60/372—Programme
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/38—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space
    • H04H60/41—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas
    • H04H60/43—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas for identifying broadcast channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/38—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space
    • H04H60/41—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas
    • H04H60/44—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas for identifying broadcast stations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/47—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for recognising genres
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/61—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/65—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 for using the result on users' side
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H2201/00—Aspects of broadcast communication
    • H04H2201/10—Aspects of broadcast communication characterised by the type of broadcast system
    • H04H2201/13—Aspects of broadcast communication characterised by the type of broadcast system radio data system/radio broadcast data system [RDS/RBDS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H2201/00—Aspects of broadcast communication
    • H04H2201/60—Aspects of broadcast communication characterised in that the receiver comprises more than one tuner

Definitions

  • the present invention is related to a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, and to a method of providing information associated with received broadcast signals.
  • a broadcast signal it is relatively common for a broadcast signal to include both an audio signal (either stereo or monophonic) and a RDS signal, where the RDS signal contains information such as the broadcast station name, program type, music information, artist information, and traffic information.
  • These multiplexed broadcast signals are often transmitted from a base or broadcast station to individual receivers via frequency modulation (“FM"), where information is conveyed through variations of the frequency of the transmitted signal, or via amplitude modulation (“AM”), where information is conveyed through variations of the amplitude of the transmitted signal.
  • FM frequency modulation
  • AM amplitude modulation
  • a broadcast signal When a broadcast signal is received by a receiving device, it is typically demodulated by a demodulator circuit and passed to both audio circuitry and RDS receiver circuitry included in the receiving device.
  • the audio circuitry can extract the audio portion of the signal (e.g., music or speech) and prepare it for playback through a speaker or other output device.
  • the RDS receiver circuitry can extract the RDS portion of the signal and prepare it for processing by appropriate data processing circuitry.
  • the data processing circuitry can display part or all of the extracted data to the user as text on a suitable user interface. For example, via the RDS portion a broadcast station can transmit content description for its broadcast station, such as announcing music type (like "pop music” or "classical music” or "talk”). It can also transmit some detailed description via radio text.
  • RDS data is often too general. For example, it is not providing enough information for a user to actually undestand the difference between several broadcast stations. For instance, many broadcast stations are labelling themselves as "pop music", wherein any further distinction is not available and cannot be determined from the RDS data. Moreover, RDS data is often inaccurate, because the content is often provided by the broadcast station for its own advertisement. Furthermore, content information support technologies are limited to specific broadcasting methods, e.g. RDS is only for FM broadcast stations, not on AM. These drawbacks are even more present in an automotive environment, such as in a vehicle where the driver has typically only limited time and attention available for searching for appropriate broadcast stations the driver likes to listen to without compromising driving safety.
  • JP 2001-186429 A discloses a digital broadcast receiver that stores information denoting a broadcast schedule of programs having been acquired before without discarding the information and effectively utilizes the past information for future program retrieval.
  • a storage section stores received information denoting broadcast schedules of past programs whose broadcast is finished without discarding the information. Then the past program is retrieved from information denoting the broadcast schedule of the past program whose broadcast has already been finished, the information denoting the broadcast schedule of the past program can effectively be utilized for the retrieval of a future program in the case of retrieving a program belonging to the same title or the series as that of the retrieved past program from the information denoting the broadcast schedule of a future program going to be broadcast from now.
  • JP 2006-190027 A discloses an information processing device which is configured to show music data by a music recognition means on a display in real time when the music data are included in a content of TV broadcasting and the like.
  • a music data display system extracts information on a characteristic quantity by a characteristic quantity information extracting device from the music information included in a content of TV broadcasting and the like received by a tuner, and transmits the information on a characteristic quantity to a server through the Internet.
  • the server recognizes the music by carrying out the matching of the information on a characteristic quantity and the music data included in a music information database, and transmits information on a music title, information on an artist, and the like corresponding to the music to the characteristic quantity information extracting device as the recognition result.
  • the recognition result received by the characteristic quantity information extracting device is associated with the content including the original music information and recorded in a storage device.
  • the content recorded in the storage device is reproduced, the music is outputted from a speaker, and, at the same time, the recognition result is shown on a display.
  • Further similar content analysing systems are disclosed in the publications EP 2 541 813 A1 US 2012/129476 A1 US 2013/318114 A1 and US 2010/291861 A1 . It is an object of the present invention to provide a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals which is capable of reducing the drawbacks described above with respect to limited capabilities of RDS information and which can improve user operability of such receiving apparatus.
  • the present invention is related to a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals according to the independent claims.
  • a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, a recognition device configured to be coupled with an audio content analysis system and configured to perform an audio content recognition process together with the audio content analysis system, wherein the audio content recognition process is configured to capture audio signal samples transmitted with the broadcast signals repeatedly over time, to analyze the captured audio signal samples, and to provide analyzing data indicative of audio content of the analyzed audio signal samples, the recognition device further configured to extract multiple items of data from the analyzing data over time, a memory adapted to store therein a database containing multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, an analyzing device which is configured to analyze a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and to provide an analyzing result for the at least one broadcast station associated with the analyzed items of data, and an information providing device which is configured to provide information to a user based on the analyzing result for the at least
  • a method of providing information associated with broadcast signals comprising receiving broadcast signals with a receiving device, for example in a vehicle, performing an audio content recognition process which captures audio signal samples transmitted with the broadcast signals repeatedly over time, analyzes the captured audio signal samples, and provides analyzing data indicative of audio content of the analyzed audio signal samples, extracting multiple items of data from the analyzing data over time, storing in a database multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, analyzing a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and providing an analyzing result for the at least one broadcast station associated with the analyzed items of data, and providing information to a user based on the analyzing result for the at least one broadcast station associated with the analyzed items of data.
  • the invention also relates to a vehicle comprising a receiving apparatus according to the invention.
  • a vehicle comprising a receiving apparatus according to the invention.
  • the analyzing result provided by the analyzing device for one or more of the broadcast stations, which may be provided to the user, is a result of a real analysis, not of a broadcast station's own information and/or advertisement.
  • a broadcast station may submit an information like "non-stop best hits" over the RDS portion of the broadcast signals, however a real analysis would show that in fact only some music content is broadcasted by that broadcast station, wherein in fact the station broadcasts a lot of talk in between, contrary to its transmitted RDS information "non-stop best hits".
  • the invention provides the advantage that the typical or average actual content information for each received broadcast station may be communicated to the user, not only the information of, e.g., an individual song which is currently played by a broadcast station, the broadcast signals of which are currently received. The user can then easily select which broadcast station is actually matching his taste or mood for listening because of the provided typical or average actual content information about that broadcast station.
  • the recognition device is configured to perform the audio content recognition process with the audio content analysis system as a permanent background process when receiving the broadcast signals.
  • the recognition device is configured to perform the audio content recognition process with the audio content analysis system for a plurality of broadcast stations, particularly for each available broadcast station.
  • the receiving device comprises a multiple tuner configuration and the recognition device is configured to perform the audio content recognition process using one of the multiple tuners which is not used for current content reproduction.
  • the recognition device is configured to extract at least one of the following items of data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
  • the multiple items of data stored in the database each include at least one of the following: transmission frequency of broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
  • the recognition device is configured to be coupled with the audio content analysis system which is remote from the receiving apparatus.
  • the recognition device is configured to be coupled with the audio content analysis system through a network connection, particularly through the Internet and/or a telecommunications network.
  • an audio content analysis system there may be used a server provider system, as e.g. described in JP 2006-190027 A mentioned above, which recognizes the music contained in the captured audio signal samples by analyzing (e.g. matching) of the captured audio signal samples and any music data included in a music information database, the server provider system has access to.
  • a server provider system as e.g. described in JP 2006-190027 A mentioned above, which recognizes the music contained in the captured audio signal samples by analyzing (e.g. matching) of the captured audio signal samples and any music data included in a music information database, the server provider system has access to.
  • music analysis service systems available to be used as an audio content analysis system in connection with the present invention, such as the known "SHAZAM” music analysis service or similar.
  • Such music analysis service systems can, e.g., identify songs based on short audio signal samples and internet databases.
  • the "SHAZAM” music analysis service is providing detailed information about the content, but it does not track the content history and it does not link the content to an audio source. Therefore, from this music analysis service alone, the user cannot understand which source (e.g. broadcast station) is playing his favourite type of music.
  • the recognition device is configured to capture the audio signal samples transmitted with the broadcast signals repeatedly over time and to send the captured audio signal samples to the audio content analysis system, whereas the audio content analysis system (such as "SHAZAM") is capable of analyzing the captured audio signal samples and providing the analyzing data indicative of audio content of the analyzed audio signal samples back to the recognition device.
  • the recognition device receives the analyzing data indicative of audio content of the analyzed audio signal samples from the audio content analysis system.
  • the receiving device is adapted to receive analyzing data indicative of analyzed audio content information associated with at least one broadcast station from a remote provider for storing in the database.
  • any information which is normally produced by the recognition device and the analyzing device can also be received from a remote provider, so that the database stored in the memory may be supplemented by the analyzing data from the remote provider.
  • the analyzing device is configured to analyze the multiple items of data stored in the database by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.
  • An embodiment according to the invention may additionally comprise storing information in the database which contains or is derived from RDS information transmitted with the broadcast signals.
  • the contents of the database and the analyzing results can be supplemented by RDS information associated with the respective broadcast station.
  • the receiving apparatus according to the invention is an automotive receiving apparatus.
  • Fig. 1 shows a receiving apparatus for receiving broadcast signals according to an exemplary embodiment of the invention in a schematic block diagram.
  • the receiving apparatus 1 is an automotive receiving apparatus, which may be installed in a vehicle, e.g., in a head unit thereof (not shown), receives broadcast signals BS which are broadcast from an exemplary broadcast station 2.
  • the receiving apparatus 1 comprises a receiving device 20 which may be a conventional receiving device as known in the art.
  • the exemplary receiving device 20 (another type thereof can also be used, e.g.
  • the demodulator 21 can demodulate the received broadcast signal BS by a frequency determined by the station or frequency that is being tuned to.
  • the demodulator 21 can be analog, digital, or a combination of the two.
  • the output signal of demodulator 21 can be received by audio circuitry 22, which can extract and decode the audio portion As of the received signal and send it to a speaker circuitry.
  • the output signal of demodulator 21 can also be received by RDS receiver circuitry 23 which can extract and decode the RDS portion Rx of the received signal and send it to any appropriate output circuitry.
  • the extracted RDS data may be displayed to a user via any suitable display circuitry, or may be processed according to embodiments of the invention.
  • the apparatus 1 further comprises a recognition device 30 which is coupled with the receiving device 20 and, in this embodiment, receives the audio portions As output by the receiving device 20 (particularly output by the audio circuitry 22). Further, in this embodiment, it receives the RDS portions Rx output by the receiving device 20 (particularly output by the RDS receiver circuitry 23).
  • a recognition device 30 which is coupled with the receiving device 20 and, in this embodiment, receives the audio portions As output by the receiving device 20 (particularly output by the audio circuitry 22). Further, in this embodiment, it receives the RDS portions Rx output by the receiving device 20 (particularly output by the RDS receiver circuitry 23).
  • the receiving device 20 comprises a multiple tuner configuration (not explicitly shown), which is known in the art, and the recognition device 30 is configured to perform an audio content recognition process, as described herein below, using one of the multiple tuners which is not used for current content reproduction.
  • the recognition device 30 is configured to be coupled with an audio content analysis system 40 (which may be remote from the automotive receiving apparatus 1, such as "SHAZAM” described above provided by a server computer, or may be installed in the vehicle, thus is “on-board”).
  • the recognition device 30 is coupled with the audio content analysis system 40 directly or via a network 80, such as the Internet and/or any other telecommunications network and/or a vehicle communications network bus, like the CAN-bus.
  • the receiving apparatus 1, which may be installed in a vehicle may use any known wired or wireless technology for communication with the audio content analysis system 40 either directly or over the network 80.
  • the audio content analysis system 40 may also be implemented in the vehicle, e.g. in a portion of a head unit with appropriate memory capabilities, or may be a distributed system with parts thereof installed in the vehicle and other parts thereof provided on a remote server computer and accessible via the network 80.
  • the recognition device 30 may be implemented in the vehicle, e.g., by comprising one or more microprocessors, for example installed in the head unit (not shown), wherein the one or more microprocessors have access to a database stored in a memory (e.g., located in the vehicle or on a remote server computer) which are part of or form the audio content analysis system 40.
  • the recognition device 30 and the audio content analysis system 40 may both comprise respective one or more microprocessors, e.g. the recognition device 30 comprising a microprocessor installed in the vehicle and the audio content analysis system 40 comprising a microprocessor installed in a remote server computer, which microprocessors communicate with each other, e.g. over the network 80.
  • a microprocessor of the recognition device 30 provides commands and/or data to the audio content analysis system 40 (e.g. a database or a server computer) when performing the audio content recognition process, and receives data and/or commands therefrom.
  • the audio content analysis system 40 e.g. a microprocessor thereof
  • the recognition device 30 which is configured to receive such commands and/or data for performing the audio content recognition process.
  • the audio content recognition process performed jointly by the recognition device 30 and the audio content analysis system 40 captures audio signal samples As (or audio clips) repeatedly over time, analyzes the captured audio signal samples As, and provides corresponding analyzing data indicative of audio content (such as music content) of the analyzed audio signal samples As repeatedly over time.
  • analyzing the captured audio signal samples may comprise comparing their audio content or parts thereof (such as the music itself) with entries in a database stored in or retrieved by the audio content analysis system 40.
  • the analyzing data may contain information regarding music title, music artist name, and/or genre etc. of the respective analyzed audio signal sample.
  • the analyzing data may contain source information indicative of the broadcast station which is associated with the respective analyzed audio signal sample.
  • the recognition device 30 extracts multiple items of data from the analyzing data over time, which in this embodiment were received from the audio content analysis system 40. For example, the recognition device 30 extracts one or more of the following items of data from the received analyzing data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, and/or music year.
  • the recognition device 30 is configured to capture multiple audio signal samples As received from the audio circuitry 22 repeatedly over time.
  • the audio content analysis system 40 analyzes the captured audio signal samples As and provides the analyzing data indicative of audio content of the analyzed audio signal samples to the recognition device 30.
  • the apparatus 1 further comprises a memory 70 adapted to store therein a database 71.
  • This database 71 contains multiple items of data which were extracted by the recognition device 30 over time and source information (e.g. frequency) indicative of one or more broadcast stations (such as SWR1, Energy, etc. shown in Fig. 2B ) which are associated with the extracted items of data.
  • source information e.g. frequency
  • broadcast stations such as SWR1, Energy, etc. shown in Fig. 2B
  • the multiple items of data stored in the database 71 are items of data which include a transmission frequency of broadcast signals, a broadcast station name, a program name, a content type, a music artist name, a music song genre, a music song chart history, and/or a music year.
  • the apparatus 1 further comprises an analyzing device 50 which analyzes a plurality of the multiple items of data stored in the database 71 for at least one broadcast station (such as SWR1 and/or Energy, etc., shown in Fig. 2B ) which are associated with the analyzed items of data, and it provides an analyzing result for this broadcast station which is associated with the analyzed items of data (such as shown in Fig. 2B for SWR1, Energy, etc.).
  • the analyzing device may comprise a microprocessor, or may be implemented by using the same microprocessor(s) as the recognition device 30.
  • An information providing device 60 such as a display device and/or a loudspeaker or other information providing device, provides information to a user based on the analyzing result provided by the analyzing device 50, i.e. provides information based on the analyzing result for the one or more broadcast stations which are associated with the analyzed items of data (such as for SWR1, Energy, etc. shown in Fig. 2B ). According to the embodiment of Fig. 2B , this information to the user can be provided or divided in multiple portions, such as for speech, music, top artists, etc.
  • the recognition device 30 performs the audio content recognition process with the audio content analysis system 40 as a permanent background process when receiving the broadcast signals by the receiving device 20.
  • the recognition device 30 performs the audio content recognition process with the audio content analysis system 40 for a plurality of broadcast stations 2, particularly for each available broadcast station, i.e. which can currently be received by the receiving device 20.
  • a music analysis service of an audio content analysis system could permanently run as a background process in any radio tuner of a receiving apparatus. It may permanently take short clips (or audio signal samples) of the content of each broadcast station (e.g. audio clips in a double tuner concept, similar to scanning RDS information in the background). Then, the music analysis service may store music information together with the source information and track the history over time. As an analysis result, the analyzing device of the receiving apparatus could provide detailed information about each broadcast station.
  • the described music recognition process is performed repeatedly for building up an information history.
  • the database stored in the memory serves to store the recognition result (in other words, items of data extracted from the analyzing data) for each broadcast station over a period time.
  • the recognition results stored in the database may be analyzed and compared, and a typical and/or average content (not, e.g., a current song only) of each broadcast station may be determined.
  • the determined typical and/or average content information for each broadcast station may be communicated to the user, not only the currently playing song's information (such as is currently available from RDS data). Then the user can easily select which broadcast station is matching his taste or mood for listening.
  • Fig. 2A shows an exemplary display of information, e.g.
  • a broadcast station list with RDS content information as currently available in the prior art.
  • the user sees the currently playing song name and/or a station list, as depicted in Fig. 2A . If the user likes this song, or if the user wants to listen to a pop music station (like SWR1 shown in the first line of the list of Fig. 2A ), the user switches to that broadcast station. But then, it may turn out that the user gets disappointed, because SWR1 is basically a talk radio station, and the played music was the only music played for a long time! The rest of the time turns out to be talk, not music, so that the user may get disappointed.
  • SWR1 is basically a talk radio station
  • FIG. 2B shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with detailed content information according to an embodiment of the invention, which can avoid such a disappointment and help the user to select a better fitting broadcast station to listen to.
  • Fig. 2B more detailed information is shown which has been determined over time according to actually broadcasted and analyzed audio signal samples (i.e. the broadcasted music itself) with particular items of data extracted from the analyzing data over time.
  • SWR1 first line of the list of Fig.
  • an additional benefit for the user is, for example, reduced driver's distraction, because the user is able to select a broadcast station which fits best for a long period of time as a result of the provided analyzing result with content history and up-to-date information, and therefore the user does not need to switch broadcast stations very often.
  • Fig. 3 shows a flowchart diagram of a method for providing information associated with received broadcast signals according to an embodiment of the invention.
  • a tuning step to the next broadcast station is performed, e.g. by actuating a switch by the user at the tuner interface.
  • a new station content snapshot (“SCS") is generated. That is, an audio content recognition process is started by the recognition device 30 for that broadcast station, with multiple items of data to be extracted from analyzing data over time and stored as SCS in the database 71 in the memory 70.
  • SCS may contain multiple data fields, such as program name, content type, music artist name, etc.
  • the program name can be determined from an RDS data portion transmitted with the broadcast signals, or can simply be the frequency of the transmitted broadcast signals.
  • the frequency can be overwritten by the corresponding RDS program station (PS).
  • step S4 a short audio signal sample or audio clip for the broadcast station tuned in step S1 is captured as an input for the audio content recognition process.
  • step S5 the content type is analyzed. If the content type is speech (step S6), this is stored in the database 71 of memory 70 and the process goes on to step S10. If the content type is music, this is stored in the database 71 of memory 70 (step S7) and the process goes on to step S8 which sends the captured audio clip or audio signal sample to the audio content analysis system 40 (here designated as music info service), which may be installed in the vehicle ("on-board"), and/or on a server computer (“web server”), and/or may be formed by SHAZAM, as described above.
  • step S9 the analyzing data provided from the audio content analysis system 40 is received and items of data extracted therefrom (SCS data set containing items of data, such as content type, artist name, song genre, etc.) are stored in the database 71.
  • SCS data set items of data, such as content type, artist name, song genre
  • step S10 it is determined whether a data set associated with the program name (i.e., frequency or RDS PS) is already stored in the database 71 ("RSP-DB"). If not, then a new radio station profile (“RSP") data set is created (step S11), i.e. a new data set which is associated with the broadcast station tuned in step S1. In this new RSP data set, the SCS data set with the items of data according to step S9 is stored. In any further iterations of the process as shown in Fig. 3 , further SCS data sets with items of data according to step S9 will be added to the RSP data set. Thus, over time, a RSP data set contains multiple SCS data sets, thus building a data history associated with the broadcast station over time. A RSP data set may additionally contain some statistics calculated over the several stored SCS data sets, such as percent music versus speech, highest percent of music genre, top decades of music year, a music song chart history, etc. After step S11, the process returns to step S1.
  • RSS radio station
  • step S10 If it is determined in step S10 that a RSP data set for that broadcast station already exists, then the SCS data set with items of data according to step S9 is added to the related RSP data set for further statistical analysis (step S12).
  • step S13 the depth of the RSP data set ("RSP-depth") is increased by 1, and in step S14 the recent SCS data set is deleted, since it is now stored in the associated RSP data set for that broadcast station. Then, the process returns to step S1.
  • RSP-depth the depth of the RSP data set
  • the receiving device 20 or recognition device 30 is adapted to receive analyzing data indicative of already analyzed audio content information associated with at least one broadcast station from a remote provider for storing in the database 71.
  • the receiving device 20 or recognition device 30 may receive over the antenna 24 or network 80 an RSP data set and/or a SCS data set associated with a particular broadcast station from a remote provider (not shown), which may be supplemented in the database 71.
  • Fig. 4 shows an example for interpretation of items of data (such as stored with a SCS data set according to Fig. 3 ) for providing some statistics, and providing analyzing results for broadcast stations according to an embodiment of the invention.
  • RSP data set In the left column, an example of a RSP data set is shown. In the mid column, an exemplary interpretation/calculation formula is listed for a respective RSP data set entry.
  • the respective data fields of multiple RSP data sets, such as program name, content type, etc., are interpreted for statistical purposes according to this interpretation/calculation formula.
  • GUI graphical user interface
  • the multiple items of data stored in the database are analyzed by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Circuits Of Receivers In General (AREA)

Claims (14)

  1. Empfangsgerät (1) zum Empfang von Rundfunksignalen, das aufweist:
    - eine Empfangsvorrichtung (20), die dafür konfiguriert ist, Rundfunksignale (BS) zu empfangen,
    - eine Erkennungsvorrichtung (30), die dafür konfiguriert ist, mit einem Audioinhaltsanalysesystem (40) gekoppelt zu werden, und dafür konfiguriert ist, zusammen mit dem Audioinhaltsanalysesystem (40) einen Audioinhaltserkennungsprozess für eine Mehrzahl von Rundfunkstationen (SWR1, Energy) auszuführen, wobei der Audioinhaltserkennungsprozess dafür konfiguriert ist, Audiosignalabtastwerte (As), die mit den Rundfunksignalen gesendet werden, im Verlauf von Zeit wiederholt zu erfassen, um die erfassten Audiosignalabtastwerte (As) zu analysieren, und dafür Analysedaten bereitzustellen, die den Audioinhalt der analysierten Audiosignalabtastwerte (As) anzeigen, wobei die Erkennungsvorrichtung (30) ferner dafür konfiguriert ist, im Verlauf von Zeit mehrere Datenelemente aus den Analysedaten zu extrahieren, wobei der Audioinhaltserkennungsprozess wiederholt ausgeführt wird, um eine Informationshistorie aufzubauen,
    - einen Speicher (70), der dafür ausgelegt ist, darin eine Datenbank (71) zu speichern, die die mehreren Datenelemente, die im Verlauf von Zeit für jede der Rundfunkstationen über einen Zeitraum extrahiert wurden, und Quelleninformation enthält, die die den extrahierten Datenelementen zugeordneten Rundfunkstationen (SWR1, Energy) anzeigt,
    - eine Analysevorrichtung (50), die dafür konfiguriert ist, eine Mehrzahl der mehreren in der Datenbank (71) gespeicherten Datenelemente für mindestens eine den analysierten Datenelementen zugeordnete Rundfunkstation (SWR1, Energy) zu analysieren und ein Analyseergebnis für die mindestens eine den analysierten Datenelementen zugeordnete Rundfunkstation (SWR1, Energy) bereitzustellen, und
    - eine Informationsbereitstellungsvorrichtung (60), die dafür konfiguriert ist, einem Nutzer auf Grundlage des Analyseergebnisses für die mindestens eine den analysierten Datenelementen zugeordnete Rundfunkstation (SWR1, Energy) Information bereitzustellen.
  2. Empfangsgerät nach Anspruch 1, wobei die Erkennungsvorrichtung (30) dafür konfiguriert ist, den Audioinhaltserkennungsprozess mit dem Audioinhaltsanalysesystem (40) als einen permanenten Hintergrundprozess beim Empfang der Rundfunksignale auszuführen.
  3. Empfangsgerät nach Anspruch 1 oder 2, wobei die Erkennungsvorrichtung (30) dafür konfiguriert ist, den Audioinhaltserkennungsprozess mit dem Audioinhaltsanalysesystem (40) für jede Rundfunkstation auszuführen, die von der Empfangsvorrichtung (20) empfangen werden kann.
  4. Empfangsgerät nach einem der Ansprüche 1 bis 3, wobei die Empfangsvorrichtung (20) eine Mehrfach-Tuner-Konfiguration aufweist und die Erkennungsvorrichtung (30) dafür konfiguriert ist, den Audioinhaltserkennungsprozess unter Verwendung eines der mehreren Tuner auszuführen, der nicht für die aktuelle Inhaltswiedergabe verwendet wird.
  5. Empfangsgerät nach einem der Ansprüche 1 bis 4, wobei die Erkennungsvorrichtung (30) dafür konfiguriert ist, mindestens eines der folgenden Datenelemente zu extrahieren: Sendefrequenz der Rundfunksignale, Name der Rundfunkstation, Programmname, Art des Inhalts, Name des Musikkünstlers, Genre des Lieds, Charts-Historie des Lieds, Musikjahr.
  6. Empfangsgerät nach einem der Ansprüche 1 bis 5, wobei die mehreren in der Datenbank (71) gespeicherten Datenelemente jeweils mindestens eines der folgenden umfassen: Sendefrequenz der Rundfunksignale, Name der Rundfunkstation, Programmname, Art des Inhalts, Name des Musikkünstlers, Genre des Lieds, Charts-Historie des Lieds, Musikjahr.
  7. Empfangsgerät nach einem der Ansprüche 1 bis 6, wobei die Erkennungsvorrichtung (30) dafür konfiguriert ist, mit dem Audioinhaltsanalysesystem (40) gekoppelt zu werden, das sich von dem Empfangsgerät (1) entfernt befindet.
  8. Empfangsgerät nach einem der Ansprüche 1 bis 7, wobei die Erkennungsvorrichtung (30) dafür konfiguriert ist, mit dem Audioinhaltsanalysesystem (40) über ein Netzwerk (80) gekoppelt zu werden, insbesondere über das Internet und/oder ein Telekommunikationsnetzwerk.
  9. Empfangsgerät nach einem der Ansprüche 1 bis 8, wobei die Erkennungsvorrichtung (30) dafür konfiguriert ist, die mit den Rundfunksignalen gesendeten Audiosignalabtastwerte (As) im Verlauf von Zeit wiederholt zu erfassen, und das Audioinhaltsanalysesystem (40) dafür konfiguriert ist, die erfassten Audiosignalabtastwerte zu analysieren und die Analysedaten, die den Audioinhalt der analysierten Audiosignalabtastwerte anzeigen, der Erkennungsvorrichtung (30) bereitzustellen.
  10. Empfangsgerät nach einem der Ansprüche 1 bis 9, wobei die Empfangsvorrichtung (20) oder die Erkennungsvorrichtung (30) dafür ausgebildet ist, Analysedaten, die die der mindestens einen Rundfunkstation (SWR1, Energy) zugeordnete analysierte Audioinhaltsinformation anzeigen, von einem entfernten Provider zum Speichern in der Datenbank (71) zu empfangen.
  11. Empfangsgerät nach einem der Ansprüche 1 bis 10, wobei die Analysevorrichtung (50) dafür konfiguriert ist, die mehreren in der Datenbank (71) gespeicherten Datenelemente durch Ausführen mindestens eines der folgenden Vorgänge zu analysieren: Berechnen eines Durchschnittsinhalts aus den mehreren Datenelementen für jede Rundfunkstation, Berechnen eines Verhältnisses von Musikinhalt zu Sprachinhalt für jede Rundfunkstation, Berechnen eines Anteils von Musikinhalt, der in einer öffentlichen Chart-Auflistung gelistet ist, Berechnen eines häufigsten Genres des Musikinhalts für jede Rundfunkstation.
  12. Verfahren zur Bereitstellung von Information, die den Rundfunksignalen zugeordnet ist, wobei das Verfahren aufweist:
    - Empfangen von Rundfunksignalen (BS) mit einer Empfangsvorrichtung (20),
    - Ausführen eines Audioinhaltserkennungsprozesses für eine Mehrzahl von Rundfunkstationen (SWR1, Energy), der mit den Rundfunksignalen (BS) gesendete Audiosignalabtastwerte (As) im Verlauf von Zeit wiederholt erfasst, die erfassten Audiosignalabtastwerte (As) analysiert und Analysedaten bereitstellt, die den Audioinhalt der analysierten Audiosignalabtastwerte (As) anzeigen,
    - Extrahieren mehrerer Datenelemente aus den Analysedaten im Verlauf von Zeit, wobei der Audioinhaltserkennungsprozess wiederholt ausgeführt wird, um eine Informationshistorie aufzubauen,
    - Speichern von mehreren im Verlauf von Zeit für jede der Rundfunkstationen über einen Zeitraum extrahierten Datenelementen und Quelleninformation, die die den extrahierten Datenelementen zugeordneten Rundfunkstationen (SWR1, Energy) anzeigt, in einer Datenbank (71),
    - Analysieren einer Mehrzahl der mehreren in der Datenbank (71) gespeicherten Datenelemente für mindestens eine den analysierten Datenelementen zugeordnete Rundfunkstation (SWR1, Energy) und Bereitstellen eines Analyseergebnisses für die mindestens eine den analysierten Datenelementen zugeordnete Rundfunkstation (SWR1, Energy), und
    - Bereitstellen von Information für einen Nutzer auf Grundlage des Analyseergebnisses für die mindestens eine den analysierten Datenelementen zugeordnete Rundfunkstation (SWR1, Energy).
  13. Verfahren nach Anspruch 12, wobei das Verfahren zusätzlich das Speichern von Information, die mit den Rundfunksignalen (BS) gesendete RDS-Information (Rx) enthält oder davon abgeleitet ist, in der Datenbank (71) aufweist.
  14. Fahrzeug, das ein Empfangsgerät (1) nach einem der Ansprüche 1 bis 11 aufweist.
EP14163387.5A 2014-04-03 2014-04-03 Empfangsvorrichtung und Verfahren zur Bereitstellung von Informationen im Zusammenhang mit empfangenen Rundfunksignalen Active EP2928094B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP14163387.5A EP2928094B1 (de) 2014-04-03 2014-04-03 Empfangsvorrichtung und Verfahren zur Bereitstellung von Informationen im Zusammenhang mit empfangenen Rundfunksignalen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14163387.5A EP2928094B1 (de) 2014-04-03 2014-04-03 Empfangsvorrichtung und Verfahren zur Bereitstellung von Informationen im Zusammenhang mit empfangenen Rundfunksignalen

Publications (2)

Publication Number Publication Date
EP2928094A1 EP2928094A1 (de) 2015-10-07
EP2928094B1 true EP2928094B1 (de) 2018-05-30

Family

ID=50478719

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14163387.5A Active EP2928094B1 (de) 2014-04-03 2014-04-03 Empfangsvorrichtung und Verfahren zur Bereitstellung von Informationen im Zusammenhang mit empfangenen Rundfunksignalen

Country Status (1)

Country Link
EP (1) EP2928094B1 (de)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016221910A1 (de) * 2016-11-08 2018-05-09 Volkswagen Aktiengesellschaft Verfahren, Vorrichtung und computerlesbares Speichermedium mit Instruktionen zum Ermitteln von Daten zu einem Radiosender
DE102017009206B3 (de) 2017-09-30 2019-02-14 Preh Car Connect Gmbh Verarbeiten eines Rundfunksignals

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000058940A2 (en) * 1999-03-29 2000-10-05 Gotuit Media, Inc. Electronic music and programme storage, comprising the recognition of programme segments, such as recorded musical performances a nd system for the management and playback of these programme segments
JP4427146B2 (ja) 1999-12-27 2010-03-03 株式会社東芝 デジタル放送受信装置及びその制御方法
US7986913B2 (en) * 2004-02-19 2011-07-26 Landmark Digital Services, Llc Method and apparatus for identificaton of broadcast source
JP2006190027A (ja) 2005-01-05 2006-07-20 Sharp Corp 情報処理装置
EP2070231B1 (de) * 2006-10-03 2013-07-03 Shazam Entertainment, Ltd. Verfahren zur identifikation verteilter rundfunkinhalte mit hohem durchsatz
DE102007009730A1 (de) * 2007-02-28 2008-09-18 Continental Automotive Gmbh Verfahren und Vorrichtung zum Bereitstellen von Informationen zu Radiosendungen
US8331966B2 (en) * 2009-05-15 2012-12-11 Apple Inc. Content selection based on simulcast data
US20120129476A1 (en) * 2010-11-24 2012-05-24 Visteon Global Technologies, Inc. Radio system including terrestrial and internet radio
EP2541813A1 (de) * 2011-06-29 2013-01-02 Harman Becker Automotive Systems GmbH Vorrichtung und Verfahren zur Tonwiedergabesteuerung
US20130318114A1 (en) * 2012-05-13 2013-11-28 Harry E. Emerson, III Discovery of music artist and title by broadcast radio receivers

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
EP2928094A1 (de) 2015-10-07

Similar Documents

Publication Publication Date Title
US7643807B2 (en) Methods for using broadcast media content information and related broadcast media receivers/playback devices
US9563699B1 (en) System and method for matching a query against a broadcast stream
US20070281606A1 (en) Systems and methods for acquiring songs or products associated with radio broadcasts
US9159076B2 (en) User answer collection server, user answer collection system, broadcast reception apparatus and control method
EP2928094B1 (de) Empfangsvorrichtung und Verfahren zur Bereitstellung von Informationen im Zusammenhang mit empfangenen Rundfunksignalen
WO2020142426A1 (en) Generation of media station previews using a secondary tuner
WO2020142339A1 (en) Generation of media station previews using a reference database
EP1380126B1 (de) Unterhaltungsgerät mit suchfunktion nach artgleichen daten zu den momentan wiedergegebenen daten
US20120117044A1 (en) Music providing system and apparatus using music broadcasting and music providing method using the same
EP3160067A1 (de) Automobil-rundfunkempfangsvorrichtung und verfahren zum bereitstellen wenigstens einer kanalliste von rundfunkkanälen darin
KR20050085829A (ko) 오디오 신호 식별 방법 및 시스템
US20100159860A1 (en) Method for displaying other stations now playing list
CN102055541B (zh) 多路复用广播接收机
CN105577305B (zh) 多路复用数据广播接收装置及其控制方法
JP3636419B2 (ja) デジタルオーディオ放送の受信機
JP2709588B2 (ja) デジタルデータ多重システムの受信方法
JPH11122204A (ja) 音声信号を利用した放送確認システム、及びこのシステムに使用される音声素材制作装置及び放送確認装置
KR20170008092A (ko) 이종 오디오 방송간 전환 방법
JP3968541B2 (ja) デジタルオーディオ放送の受信機
US10528957B2 (en) Systems and methods for providing broadcast data analysis
US20240039651A1 (en) Radio tuner system using metadata and method thereof
JP4136986B2 (ja) デジタル音楽放送受信装置
WO2019008612A1 (en) METHOD FOR ACCESSING ADDITIONAL INTERNET CONTENT ASSOCIATED WITH RADIO AND / OR TELEVISION PROGRAM
KR101630845B1 (ko) 음악 인식 방법과, 이를 이용한 방송 음악 검색 시스템 및 방송 음악 검색 서비스 제공 방법
RU2307472C2 (ru) Идентификация изменений в вещаемой базе данных

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150325

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17Q First examination report despatched

Effective date: 20160712

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180103

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1004697

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014026072

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20180530

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180830

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180830

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180831

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1004697

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014026072

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20190301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20140403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180530

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240419

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240418

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240425

Year of fee payment: 11