EP2928094B1 - Receiving apparatus and method of providing information associated with received broadcast signals - Google Patents
Receiving apparatus and method of providing information associated with received broadcast signals Download PDFInfo
- Publication number
- EP2928094B1 EP2928094B1 EP14163387.5A EP14163387A EP2928094B1 EP 2928094 B1 EP2928094 B1 EP 2928094B1 EP 14163387 A EP14163387 A EP 14163387A EP 2928094 B1 EP2928094 B1 EP 2928094B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- data
- broadcast
- audio content
- music
- items
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 47
- 238000004458 analytical method Methods 0.000 claims description 48
- 230000005236 sound signal Effects 0.000 claims description 38
- 102100031880 Helicase SRCAP Human genes 0.000 claims description 19
- 101000704158 Homo sapiens Helicase SRCAP Proteins 0.000 claims description 19
- 230000005540 biological transmission Effects 0.000 claims description 7
- 239000000284 extract Substances 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000036651 mood Effects 0.000 description 2
- 230000010365 information processing Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
- H04H60/58—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of audio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
- H04H60/37—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
- H04H60/372—Programme
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
- H04H60/38—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space
- H04H60/41—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas
- H04H60/43—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas for identifying broadcast channels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
- H04H60/38—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space
- H04H60/41—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas
- H04H60/44—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying broadcast time or space for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas for identifying broadcast stations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
- H04H60/47—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for recognising genres
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/61—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
- H04H60/65—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 for using the result on users' side
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H2201/00—Aspects of broadcast communication
- H04H2201/10—Aspects of broadcast communication characterised by the type of broadcast system
- H04H2201/13—Aspects of broadcast communication characterised by the type of broadcast system radio data system/radio broadcast data system [RDS/RBDS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H2201/00—Aspects of broadcast communication
- H04H2201/60—Aspects of broadcast communication characterised in that the receiver comprises more than one tuner
Definitions
- the present invention is related to a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, and to a method of providing information associated with received broadcast signals.
- a broadcast signal it is relatively common for a broadcast signal to include both an audio signal (either stereo or monophonic) and a RDS signal, where the RDS signal contains information such as the broadcast station name, program type, music information, artist information, and traffic information.
- These multiplexed broadcast signals are often transmitted from a base or broadcast station to individual receivers via frequency modulation (“FM"), where information is conveyed through variations of the frequency of the transmitted signal, or via amplitude modulation (“AM”), where information is conveyed through variations of the amplitude of the transmitted signal.
- FM frequency modulation
- AM amplitude modulation
- a broadcast signal When a broadcast signal is received by a receiving device, it is typically demodulated by a demodulator circuit and passed to both audio circuitry and RDS receiver circuitry included in the receiving device.
- the audio circuitry can extract the audio portion of the signal (e.g., music or speech) and prepare it for playback through a speaker or other output device.
- the RDS receiver circuitry can extract the RDS portion of the signal and prepare it for processing by appropriate data processing circuitry.
- the data processing circuitry can display part or all of the extracted data to the user as text on a suitable user interface. For example, via the RDS portion a broadcast station can transmit content description for its broadcast station, such as announcing music type (like "pop music” or "classical music” or "talk”). It can also transmit some detailed description via radio text.
- RDS data is often too general. For example, it is not providing enough information for a user to actually undestand the difference between several broadcast stations. For instance, many broadcast stations are labelling themselves as "pop music", wherein any further distinction is not available and cannot be determined from the RDS data. Moreover, RDS data is often inaccurate, because the content is often provided by the broadcast station for its own advertisement. Furthermore, content information support technologies are limited to specific broadcasting methods, e.g. RDS is only for FM broadcast stations, not on AM. These drawbacks are even more present in an automotive environment, such as in a vehicle where the driver has typically only limited time and attention available for searching for appropriate broadcast stations the driver likes to listen to without compromising driving safety.
- JP 2001-186429 A discloses a digital broadcast receiver that stores information denoting a broadcast schedule of programs having been acquired before without discarding the information and effectively utilizes the past information for future program retrieval.
- a storage section stores received information denoting broadcast schedules of past programs whose broadcast is finished without discarding the information. Then the past program is retrieved from information denoting the broadcast schedule of the past program whose broadcast has already been finished, the information denoting the broadcast schedule of the past program can effectively be utilized for the retrieval of a future program in the case of retrieving a program belonging to the same title or the series as that of the retrieved past program from the information denoting the broadcast schedule of a future program going to be broadcast from now.
- JP 2006-190027 A discloses an information processing device which is configured to show music data by a music recognition means on a display in real time when the music data are included in a content of TV broadcasting and the like.
- a music data display system extracts information on a characteristic quantity by a characteristic quantity information extracting device from the music information included in a content of TV broadcasting and the like received by a tuner, and transmits the information on a characteristic quantity to a server through the Internet.
- the server recognizes the music by carrying out the matching of the information on a characteristic quantity and the music data included in a music information database, and transmits information on a music title, information on an artist, and the like corresponding to the music to the characteristic quantity information extracting device as the recognition result.
- the recognition result received by the characteristic quantity information extracting device is associated with the content including the original music information and recorded in a storage device.
- the content recorded in the storage device is reproduced, the music is outputted from a speaker, and, at the same time, the recognition result is shown on a display.
- Further similar content analysing systems are disclosed in the publications EP 2 541 813 A1 US 2012/129476 A1 US 2013/318114 A1 and US 2010/291861 A1 . It is an object of the present invention to provide a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals which is capable of reducing the drawbacks described above with respect to limited capabilities of RDS information and which can improve user operability of such receiving apparatus.
- the present invention is related to a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals according to the independent claims.
- a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, a recognition device configured to be coupled with an audio content analysis system and configured to perform an audio content recognition process together with the audio content analysis system, wherein the audio content recognition process is configured to capture audio signal samples transmitted with the broadcast signals repeatedly over time, to analyze the captured audio signal samples, and to provide analyzing data indicative of audio content of the analyzed audio signal samples, the recognition device further configured to extract multiple items of data from the analyzing data over time, a memory adapted to store therein a database containing multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, an analyzing device which is configured to analyze a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and to provide an analyzing result for the at least one broadcast station associated with the analyzed items of data, and an information providing device which is configured to provide information to a user based on the analyzing result for the at least
- a method of providing information associated with broadcast signals comprising receiving broadcast signals with a receiving device, for example in a vehicle, performing an audio content recognition process which captures audio signal samples transmitted with the broadcast signals repeatedly over time, analyzes the captured audio signal samples, and provides analyzing data indicative of audio content of the analyzed audio signal samples, extracting multiple items of data from the analyzing data over time, storing in a database multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, analyzing a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and providing an analyzing result for the at least one broadcast station associated with the analyzed items of data, and providing information to a user based on the analyzing result for the at least one broadcast station associated with the analyzed items of data.
- the invention also relates to a vehicle comprising a receiving apparatus according to the invention.
- a vehicle comprising a receiving apparatus according to the invention.
- the analyzing result provided by the analyzing device for one or more of the broadcast stations, which may be provided to the user, is a result of a real analysis, not of a broadcast station's own information and/or advertisement.
- a broadcast station may submit an information like "non-stop best hits" over the RDS portion of the broadcast signals, however a real analysis would show that in fact only some music content is broadcasted by that broadcast station, wherein in fact the station broadcasts a lot of talk in between, contrary to its transmitted RDS information "non-stop best hits".
- the invention provides the advantage that the typical or average actual content information for each received broadcast station may be communicated to the user, not only the information of, e.g., an individual song which is currently played by a broadcast station, the broadcast signals of which are currently received. The user can then easily select which broadcast station is actually matching his taste or mood for listening because of the provided typical or average actual content information about that broadcast station.
- the recognition device is configured to perform the audio content recognition process with the audio content analysis system as a permanent background process when receiving the broadcast signals.
- the recognition device is configured to perform the audio content recognition process with the audio content analysis system for a plurality of broadcast stations, particularly for each available broadcast station.
- the receiving device comprises a multiple tuner configuration and the recognition device is configured to perform the audio content recognition process using one of the multiple tuners which is not used for current content reproduction.
- the recognition device is configured to extract at least one of the following items of data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
- the multiple items of data stored in the database each include at least one of the following: transmission frequency of broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
- the recognition device is configured to be coupled with the audio content analysis system which is remote from the receiving apparatus.
- the recognition device is configured to be coupled with the audio content analysis system through a network connection, particularly through the Internet and/or a telecommunications network.
- an audio content analysis system there may be used a server provider system, as e.g. described in JP 2006-190027 A mentioned above, which recognizes the music contained in the captured audio signal samples by analyzing (e.g. matching) of the captured audio signal samples and any music data included in a music information database, the server provider system has access to.
- a server provider system as e.g. described in JP 2006-190027 A mentioned above, which recognizes the music contained in the captured audio signal samples by analyzing (e.g. matching) of the captured audio signal samples and any music data included in a music information database, the server provider system has access to.
- music analysis service systems available to be used as an audio content analysis system in connection with the present invention, such as the known "SHAZAM” music analysis service or similar.
- Such music analysis service systems can, e.g., identify songs based on short audio signal samples and internet databases.
- the "SHAZAM” music analysis service is providing detailed information about the content, but it does not track the content history and it does not link the content to an audio source. Therefore, from this music analysis service alone, the user cannot understand which source (e.g. broadcast station) is playing his favourite type of music.
- the recognition device is configured to capture the audio signal samples transmitted with the broadcast signals repeatedly over time and to send the captured audio signal samples to the audio content analysis system, whereas the audio content analysis system (such as "SHAZAM") is capable of analyzing the captured audio signal samples and providing the analyzing data indicative of audio content of the analyzed audio signal samples back to the recognition device.
- the recognition device receives the analyzing data indicative of audio content of the analyzed audio signal samples from the audio content analysis system.
- the receiving device is adapted to receive analyzing data indicative of analyzed audio content information associated with at least one broadcast station from a remote provider for storing in the database.
- any information which is normally produced by the recognition device and the analyzing device can also be received from a remote provider, so that the database stored in the memory may be supplemented by the analyzing data from the remote provider.
- the analyzing device is configured to analyze the multiple items of data stored in the database by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.
- An embodiment according to the invention may additionally comprise storing information in the database which contains or is derived from RDS information transmitted with the broadcast signals.
- the contents of the database and the analyzing results can be supplemented by RDS information associated with the respective broadcast station.
- the receiving apparatus according to the invention is an automotive receiving apparatus.
- Fig. 1 shows a receiving apparatus for receiving broadcast signals according to an exemplary embodiment of the invention in a schematic block diagram.
- the receiving apparatus 1 is an automotive receiving apparatus, which may be installed in a vehicle, e.g., in a head unit thereof (not shown), receives broadcast signals BS which are broadcast from an exemplary broadcast station 2.
- the receiving apparatus 1 comprises a receiving device 20 which may be a conventional receiving device as known in the art.
- the exemplary receiving device 20 (another type thereof can also be used, e.g.
- the demodulator 21 can demodulate the received broadcast signal BS by a frequency determined by the station or frequency that is being tuned to.
- the demodulator 21 can be analog, digital, or a combination of the two.
- the output signal of demodulator 21 can be received by audio circuitry 22, which can extract and decode the audio portion As of the received signal and send it to a speaker circuitry.
- the output signal of demodulator 21 can also be received by RDS receiver circuitry 23 which can extract and decode the RDS portion Rx of the received signal and send it to any appropriate output circuitry.
- the extracted RDS data may be displayed to a user via any suitable display circuitry, or may be processed according to embodiments of the invention.
- the apparatus 1 further comprises a recognition device 30 which is coupled with the receiving device 20 and, in this embodiment, receives the audio portions As output by the receiving device 20 (particularly output by the audio circuitry 22). Further, in this embodiment, it receives the RDS portions Rx output by the receiving device 20 (particularly output by the RDS receiver circuitry 23).
- a recognition device 30 which is coupled with the receiving device 20 and, in this embodiment, receives the audio portions As output by the receiving device 20 (particularly output by the audio circuitry 22). Further, in this embodiment, it receives the RDS portions Rx output by the receiving device 20 (particularly output by the RDS receiver circuitry 23).
- the receiving device 20 comprises a multiple tuner configuration (not explicitly shown), which is known in the art, and the recognition device 30 is configured to perform an audio content recognition process, as described herein below, using one of the multiple tuners which is not used for current content reproduction.
- the recognition device 30 is configured to be coupled with an audio content analysis system 40 (which may be remote from the automotive receiving apparatus 1, such as "SHAZAM” described above provided by a server computer, or may be installed in the vehicle, thus is “on-board”).
- the recognition device 30 is coupled with the audio content analysis system 40 directly or via a network 80, such as the Internet and/or any other telecommunications network and/or a vehicle communications network bus, like the CAN-bus.
- the receiving apparatus 1, which may be installed in a vehicle may use any known wired or wireless technology for communication with the audio content analysis system 40 either directly or over the network 80.
- the audio content analysis system 40 may also be implemented in the vehicle, e.g. in a portion of a head unit with appropriate memory capabilities, or may be a distributed system with parts thereof installed in the vehicle and other parts thereof provided on a remote server computer and accessible via the network 80.
- the recognition device 30 may be implemented in the vehicle, e.g., by comprising one or more microprocessors, for example installed in the head unit (not shown), wherein the one or more microprocessors have access to a database stored in a memory (e.g., located in the vehicle or on a remote server computer) which are part of or form the audio content analysis system 40.
- the recognition device 30 and the audio content analysis system 40 may both comprise respective one or more microprocessors, e.g. the recognition device 30 comprising a microprocessor installed in the vehicle and the audio content analysis system 40 comprising a microprocessor installed in a remote server computer, which microprocessors communicate with each other, e.g. over the network 80.
- a microprocessor of the recognition device 30 provides commands and/or data to the audio content analysis system 40 (e.g. a database or a server computer) when performing the audio content recognition process, and receives data and/or commands therefrom.
- the audio content analysis system 40 e.g. a microprocessor thereof
- the recognition device 30 which is configured to receive such commands and/or data for performing the audio content recognition process.
- the audio content recognition process performed jointly by the recognition device 30 and the audio content analysis system 40 captures audio signal samples As (or audio clips) repeatedly over time, analyzes the captured audio signal samples As, and provides corresponding analyzing data indicative of audio content (such as music content) of the analyzed audio signal samples As repeatedly over time.
- analyzing the captured audio signal samples may comprise comparing their audio content or parts thereof (such as the music itself) with entries in a database stored in or retrieved by the audio content analysis system 40.
- the analyzing data may contain information regarding music title, music artist name, and/or genre etc. of the respective analyzed audio signal sample.
- the analyzing data may contain source information indicative of the broadcast station which is associated with the respective analyzed audio signal sample.
- the recognition device 30 extracts multiple items of data from the analyzing data over time, which in this embodiment were received from the audio content analysis system 40. For example, the recognition device 30 extracts one or more of the following items of data from the received analyzing data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, and/or music year.
- the recognition device 30 is configured to capture multiple audio signal samples As received from the audio circuitry 22 repeatedly over time.
- the audio content analysis system 40 analyzes the captured audio signal samples As and provides the analyzing data indicative of audio content of the analyzed audio signal samples to the recognition device 30.
- the apparatus 1 further comprises a memory 70 adapted to store therein a database 71.
- This database 71 contains multiple items of data which were extracted by the recognition device 30 over time and source information (e.g. frequency) indicative of one or more broadcast stations (such as SWR1, Energy, etc. shown in Fig. 2B ) which are associated with the extracted items of data.
- source information e.g. frequency
- broadcast stations such as SWR1, Energy, etc. shown in Fig. 2B
- the multiple items of data stored in the database 71 are items of data which include a transmission frequency of broadcast signals, a broadcast station name, a program name, a content type, a music artist name, a music song genre, a music song chart history, and/or a music year.
- the apparatus 1 further comprises an analyzing device 50 which analyzes a plurality of the multiple items of data stored in the database 71 for at least one broadcast station (such as SWR1 and/or Energy, etc., shown in Fig. 2B ) which are associated with the analyzed items of data, and it provides an analyzing result for this broadcast station which is associated with the analyzed items of data (such as shown in Fig. 2B for SWR1, Energy, etc.).
- the analyzing device may comprise a microprocessor, or may be implemented by using the same microprocessor(s) as the recognition device 30.
- An information providing device 60 such as a display device and/or a loudspeaker or other information providing device, provides information to a user based on the analyzing result provided by the analyzing device 50, i.e. provides information based on the analyzing result for the one or more broadcast stations which are associated with the analyzed items of data (such as for SWR1, Energy, etc. shown in Fig. 2B ). According to the embodiment of Fig. 2B , this information to the user can be provided or divided in multiple portions, such as for speech, music, top artists, etc.
- the recognition device 30 performs the audio content recognition process with the audio content analysis system 40 as a permanent background process when receiving the broadcast signals by the receiving device 20.
- the recognition device 30 performs the audio content recognition process with the audio content analysis system 40 for a plurality of broadcast stations 2, particularly for each available broadcast station, i.e. which can currently be received by the receiving device 20.
- a music analysis service of an audio content analysis system could permanently run as a background process in any radio tuner of a receiving apparatus. It may permanently take short clips (or audio signal samples) of the content of each broadcast station (e.g. audio clips in a double tuner concept, similar to scanning RDS information in the background). Then, the music analysis service may store music information together with the source information and track the history over time. As an analysis result, the analyzing device of the receiving apparatus could provide detailed information about each broadcast station.
- the described music recognition process is performed repeatedly for building up an information history.
- the database stored in the memory serves to store the recognition result (in other words, items of data extracted from the analyzing data) for each broadcast station over a period time.
- the recognition results stored in the database may be analyzed and compared, and a typical and/or average content (not, e.g., a current song only) of each broadcast station may be determined.
- the determined typical and/or average content information for each broadcast station may be communicated to the user, not only the currently playing song's information (such as is currently available from RDS data). Then the user can easily select which broadcast station is matching his taste or mood for listening.
- Fig. 2A shows an exemplary display of information, e.g.
- a broadcast station list with RDS content information as currently available in the prior art.
- the user sees the currently playing song name and/or a station list, as depicted in Fig. 2A . If the user likes this song, or if the user wants to listen to a pop music station (like SWR1 shown in the first line of the list of Fig. 2A ), the user switches to that broadcast station. But then, it may turn out that the user gets disappointed, because SWR1 is basically a talk radio station, and the played music was the only music played for a long time! The rest of the time turns out to be talk, not music, so that the user may get disappointed.
- SWR1 is basically a talk radio station
- FIG. 2B shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with detailed content information according to an embodiment of the invention, which can avoid such a disappointment and help the user to select a better fitting broadcast station to listen to.
- Fig. 2B more detailed information is shown which has been determined over time according to actually broadcasted and analyzed audio signal samples (i.e. the broadcasted music itself) with particular items of data extracted from the analyzing data over time.
- SWR1 first line of the list of Fig.
- an additional benefit for the user is, for example, reduced driver's distraction, because the user is able to select a broadcast station which fits best for a long period of time as a result of the provided analyzing result with content history and up-to-date information, and therefore the user does not need to switch broadcast stations very often.
- Fig. 3 shows a flowchart diagram of a method for providing information associated with received broadcast signals according to an embodiment of the invention.
- a tuning step to the next broadcast station is performed, e.g. by actuating a switch by the user at the tuner interface.
- a new station content snapshot (“SCS") is generated. That is, an audio content recognition process is started by the recognition device 30 for that broadcast station, with multiple items of data to be extracted from analyzing data over time and stored as SCS in the database 71 in the memory 70.
- SCS may contain multiple data fields, such as program name, content type, music artist name, etc.
- the program name can be determined from an RDS data portion transmitted with the broadcast signals, or can simply be the frequency of the transmitted broadcast signals.
- the frequency can be overwritten by the corresponding RDS program station (PS).
- step S4 a short audio signal sample or audio clip for the broadcast station tuned in step S1 is captured as an input for the audio content recognition process.
- step S5 the content type is analyzed. If the content type is speech (step S6), this is stored in the database 71 of memory 70 and the process goes on to step S10. If the content type is music, this is stored in the database 71 of memory 70 (step S7) and the process goes on to step S8 which sends the captured audio clip or audio signal sample to the audio content analysis system 40 (here designated as music info service), which may be installed in the vehicle ("on-board"), and/or on a server computer (“web server”), and/or may be formed by SHAZAM, as described above.
- step S9 the analyzing data provided from the audio content analysis system 40 is received and items of data extracted therefrom (SCS data set containing items of data, such as content type, artist name, song genre, etc.) are stored in the database 71.
- SCS data set items of data, such as content type, artist name, song genre
- step S10 it is determined whether a data set associated with the program name (i.e., frequency or RDS PS) is already stored in the database 71 ("RSP-DB"). If not, then a new radio station profile (“RSP") data set is created (step S11), i.e. a new data set which is associated with the broadcast station tuned in step S1. In this new RSP data set, the SCS data set with the items of data according to step S9 is stored. In any further iterations of the process as shown in Fig. 3 , further SCS data sets with items of data according to step S9 will be added to the RSP data set. Thus, over time, a RSP data set contains multiple SCS data sets, thus building a data history associated with the broadcast station over time. A RSP data set may additionally contain some statistics calculated over the several stored SCS data sets, such as percent music versus speech, highest percent of music genre, top decades of music year, a music song chart history, etc. After step S11, the process returns to step S1.
- RSS radio station
- step S10 If it is determined in step S10 that a RSP data set for that broadcast station already exists, then the SCS data set with items of data according to step S9 is added to the related RSP data set for further statistical analysis (step S12).
- step S13 the depth of the RSP data set ("RSP-depth") is increased by 1, and in step S14 the recent SCS data set is deleted, since it is now stored in the associated RSP data set for that broadcast station. Then, the process returns to step S1.
- RSP-depth the depth of the RSP data set
- the receiving device 20 or recognition device 30 is adapted to receive analyzing data indicative of already analyzed audio content information associated with at least one broadcast station from a remote provider for storing in the database 71.
- the receiving device 20 or recognition device 30 may receive over the antenna 24 or network 80 an RSP data set and/or a SCS data set associated with a particular broadcast station from a remote provider (not shown), which may be supplemented in the database 71.
- Fig. 4 shows an example for interpretation of items of data (such as stored with a SCS data set according to Fig. 3 ) for providing some statistics, and providing analyzing results for broadcast stations according to an embodiment of the invention.
- RSP data set In the left column, an example of a RSP data set is shown. In the mid column, an exemplary interpretation/calculation formula is listed for a respective RSP data set entry.
- the respective data fields of multiple RSP data sets, such as program name, content type, etc., are interpreted for statistical purposes according to this interpretation/calculation formula.
- GUI graphical user interface
- the multiple items of data stored in the database are analyzed by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Circuits Of Receivers In General (AREA)
Description
- The present invention is related to a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, and to a method of providing information associated with received broadcast signals.
- Broadcast signals transmitted by broadcast stations and which can be received by receivers, e.g. installed in a vehicle, often include several components multiplexed together upon transmission. For example, it is relatively common for a broadcast signal to include both an audio signal (either stereo or monophonic) and a RDS signal, where the RDS signal contains information such as the broadcast station name, program type, music information, artist information, and traffic information. These multiplexed broadcast signals are often transmitted from a base or broadcast station to individual receivers via frequency modulation ("FM"), where information is conveyed through variations of the frequency of the transmitted signal, or via amplitude modulation ("AM"), where information is conveyed through variations of the amplitude of the transmitted signal.
- When a broadcast signal is received by a receiving device, it is typically demodulated by a demodulator circuit and passed to both audio circuitry and RDS receiver circuitry included in the receiving device. The audio circuitry can extract the audio portion of the signal (e.g., music or speech) and prepare it for playback through a speaker or other output device. The RDS receiver circuitry can extract the RDS portion of the signal and prepare it for processing by appropriate data processing circuitry. As an example, the data processing circuitry can display part or all of the extracted data to the user as text on a suitable user interface. For example, via the RDS portion a broadcast station can transmit content description for its broadcast station, such as announcing music type (like "pop music" or "classical music" or "talk"). It can also transmit some detailed description via radio text.
- In multiple instances, RDS data is often too general. For example, it is not providing enough information for a user to actually undestand the difference between several broadcast stations. For instance, many broadcast stations are labelling themselves as "pop music", wherein any further distinction is not available and cannot be determined from the RDS data. Moreover, RDS data is often inaccurate, because the content is often provided by the broadcast station for its own advertisement. Furthermore, content information support technologies are limited to specific broadcasting methods, e.g. RDS is only for FM broadcast stations, not on AM. These drawbacks are even more present in an automotive environment, such as in a vehicle where the driver has typically only limited time and attention available for searching for appropriate broadcast stations the driver likes to listen to without compromising driving safety.
-
JP 2001-186429 A -
JP 2006-190027 A publications EP 2 541 813 A1 US 2012/129476 A1 US 2013/318114 A1 andUS 2010/291861 A1 . It is an object of the present invention to provide a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals which is capable of reducing the drawbacks described above with respect to limited capabilities of RDS information and which can improve user operability of such receiving apparatus. - The present invention is related to a receiving apparatus for receiving broadcast signals and a method of providing information associated with received broadcast signals according to the independent claims.
- According to an aspect of the invention, there is provided a receiving apparatus for receiving broadcast signals comprising a receiving device configured to receive broadcast signals, a recognition device configured to be coupled with an audio content analysis system and configured to perform an audio content recognition process together with the audio content analysis system, wherein the audio content recognition process is configured to capture audio signal samples transmitted with the broadcast signals repeatedly over time, to analyze the captured audio signal samples, and to provide analyzing data indicative of audio content of the analyzed audio signal samples, the recognition device further configured to extract multiple items of data from the analyzing data over time, a memory adapted to store therein a database containing multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, an analyzing device which is configured to analyze a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and to provide an analyzing result for the at least one broadcast station associated with the analyzed items of data, and an information providing device which is configured to provide information to a user based on the analyzing result for the at least one broadcast station associated with the analyzed items of data.
- According to another aspect, there is disclosed a method of providing information associated with broadcast signals, for example received in a vehicle, the method comprising receiving broadcast signals with a receiving device, for example in a vehicle, performing an audio content recognition process which captures audio signal samples transmitted with the broadcast signals repeatedly over time, analyzes the captured audio signal samples, and provides analyzing data indicative of audio content of the analyzed audio signal samples, extracting multiple items of data from the analyzing data over time, storing in a database multiple items of data extracted over time and source information indicative of at least one broadcast station associated with the extracted items of data, analyzing a plurality of the multiple items of data stored in the database for at least one broadcast station associated with the analyzed items of data and providing an analyzing result for the at least one broadcast station associated with the analyzed items of data, and providing information to a user based on the analyzing result for the at least one broadcast station associated with the analyzed items of data.
According to another aspect, the invention also relates to a vehicle comprising a receiving apparatus according to the invention.
With the present invention, in principle, detailed information regarding the broadcast stations available for the receiving apparatus can be collected, processed and provided to the user, so that is becomes easy for the user to select preferred content of a particular broadcast station. The analyzing result provided by the analyzing device for one or more of the broadcast stations, which may be provided to the user, is a result of a real analysis, not of a broadcast station's own information and/or advertisement. For example, a broadcast station may submit an information like "non-stop best hits" over the RDS portion of the broadcast signals, however a real analysis would show that in fact only some music content is broadcasted by that broadcast station, wherein in fact the station broadcasts a lot of talk in between, contrary to its transmitted RDS information "non-stop best hits". The invention provides the advantage that the typical or average actual content information for each received broadcast station may be communicated to the user, not only the information of, e.g., an individual song which is currently played by a broadcast station, the broadcast signals of which are currently received. The user can then easily select which broadcast station is actually matching his taste or mood for listening because of the provided typical or average actual content information about that broadcast station.
Advantageously, multiple or all available broadcasting technologies may be used in connection with the present invention, such as FM, AM, DAB, etc. There is no need to switch any broadcasting mode, since, in principle, audio signal samples transmitted with all available broadcasting technologies can be analyzed.
According to an embodiment, the recognition device is configured to perform the audio content recognition process with the audio content analysis system as a permanent background process when receiving the broadcast signals. - According to the invention, the recognition device is configured to perform the audio content recognition process with the audio content analysis system for a plurality of broadcast stations, particularly for each available broadcast station.
- In a potential implementation, the receiving device comprises a multiple tuner configuration and the recognition device is configured to perform the audio content recognition process using one of the multiple tuners which is not used for current content reproduction.
- For example, the recognition device is configured to extract at least one of the following items of data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
- According to a further embodiment, the multiple items of data stored in the database each include at least one of the following: transmission frequency of broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year.
- According to an embodiment, the recognition device is configured to be coupled with the audio content analysis system which is remote from the receiving apparatus. For example, the recognition device is configured to be coupled with the audio content analysis system through a network connection, particularly through the Internet and/or a telecommunications network.
- For example, as an audio content analysis system, there may be used a server provider system, as e.g. described in
JP 2006-190027 A - There are also other potential music analysis service systems available to be used as an audio content analysis system in connection with the present invention, such as the known "SHAZAM" music analysis service or similar. Such music analysis service systems can, e.g., identify songs based on short audio signal samples and internet databases. The "SHAZAM" music analysis service, on the one hand, is providing detailed information about the content, but it does not track the content history and it does not link the content to an audio source. Therefore, from this music analysis service alone, the user cannot understand which source (e.g. broadcast station) is playing his favourite type of music.
- According to an embodiment, the recognition device is configured to capture the audio signal samples transmitted with the broadcast signals repeatedly over time and to send the captured audio signal samples to the audio content analysis system, whereas the audio content analysis system (such as "SHAZAM") is capable of analyzing the captured audio signal samples and providing the analyzing data indicative of audio content of the analyzed audio signal samples back to the recognition device. As such, the recognition device receives the analyzing data indicative of audio content of the analyzed audio signal samples from the audio content analysis system.
- According to another embodiment, the receiving device is adapted to receive analyzing data indicative of analyzed audio content information associated with at least one broadcast station from a remote provider for storing in the database. In this embodiment, any information which is normally produced by the recognition device and the analyzing device can also be received from a remote provider, so that the database stored in the memory may be supplemented by the analyzing data from the remote provider.
- According to a further embodiment, the analyzing device is configured to analyze the multiple items of data stored in the database by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.
- The embodiments as described above with respect to the receiving apparatus can equally be applied in connection with the method according to the invention.
- An embodiment according to the invention may additionally comprise storing information in the database which contains or is derived from RDS information transmitted with the broadcast signals. Thus, the contents of the database and the analyzing results can be supplemented by RDS information associated with the respective broadcast station.
- According to an embodiment of the invention, the receiving apparatus according to the invention is an automotive receiving apparatus.
- Aspects and embodiments of the invention will now be described with reference to the drawings, in which:
- Fig. 1
- shows a receiving apparatus for receiving broadcast signals according to an exemplary embodiment of the invention,
- Fig. 2A
- shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with RDS content information as currently available in the prior art,
- Fig. 2B
- shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with detailed content information according to an embodiment of the invention,
- Fig. 3
- shows a flowchart diagram of a method for providing information associated with received broadcast signals according to an embodiment of the invention,
- Fig. 4
- shows an example for interpretation of items of data and providing analyzing results for broadcast stations according to an embodiment of the invention.
-
Fig. 1 shows a receiving apparatus for receiving broadcast signals according to an exemplary embodiment of the invention in a schematic block diagram. In this embodiment, the receivingapparatus 1 is an automotive receiving apparatus, which may be installed in a vehicle, e.g., in a head unit thereof (not shown), receives broadcast signals BS which are broadcast from anexemplary broadcast station 2. The receivingapparatus 1 comprises a receivingdevice 20 which may be a conventional receiving device as known in the art. The exemplary receiving device 20 (another type thereof can also be used, e.g. when applied to another broadcasting technology) comprises anantenna 24 for receiving the broadcast signals BS, ademodulator 21, anaudio circuitry 22 which can extract the audio portion As of the received signal (i.e., music or speech) and prepare it for playback through a speaker or other output device (not shown), and aRDS receiver circuitry 23 which can extract the RDS portion Rx of the received signal and prepare it for processing by appropriate data processing circuitry (not shown). It will be understood that, as used herein, the expression "coupled to" can be used to define either a direct or an indirect connection between elements. When it is referred herein to an installation of any part of the receiving apparatus in a vehicle, it should be understood that the receiving apparatus or any part thereof may also be installed in other installation locations where the receiving apparatus may be used. - Particularly, the
demodulator 21 can demodulate the received broadcast signal BS by a frequency determined by the station or frequency that is being tuned to. Thedemodulator 21 can be analog, digital, or a combination of the two. The output signal ofdemodulator 21 can be received byaudio circuitry 22, which can extract and decode the audio portion As of the received signal and send it to a speaker circuitry. The output signal ofdemodulator 21 can also be received byRDS receiver circuitry 23 which can extract and decode the RDS portion Rx of the received signal and send it to any appropriate output circuitry. For instance, the extracted RDS data may be displayed to a user via any suitable display circuitry, or may be processed according to embodiments of the invention. - The
apparatus 1 further comprises arecognition device 30 which is coupled with the receivingdevice 20 and, in this embodiment, receives the audio portions As output by the receiving device 20 (particularly output by the audio circuitry 22). Further, in this embodiment, it receives the RDS portions Rx output by the receiving device 20 (particularly output by the RDS receiver circuitry 23). - For example, the receiving
device 20 comprises a multiple tuner configuration (not explicitly shown), which is known in the art, and therecognition device 30 is configured to perform an audio content recognition process, as described herein below, using one of the multiple tuners which is not used for current content reproduction. - The
recognition device 30 is configured to be coupled with an audio content analysis system 40 (which may be remote from theautomotive receiving apparatus 1, such as "SHAZAM" described above provided by a server computer, or may be installed in the vehicle, thus is "on-board"). For example, therecognition device 30 is coupled with the audiocontent analysis system 40 directly or via anetwork 80, such as the Internet and/or any other telecommunications network and/or a vehicle communications network bus, like the CAN-bus. To this end, the receivingapparatus 1, which may be installed in a vehicle, may use any known wired or wireless technology for communication with the audiocontent analysis system 40 either directly or over thenetwork 80. According to other embodiments, the audiocontent analysis system 40 may also be implemented in the vehicle, e.g. in a portion of a head unit with appropriate memory capabilities, or may be a distributed system with parts thereof installed in the vehicle and other parts thereof provided on a remote server computer and accessible via thenetwork 80. - According to another embodiment, the
recognition device 30 may be implemented in the vehicle, e.g., by comprising one or more microprocessors, for example installed in the head unit (not shown), wherein the one or more microprocessors have access to a database stored in a memory (e.g., located in the vehicle or on a remote server computer) which are part of or form the audiocontent analysis system 40. According to another embodiment, therecognition device 30 and the audiocontent analysis system 40 may both comprise respective one or more microprocessors, e.g. therecognition device 30 comprising a microprocessor installed in the vehicle and the audiocontent analysis system 40 comprising a microprocessor installed in a remote server computer, which microprocessors communicate with each other, e.g. over thenetwork 80. - The
recognition device 30, when coupled with the audiocontent analysis system 40, e.g. wirelessly, is configured to perform an audio content recognition process together with the audiocontent analysis system 40. For example, a microprocessor of therecognition device 30 provides commands and/or data to the audio content analysis system 40 (e.g. a database or a server computer) when performing the audio content recognition process, and receives data and/or commands therefrom. Alternatively or additionally, according to an embodiment, the audio content analysis system 40 (e.g. a microprocessor thereof) provides commands and/or data to therecognition device 30 which is configured to receive such commands and/or data for performing the audio content recognition process. - The audio content recognition process performed jointly by the
recognition device 30 and the audiocontent analysis system 40 captures audio signal samples As (or audio clips) repeatedly over time, analyzes the captured audio signal samples As, and provides corresponding analyzing data indicative of audio content (such as music content) of the analyzed audio signal samples As repeatedly over time. For example, analyzing the captured audio signal samples may comprise comparing their audio content or parts thereof (such as the music itself) with entries in a database stored in or retrieved by the audiocontent analysis system 40. - For example, the analyzing data may contain information regarding music title, music artist name, and/or genre etc. of the respective analyzed audio signal sample. Moreover, the analyzing data may contain source information indicative of the broadcast station which is associated with the respective analyzed audio signal sample.
- The
recognition device 30 extracts multiple items of data from the analyzing data over time, which in this embodiment were received from the audiocontent analysis system 40. For example, therecognition device 30 extracts one or more of the following items of data from the received analyzing data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, and/or music year. - According to an embodiment, the
recognition device 30 is configured to capture multiple audio signal samples As received from theaudio circuitry 22 repeatedly over time. The audiocontent analysis system 40 analyzes the captured audio signal samples As and provides the analyzing data indicative of audio content of the analyzed audio signal samples to therecognition device 30. - The
apparatus 1 further comprises amemory 70 adapted to store therein adatabase 71. Thisdatabase 71 contains multiple items of data which were extracted by therecognition device 30 over time and source information (e.g. frequency) indicative of one or more broadcast stations (such as SWR1, Energy, etc. shown inFig. 2B ) which are associated with the extracted items of data. - For example, the multiple items of data stored in the
database 71 are items of data which include a transmission frequency of broadcast signals, a broadcast station name, a program name, a content type, a music artist name, a music song genre, a music song chart history, and/or a music year. - The
apparatus 1 further comprises an analyzingdevice 50 which analyzes a plurality of the multiple items of data stored in thedatabase 71 for at least one broadcast station (such as SWR1 and/or Energy, etc., shown inFig. 2B ) which are associated with the analyzed items of data, and it provides an analyzing result for this broadcast station which is associated with the analyzed items of data (such as shown inFig. 2B for SWR1, Energy, etc.). For example, the analyzing device may comprise a microprocessor, or may be implemented by using the same microprocessor(s) as therecognition device 30. - An
information providing device 60, such as a display device and/or a loudspeaker or other information providing device, provides information to a user based on the analyzing result provided by the analyzingdevice 50, i.e. provides information based on the analyzing result for the one or more broadcast stations which are associated with the analyzed items of data (such as for SWR1, Energy, etc. shown inFig. 2B ). According to the embodiment ofFig. 2B , this information to the user can be provided or divided in multiple portions, such as for speech, music, top artists, etc. - Preferably, the
recognition device 30 performs the audio content recognition process with the audiocontent analysis system 40 as a permanent background process when receiving the broadcast signals by the receivingdevice 20. Advantageously, therecognition device 30 performs the audio content recognition process with the audiocontent analysis system 40 for a plurality ofbroadcast stations 2, particularly for each available broadcast station, i.e. which can currently be received by the receivingdevice 20.
In an advantageous embodiment, a music analysis service of an audio content analysis system (like "SHAZAM", as mentioned above) could permanently run as a background process in any radio tuner of a receiving apparatus. It may permanently take short clips (or audio signal samples) of the content of each broadcast station (e.g. audio clips in a double tuner concept, similar to scanning RDS information in the background). Then, the music analysis service may store music information together with the source information and track the history over time. As an analysis result, the analyzing device of the receiving apparatus could provide detailed information about each broadcast station. - The described music recognition process is performed repeatedly for building up an information history. The database stored in the memory serves to store the recognition result (in other words, items of data extracted from the analyzing data) for each broadcast station over a period time. The recognition results stored in the database may be analyzed and compared, and a typical and/or average content (not, e.g., a current song only) of each broadcast station may be determined.
Advantageously, the determined typical and/or average content information for each broadcast station may be communicated to the user, not only the currently playing song's information (such as is currently available from RDS data). Then the user can easily select which broadcast station is matching his taste or mood for listening.
Fig. 2A shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with RDS content information as currently available in the prior art. In a common use case, in current radio tuners, the user sees the currently playing song name and/or a station list, as depicted inFig. 2A . If the user likes this song, or if the user wants to listen to a pop music station (like SWR1 shown in the first line of the list ofFig. 2A ), the user switches to that broadcast station. But then, it may turn out that the user gets disappointed, because SWR1 is basically a talk radio station, and the played music was the only music played for a long time! The rest of the time turns out to be talk, not music, so that the user may get disappointed.
Fig. 2B shows an exemplary display of information, e.g. on a display screen, in the form of a broadcast station list with detailed content information according to an embodiment of the invention, which can avoid such a disappointment and help the user to select a better fitting broadcast station to listen to. Particularly, as shown inFig. 2B , more detailed information is shown which has been determined over time according to actually broadcasted and analyzed audio signal samples (i.e. the broadcasted music itself) with particular items of data extracted from the analyzing data over time. For example, for the broadcast station SWR1 (first line of the list ofFig. 2B ) different portions of an analyzing result as to, e.g., speech, music, top artists, have been determined according to the analyzed items of data stored in the database over time associated with the broadcast station SWR1. Thus, an additional benefit for the user is, for example, reduced driver's distraction, because the user is able to select a broadcast station which fits best for a long period of time as a result of the provided analyzing result with content history and up-to-date information, and therefore the user does not need to switch broadcast stations very often. -
Fig. 3 shows a flowchart diagram of a method for providing information associated with received broadcast signals according to an embodiment of the invention. - In step S1, a tuning step to the next broadcast station is performed, e.g. by actuating a switch by the user at the tuner interface. In step S2, a new station content snapshot ("SCS") is generated. That is, an audio content recognition process is started by the
recognition device 30 for that broadcast station, with multiple items of data to be extracted from analyzing data over time and stored as SCS in thedatabase 71 in thememory 70. As shown inFig. 3 , a SCS may contain multiple data fields, such as program name, content type, music artist name, etc. For example, the program name can be determined from an RDS data portion transmitted with the broadcast signals, or can simply be the frequency of the transmitted broadcast signals. In step S3, if such RDS information is available, the frequency can be overwritten by the corresponding RDS program station (PS). - In step S4, a short audio signal sample or audio clip for the broadcast station tuned in step S1 is captured as an input for the audio content recognition process. In step S5, the content type is analyzed. If the content type is speech (step S6), this is stored in the
database 71 ofmemory 70 and the process goes on to step S10. If the content type is music, this is stored in thedatabase 71 of memory 70 (step S7) and the process goes on to step S8 which sends the captured audio clip or audio signal sample to the audio content analysis system 40 (here designated as music info service), which may be installed in the vehicle ("on-board"), and/or on a server computer ("web server"), and/or may be formed by SHAZAM, as described above. In step S9, the analyzing data provided from the audiocontent analysis system 40 is received and items of data extracted therefrom (SCS data set containing items of data, such as content type, artist name, song genre, etc.) are stored in thedatabase 71. - In step S10, it is determined whether a data set associated with the program name (i.e., frequency or RDS PS) is already stored in the database 71 ("RSP-DB"). If not, then a new radio station profile ("RSP") data set is created (step S11), i.e. a new data set which is associated with the broadcast station tuned in step S1. In this new RSP data set, the SCS data set with the items of data according to step S9 is stored. In any further iterations of the process as shown in
Fig. 3 , further SCS data sets with items of data according to step S9 will be added to the RSP data set. Thus, over time, a RSP data set contains multiple SCS data sets, thus building a data history associated with the broadcast station over time. A RSP data set may additionally contain some statistics calculated over the several stored SCS data sets, such as percent music versus speech, highest percent of music genre, top decades of music year, a music song chart history, etc. After step S11, the process returns to step S1. - If it is determined in step S10 that a RSP data set for that broadcast station already exists, then the SCS data set with items of data according to step S9 is added to the related RSP data set for further statistical analysis (step S12). In step S13, the depth of the RSP data set ("RSP-depth") is increased by 1, and in step S14 the recent SCS data set is deleted, since it is now stored in the associated RSP data set for that broadcast station. Then, the process returns to step S1.
- According to an embodiment, the receiving
device 20 orrecognition device 30 is adapted to receive analyzing data indicative of already analyzed audio content information associated with at least one broadcast station from a remote provider for storing in thedatabase 71. According to the example ofFig. 3 , the receivingdevice 20 orrecognition device 30 may receive over theantenna 24 ornetwork 80 an RSP data set and/or a SCS data set associated with a particular broadcast station from a remote provider (not shown), which may be supplemented in thedatabase 71. -
Fig. 4 shows an example for interpretation of items of data (such as stored with a SCS data set according toFig. 3 ) for providing some statistics, and providing analyzing results for broadcast stations according to an embodiment of the invention. - In the left column, an example of a RSP data set is shown. In the mid column, an exemplary interpretation/calculation formula is listed for a respective RSP data set entry. The respective data fields of multiple RSP data sets, such as program name, content type, etc., are interpreted for statistical purposes according to this interpretation/calculation formula.
- In the right column, an example of a graphical user interface ("GUI"), here display, is shown.
- For example, the multiple items of data stored in the database (in the above example, the multiple items of data of a RSP data set) are analyzed by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.
Claims (14)
- A receiving apparatus (1) for receiving broadcast signals, comprising:- a receiving device (20) configured to receive broadcast signals (BS),- a recognition device (30) configured to be coupled with an audio content analysis system (40) and configured to perform an audio content recognition process together with the audio content analysis system (40) for a plurality of broadcast stations (SWR1, Energy), wherein the audio content recognition process is configured to capture audio signal samples (As) transmitted with the broadcast signals repeatedly over time, to analyze the captured audio signal samples (As), and to provide analyzing data indicative of audio content of the analyzed audio signal samples (As), the recognition device (30) further configured to extract multiple items of data from the analyzing data over time, wherein the audio content recognition process is performed repeatedly for building up an information history,- a memory (70) adapted to store therein a database (71) containing the multiple items of data extracted over time for each of the broadcast stations over a period of time and source information indicative of the broadcast stations (SWR1, Energy) associated with the extracted items of data,- an analyzing device (50) which is configured to analyze a plurality of the multiple items of data stored in the database (71) for at least one broadcast station (SWR1, Energy) associated with the analyzed items of data and to provide an analyzing result for the at least one broadcast station (SWR1, Energy) associated with the analyzed items of data, and- an information providing device (60) which is configured to provide information to a user based on the analyzing result for the at least one broadcast station (SWR1, Energy) associated with the analyzed items of data.
- The receiving apparatus according to claim 1, wherein the recognition device (30) is configured to perform the audio content recognition process with the audio content analysis system (40) as a permanent background process when receiving the broadcast signals.
- The receiving apparatus according to claim 1 or 2, wherein the recognition device (30) is configured to perform the audio content recognition process with the audio content analysis system (40) for each broadcast station receivable by the receiving device (20).
- The receiving apparatus according to one of claims 1 to 3, wherein the receiving device (20) comprises a multiple tuner configuration, and the recognition device (30) is configured to perform the audio content recognition process using one of the multiple tuners which is not used for current content reproduction.
- The receiving apparatus according to one of claims 1 to 4,
wherein the recognition device (30) is configured to extract at least one of the following items of data: transmission frequency of the broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year. - The receiving apparatus according to one of claims 1 to 5,
wherein the multiple items of data stored in the database (71) each include at least one of the following: transmission frequency of broadcast signals, broadcast station name, program name, content type, music artist name, music song genre, music song chart history, music year. - The receiving apparatus according to one of claims 1 to 6,
wherein the recognition device (30) is configured to be coupled with the audio content analysis system (40) which is remote from the receiving apparatus (1). - The receiving apparatus according to one of claims 1 to 7, wherein the recognition device (30) is configured to be coupled with the audio content analysis system (40) through a network (80), particularly through the Internet and/or a telecommunications network.
- The receiving apparatus according to one of claims 1 to 8, wherein the recognition device (30) is configured to capture the audio signal samples (As) transmitted with the broadcast signals repeatedly over time, and the audio content analysis system (40) is configured to analyze the captured audio signal samples and to provide the analyzing data indicative of audio content of the analyzed audio signal samples to the recognition device (30).
- The receiving apparatus according to one of claims 1 to 9, wherein the receiving device (20) or the recognition device (30) is adapted to receive analyzing data indicative of analyzed audio content information associated with at least one broadcast station (SWR1, Energy) from a remote provider for storing in the database (71).
- The receiving apparatus according to one of claims 1 to 10, wherein the analyzing device (50) is configured to analyze the multiple items of data stored in the database (71) by performing at least one of the following operations: calculate an average content from the multiple items of data per broadcasting station, calculate a ratio of music content versus speech content per broadcasting station, calculate a fraction of music content listed in a public chart listing, calculate a most frequent genre of music content per each broadcasting station.
- A method of providing information associated with broadcast signals, the method comprising:- receiving broadcast signals (BS) with a receiving device (20),- performing an audio content recognition process for a plurality of broadcast stations (SWR1, Energy) which captures audio signal samples (As) transmitted with the broadcast signals (BS) repeatedly over time, analyzes the captured audio signal samples (As), and provides analyzing data indicative of audio content of the analyzed audio signal samples (As),- extracting multiple items of data from the analyzing data over time, wherein the audio content recognition process is performed repeatedly for building up an information history,- storing in a database (71) multiple items of data extracted over time for each of the broadcast stations over a period of time and source information indicative of the broadcast stations (SWR1, Energy) associated with the extracted items of data,- analyzing a plurality of the multiple items of data stored in the database (71) for at least one broadcast station (SWR1, Energy) associated with the analyzed items of data and providing an analyzing result for the at least one broadcast station (SWR1, Energy) associated with the analyzed items of data, and- providing information to a user based on the analyzing result for the at least one broadcast station (SWR1, Energy) associated with the analyzed items of data.
- The method according to claim 12, wherein the method additionally comprises storing information in the database (71) which contains or is derived from RDS information (Rx) transmitted with the broadcast signals (BS).
- A vehicle comprising a receiving apparatus (1) according to one of claims 1 to 11.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP14163387.5A EP2928094B1 (en) | 2014-04-03 | 2014-04-03 | Receiving apparatus and method of providing information associated with received broadcast signals |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP14163387.5A EP2928094B1 (en) | 2014-04-03 | 2014-04-03 | Receiving apparatus and method of providing information associated with received broadcast signals |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2928094A1 EP2928094A1 (en) | 2015-10-07 |
EP2928094B1 true EP2928094B1 (en) | 2018-05-30 |
Family
ID=50478719
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14163387.5A Active EP2928094B1 (en) | 2014-04-03 | 2014-04-03 | Receiving apparatus and method of providing information associated with received broadcast signals |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP2928094B1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102016221910A1 (en) * | 2016-11-08 | 2018-05-09 | Volkswagen Aktiengesellschaft | A method, apparatus and computer readable storage medium having instructions for acquiring data to a radio station |
DE102017009206B3 (en) | 2017-09-30 | 2019-02-14 | Preh Car Connect Gmbh | Processing a broadcast signal |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1197020B2 (en) * | 1999-03-29 | 2011-04-13 | Gotuit Media Corp. | Electronic music and programme storage, comprising the recognition of programme segments, such as recorded musical performances and system for the management and playback of these programme segments |
JP4427146B2 (en) | 1999-12-27 | 2010-03-03 | 株式会社東芝 | Digital broadcast receiving apparatus and control method thereof |
JP4933899B2 (en) * | 2004-02-19 | 2012-05-16 | ランドマーク、ディジタル、サーヴィセズ、エルエルシー | Method and apparatus for broadcast source identification |
JP2006190027A (en) | 2005-01-05 | 2006-07-20 | Sharp Corp | Information processing device |
ES2433966T3 (en) * | 2006-10-03 | 2013-12-13 | Shazam Entertainment, Ltd. | Method for high flow rate of distributed broadcast content identification |
DE102007009730A1 (en) * | 2007-02-28 | 2008-09-18 | Continental Automotive Gmbh | Method and device for providing information on radio broadcasts |
US8331966B2 (en) * | 2009-05-15 | 2012-12-11 | Apple Inc. | Content selection based on simulcast data |
US20120129476A1 (en) * | 2010-11-24 | 2012-05-24 | Visteon Global Technologies, Inc. | Radio system including terrestrial and internet radio |
EP2541813A1 (en) * | 2011-06-29 | 2013-01-02 | Harman Becker Automotive Systems GmbH | Device and method for controlling audio reproduction |
US20130318114A1 (en) * | 2012-05-13 | 2013-11-28 | Harry E. Emerson, III | Discovery of music artist and title by broadcast radio receivers |
-
2014
- 2014-04-03 EP EP14163387.5A patent/EP2928094B1/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
EP2928094A1 (en) | 2015-10-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7643807B2 (en) | Methods for using broadcast media content information and related broadcast media receivers/playback devices | |
US9563699B1 (en) | System and method for matching a query against a broadcast stream | |
US20070281606A1 (en) | Systems and methods for acquiring songs or products associated with radio broadcasts | |
US9159076B2 (en) | User answer collection server, user answer collection system, broadcast reception apparatus and control method | |
EP2928094B1 (en) | Receiving apparatus and method of providing information associated with received broadcast signals | |
WO2020142426A1 (en) | Generation of media station previews using a secondary tuner | |
WO2020142339A1 (en) | Generation of media station previews using a reference database | |
EP1380126B1 (en) | Entertainment device with a search function for data similar in type to instantaneously reproduced data | |
US20120117044A1 (en) | Music providing system and apparatus using music broadcasting and music providing method using the same | |
EP3160067A1 (en) | Automotive broadcast receiving apparatus and method of providing at least one channel list of broadcast channels therein | |
KR20050085829A (en) | Audio signal identification method and system | |
US20100159860A1 (en) | Method for displaying other stations now playing list | |
CN102055541B (en) | Multiplexing radio receiver | |
CN105577305B (en) | Multiplexed data broadcast receiver and its control method | |
JP3636419B2 (en) | Digital audio broadcast receiver | |
JP2709588B2 (en) | Digital data multiplexing system receiving method | |
JPH11122204A (en) | Broadcasting recognition system using sound signal, sound element generation device used for the same and broadcasting recognition device | |
KR20170008092A (en) | Method for switching variety audio broadcasting | |
JP3968541B2 (en) | Digital audio broadcast receiver | |
JP2694770B2 (en) | Digital data multiplexing system receiving method | |
US10528957B2 (en) | Systems and methods for providing broadcast data analysis | |
US20240039651A1 (en) | Radio tuner system using metadata and method thereof | |
JP4136986B2 (en) | Digital music broadcast receiver | |
WO2019008612A1 (en) | Method for access to additional internet content associated with a radio and/or television program | |
RU2307472C2 (en) | Method for identification of changes in broadcasted database |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20150325 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
17Q | First examination report despatched |
Effective date: 20160712 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20180103 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1004697 Country of ref document: AT Kind code of ref document: T Effective date: 20180615 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014026072 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180530 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180830 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180830 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180831 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1004697 Country of ref document: AT Kind code of ref document: T Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602014026072 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20190301 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190403 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190430 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190403 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181001 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20140403 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240419 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240418 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240425 Year of fee payment: 11 |