EP4457658A1 - Erzeugung und zuordnung von metadaten - Google Patents
Erzeugung und zuordnung von metadatenInfo
- Publication number
- EP4457658A1 EP4457658A1 EP22714549.7A EP22714549A EP4457658A1 EP 4457658 A1 EP4457658 A1 EP 4457658A1 EP 22714549 A EP22714549 A EP 22714549A EP 4457658 A1 EP4457658 A1 EP 4457658A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- action object
- action
- time
- audio
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/71—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/41—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/61—Indexing; Data structures therefor; Storage structures
Definitions
- the present invention relates to a method, a device, a computer program and a computer program product for generating and assigning metadata of action objects of an audio and/or visual media content.
- Metadata is used as additional information to describe audio and/or visual media content and specifies technical and descriptive properties of an audio and/or visual media content.
- the author, creation date, location of recording, camera information, date of upload, image resolution, refresh rate, aperture, focal length, artist name, musical style and sample rate can be specified as examples of metadata.
- the invention is based on the object of generating and assigning metadata about action objects that appear in audio and/or visual media content.
- the action objects are visual and/or audible objects or elements that can be perceived by a viewer and/or listener in an audio and/or visual media content and are not physical characteristics of the digital data of a video file or an audio file.
- the invention is based on the object of making the metadata of action objects from the various production steps of the audio and/or visual media content clearly identifiable and traceable in terms of concepts and/or time.
- a method for processing and generating metadata of action objects of an audio and/or visual media content having the following steps:
- data elements are identified from the data with reference to the action objects that are used in the audio and/or visual media content in order to create or produce the audio and/or visual media content.
- the action objects can be people, objects, be services, backgrounds, locations or, in general, complete elements of images and/or sound that are used based on the plot of the audio and/or visual media content in the respective sequences of the audio and/or visual media content.
- data elements from at least two production steps that belong to a single action object are assigned.
- data elements from the at least two different production steps are processed in such a way that a clear assignment to the associated and only action object is made.
- the assignment is preferably carried out in such a way that different names and/or specifications from the at least two different production steps for the same action object are identified on an algorithm-based basis and the data elements are assigned to one another in order to record that these are data elements for the same action object.
- the assignment of data elements to the same action object is based on the ontology and/or the data model, so that similar and/or synonymous terms are identified in the different production steps and are assigned to the action object in question.
- the assignment of data elements to the same action object is based on a comparison of parameters and/or parameter values that specify a specific action object and can be assigned to the same action object, so that it can be concluded that it is the same action object.
- a uniform name for the data elements from the at least two production steps that belong to the single action object is determined and a first time value of the time of occurrence of the single action object is assigned.
- the uniform name for the data elements is introduced, so that the action object is marked with the uniform name across different production steps and additionally receives the time value at which the action object appeared in the audio and / or visual media content.
- the first time value can be a plurality of time values and/or a plurality of time windows.
- a time offset of the first time value of the time of appearance of the action object is identified.
- the time offset is preferably identified by comparing the first time value with a further time value of the time of appearance in another production step and/or a master version or a final version of the audio and/or visual media content.
- a second time value of the time of appearance of the action object in a master version of the audio and/or visual media content is then calculated, the second time value being based on the identified offset.
- metadata is generated consisting of the uniform name and the calculated second time value in the master version for the single action object.
- an action object is an object, a person or a service.
- segment information is additionally processed and the single action object is assigned to a specific segment from the audio and/or visual media content and the metadata generated is additionally provided with the segment information.
- a link is established between the single action object and at least one further action object or further single action object and the generated metadata is additionally provided with link information between the single action object or the further single action object and the further single action object.
- action objects that represent a product and/or service are linked to an action object as a person.
- the data element of an action object has at least one predefined parameter, the predefined parameter having at least one parameter value to specify the action object.
- the time of appearance is a time of perception or time window of perception of the action object in an audio and/or video content by a viewer and/or listener.
- the assignment is carried out by a plausibility check of existing and/or missing parameters and/or parameter values and/or ontology-based and/or based on a data model and/or depending on a comparison between the parameters from at least two different production steps for the same action object.
- information about the presence of action objects is used in a further data set, in particular in an action object data set of a third-party provider for products and / or services and / or a sales platform and / or a knowledge database with a step for generating a comparison list based on the action objects of the audio and/or visual media content and the existing action objects in the further data set.
- a comparison is made between the data set created according to the invention for the action objects of the audio and/or visual media content with the further data set with products and/or services to identify matches and/or similarities and/or differences, so that the aforementioned comparison list is then created can.
- the aforementioned is preferred
- Comparison based on a predefined scaling used to calculate a match rate.
- the parameter is a placeholder for color, size,
- Time of appearance duration of appearance, number of appearances, size of appearance or
- the electronic computer is preferably a personal computer, a smartphone, a tablet PC, a server or a notebook.
- the third-party data set is data from a video platform and/or a digital online shop for products and/or services.
- time values for the action objects or time codes of action objects are bound to the master version or the master files of the audio and/or visual media content.
- the data record created according to the invention is assigned or mapped according to a predefined standard.
- the production step is a script, a pre-production, a costume design, a production design, a script continuity, a footage, a film editing, a visual effect, a color correction, a sound mixing, a master .
- a device for processing and generating metadata of action objects of an audio and / or visual media content having: a processing unit with at least one input for receiving and processing data from at least two production steps of the audio and/or visual media content, wherein the processing unit is set up to identify data elements from the data with reference to the action objects, the device having an assignment unit which is set up to assign the data elements from at least two production steps that belong to a single action object to one another, wherein the processing unit is further set up to determine a uniform name for the data elements from the at least two production steps that belong to the single action object, the device having an assignment unit which is set up to assign a first time value of the time of occurrence of the single action object, the processing unit is further set up to identify a temporal offset of the first time value of the time of appearance of the action object, wherein the device further has a calculation unit which is set up to calculate a second time value of the time of appearance of the action object in a master version of the audio and /
- the processing unit is further set up to process segment information and to assign the only action object to a specific segment from the audio and/or visual media content and to additionally equip the generated metadata with the segment information.
- the device further has a linking unit which is set up to additionally establish a link between the single action object and at least one further single action object and to additionally equip the generated metadata with linking information between the single action object and the further single action object.
- the processing unit is further set up to process information about an action object as an object, a person, a service, a real body, an animated body or a real-animated combination of a body and/or that the processing unit is set up for processing a data element, wherein the data element of an action object has at least one predefined parameter and wherein the predefined parameter has at least one parameter value to specify the action object.
- the processing unit is set up to process the time of appearance as a perception time or perception time window of the action object in which audio and/or video content is and/or that the processing unit is set up to receive and process additional data in order to assign the ontology -based and/or data model-based.
- the processing unit is set up to assign existing and/or missing ones by means of a plausibility check Parameters and / or parameter values between at least two production steps and / or that the processing unit is set up to receive and use information about the presence of action objects in a further data set, in particular in an action object data set of a third-party provider for products and / or services, a sales platform or a Knowledge database and wherein the processing unit is further set up to generate a comparison list based on the action objects of the audio and / or visual media content and the existing action objects in the further data set.
- the processing unit is set up to process the parameter as a placeholder for color, size, manufacturer information, material, reference address, time information, ingredient, design name, reason for use, identification number, price, description of the action, location information, duration of visibility, statistical information, time of appearance , appearance duration, number of appearances, appearance size or action object specification.
- a computer program comprises commands which, when the program is executed by a device, causes the device to work according to one of the devices described here according to the invention.
- a computer program product which can be loaded into the memory of an electronic computer and which has instructions which, when executed by the electronic computer, cause the electronic computer to carry out the steps according to one of the methods described here.
- Figure 1 shows metadata from various production steps and the generation of new metadata according to one aspect of the present invention.
- Figure 2 shows a comparison of the metadata generated according to the invention with another data set from a third party provider.
- Figure 1 shows metadata of action objects of an audio and/or visual media content from different production steps DPI, DP2, DP3 and DP4.
- the metadata from the first production step DPI and the second production step DP2 are identified.
- step Z the assignment is made Metadata from DPI and DP2, which belong to a single action object and further there is a temporal assignment of a first time value of the time of occurrence of the respective action objects from the metadata DPI and DP2, so that new metadata DPN are then available, which assign both the action objects from DPI and DP2 to one another and also show the respective times of appearance of the plot objects.
- the metadata DPN is generated, which clearly indicates the action objects with the associated time of occurrence.
- step M the action objects standardized in the metadata DPN from the production steps DPI and DP2 are compared with the further data set E and the action objects that find a correspondence in E are generated as a new data set DPE or as a comparison list.
- the relevance of the action objects from DPI and DP2 is determined with the comparison list DPE using the metadata DPN for the data set of the third-party provider E.
- the third-party data set E represents a specification for displaying the metadata DPN depending on this specification, which is defined by the data set E. Consequently, according to the aforementioned alternative, the comparison list DPE can contain data on action objects that are defined as relevant by the data record E and are therefore important for the third-party provider.
- the data record E can be used as a predefined or standardized specification for displaying or formatting the metadata DPN, so that the metadata DPN is converted into a formatting that conforms to the standard E depending on the specified standard E and then the respective desired representation Third party provider as DPE.
- the data record E is a distribution-related specification, which, for example, depending on the platform to be used, e.g. television, Internet platform, mobile distribution, the metadata DPN is adapted depending on the data record E and then platform-compliant as a data record DPE present.
- the platform to be used e.g. television, Internet platform, mobile distribution
- the metadata DPN is adapted depending on the data record E and then platform-compliant as a data record DPE present.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Library & Information Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/IB2022/052389 WO2023175376A1 (de) | 2022-03-16 | 2022-03-16 | Erzeugung und zuordnung von metadaten |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4457658A1 true EP4457658A1 (de) | 2024-11-06 |
Family
ID=81325979
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP22714549.7A Pending EP4457658A1 (de) | 2022-03-16 | 2022-03-16 | Erzeugung und zuordnung von metadaten |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US12174879B2 (de) |
| EP (1) | EP4457658A1 (de) |
| WO (1) | WO2023175376A1 (de) |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1102271B8 (de) * | 1999-11-05 | 2016-12-07 | Sony Europe Limited | Verfahren und Vorrichtung zur Erzeugung von Audio- und/oder Videosignalen |
| GB201405045D0 (en) * | 2014-03-21 | 2014-05-07 | Secr Defence | Recognition of objects within a video |
| US20160094600A1 (en) * | 2014-09-30 | 2016-03-31 | The Nielsen Company (Us), Llc | Methods and apparatus to measure exposure to streaming media |
| US10311305B2 (en) * | 2017-03-20 | 2019-06-04 | Honeywell International Inc. | Systems and methods for creating a story board with forensic video analysis on a video repository |
| US10956181B2 (en) * | 2019-05-22 | 2021-03-23 | Software Ag | Systems and/or methods for computer-automated execution of digitized natural language video stream instructions |
| EP4131936A1 (de) * | 2021-08-03 | 2023-02-08 | Idomoo Ltd | System und verfahren zum programmieren von videos |
-
2022
- 2022-03-16 EP EP22714549.7A patent/EP4457658A1/de active Pending
- 2022-03-16 WO PCT/IB2022/052389 patent/WO2023175376A1/de not_active Ceased
-
2024
- 2024-05-31 US US18/680,948 patent/US12174879B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| US20240320261A1 (en) | 2024-09-26 |
| WO2023175376A1 (de) | 2023-09-21 |
| US12174879B2 (en) | 2024-12-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE69701566T2 (de) | Medieneditiersystem und verfahren mit verbesserter effektsteuerung | |
| DE69014977T2 (de) | Videoverarbeitungssystem. | |
| DE69718652T2 (de) | Zeitbasiertes medienverarbeitungssystem und -verfahren | |
| DE102017207686A1 (de) | Einblicke in die belegschaftsstrategie | |
| DE102020211679A1 (de) | Computer-implementiertes system und verfahren mit einem digitalen zwilling und einer graphen-basierten struktur | |
| DE102017125463A1 (de) | Verwendung von maschinellem lernen zur erkennung eines bildbestandteils in einem zusammengesetzten bild | |
| DE102012218485B4 (de) | Verfahren für ein Instant Messaging-System und Instant Messaging-System | |
| DE60309016T2 (de) | Vereinfachte herstellung einer komplexen interaktiven dvd | |
| DE102007045741A1 (de) | Verfahren und Vorrichtung zum Codieren und Decodieren von Multimediadaten | |
| DE69423200T2 (de) | Vorrichtung zur Zeitlupenwiedergabe mit normaler Wiedergabegeschwindigkeit | |
| DE69833721T2 (de) | Verfahren zur Anzeige von reichen Texten und System zur Bereitstellung von Bildinformationen | |
| EP4457658A1 (de) | Erzeugung und zuordnung von metadaten | |
| DE102012223587B4 (de) | Verfahren zum Testen einer Applikation | |
| EP1983450B1 (de) | Verfahren und Vorrichtung zur Ermittlung und Bereitstellung von Information zu einem Bild | |
| DE202022000660U1 (de) | Vorrichtung, Computerprogramm und Computerprogrammprodukt zur Erzeugung und Zuordnung von Metadaten | |
| DE102012218768B4 (de) | Bildverarbeitungssysteme und verwandte verfahren | |
| DE112021003445T5 (de) | Vorrichtung zur Editierung von Bewegtbildern, Verfahren zur Editierung von Bewegtbildern, und Programm zur Editierung von Bewegtbildern | |
| DE102017008914A1 (de) | Kombinierte Interaktionsüberwachung für Medieninhaltgruppen auf soziale Medien-Diensten | |
| DE102016218656A1 (de) | Verfahren zur Generierung eines User-Interfaces in Form einer Mindmap | |
| DE112012004975T5 (de) | Informationsverarbeitungssystem und Informationsverarbeitungsverfahren | |
| DE102020002511A1 (de) | Verfahren zum Erzeugen von Trainingsdaten für ein Neuronales Netz | |
| DE112012006597T5 (de) | Bildinformationsbereitstellungsvorrichtung, Bildinformationsbereitstellungssystem und Bildinformationsbereitstellungsverfahren | |
| DE69900965T2 (de) | Verfahren und Gerät um die Herstellung von Multimedia zu vereinfachen | |
| KR20240126855A (ko) | 콘텐츠 처리 방법 및 장치 | |
| DE102022202336A1 (de) | Techniken zur abgesicherten bereitstellung von digitalen objekten |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20240730 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |