WO2005057431A1 - 制御信号を利用したインデックス付与システム - Google Patents
制御信号を利用したインデックス付与システム Download PDFInfo
- Publication number
- WO2005057431A1 WO2005057431A1 PCT/JP2004/018568 JP2004018568W WO2005057431A1 WO 2005057431 A1 WO2005057431 A1 WO 2005057431A1 JP 2004018568 W JP2004018568 W JP 2004018568W WO 2005057431 A1 WO2005057431 A1 WO 2005057431A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- control signal
- attribute information
- unit
- identifier
- metadata
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/41—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
Definitions
- the present invention relates to an index assigning technique for automatically assigning an index using various control signals used in a program production site of a broadcast station system.
- Patent Document 1 JP-A-11-167583
- the recognition rate varies when the screen position, the background image, and a plurality of subjects are simultaneously displayed, and it has been difficult to achieve high accuracy and metadata.
- telop character recognition the appearance position of telop characters, background video, character fonts, and the like are limited, and it is difficult to perform highly accurate recognition that is not affected by the environment.
- speech recognition and speaker recognition technology erroneous recognition often occurs in programs where multiple speakers are mixed or when an unspecified number of speakers appear frequently. I was
- the present invention has been made in view of the advantages of the present invention, and has an indexing system capable of eliminating correction work, automatically generating accurate metadata, and automatically providing information on a program.
- the purpose is to provide a stem.
- the automatic indexing system of the present invention is an indexing system that automatically assigns metadata using control signals of various devices used in a broadcasting station.
- the control signal detector that determines the type of the control signal and the identifier that uniquely identifies the control signal and obtains the time of detection is linked to the control signal identifier and the attribute information related to the control signal.
- the control signal attribute information management unit determines attribute information based on the identifier acquired by the control unit, and the metadata is generated as the type, identifier, and time determined by the control signal detection unit are acquired.
- An index generation unit that adds attribute information requested and obtained to the information management unit to the metadata.
- the automatic indexing system of the present invention generates log data in which the time is arranged for each identifier as the identifier and the time are obtained from the control signal detector, and outputs the log data to the index generator. It is characterized by having a log analysis unit.
- the log analysis unit generates log data in which the time is arranged for each identifier using the identifier of the control signal and the detection time, and outputs the log data to a network or a removable medium; and a network output unit or a removable medium.
- a log input unit for inputting log data via the interface and transmitting the log data to the index generation unit.
- the control signal attribute information management unit includes a database search unit that connects to a database storing the detailed information of the attribute information, and stores the detailed information acquired from the database.
- the feature is that it is automatically added to the metadata generated by the index generator.
- the database that stores the detailed information of the attribute information is characterized in that it is a database that stores at least one of detailed information of a person, news, and a script.
- the control signal detection unit detects various control signals used during the broadcast of a program, determines the type, identifier, and time of the control signal. , And automatically generate metadata.
- the index generation unit Requests and acquires the attribute information associated with the determined identifier from the control signal attribute information management unit that manages the signal identifier and its attribute information in association with each other, and automatically attaches it to the metadata. I am trying to do it.
- it is possible to automatically generate metadata indicating various information constituting a program broadcast in synchronization with the broadcast of the program, thereby greatly reducing the conventional manual metadata generation work. If accurate and accurate information can be given, the effect can be obtained.
- the log analysis unit is used to generate log data in which the time is arranged for each identifier, and output the log data to the index generation unit.
- This makes it possible to generate metadata collectively.
- by generating log data it is possible to automatically generate metadata indicating various information that constitutes a program broadcast at any time without synchronizing it during program broadcasting. If the metadata generation work can be greatly reduced and accurate information can be given, the effect can be obtained.
- FIG. 1 is a block diagram showing an overall configuration of an indexing system according to an embodiment of the present invention.
- FIG. 3 is a block diagram showing an internal configuration of a control signal detection unit.
- FIG. 4 is a block diagram showing an internal configuration of a control signal detection unit for detecting a sound pressure level
- FIG. 5 is a diagram showing the structure of a digitized control signal
- FIG. 6 is a diagram showing a data configuration managed by a control signal type management unit.
- FIG. 7 is a block diagram showing an internal configuration of a control signal attribute information management unit.
- Garden 10 A flow diagram showing a process of detecting a voice control signal and making a metadata generation request.
- Garden 11 A diagram schematically showing various pin microphones and their use start time and use end time.
- FIG. 24 A block diagram showing an operation form of an indexing system used in a broadcasting station (second embodiment)
- a control signal detection unit detects control signals of various devices used in a station system that broadcasts a program, obtains the type, identifier, and time, and generates metadata. Also, by acquiring attribute information associated with the control signal detected by the control signal detection unit from the control signal attribute information management unit and attaching it to the metadata, the metadata of the program can be automatically and accurately generated. Information is automatically added to metadata.
- the type identifies the type of the device, and the identifier is assigned to uniquely identify the same type of device.
- FIG. 1 shows a configuration of a main block of an index providing system according to an embodiment of the present invention.
- the indexing system 10 shown in FIG. 1 detects a program broadcast studio system 11 for producing, recording, and transmitting a program broadcast, and a control signal output from the program broadcast studio system 11 when performing a program broadcast.
- the control signal detector 12 that determines the type of the control signal, its identifier, the time, etc., and manages the identifier of the control signal and the attribute information related thereto in association with each other, and obtains the information by the control signal detector 12.
- the control signal attribute information management unit 14 that determines attribute information based on the obtained identifier, and the metadata is generated according to the acquisition of the type, identifier, detection time, and the like from the control signal detection unit 12, while the control signal An index generation unit 13 for requesting the attribute information management unit 14 and adding the obtained attribute information to the metadata is provided.
- FIG. 2 is a block diagram showing a schematic configuration of a broadcasting system that can be considered when the indexing system 10 is actually applied to a broadcasting station or the like.
- This broadcasting system is broadly divided into a studio 1 and an adjustment booth 2 that issues instructions to the studio 1 and captures video and audio signals from the studio 1 to produce, record, and transmit programs. Is
- a pin microphone (including Pml, Pm2, Pm3) 20 as a microphone worn by an announcer or a performer, a studio camera (including StCl, StC2) 30, and the like are arranged.
- VTR controller 40 for controlling VTR recording / playback operation
- editing PC for editing program broadcast material (Personal computer) 41
- a cart machine 42 for actually executing a VTR reproduction process
- a relay controller 60 for performing control for relay broadcasting.
- the edit switch 19 is connected to the control signal detection unit 12, and the control signal detection unit 12 detects various control signals from the edit switch 19. That is, a pin microphone audio signal output by the pin microphone 20, a studio camera switching signal output by the studio camera 30, a VTR switching signal output by the VTR controller 40, a telop switching signal output by the telop generator 50, and the like. Performs input detection of control signals output from various devices.
- the pin microphone 20, studio camera 30, VTR controller 40, editing PC 41, cart machine 42, telop generator 50, telop generator 51, relay controller 60, etc. are connected as shown in Fig. 2. .
- control signal detector 12 Next, the internal configuration of the control signal detection unit 12 will be described with reference to FIG. Control signal detector
- Numeral 12 detects an input control signal, determines its type and its identifier, obtains a time, and requests the index generation unit 13 to generate metadata.
- the control signal detection unit 12 detects a control signal and determines the type and identifier of the control signal.
- the control signal type determination unit 121 associates the control signal with the type and identifier to enable the control signal to be determined.
- the control signal type management unit 122 to manage, the time acquisition unit 125 to acquire the time at which the control signal is detected, the identified type and its identifier, and the acquired time are sent to the index generation unit 13 to request metadata generation. It comprises an index generation request unit 124.
- the control signal is registered in the control signal type management unit 122 before the system is operated, and its type and identifier are also registered.
- the identifier may be registered automatically according to the registration of the control signal.
- Control signal type determination section 121 determines the type and the identifier of the input control signal by analyzing the header portion of the input control signal.
- the control signal can be divided into a header section 200 containing information such as the type and its identifier and a body section 201 of the control signal itself.
- a bit string representing the signal type of the header section 200 is analyzed, and the control signal type management section is analyzed.
- the type of the input control signal and its identifier are determined.
- FIG. 4 shows the internal configuration of the control signal detection unit 12 for determining the sound pressure level of the audio signal as the control signal.
- the voice input from the microphone 30 given to the program performer is input to the microphone signal sound pressure level determination unit 123 via the voice switching switch 18.
- the microphone signal sound pressure level determination unit 123 detects the sound pressure level of the input voice.
- FIG. 5 is a diagram showing an example of the structure of a digitized control signal.
- Information indicating the signal type is assigned to the upper 8 bits of the header section 200 of the control signal, and information indicating an identifier for uniquely identifying the signal type is assigned to the lower 8 bits.
- FIG. 6 is a diagram showing a configuration example of management data in the control signal type management unit 122.
- the control signal type management unit 122 controls the control signal
- the information 211 indicating the type of the signal, the identifier information 212 for uniquely identifying the signal type, the type 213 corresponding to the signal type information 211, and the signal ID (identifier) 210 corresponding to the identifier information 212 are linked and managed in a table format. I do.
- the control signal type determination unit 121 extracts the header part of the control signal and outputs the control signal type.
- the management unit 122 is inquired about the type and its identifier. In the control signal type management unit 122, since the upper 8 bits of the header unit 200 indicating the signal type information are “00000010”, the control signal type management unit 122 is linked to the matching item of the signal type information 211. It is determined that the type is 213 of “pin microphone”, and since the lower 8 bits are “0000 0001”, the identifier 210 of “PM_1” linked to the matching item of the identifier information 212 is determined. to decide. Accordingly, the control signal type management unit 122 determines that the type of the input control signal is “pin microphone” and the identifier is “PM-1”, and sends the control signal type determination unit 121 “ Notify "Pin microphone” or "PM-1".
- the type and the identifier are notified to the control signal type determination unit 121.
- the type can be determined only by the identifier, only the identifier (PM-1) is notified. Also good ,.
- the length and position of the bit sequence for determining the type of the signal and the identifier thereof are not limited to the above-described example.
- the analog signal power type and its identifier are determined directly, and the control signal determination unit 121 is provided with separate input systems for the number of control signals to be detected.
- the input signal input from the input system may be determined.
- a GUI Graphic User Interface
- control signal attribute information management unit 14 is registered in advance so that various control signals and attribute information can be associated with each other. For example, an identifier that uniquely specifies a control signal and attribute information are linked and managed, and attribute information can be determined based on the identifier acquired by the control signal detection unit 12.
- the control signal attribute information management unit 14 registers identifiers and attribute information of various control signals.
- the attribute information registration unit 141 receives the registration from the attribute information registration unit 141, registers the attribute information in the attribute information database 143, receives the attribute information request from the index generation unit 13, and receives the attribute information from the attribute information database 143.
- An attribute information management unit 142 manages reading of attribute information based on the identifier, and the like, and an attribute information database 143 that stores the types of control signals and their identifiers and the corresponding attribute information in association with each other.
- the registration of the attribute information can be performed manually by a person involved in the production or editing of a program, or by online registration from various devices used in a broadcasting station. For example, information such as a character string created by the telop creator 51 and a video of a VTR edited by the editing PC 41 can be diverted, and linked online with identifiers of various devices. Thereby, the registration work of the attribute information indicating the character string, the video information, and the like is reduced. In addition, it is also possible to store the created or edited character string, video information, and the like in a removable medium, and register it using the removable medium.
- the index generation unit 13 generates metadata according to the type of the control signal, its identifier, and the detection time, and, on the other hand, attribute information associated with the obtained identifier to the control signal attribute information management unit 14 The attribute information obtained from the control signal attribute information management unit 14 is added to the generated metadata.
- control signals, types, and identifiers of various devices are registered in the control signal type management unit 122 of the control signal detection unit 12 before broadcast / recording of a program.
- the input signal is a pin microphone signal
- the control signal, type, and identifier of the pin microphone are determined in advance so that the input of the pin microphone can be determined.
- the control signal is converted into a type or an identifier.
- who wears the pin microphone (the power of which identifier corresponds to whom) is registered in the control signal attribute information management unit 14.
- FIG. 8 shows the relationship between the pin microphone identifiers registered in the attribute information database 143 of the control signal attribute information management unit 14 and the performers who wear the pin microphones. Assuming that the corresponding identifier and the pin microphone wearer are managed and registered as a set. Figure 8 shows that the pin microphone identifiers PM-1, PM-2, and PM-3 are linked to Performer A, Performer B, and Performer C respectively in the default state.
- the attribute information registration unit 141 updates the attribute information, so that the wearers of the respective pin microphones, Taro Yamada, Jiro Tanaka, and Hanako Suzuki, are linked. Indicates that it is being updated and managed. Also, once set attribute information is recorded in the attribute information database 143, the attribute information can be easily associated with the identifier from the attribute information database 143 by a method such as a selection formula.
- FIG. 9 is a flowchart showing a process of detecting the sound pressure level of the sound control signal input to the pin microphone and notifying the control signal type determination unit 121 of the sound control signal that has reached the sound pressure level.
- FIG. 5 is a flowchart from when a type control unit 121 is notified of a voice control signal to when a metadata generation request is made. The flow of the metadata generation process will be described with reference to the flowcharts of FIGS.
- a voice control signal is input from the pin microphone to the microphone signal sound pressure level determination unit 123 of the control signal detection unit 12 via the voice switching switch 18 each time an utterance occurs (S20, S21). ).
- the microphone signal sound pressure level discriminating unit 123 does not consider noise or the like as speech, and considers that only a speech control signal that has reached a sound pressure level equal to or higher than a certain level is considered to be speech and performs control.
- the voice control signal is input to the signal type determination unit 121.
- a sound control signal that does not reach a sound pressure level equal to or higher than a certain level is regarded as having no speech or being finished, and no speech control signal is input to the control signal type discriminating unit 121 or the speech is not spoken. Notify that it has finished.
- control signal type discriminating unit 121 in order to detect the start and end of the utterance, it is necessary to notify the control signal type discriminating unit 121 only when the sound pressure level reaches or exceeds a certain level or lower than the sound pressure level. However, it may be determined that the utterance has been made only when the sound pressure level has reached the sound pressure level continuously for a certain period of time, and the control signal type determination unit 121 may be notified of the voice control signal. Also, the control signal type determination unit 121 may be notified only when the sound pressure level has been continuously lower than the sound pressure level for a certain period of time.
- control signal type identification unit 121 When an audio control signal is input to the control signal type identification unit 121, the control signal type identification unit 121 extracts the header part and sends it to the control signal type management unit 122 to handle the audio control signal. Inquire about the type and identifier that are used.
- the control signal type management unit 122 determines the type and identifier of the audio control signal based on the signal type information and the signal identifier indicated in the header unit 200, and sends the type and identifier to the control signal type determination unit 121. Notify. Here, if the type can be determined only by the identifier (see FIG. 6), only the identifier may be notified (S12).
- control signal type determining unit 121 acquires the type and the identifier, it sends them to the index generation requesting unit 124, and the index generation request 124 sends the current time to the time obtaining unit 125. To obtain the time (S13). Index generation required The requesting unit 124 sends these to the index generation unit 13 as it acquires the type, identifier, and time of the voice control signal, and requests index (metadata) generation (S14).
- the index generation unit 13 generates metadata according to the acquisition of the type, the identifier, and the time from the control signal detection unit 12 (index generation request unit 124), and controls the type and the identifier. Sent to the signal attribute information management unit 14 to inquire attribute information. The control signal attribute information management unit 14 acquires attribute information that is associated with and managed based on the transmitted type and identifier, and notifies the index generation unit 13 of this. The index generator 13 adds attribute information to the generated metadata in response to the notification of the attribute information. By performing the above-described processing each time the control signal detection unit 12 detects the voice control signal, the start and end times of the utterance of the performer wearing the pin microphone are arranged for each performer. Can be generated.
- FIG. 11 schematically illustrates the relationship between the type and identifier of the control signal generated by the index generation unit 13 and the attribute information thereof.
- FIG. 12 is an example of expressing the result of the above processing in XML (extensible Markup Language), and it is possible to see at a glance at which time the speaker starts and ends the utterance.
- control signal detection unit detects the voice control signal for controlling the voice simultaneously with the utterance of the program performer, thereby automatically and accurately generating information on at what timing and who spoke.
- the cost can be significantly reduced compared to the conventional manual metadata generation.
- control signals, types, and identifiers of various devices are registered before system operation. That is, when the VTR is switched to the VTR using the VTR controller 40 during the broadcast of the program, the control signal detection unit 12 detects the VTR control signal output from the VTR switch 16 and further the input of any VTR. Register the control signal, type, and identifier of the VTR in advance so that it can be determined. The VTR is also considered to record “title”, “content”, “location”, “time”, etc. at the time of editing. These pieces of attribute information are also registered in the control signal attribute information management unit 14, and are associated with attribute information (here, title) and an identifier in order to identify which VTR is used.
- control signal attribute information management unit 14 can register the attribute information and the identifier to be registered by online connection of the editing PC 41.
- the attribute information and identifier created at the same time as the VTR editing are automatically registered as they are in the control signal attribute information management unit 14.
- attribute information and an identifier can be recorded on a removable medium such as a CD-ROM, a flexible disk, and a DVD SD memory card which are not registered online, and the control signal attribute information management unit 14 can be registered using the removable medium.
- FIG. 13 shows the relationship between the VTR identifier registered in the attribute information database 143 of the control signal attribute information management unit 14 and the title of the VTR.
- the identifier of the VTR and the title are managed as a set. It is assumed that it will be registered.
- VTR-1 VTR-2 and VTR-3 which are VTR identifiers, are associated with the titles of the captured images, "Future Report of Burned Body Incident,” “Nagata-cho the Night Before Dissolution,” and “Sports Corner Video.” It is attached and managed.
- the attribute information registered in the attribute information database 143 may be managed by linking information such as VTR contents, time, location, performers, and recording time, in addition to the VTR title.
- the designated VTR is broadcast by the VTR controller 40, and at the same time, the VTR control signal is transmitted to the control signal detector 12 by the control signal type. It is input to the determination unit 121.
- the control signal type determination unit 121 extracts the header part and sends it to the control signal management unit 122 according to the processing flow shown in FIG. Compatible with Inquire about the type and identifier.
- the control signal type management unit 122 determines the type and identifier of the VTR control signal based on the signal type information and signal identifier indicated in the header unit 200, and notifies the control signal type determination unit 121 of the type and identifier. I do.
- the type can be determined only by the identifier (see FIG. 6), only the identifier may be notified.
- control signal type determining unit 121 obtains the type and identifier, it sends them to the index generation requesting unit 124, and the index generation request 124 responds to the request and the time obtaining unit 125. To get the time.
- the index generation request unit 124 sends these to the index generation unit 13 in response to acquiring the type, identifier, and time of the voice control signal, and requests index (metadata) generation.
- the index generation unit 13 generates metadata according to the acquisition of the type, identifier, and time from the control signal detection unit 12 (index generation request unit 124), and controls the type and identifier. Sent to the signal attribute information management unit 14 to inquire attribute information. The control signal attribute information management unit 14 acquires attribute information that is associated with and managed based on the transmitted type and identifier, and notifies the index generation unit 13 of this. As the attribute information is notified, the index generation unit 13 adds the attribute information to the generated metadata.
- FIG. 14 is an example of the result of the above processing expressed in XML, and it can be seen at a glance at what time the VTR is broadcast and what the title is.
- the VTR control signal is detected by the control signal detection unit at the same time that the VTR is used, so that information about when the VTR was used is automatically and accurately converted to metadata, and the attribute information is also obtained.
- the telop is created and output by a telop creator 51 that performs electronic processing such as a telop document creation tool.
- control signals, types, and identifiers of various devices are registered before system operation.
- the control signal detection unit 12 detects the telop control signal output from the telop switch 17 and further determines which telop was input.
- the control signal, type, and identifier of the telop are registered in advance so that the telop can be determined. It is also considered that information such as “character string”, “character string type”, “font”, “font”, and “color” is recorded when the telop is created.
- Pieces of attribute information are also registered in the control signal attribute information management unit 14, and are managed by linking attribute information (here, a character string) and an identifier in order to identify which telop is.
- attribute information here, a character string
- the attribute information and the identifier registered in the control signal attribute information management unit 14 can be registered by online connection from the telop creator 51.
- the attribute information and the identifier created at the same time as the telop creation are automatically registered in the control signal attribute information management unit 14 as they are.
- FIG. 15 shows the relationship between a telop identifier and a telop character string registered in the attribute information database 143 of the control signal attribute information management unit 14.
- the telop identifier and the character string are managed as a set. It is assumed that it will be registered.
- the telop identifiers TP_1, ⁇ _2, ⁇ _3, and ⁇ -4 respectively, create the character strings of the telops and their types “Taro Yamada, personal name”, “Niro Sato, personal name”, and “ , Topic name ", and” dissolution Nagata-cho of the previous night, topic name ".
- the attribute information registered in the attribute information database 143 may be managed by linking information such as the font, font, and color of the telop in addition to the telop character string and its type.
- the designated telop is broadcast by the telop generator 50, and at the same time, the telop control signal is controlled by the control signal detector 12.
- the signal is input to the signal type determination unit 121.
- Control signal type discrimination When the telop control signal is input to the section 121, the control signal type discriminating section 121 extracts the header section and sends it to the control signal management section 122 according to the processing flow shown in FIG. Inquire about the type and identifier that are used.
- the control signal type management unit 122 determines the type and identifier of the telop control signal based on the signal type information and signal identifier indicated in the header unit 200, and sends the type and identifier to the control signal type determination unit 121. Notify. Here, if the type can be determined only by the identifier (see FIG. 6), only the identifier may be notified.
- control signal type determining unit 121 obtains the type and identifier, it sends them to the index generation requesting unit 124, and the index generation request 124 responds to the request and the time obtaining unit 125. To get the time.
- the index generation request unit 124 sends these to the index generation unit 13 in response to acquiring the type, identifier, and time of the voice control signal, and requests index (metadata) generation.
- the index generation unit 13 generates metadata as the type, identifier, and time are obtained from the control signal detection unit 12 (index generation request unit 124). Sent to management unit 14 to inquire about attribute information.
- the control signal attribute information management unit 14 acquires attribute information that is associated with and managed based on the transmitted type and identifier, and notifies the index generation unit 13 of this. As the attribute information is notified, the index generation unit 13 adds the attribute information to the generated metadata.
- Fig. 16 is an example of the result of the above processing expressed in XML. At a glance, it is possible to see at what time this XML telop is broadcast and what the telop is.
- the information about when the telop was used is automatically and accurately converted to metadata, and the attribute information is further obtained.
- the number of man-hours can be significantly reduced compared to the conventional manual metadata.
- Metadata generation technology using conventional telops is erroneous because information is obtained by recognizing the character string itself of the telop. Although recognized and given incorrect metadata, the present invention does not provide incorrect metadata.
- control signals, types, and identifiers of various devices are registered before system operation.
- a camera control signal for switching cameras it is determined that the camera has been switched, and the camera control signal, type, and identifier are registered in advance so that it is possible to determine which camera has been switched. Keep it.
- the camera control signal By detecting the camera control signal by the control signal detection unit 12 at the same time as the camera is switched, the camera work information indicating which camera was used and when can be automatically and accurately converted to metadata.
- detecting a camera control signal that has switched from a relay video to a studio video it is possible to meta-data the insertion information of the relay video.
- RF tag Radio Frequency tag
- This information can be converted to metadata.
- the signal, type, and identifier of the RF tag are registered in the control signal type management unit 122 of the control signal detection unit 12 before the system operation, and the attribute information database 143 of the control signal attribute information management unit 14 stores the RF tag.
- the nomination and date of birth of the leading actor, which are attribute information on the tag identifier and the actor to which the RF tag is attached, are registered and linked.
- control signal detection unit 12 detects two or more control signals at the same time, rather than using these various control signals alone, to determine when various devices have been used. Automatically and accurately, and by adding attribute information, various information constituting the program broadcast can be converted into metadata in synchronization with the program broadcast. This makes it possible to significantly reduce the conventional manual metadata generation work and to provide accurate information.
- the control signal attribute information management unit 14 includes a database search unit 144 for connecting to a database storing the detailed information of the attribute information, and stores the detailed information acquired from the database 70. It is acceptable to automatically add the metadata generated by the index generator 13.
- the database 70 includes a personal information database 71, a news database 72, and a script database 73, which are connected online.
- the person information database 71 manages a person's name, gender, date of birth, place of birth, and the like in association with each other.
- the news database 72 video information, contents, location locations, and the like are linked and managed.
- the script database 73 character string information, video information, performers, and the like are linked and managed.
- the attribute information management unit 142 acquires the identifiers of various devices sent from the index generation unit 13, the attribute information management unit 142 An inquiry is made as to whether there is attribute information associated with the identifier (S201).
- the attribute information database 143 searches for the attribute information associated with the identifier (S202), and notifies the attribute information management unit 142 of the attribute information.
- the attribute information management unit 142 links the notified attribute information with the identifier (S203), and sends the attribute information to the database search unit 144.
- the database search unit 144 inquires of the personal information database 71, the news database 72, and the script database 73 whether there is detailed information of the attribute information (S204). Here, it is OK to make inquiries to various databases selectively.
- the various databases 71 to 73 search for detailed information linked to the attribute information, and notify the attribute information management unit 142 of the detailed information via the database search unit 144.
- the attribute information management unit 142 links the attribute information obtained from the attribute information database 143 and the detailed information obtained from the various databases 71 to 73 to the index generation unit 13 in a linked manner (S206).
- the above processing is to search for detailed information on attribute information linked based on one identifier. However, if there is more than one attribute information, the new attribute information is used as a search key for detailed information.
- FIGS. 21 and 22 show examples of metadata to which attribute information and detailed information are added.
- control signal attribute information management unit includes the database search unit 144 that searches for detailed information of the attribute information managed by the control signal attribute information management unit.
- the detailed information can be obtained from 71 to 73 and can be added to the metadata. Since the detailed information can be acquired based on the attribute information linked to the identifier, the attribute information managed by the control signal attribute information management unit 14 is the minimum necessary information.
- the control signal detection unit detects the control signals to determine their types and identifiers, and obtains the time. As these are acquired by the index generator, metadata is automatically generated. Further, the index generation unit requests and obtains the attribute information associated with the determined identifier from the control signal attribute information management unit which manages the identifiers of various control signals in association with their attribute information. And it is automatically added to the metadata. That is, in the present embodiment, it is possible to automatically generate metadata indicating various information constituting the program broadcast in synchronization with the broadcast of the program, thereby greatly reducing the conventional manual metadata generation work. In addition, it is possible to obtain accurate information.
- the detailed information can be obtained from another database and added to the metadata, so even if the attribute information is small, it can be searched.
- accurate and detailed information-rich metadata can be automatically generated.
- FIG. 23 is a configuration of a main block of the indexing system according to one embodiment of the present invention.
- the same components as those of the indexing system shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted.
- the configuration different from the system shown in FIG. 1 is that a log analysis unit 230 is provided.
- the log analyzer 230 generates and outputs log data according to the acquisition of the type, identifier, and time of the control signal from the control signal detector 12. As shown in FIG.
- the log data is data in which the times are arranged for each identifier.
- the log analysis unit generates log data and outputs the log data to the network or the removable medium 233, and the log output unit 241 inputs the log data and sends the log data to the index generation unit 13.
- a log input unit 242 for sending log data is provided.
- the network here may be connected online, and the removable medium 243 may be a recording medium such as a CD-ROM / flexible disk, DVD, or SD memory card.
- the log analysis unit 230 generates log data in which the time is simply arranged for each identifier without having to go through a network or a recording medium, and a block for outputting the log data is also physically integrated. It can be something.
- the log output unit 241 of the log analysis unit 230 generates log data by organizing the time for each identifier as the control signal identifier and the detection time are obtained from the control signal detection unit 12 (see FIG. 25). ).
- the log data shown in the figure is obtained by logging the control signal of the pin microphone for each identifier. Since the pin microphone observes the start and end times of the utterance, the time indicated here indicates a state in which the start and end of the utterance of the performer are repeated.
- the generated log data is input from the log output unit 241 to the log input unit 242 via the network or the removable media 243, and the log input unit 242 sends the log data to the index generation unit 13.
- the index generation unit 13 obtains log data whose time is arranged for each identifier
- the index generation unit 13 generates metadata as shown in FIG. Since the log data is organized in time for each identifier, it is possible to collectively manage the metadata.
- the index generation unit 13 uses the identifier indicated in the log data to inquire the control signal attribute information management unit 14 of attribute information managed in association with the control signal attribute information management unit 14.
- the control signal attribute information management unit 14 obtains the identifier from the index generation unit 13
- the control signal attribute information management unit 14 obtains the associated attribute information and notifies the index generation unit 13 of the obtained attribute information.
- the attribute information is added to the generated metadata.
- the power that describes the log data generated when a pin microphone control signal is detected.
- the control signal of the VTR, telop, or camera or RF tag described in the first embodiment is detected.
- log data can be generated in the same manner, and metadata as shown in FIGS. 14 and 16 can be generated as in the first embodiment.
- the control signal attribute information management unit 14 uses the attribute information acquired from the identifier indicated in the log data as a search key, and further obtains a person information database 71, a news database 72, and a script database 73 from the database search unit 144. You may access to and obtain detailed information.
- metadata as shown in FIGS. 21 and 22 is generated.
- the index generation unit acquires the generated log data, the index generation unit automatically generates metadata. Also, the index generation unit requests the attribute information associated with the determined identifier from the control signal attribute information management unit that manages the identifiers of the various control signals in association with their attribute information, They are acquired and automatically added to metadata.
- the present embodiment by using the determined control signal type, identifier, and time to generate log data in which the time is arranged for each identifier, it is possible to convert various information constituting the program broadcast into metadata. For example, various methods that automatically configure program broadcasting at an arbitrary timing without synchronization when shooting a program, such as converting log data into metadata after the editing work of recorded video is completed in a recording and recording program. Metadata generation of important information becomes possible, and the conventional manual metadata The effect is obtained that the generation work can be greatly reduced and accurate information can be given.
- detection of a control signal is triggered by presetting various control signals used at the time of broadcasting and information accompanying the signals as attribute information. As metadata.
- accurate indexing can be performed, and the effect of eliminating the need for manual correction work can be obtained.
- manual setting of attribute information can be simplified.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Signal Processing (AREA)
- Mathematical Physics (AREA)
- Studio Devices (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/583,045 US7873637B2 (en) | 2003-12-15 | 2004-12-13 | Automatically imparting an index by using various kinds of control signals |
EP04806929A EP1698983A1 (en) | 2003-12-15 | 2004-12-13 | Index imparting system using control signal |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2003416929 | 2003-12-15 | ||
JP2003-416929 | 2003-12-15 | ||
JP2004-359053 | 2004-12-10 | ||
JP2004359053A JP4531546B2 (ja) | 2003-12-15 | 2004-12-10 | 制御信号を利用したインデックス付与システム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005057431A1 true WO2005057431A1 (ja) | 2005-06-23 |
Family
ID=34680653
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2004/018568 WO2005057431A1 (ja) | 2003-12-15 | 2004-12-13 | 制御信号を利用したインデックス付与システム |
Country Status (5)
Country | Link |
---|---|
US (1) | US7873637B2 (ja) |
EP (1) | EP1698983A1 (ja) |
JP (1) | JP4531546B2 (ja) |
KR (1) | KR20060123316A (ja) |
WO (1) | WO2005057431A1 (ja) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4432877B2 (ja) * | 2005-11-08 | 2010-03-17 | ソニー株式会社 | 情報処理システム、および、情報処理方法、情報処理装置、プログラム、並びに、記録媒体 |
KR101087134B1 (ko) * | 2007-12-10 | 2011-11-25 | 한국전자통신연구원 | 체감 정보를 이용한 디지털 데이터 태깅 장치, 태깅 및검색서비스 제공 시스템 및 방법 |
US8620946B2 (en) * | 2010-12-16 | 2013-12-31 | Sap Ag | Storage and searching of temporal entity information |
JP7255918B2 (ja) * | 2020-09-16 | 2023-04-11 | 日本紙工株式会社 | 映像評価システム、映像評価プログラム、映像評価方法 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08339379A (ja) * | 1995-06-12 | 1996-12-24 | Nippon Telegr & Teleph Corp <Ntt> | 映像解析方法および装置 |
JPH11155122A (ja) * | 1997-11-20 | 1999-06-08 | Matsushita Electric Ind Co Ltd | 映像録画システム |
JPH11167583A (ja) * | 1997-12-04 | 1999-06-22 | Nippon Telegr & Teleph Corp <Ntt> | テロップ文字認識方法および映像蓄積表示装置、テロップ文字認識・検索端末、映像検索端末 |
JPH11338876A (ja) * | 1998-05-27 | 1999-12-10 | Hitachi Ltd | 映像検索方法及び装置ならびに記録媒体 |
JP2001069436A (ja) * | 1999-08-30 | 2001-03-16 | Nippon Hoso Kyokai <Nhk> | 話者情報記録装置および検索装置 |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5418621A (en) * | 1987-09-29 | 1995-05-23 | Goldstar Co., Ltd. | Circuit for detecting TV/radio broadcasting program, auto-tuning to channel selection and controlling VCR tape in recording operation |
US5805545A (en) * | 1991-08-14 | 1998-09-08 | Pioneer Electronic Corporation | Midi standards recorded information reproducing device with repetitive reproduction capacity |
EP1037465B1 (en) * | 1992-08-06 | 2005-06-08 | Fujitsu Limited | Terminal used with transaction processing system utilizing teletext broadcasting |
US5706352A (en) * | 1993-04-07 | 1998-01-06 | K/S Himpp | Adaptive gain and filtering circuit for a sound reproduction system |
US5491838A (en) * | 1993-04-08 | 1996-02-13 | Digital D.J. Inc. | Broadcast system with associated data capabilities |
US5579537A (en) * | 1993-04-08 | 1996-11-26 | Digital D.J. Inc. | Broadcast system with associated data capabilities |
KR0171930B1 (ko) * | 1993-12-15 | 1999-03-30 | 모리시다 요이치 | 반도체 메모리, 동화기억 메모리, 동화기억장치, 동화표시장치, 정지화기억 메모리 및 전자노트 |
US7055166B1 (en) * | 1996-10-03 | 2006-05-30 | Gotuit Media Corp. | Apparatus and methods for broadcast monitoring |
US6366699B1 (en) * | 1997-12-04 | 2002-04-02 | Nippon Telegraph And Telephone Corporation | Scheme for extractions and recognitions of telop characters from video data |
US6542611B1 (en) * | 1998-07-31 | 2003-04-01 | Circuit Research Labs, Inc. | Multi-state echo suppressor |
US6637028B1 (en) * | 1999-02-18 | 2003-10-21 | Cliq Distribution, Inc. | Integrated television and internet information system |
US7228305B1 (en) * | 2000-01-24 | 2007-06-05 | Friskit, Inc. | Rating system for streaming media playback system |
US7293279B1 (en) * | 2000-03-09 | 2007-11-06 | Sedna Patent Services, Llc | Advanced set top terminal having a program pause feature with voice-to-text conversion |
CN100592788C (zh) * | 2000-04-14 | 2010-02-24 | 日本电信电话株式会社 | 与广播信息相关的信息取得方法、系统和装置 |
JP2002027374A (ja) * | 2000-06-30 | 2002-01-25 | Sony Corp | 情報記録装置及び方法、情報処理装置及び方法、情報処理システム |
JP2002101393A (ja) * | 2000-09-22 | 2002-04-05 | Sony Corp | 映像表示装置 |
KR100434545B1 (ko) * | 2002-03-15 | 2004-06-05 | 삼성전자주식회사 | 홈네트워크로 연결된 가전기기들을 제어하는 방법 및 장치 |
JP4954471B2 (ja) * | 2002-06-07 | 2012-06-13 | トムソン ライセンシング | ネットワークに接続された装置から別の装置へのデータの配信を制御する方法 |
US7509321B2 (en) * | 2003-01-21 | 2009-03-24 | Microsoft Corporation | Selection bins for browsing, annotating, sorting, clustering, and filtering media objects |
US7487072B2 (en) * | 2004-08-04 | 2009-02-03 | International Business Machines Corporation | Method and system for querying multimedia data where adjusting the conversion of the current portion of the multimedia data signal based on the comparing at least one set of confidence values to the threshold |
-
2004
- 2004-12-10 JP JP2004359053A patent/JP4531546B2/ja not_active Expired - Fee Related
- 2004-12-13 KR KR1020067011595A patent/KR20060123316A/ko not_active Application Discontinuation
- 2004-12-13 US US10/583,045 patent/US7873637B2/en not_active Expired - Fee Related
- 2004-12-13 EP EP04806929A patent/EP1698983A1/en not_active Withdrawn
- 2004-12-13 WO PCT/JP2004/018568 patent/WO2005057431A1/ja not_active Application Discontinuation
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08339379A (ja) * | 1995-06-12 | 1996-12-24 | Nippon Telegr & Teleph Corp <Ntt> | 映像解析方法および装置 |
JPH11155122A (ja) * | 1997-11-20 | 1999-06-08 | Matsushita Electric Ind Co Ltd | 映像録画システム |
JPH11167583A (ja) * | 1997-12-04 | 1999-06-22 | Nippon Telegr & Teleph Corp <Ntt> | テロップ文字認識方法および映像蓄積表示装置、テロップ文字認識・検索端末、映像検索端末 |
JPH11338876A (ja) * | 1998-05-27 | 1999-12-10 | Hitachi Ltd | 映像検索方法及び装置ならびに記録媒体 |
JP2001069436A (ja) * | 1999-08-30 | 2001-03-16 | Nippon Hoso Kyokai <Nhk> | 話者情報記録装置および検索装置 |
Also Published As
Publication number | Publication date |
---|---|
KR20060123316A (ko) | 2006-12-01 |
US7873637B2 (en) | 2011-01-18 |
US20080154932A1 (en) | 2008-06-26 |
JP2005204291A (ja) | 2005-07-28 |
JP4531546B2 (ja) | 2010-08-25 |
EP1698983A1 (en) | 2006-09-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20050228665A1 (en) | Metadata preparing device, preparing method therefor and retrieving device | |
US7924325B2 (en) | Imaging device and imaging system | |
US6687671B2 (en) | Method and apparatus for automatic collection and summarization of meeting information | |
JP5145937B2 (ja) | 再生開始位置制御付きコンテンツ再生方法および装置 | |
JP4794740B2 (ja) | オーディオ/ビデオ信号生成装置、及びオーディオ/ビデオ信号生成方法 | |
JP4591982B2 (ja) | オーディオ信号及び/又はビデオ信号生成装置、及びオーディオ信号及び/又はビデオ信号生成方法 | |
JP3895892B2 (ja) | マルチメディア情報収集管理装置およびプログラムを格納した記憶媒体 | |
JP4491700B2 (ja) | 音響検索処理方法、音響情報検索装置、音響情報蓄積方法、音響情報蓄積装置および音響映像検索処理方法、音響映像情報検索装置、音響映像情報蓄積方法、音響映像情報蓄積装置 | |
WO2001016935A1 (fr) | Procede et dispositif d'extraction/traitement d'informations, et procede et dispositif de stockage | |
JP4405418B2 (ja) | 情報処理装置及びその方法 | |
JP3781715B2 (ja) | メタデータ制作装置及び検索装置 | |
JP4018678B2 (ja) | データ管理方法および装置 | |
JP4531546B2 (ja) | 制御信号を利用したインデックス付与システム | |
JP2015084504A (ja) | 信号記録装置、カメラレコーダおよび信号処理装置 | |
US7444068B2 (en) | System and method of manual indexing of image data | |
JP2008102538A (ja) | 記憶再生装置及び記憶再生装置の制御方法 | |
WO2020057467A1 (zh) | 信息处理装置、信息处理系统以及影像装置 | |
CN115699723B (zh) | 影像编辑装置、影像编辑方法以及记录介质 | |
JP4256250B2 (ja) | データ記録システム、データ記録装置、データ送信装置、データ記録方法、並びに、記録プログラムおよびそれを記録した記録媒体 | |
JP2002288178A (ja) | マルチメディア情報収集管理装置およびプログラム | |
JP4686904B2 (ja) | 知識情報管理システムおよび知識情報管理方法 | |
CN1902630A (zh) | 利用控制信号的索引赋予系统 | |
JP2005204159A (ja) | 番組スケジュールを用いたインデックス付与システム | |
JP2010212821A (ja) | 記録再生装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200480040280.3 Country of ref document: CN |
|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 1020067011595 Country of ref document: KR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10583045 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2004806929 Country of ref document: EP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: DE |
|
WWP | Wipo information: published in national office |
Ref document number: 2004806929 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 1020067011595 Country of ref document: KR |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2004806929 Country of ref document: EP |