JP2002135719A - Management method and its device by means of interactive computer control for elements of video sequence - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method and a device simplifying the management of interactivity for elements related to audio, video or contents of a video sequence, in consideration of movable elements and various reproducing platforms. SOLUTION: In the management method and its device by an interactive computer control for elements of a video sequence of which the elements related to audio, video, or contents are provided with an element 11, 12 and 15 of a video sequence 10, an identifier is associated with each of the elements 11, 12, and 15 of the video sequence 10 potentially capable of operating, and a time stamp is set for the identifier as a criterion for capability of operation of the associated elements 11, 12, and 15, in response to the operation of a transactor at reproduction of the video sequence 10.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a computer-controlled method and apparatus for managing the interactivity of video sequence elements.

[0002]

BACKGROUND OF THE INVENTION Consumers are exposed to goods or information about them in a simple or attractive manner, an increasing number of different playback platforms for video sequences and the possibility of receiving video sequences via the Internet. Because of the financial interest of the market and sales departments to guide, interactivity in the video sequence is a major factor in processing the video sequence.

FIG. 1 shows elements 11 of a video sequence 10,
The basic principle of creating interactivity for 12 or 15 is shown. The video sequence 10 includes, for example, an image sequence 13 and an audio sequence 14. In the unit 20 for creating interactivity, the operating properties for the elements 11 and 12 (activation properties)
21 and 22 are defined, and activatable objects 31 and (12 + 22) are created. Operable object 31, (12 + 22)
Has been incorporated into the video sequence 10 to provide interactivity on the playback platform 30. Here, the image sequence 13 is an actable object 31
And the display unit 33 having the operable area 22, while the audio sequence 14 is reproduced in the audio reproduction unit 34 as a series of sounds. A viewer (not shown) can operate the object 31 or (12 + 22) by operating the instruction unit 35 (action).
Can be activated. The operating characteristics 21 and 22 can provide different things (events) for various operations of the viewer. If the viewer is pointing at the object 31 operable by the indicating unit 35, the text of the information on the element 11 is displayed. Upon further pressing of the button on the indicating unit 35, a short video sequence (not shown) with further activatable objects is displayed,
The reproduction of the video sequence 10 then continues after the end of this short video sequence.

As shown in FIG. 1, the elements of a video sequence can be images (buildings 11) or audio (acoustic sequences 12), but have content-related (eg,
Happiness or friendship) element. A common way to create interactivity of elements in a video sequence is with image elements.

FIG. 3 illustrates a conventional method for managing the interactivity of elements of a video sequence. In the creation unit 20 for the elements of the video sequence, which are intended to be operable, the positional arrangement of the elements is determined in a unit 25 for recording the coordinates, and the positional arrangement of the elements in their temporal development The correct arrangement is monitored in the movement recognition unit 24. Operating characteristic determination unit 2
At 6, the operating characteristics of the element are determined. Unit 2
Together with the positional information from 4 and 26, the operating characteristics are incorporated into the video sequence in the insertion unit 23. Depending on the requirements for the playback platform 30, the video sequence 10 may be transcribed to the playback platform 30 by its embedded actuatable object or separated therefrom.

Various methods are known in the prior art for recognizing the movement of an element, all of which involve their respective disadvantages. Operating characteristics can be associated with elements on a per image basis in a manual process. This requires a lot of work and includes various error possibilities. In semi-automatic processing, actuatable objects are created only for the selection of the main frame of the video sequence. In that case,
Movement between main frames can be calculated automatically, as long as the elements move mathematically easily to define the path. Thereby, the required manual processing is reduced with an increased computational burden. Starting from the element's basic shape, the pattern recognition method automatically records the element on a frame-by-frame basis and thereby tracks the movement of the element in the video sequence. Pattern recognition is particularly difficult by the fact that elements can change in their representation in a video sequence.
Therefore, for simple video sequences as well,
An enormous amount of calculation is required. For example, pattern recognition of the indicated part, the whole picture used or the person whose behavior is changing becomes extremely difficult.

[0007] Yet another problem arises when the element to be actuated is perceived by the viewer or is shown in the video sequence over a very short time or very rapid movement of the element being actuated. Depending on the viewer and the playback platform, the maximum speed of movement or minimum period of interactivity performed for an actuatable object may be different. The playback platform is
For example, it may vary with screen size, resolution, playback speed, operability, operating system, computer program for playing video sequences or various versions thereof.

[0008]

Due to possible differences between the playback platforms, the video sequence must be adapted to a special format for the playback platform. Conversion of a video sequence containing actuatable objects for different playback platforms can be performed only with certain restrictions. In contrast, the creation of special formats of versions of video sequences for various playback platforms in the prior art method requires repeated steps which increase the work of the method.

It is an object of the present invention to provide a method and apparatus that simplifies the management of interactivity for audio, image or content related elements of a video sequence in view of movable elements and various playback platforms. is there.

[0010]

According to the invention, this object is solved by a method comprising the steps of claim 1. The dependent claims illustrate preferred embodiments of the present invention.

In accordance with the present invention, an identifier is associated with a potentially operable element of a video sequence, and a timestamp is associated with the operation of the person processing the video sequence during playback of the video sequence. Accordingly, a criterion for the operability of the associated element is set for the identifier. The advantages of this method are the simplified operation, the scalability of the time stamps or timing marks for the various playback platforms and the similarity of the method to the slower activation of the viewer of the actuatable object. The processor, who is the same as the viewer, must recognize the element and take corresponding action. The time stamp is thereby better adapted to the situation of the viewer.

According to a preferred embodiment of the method, the setting of the time stamp is performed in response to a keyboard input by a processor. Keyboard input causes a first timestamp to be set when a key is pressed to mark the start of an operability cycle, and a second timestamp to be set when the key is released. Can be set to mark the end. The processor can press multiple keys in parallel, thereby setting multiple timestamps. Alternatively, the start timestamp may be set by a first keystroke and the end timestamp may be set by a second keystroke of the same or another key.

[0013] In order to process the video sequence more quickly and, for example, during repeated playback of the video sequence, to characterize the element already actuated by the corresponding text or push button for the processor, the potential for the processor by the text or push button. It is particularly appropriate to indicate the appearance of a specifically operable element.

According to an advantageous embodiment of the method, the time stamp is managed independently of the location information of the element. Thereby, the need to perceive elements at their location is avoided. Further, audio, image or content related elements may not be identified in the management process.

[0015] According to a preferred embodiment of the method, the playback of the video sequence is performed in a moving image manner, thereby increasing the processing speed. Especially when playing in real time, the same situation is achieved with regard to the processor as the viewer of the video sequence. In addition, the processor can adapt to the actual processing speed of the video sequence, in particular to playback speeds faster or slower than real time.

It is particularly advantageous to manage the time stamps and the operating characteristics of the elements separately from the video sequence, which simplifies the creation of video sequences for different playback platforms.

According to yet another embodiment of the method, the separately managed timestamps or links to the operating characteristics of the elements are stored in the video sequence, whereby the incorporation of the operable objects into the video sequence is reduced. Made easier.

According to yet another preferred embodiment of the method, the minimum length of the operability period is monitored. The availability period too short to be perceived by the viewer can be extended by semi-automatic movement of the time stamp. According to a preferred embodiment of the method, a timely minimum interval for the operability cycle is monitored and achieved by joining the operability cycles. Thereby,
Short-term inactivity of an activatable object that a viewer may interpret as an error in the video sequence can be avoided.

According to a particularly advantageous embodiment of the method, the operable object is created for a playback platform having a special format for the video sequence based on the time stamp and the operating characteristics of the special format. Video sequences with actuatable objects can thereby be created individually for different playback platforms based on the same information. In addition, the method can be repeated at any time,
It can be done on demand and allows any use of positional information about the element or activatable object depending on the actuation characteristics.

According to a preferred embodiment for implementing one of the methods described above, a computer-controlled device is used, which allows for a fast processing and an optimal embodiment of the method.

Furthermore, according to the present invention, a storage medium can include a computer program or a sequence of instructions for implementing one of the above methods. Thereby, the method once implemented can be used in multiple devices at different locations.

[0022]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below with reference to the drawings.

FIG. 2 shows a preferred embodiment of the present invention. In the creation means 220, the video sequence 10 comprises an actuatable object that is made playable on the playback platform 30. Video sequence 10
Has an image sequence 13 and an audio sequence 14. The creating means 220 may be, in particular, a part of a computer, a video processing interface or a movie processing means. Existing processing means essentially determine an embodiment of the method. The computer has, in particular, a display unit, a keyboard, a mouse, a control unit, a hard disk and a drive for optical or magnetic storage media. In the following, it is assumed that the creating means 220 is a computer.

The video sequence 10 includes, for example, a commercial for a shop 11 that sells music works and may exist as a frame-oriented video, videotape or in digitized or additionally compressed form. First, for those elements that are intended to be potentially operable, the identifier is assigned to the association unit 2
Associated with it at 28. Simple numbers can be used as identifiers, but further, unambiguous names can also be selected as identifiers. For example, in a commercial, the identifiers would appear to be "music shop" for element 11, "music title" for element 12, and "consumer" for element 15. These identifiers are stored in, for example, an external database. In order for a processor (not shown) to set the time stamps for the elements, the operations for the elements for which these time stamps are to be set must be determined. For example, key presses such as "g" for a music shop, "t" for a music title, and "k" for a consumer.

According to the invention, the start time stamp for the operability of element 11 is determined by the processor
When the key “g” is pressed during reproduction of “0”, the time stamp unit 227 is set. Thus, the end timestamp is set when the processor releases key "g". The processor recognizes the element 11 in the video sequence and performs the operation associated with this element to set the time stamp. The start time and end time of the operability of the associated element can be used as a time stamp, but the start time and the operability period can be used as a time stamp, or similarly the frame number from the video sequence Can be used as a time stamp. For example, touching the touch-sensitive screen at the location associated with the element,
Or, similarly, it appears that speech recognition for element identifiers ("music titles") is possible as a processor action. Further, the setting of the time stamp can be performed in response to a perceptible processor gesture.

The appearance of the potentially operable elements 11, 12 and 15 is indicated to the processor by push buttons.
Thereby, the processor can recognize the appearance of the operable element faster as well and determine the state of operability of the element based on the push button. The push button indicates that the processor has enabled element 11 in the previous playback of the video sequence.
Is depressed over a timely cycle that already indicates the operability of the

The time stamp is associated with the identifier,
For example, it is stored in an external database. Thereby, the time stamp is independent of any positional information about the element that is the operating criterion. Therefore, no knowledge of the coordinates of the elements, their size, or movement is required. Further, the processor may, for example, activate the element 12 before it is played or heard in a video sequence, especially to emphasize this. The processor includes additional standard products of the music shop 11 that are not included in this video sequence but are shown to the processor as additional operational objects for commercials manufactured for this music shop. Can be. Thus, the operability of the element can be completely independent of the playback of the element in the video sequence.

The video sequence 10 is played back in a moving or full moving manner, especially in real time, to provide context for the processor as well as for later viewers. In doing so, the processor can control the playback speed, slower or faster than real time, so that a processing speed adapted to the video sequence can be selected.
For example, if in the first part of the commercial only the music shop 11 is made to be the active element, then this part of the video sequence
For example, it may be processed faster than more complex parts that contain various music titles that are played back in short, partially continuous, all to be enabled. The processor
For example, at a reduced playback speed, the keys for each new music title can be pressed and held pressed until both are released. This produces a timestamp starting from each title, with the operability cycles existing in parallel and continuing after the end of each music title. This involves storing timestamps in an external database,
Or by adding a separate track to the video sequence over each availability cycle.

In the unit 226, for example, the element 1
The operating characteristics for 1 and 12 are determined. In addition to the operation of the viewer having an associated event, for example, image display, even positional information, may be included in the operating characteristics for the element.

Preferably, in the video sequence:
Links are stored against time stamps or operating characteristics of elements stored in an external database. Due to the separate management of time stamps and operating characteristics, this information is easily modified and clearly located. For the processor, for example, a time stamp or a list of operating characteristics is displayed and provided for editing.

[0031] Preferably, the minimum length of the enablement period is monitored in order to avoid actuatable objects in the video sequence which are actually inoperable for the viewer. The minimum length is automatically augmented and achieved by moving the end timestamp or showing a warning message to the processor. In addition, if there are a plurality of availability cycles for an element in a timely manner, the minimum timely interval between these availability cycles is monitored and ensured by joining them if necessary. The joining of the ready cycles can also take place automatically or in connection with a warning message to the processor.

In the insertion unit 229, the operable object 23 for the playback platform 30 having a special format for playing the video sequence
One or (12 + 222) is created based on the timestamp and specially formatted operating characteristics. The playback platforms 30 may differ from each other in various software or hardware characteristics. For example, digital video can be played on a computer by software "Quick Time" or "Windows Media Player". The playback platform 30 shown in FIG.
Is a screen 33 for playing, for example, an actuatable object 231 and an activatable surface 222, for example a sound reproducing unit 34 for playing the sound sequence 12, and at least one interface for the viewer, for example a mouse. 35 is provided. For example,
A computer, a mobile phone, a video game means, a television in combination with a reproduction means such as a television or a video recorder including respective additional functions can be used as the reproduction platform 30.

A computer controlled device with means for implementing one of the methods described above can rely on a video sequence input format in its execution.

A computer program for implementing one of the above-described methods may be stored on a computer hard disk or a magnetic or optical storage medium.

[0035]

As mentioned above, the present invention comprises the step of associating an identifier with an element of a video sequence that is to be potentially enabled, said element being an audio, image or content related element. In a computer controlled management method of interactivity for elements of a sequence, the method according to a processor operation during playback of the video sequence,
Since the timestamp for the identifier is set as a criterion for the operability of the associated element, audio, image or content related elements of the video sequence in view of the movable elements and the various playback platforms A computer controlled management method and apparatus for interactivity of elements of a video sequence can be provided that simplifies the management of interactivity for a video sequence.

[Brief description of the drawings]

FIG. 1 illustrates the basic concept for creating interactivity of the elements of a video sequence.

FIG. 2 is a diagram illustrating a method for managing elements of a video sequence in a preferred embodiment of the present invention.

FIG. 3 illustrates a prior art method for managing the interactivity of elements of a video sequence.

[Explanation of symbols]

 Reference Signs List 10 video sequence 11 element (music shop) 12 element (music title) 15 element (consumer) 30 playback platform 222 workable surface 231 workable object

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Winfried Piegsda, Germany Eggenstein-Leopoldshafen, Eisenbahn Schutlasse 45 (72) Inventor Ralph Sontag, Germany Künzel, Falkenweg 1F Term (Reference) 5C053 FA14 GA11 GB06 GB11 GB21 JA03 JA22 LA11 LA15 5C063 AA01 AB03 AB05 AC01 AC05 CA11 CA20 CA23 CA36 DA05 DA07 DA13 DB10 5D044 AB07 CC03 DE39 DE49 FG18 GK12 5D110 AA04 AA29 DA08 DA12 DB05 DC04 DE02 EA07

Claims (12)

[Claims] 1. Associating an identifier with an element (11,12,15) of a video sequence (10) to be potentially enabled, said element (11,12,15)
Is a computer-controlled management method of interactivity for elements of a video sequence, wherein the elements are audio, image or content related elements, wherein the associated elements (11 , 12, 15)
A method of managing interactivity for elements of a video sequence, wherein a timestamp for said identifier is set as a criterion for the operability of the video sequence. 2. The method according to claim 1, wherein the setting of the time stamp is performed in response to a keyboard input of the processor. 3. The method according to claim 1, wherein the time stamp is the element (11,
A method according to claim 1, characterized in that it is managed independently of the location information (12, 15). 4. The method according to claim 1, wherein the reproduction of the video sequence is performed in a moving image manner. 5. The time stamp and the element (1)
The method according to claim 1, characterized in that the operating characteristics of the video sequence (1, 12, 15) are managed separately from the video sequence (10). 6. The interactive computer control for elements of a video sequence according to claim 1, wherein the appearance of a potentially operable element is indicated to the processor by text or a push button. Management method. 7. The video sequence element according to claim 5, wherein the separately managed timestamps or links to the operating characteristics of the element are stored in the video sequence. An interactive computer controlled management method. 8. The method according to claim 1, wherein a minimum length of the ready period is monitored. 9. The interactive computer for elements of a video sequence according to claim 1, wherein a minimum time interval for the availability cycle is monitored and implemented by joining the availability cycles. Management method by control. 10. The operable object (231, 12 + 222) for a playback platform (30) having a special format according to the time stamp and the special format operating characteristics. Computer-controlled method of managing interactivity for elements of a video sequence. 11. A computer controlled device comprising means for implementing the method of claim 1. 12. A storage medium comprising a computer program or an instruction sequence for implementing the method according to claim 1.