Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
  • H04N21/8583—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by creating hot-spots
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
  • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
  • H04N21/23614—Multiplexing of additional data and video streams
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
  • H04N21/23614—Multiplexing of additional data and video streams
  • H04N21/23617—Multiplexing of additional data and video streams by inserting additional data into a data carousel, e.g. inserting software modules into a DVB carousel
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
  • H04N21/2362—Generation or processing of Service Information [SI]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
  • H04N21/4348—Demultiplexing of additional data and video streams
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
  • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
  • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
  • H04N21/47815—Electronic shopping
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/16—Analogue secrecy systems; Analogue subscription systems
  • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
  • H04N7/17309—Transmission or handling of upstream communications
  • H04N7/17318—Direct or substantially direct transmission and handling of requests

Definitions

• the present invention relates in general to producing of digital information and digital broadcasting and more specifically to system and method for combining video stream with digital information.
• Disc provide the user with a lot of different options to select how to view the content.
• FIG. 1 illustrates a prior art digital broadcasting sys- tern.
• the presented prior art digital broadcasting system has several audio and video sources e.g. video cameras and other video sources.
• the prior art digital broadcasting system has a Video Processing unit 1, a Broadcast unit 2, a multiplexer 6, and a transmitter unit 9.
• the Broadcast unit 2 has a Play Out unit 3 a broadcast automation system 4 and a Data Carousel unit 5.
• Video cameras have first recorded the event to a recorded video signal.
• the recorded video signal is next forwarded to a Video Processing unit 1, which is used to combine the different recorded video signals to a single video program stream.
• Video Processing unit 1 there is typically made adjustments, editing and modifications (Video Processing) to the recorded video signals.
• the processed single video program stream is next forwarded to a Play Out unit 3.
• a Play Out unit 3 normally handles the processing of several video program streams. These program streams are then forwarded to a multiplexer 6, which is used to multiplex different video program streams into a multi-program transport stream.
• the application data is usually stored in a Digital Storage Medium.
• the Digital Storage Medium can for example be a Data Carousel 5, from which the said application data is forwarded to the multiplexer 6.
• the multiplexer 6 is used to multiplex different digital video program streams and digital data streams into a multi-program transport stream.
• Data Carousel 5 is basically a memory database, where data sets from the different application sources 7 are assembled into a buffer. From the buffer the data sets are played out in a cyclic manner. There is also a system information table 8 linked to the multiplexer 6.
• the broadcasting stream is forwarded to a transmitter unit 9.
• the transmitter unit 9 sends the stream over a transport network 10 to the receiving unit 11.
• the receiving unit 11 presents the infor ⁇ mation in a monitoring unit 12 e.g. a television.
• the monitoring unit 12 and/or the receiving unit 11 can be controlled by a controlling unit 13.
• the present invention provides a system and a method for transmitting and receiving digital information, a digital information combining means, a digital information presenting means, a method for combining video stream with digital information, a method for presenting digital information combined with a video stream and a method for performing a business transaction in a digital transmis- sion system.
• a system for transmitting and receiving digital information comprising: - processing means for combining recorded signals from different audio and video sources to a single video program stream, motion tracking means for defining active areas in a selected video program stream, - linking means for linking appropriate application data to the corresponding active areas in the video program stream, transmitting means for transmitting the video stream over a transport network to the receiving side, - receiving means for receiving the incoming video stream, monitoring means for presenting the monitored program to the user, and controlling means for controlling the receiving means and the monitoring means.
• the said transmitting means comprises storing and forwarding means, and multiplexing means for multiplexing different digital video program streams and digital data streams into a multi-program transport stream, and sending means, so that the storing and forwarding means receives application data from different applications, and forwards the appropriate application data to the multiplexing means.
• the said motion tracking means forwards the knowledge of the active areas to the said multi- plexing means via the storing and forwarding means.
• the said motion tracking means forwards the knowledge of the active areas to the said multiplexing means via a system information table.
• the said motion tracking means forwards the knowledge of the active areas directly to the said multiplexing means.
• the said storing and forwarding means has a Carousel unit and a Database server having a connec- tion to one or more client units, so that the Database server receives information from the client units, stores the client information, and forwards the client information to the Carousel unit, and that the Carousel unit forwards the appropriate application data corresponding to the active areas to the multiplexing means.
• the said storing and forwarding means has also an automation system, which controls both the Database server and the Carousel unit.
• a data combining arrangement for combining application data to a video program stream in a digital transmission system, said data combining arrangement comprising: processing means for combining recorded signals from different audio and video sources to a single video program stream, motion tracking means for defining active areas in a selected video program stream, and linking means for linking appropriate application data to the corresponding active areas in the video program stream, and transmitting means for transmitting the video stream over a transport network to the receiving side.
• the said transmitting means comprises storing and forwarding means, and multiplexing means for multiplexing different digital video program streams and digital data streams into a multi-program transport stream, and sending means, so that the storing and forwarding means receives application data from different applications, and forwards the appropriate application data to the multiplexing means.
• the said motion tracking means forwards the knowledge of the active areas to the said multiplexing means via the storing and forwarding means.
• the said motion tracking means forwards the knowledge of the active areas to the said multiplexing means via a system information table.
• the said motion tracking means forwards the knowledge of the active areas directly to the said multiplexing means .
• the said storing and forwarding means has a Carousel unit and a Database server having a connection to one or more client units, so that the Database server receives information from the client units, stores the client information, and forwards the client information to the Carousel unit, and that the Carousel unit forwards the appropriate application data corresponding to the active areas to the multiplexing means.
• the said storing and forwarding means has also an automation system, which controls both the Database server and the Carousel unit.
• the active areas in a selected video program stream are defined by - selecting locking points, defining the active areas around the locking points, and tracking the movement of the locking points and the active areas in a selected video program stream using motion tracking means.
• the movement of the locking points is calculated based on differences between frames following each other.
• the locking points are defined with vectors.
• the locking points are defined with coordinates.
• the active area corresponding to a specific locking point is defined as a function or a group of func- tions relating to the locking point.
• the active area is updated for every frame.
• the active area remains same for X frames and is updated for every X th frame, where X is an integer.
• the size and the shape of the active areas depend on the dis- tance between locking points located close to each other.
• the size and the shape of the active areas depend on the distance between active areas located close to each other.
• a data presenting arrangement for presenting a video program stream combined with application data in a digital transmission system
• said data presenting arrangement comprising: - receiving means for receiving the incoming video stream from a digital broadcasting system, in which the application data is linked to the relating video program stream, and all the different video program streams are multiplexed into a multi-program transport stream, - monitoring means for presenting the monitored program to the user, and controlling means for controlling the receiving means and the monitoring means .
• the receiving unit and the monitoring unit are combined as one unit.
• the receiving unit, the monitoring unit and the user control device are combined as one unit.
• the said data presenting arrangement also comprises transmitting means for transmitting information from the user to a service provider over a transport network.
• the said controlling means is also used for controlling the transmitting unit.
• the transmitting unit is equipped for sending a business transaction request from the user to a service provider.
• the transmitting unit is equipped for receiving a confirmation from the service provider to the user.
• the receiving unit, the monitoring unit and the transmitting unit are combined as one unit.
• the receiving unit, the monitoring unit, the user control device and the transmitting unit are combined as one unit.
• the said monitoring device has a screen display with a movable cursor, and means for cursor location detection.
• the incoming multi-program stream also includes an application, which is used to produce a movable cursor for the monitoring device.
• the said movable cursor can be controlled with the user control device.
• the incoming multi-program stream also includes an application, which is used for constantly tracking the movements of the selected locking points in a digital video program, and constantly comparing the loca- tion of the active areas relating to the locking points with the movements of the cursor.
• the said screen display has a set of selecting buttons, which selecting buttons can be controlled with the user control device .
• the first data application when the cursor is moved to be on a defined active area, the first data application will start automatically.
• the data application first shows a confirmation prompt to the user and asks the user to con- firm with the user control device, that the user is willing to proceed with the data application.
• the data application shows information relating to the selected active area. More preferably, the data application displays selection buttons to the user. More preferably, the data application shows a selection button confirming a purchase of a product.
• a method for transmitting and receiving a combined video stream with data comprising the steps of: defining data for active areas on a video stream, sending data and video program over a transport network to the receiving side, receiving data and video program at the receiving side, and presenting data and video program stream to the user.
• a method for combining video stream with data comprising the steps of: selecting locking points in a single picture of a incoming digital video program in a video stream, - defining active areas for the selected locking points, and defining data and applications for the active areas.
• a method for presenting a combined video stream with data comprising the steps of: announcing to the user that there is a data service present, detecting the location of the cursor, and comparing the location of the cursor to the location of the active areas detected by an application received in the multi-program transport stream, and when it is detected that the cursor is on the active areas, presenting the retrieved data from the data appli- cation.
• announcing to the user that there is a data service present detecting the location of the cursor, and comparing the location of the cursor to the location of the active areas detected by an application received in the multi-program transport stream, and when it is detected that the cursor is on the active areas, presenting the retrieved data from the data appli- cation.
• a seventh aspect of the present invention there is provided a method for performing a business transaction in a digital transmission system, said method comprising the steps of: announcing to the user that there is a data service present, - detecting the location of the cursor, when it is detected that the cursor is on the active areas, presenting the retrieved data from the data application, and the user performing a business transaction.
• Figure 1 illustrates a prior art digital broadcasting system.
• Figure 2 illustrates a digital broadcasting system according to the present invention.
• Figure 3 illustrates a Digital Storage Medium of the digital broadcasting system according to the present invention.
• Figure 4 illustrates the structure of operating multiple active applications in a digital broadcasting system according to the present invention.
• Figure 5 illustrates the selecting of locking points in a digital video program according to the present invention.
• Figure 6 illustrates the defining of active areas for the selected locking points in a digital video program according to the present invention.
• Figure 7 illustrates the selecting of locking points and the defining of active areas with the help of vectors in a digital video program according to the present invention.
• Figure 8 illustrates the defining of active areas and the cursor movement with the help of vectors in a digital video program according to the present invention.
• Figure 9 illustrates the selecting of locking points and the defining of active areas with the help of coordinates in a digital video program according to the present invention.
• Figure 10 illustrates the defining of active areas and the cursor movement with the help of coordinates in a digital video program according to the present invention.
• Figure 11 illustrates a receiving system for receiv- ing a video stream combined with data according to the present invention.
• Figure 12 illustrates another embodiment of a receiving system for receiving a video stream combined with data according to the present invention.
• Figure 13 illustrates a monitoring unit according to the present invention.
• Figure 14 illustrates the starting of a data application in a receiving system according to the present invention.
• Figure 15 illustrates the activating of further options of a data application in a receiving system according to the present invention.
• Figure 16 illustrates a method for transmitting and receiving a combined video stream with data according to the present invention.
• Figure 17 illustrates a method for combining video stream with data according to the present invention.
• Figure 18 illustrates a method for presenting a com- bined video stream with data according to the present invention.
• Figure 19 illustrates a second alternative method for presenting a combined video stream with data according to the present invention.
• Figure 20 illustrates a third alternative method for presenting a combined video stream with data according to the present invention.
• Figure 2 illustrates a digital broadcasting system according to the present invention.
• the presented digital broadcasting system has several audio and video sources e.g. video cameras and other video sources.
• the prior art digital broadcasting system has a Production unit 14, a Broad- cast unit 2, a multiplexer 6, and a transmitter unit 9.
• the Production unit 14 has a Video Processing unit 15 and a Motion Tracking unit 16.
• the Broadcast unit 17 has a Play Out unit 3 a broadcast automation system 18 and a Data Carousel unit 19.
• Video cameras have first recorded the event to a recorded video signal.
• the recorded video signal is next forwarded to a Video Processing unit 15, which is used to combine the different recorded video signals to a single video program stream.
• the processed single video program stream is next forwarded to a Play Out unit 3.
• a Play Out unit 3 normally handles the processing of several video program streams. These program streams are then forwarded to a multiplexer 6, which is used to multiplex different digital video program streams and digital data streams into a multi-program transport stream.
• Video Processing unit 15 also forwards selected video program streams to a Motion Tracking unit 16.
• the Motion Tracking unit 16 is a unit tracking movements between video frames following each other, utilizing standard motion tracking techniques.
• Motion Tracking unit 16 there are active areas defined in a selected video program stream. The knowledge of these active areas is then forwarded to the multiplexer 6. There is also a system information table 8 linked to the multiplexer 6.
• DSM Digital Storage Medium
• the Data Carousel Unit 19 also receives application data from different applications 20. The application data is then forwarded to the multiplexer 6.
• the multiplexer 6 is used to multiplex different digital video program streams and digital data streams into a multi-program transport stream.
• the Motion Tracking unit 16 can also forward the knowledge of the active areas to a Digital Storage Medium (DSM) e.g. a Data Carousel Unit 19.
• DSM Digital Storage Medium
• the multiplexer 6 is used to multiplex different digital video program streams and digital data streams into a multi-program transport stream.
• the Motion Tracking unit 16 can also forward the knowledge of the active areas to the multiplexer 6 via the system information table 8. From the multiplexer 6 the broad- casting stream is forwarded to a transmitter unit 9. The transmitter unit 9 sends the stream over a transport network 10 to the receiving side.
• Figure 3 illustrates a Digital Storage Medium of the digi- tal broadcasting system according to the present invention.
• the video program streams are received from the Play Out unit 3 by a multiplexer 6, which is used to multiplex different video program streams and digital data streams into a multi-program transport stream for- warded to a transmitter unit 9.
• the Digital Storage Medium is indicated with number 19.
• the Digital Storage Medium 19 has one or more client units 21-23 that give client information to a Database server 24 of the Digital Storage Medium 19.
• the Database server 24 stores the information received from the client units 21-23 and forwards it to a Carousel unit 25.
• the Carousel unit 25 forwards the appropriate ap- plication data corresponding to the active areas to the multiplexer 6.
• the Digital Storage Medium 19 has also a control system 26, which controls both the Database server 24 and the Carousel unit 25.
• the multiplexer 6 is used to multiplex different digital video program streams and digital data streams into a multi-program transport stream.
• Figure 4 illustrates the structure of operating multiple active applications in a digital broadcasting system according to the present invention.
• the applications and active areas can appear both sequently and simultaneously.
• in the video program streams there has been defined active areas with linked data ap- plications 29, 31, 33.
• Each of these data applications 29, 31, 33 have a specified activation time intervals, during which the said data applications 29, 31, 33 can be activated from the active areas during the program flow.
• These activation time intervals have been identified with num- bers ®, ⁇ , ®, ® in the system information flow 27.
• the data application 29 can only be activated from the active areas during activation time interval ® of the program flow. Respectively the data applications 31 and 33 can only be activated during activation time intervals ⁇ and ® . The data application 29 can thus be started on the time interval marked with number 28 but not after. Respectively the data applications 31 and 33 can be started on the time intervals marked with numbers 30 and 32 but not after. Anyhow the data applications 29, 31, 33 once activated will continue to run after the starting time intervals 28, 30, 32 have elapsed.
• Figure 5 illustrates the selecting of locking points in a digital video program according to the present invention.
• the digital broadcasting system according to the present invention there are selected locking points in a single picture 34 of a digital video program.
• lady's eyebrow has one locking point
• lady's lower eye- lid has another locking point
• lady's lower lip has a third locking point.
• the selected locking points are each given a unique iden- tifier.
• the first position of the locking point in the first picture is then defined e.g. with the help of length and angle of a vector.
• a new position of the locking point is calculated for each picture e.g. based on contrast differences in a group of pixels. This allows the tracking of the motion i.e. the movement of the locking point.
• the movements of the selected locking points in a digital video program are constantly tracked.
• Figure 6 illustrates the defining of active areas for the selected locking points in a digital video program according to the present invention.
• the digital broadcasting system according to the present invention there are de- fined invisible active areas corresponding to the selected locking points in a single picture 35. These invisible active areas can be defined for each frame in a digital video program according to the present invention.
• the active areas can be defined e.g. by a maximum distance from the locking point thus forming a circle shaped active areas.
• the active area can also have any other shape e.g. a rectangle or an ellipse. When there are several active areas within close vicinity from each other, the active areas can be defined smaller in size. As the movements of the locking points are tracked, also the positions of the invisible active areas are following the corresponding locking points.
• Figure 7 illustrates the selecting of locking points and the defining of active areas with the help of vectors in a digital video program according to the present invention.
• a locking point defined with the help of length and angle of a vector / 37.
• an active area defined with of a vector j forming a circle shaped active area 38.
• a vector k 36 defining the position of a cursor of a user monitoring unit. When the vector k 36 is not inside the active area 38 defined by the vector j , the corresponding data application will not be activated.
• the movements of the selected locking points in a digital video program are constantly tracked.
• location information relating to the selected locking points i.e. length and angle of a vector i 37.
• Figure 8 illustrates the defining of active areas and the cursor movement with the help of vectors in a digital video program according to the present invention.
• a locking point defined with the help of length and angle of a vector i 40.
• an active area defined with of a vector j forming a circle shaped active area 41.
• a vector k 39 defining the position of a cursor of a user monitoring unit. When the vector k 39 moves inside the active area 41 defined by the vector j , the corresponding data application will be activated.
• Figure 9 illustrates the selecting of locking points and the defining of active areas with the help of coordinates in a digital video program according to the present invention.
• a locking point defined with the help of coordinates (x a ,y a ) 43.
• an active area defined with radius r forming a circle shaped active area 44.
• coordinates (x k ,y k ) 42 defining the position of a cursor of a user monitoring unit.
• the movements of the selected locking points in a digital video program are constantly tracked.
• location information relating to the selected locking points i.e. coordinates (x a ,y a ) 43.
• Figure 10 illustrates the defining of active areas and the cursor movement with the help of coordinates in a digital video program according to the present invention.
• a locking point defined with the help of coordinates (x a ,y a ) 46.
• an active area defined with radius r forming a circle shaped active area 47.
• coordinates (x k ,y k ) 45 defining the position of a cursor of a user monitoring unit.
• the active area corresponding to a specific locking point can be defined as a function or a group of functions relating to the locking point. Also the active area can be set to be updated for every frame. Alternatively, the active area can be set to remain same for X frames and to be updated for every X th frame, where X is an integer.
• FIG 11 illustrates a receiving system for receiving a video stream combined with data according to the present invention.
• the receiving system according to the present invention comprises a receiving unit 48, a monitoring unit 49 and a user control device 50.
• the presented receiving system receives the video stream from a digital broadcasting system.
• the digital broadcasting system has a multiplexer 6, in which all the different video program streams and digital data streams are multiplexed into a multi- program transport stream. From the multiplexer 6 the broadcasting stream is forwarded to a transmitter unit 9.
• the transmitter unit 9 sends the stream over a transport network 10 to the receiving unit 48 of the receiving sys- tern.
• the receiving unit 48 demultiplexes the incoming multi-program stream and forwards the currently monitored program stream to the monitoring unit 49 of the receiving system.
• the monitoring unit 49 monitors the currently monitored program to the user.
• User can control the re- ceiving unit 48 and the monitoring unit 49 with a user control device 50.
• the receiving unit 48 and the monitoring unit 49 can be combined as one unit. Also the receiving unit 48, the monitoring unit 49 and the user control device 50 can all be combined as one unit.
• Figure 12 illustrates another embodiment of a receiving system for receiving a video stream combined with data according to the present invention.
• the receiving system comprises a receiving unit 48, a monitoring unit 49 and a user control device 50 and a transmitting unit 51.
• the presented receiving system receives the video stream from a multiplexer 6 of a digital broadcasting system. From the multiplexer 6 the broadcasting stream is forwarded to a transmitter unit 9.
• the transmitter unit 9 sends the stream over a transport network 10 to the receiving unit 48 of the receiving system.
• the receiving unit 48 demultiplexes the incoming multi-program stream and forwards the currently monitored program stream to the monitoring unit 49 of the receiving system.
• the monitoring unit 49 monitors the currently monitored program to the user.
• the incoming multi-program stream also includes an application, which is then further used to constantly track the movements of the selected locking points in a digital video program.
• a transmitting unit 51 which can be used to transmit information from the user to a service provider 53 over a transport network 52.
• User can control the receiving unit 48, the monitoring unit 49 and the transmit- ting unit 51 with a user control device 50.
• the transmitting unit 51 can send a business transaction request from the user to a service provider 53 e.g. for a purchase of a product or a service.
• the transmitting unit 51 can also be equipped to receive a confirmation from the service provider 53 to the user.
• the receiving unit 48, the monitoring unit 49 and the transmitting unit 51 can be combined as one unit. Also the receiving unit 48, the monitoring unit 49, the user control device 50 and the transmitting unit 51 can all be combined as one unit.
• FIG. 13 illustrates a monitoring unit according to the present invention.
• the monitoring unit according to the present invention comprises a monitoring device 49 having a screen display 54.
• the screen display 54 has a movable cursor 55 and can also have a set of selecting buttons 56. The movement of the cursor 55 as well as the selection of the selecting buttons 56 can be controlled with the user control device 50.
• the incoming multi-program stream also includes an application, which is then further used to constantly track the movements of the selected locking points in a digital video program. As the movements of the selected locking points are being tracked, also the location of the active areas relating to the locking points are constantly being compared with the movements of the cursor.
• Figure 14 illustrates the starting of a data application in a receiving system according to the present invention.
• the monitoring unit in the receiving system according to the present invention has a screen display 57 with a mov- able cursor 55.
• the user can control the movement of the cursor 55 with the user control device 50.
• the first data application will start automatically.
• First the data application can show a confirmation prompt 58 to the user and ask the user to confirm, that the user is willing to proceed with the data application.
• the user can confirm willingness to proceed with the user control device 50.
• the data application can now start showing information 59 e.g. product information 59 in accordance to the selected active area. In the presented figure this product information 59 can present the different make-up products, the lady in the video program is using i.e. make-up powder, anti-wrinkle eye cream, eyelid colour, eye lining, mascara and lipstick.
• the data application can also display selection buttons to the user.
• a selection button can for example be a button 60 confirming the purchase of a product.
• the data application can also be set to start directly without a confirmation from the user.
• the data application can be set to prompt further options that the user can activate with the user control device 50.
• the prompting of further op- tions can e.g. be done with buttons, hyperlinks or highlighted active areas.
• Figure 15 illustrates the activating of further options of a data application in a receiving system according to the present invention.
• the monitoring unit in the receiving system according to the present invention has a screen display 61 with a movable cursor 55. The user can move the cursor 55 to a desired position and activate further options of a data application with the user control device 50.
• the data application can show e.g. detailed product information 63 and a selection button 64 confirming the purchase of a product.
• this detailed product information 63 can present the detailed character- istics of an anti-wrinkle eye cream the lady in the video program is using.
• Figure 16 illustrates a method for transmitting and re- ceiving a combined video stream with data according to the present invention.
• the data and video program is then sent 66 over a transport network 10 to the receiving side.
• the data and video program is received 67.
• the data and video program stream is presented 68 to the user.
• Figure 17 illustrates a method for combining video stream with data according to the present invention.
• the active areas are defined 70 for the selected locking points.
• specific data and applications are defined 71 for the active areas.
• the output digital video program with the combined data and applications is ready to be sent out.
• Figure 18 illustrates a method for presenting a combined video stream with data according to the present invention.
• a prompt e.g. text or a known figure added to the video program.
• the service is active, the location of the cursor is constantly being detected 73.
• the retrieved data from the data application is presented 75.
• Figure 19 illustrates a second alternative method for pre- senting a combined video stream with data according to the present invention.
• the location of the cursor is constantly being detected 73.
• it is detected 74 that the cursor is on the active areas there is announced 76 to the user that there is retrievable data present.
• the retrievable data has been announced 76 to the user, there is user approval being detected 77.
• the data service application has detected 77 user approval, the retrieved data from the data application is presented 75.
• Figure 20 illustrates a third alternative method for presenting a combined video stream with data according to the present invention.
• the location of the cursor is constantly being detected 73.
• the retrieved data from the data application is presented 75.
• the user can perform 78 a business transaction.
• the user can send a business transaction request from the user to a service provider 53 e.g. for a purchase of a product or a service.
• the transmitting unit 51 can also be equipped to receive a confirmation from the service provider 53 to the user.
• the present invention provides a solution for combining video stream with digital information, which can be utilized in different future networks, such as digital television networks, third generation mobile networks and IP networks (IP, Internet Protocol) .
• digital television networks such as digital television networks, third generation mobile networks and IP networks (IP, Internet Protocol) .
• IP Internet Protocol

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Databases & Information Systems (AREA)
• Human Computer Interaction (AREA)
• Television Systems (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Priority Applications (2)

Applications Claiming Priority (2)

Publications (1)

Family

ID=8562096

Family Applications (1)

Country Status (5)

Families Citing this family (5)

Citations (4)

Family Cites Families (6)

• 2001
  • 2001-10-19 FI FI20012041A patent/FI115684B/fi not_active IP Right Cessation
• 2002
  • 2002-10-16 EP EP02801345A patent/EP1436989A1/en not_active Ceased
  • 2002-10-16 WO PCT/FI2002/000806 patent/WO2003034726A1/en not_active Ceased
  • 2002-10-16 JP JP2003537313A patent/JP2005506769A/ja active Pending
  • 2002-10-21 US US10/274,377 patent/US20030086015A1/en not_active Abandoned

Patent Citations (4)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events