WO2003045066A3 - Producing acoustic signals from a video data flow - Google Patents

Producing acoustic signals from a video data flow Download PDF

Info

Publication number
WO2003045066A3
WO2003045066A3 PCT/EP2002/012295 EP0212295W WO03045066A3 WO 2003045066 A3 WO2003045066 A3 WO 2003045066A3 EP 0212295 W EP0212295 W EP 0212295W WO 03045066 A3 WO03045066 A3 WO 03045066A3
Authority
WO
WIPO (PCT)
Prior art keywords
video data
data flow
acoustic signals
displacement vector
producing acoustic
Prior art date
Application number
PCT/EP2002/012295
Other languages
German (de)
French (fr)
Other versions
WO2003045066A2 (en
Inventor
Markus Simon
Original Assignee
Siemens Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Ag filed Critical Siemens Ag
Priority to EP02790332A priority Critical patent/EP1446956A2/en
Priority to JP2003546577A priority patent/JP2005510907A/en
Publication of WO2003045066A2 publication Critical patent/WO2003045066A2/en
Publication of WO2003045066A3 publication Critical patent/WO2003045066A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N2007/145—Handheld terminals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection
    • H04N5/145—Movement estimation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)

Abstract

According to the invention, acoustic signals (snd) are produced from a video data flow containing a temporal sequence of individual images (img). A displacement vector field (vfd) is determined from the image data of the individual images (img), for example by means of an MPEG algorithm; at least one characteristic variable (chs) is then derived from the displacement vector field (vfd), e.g. a dominant displacement vector, in an analysis module (AAN); and an acoustic signal (snd) is produced on the basis of said variables (chs) by means of a synthesis module (SYN).
PCT/EP2002/012295 2001-11-22 2002-11-04 Producing acoustic signals from a video data flow WO2003045066A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP02790332A EP1446956A2 (en) 2001-11-22 2002-11-04 Method and device for producing acoustic signals from a video data flow
JP2003546577A JP2005510907A (en) 2001-11-22 2002-11-04 Method and apparatus for forming an audio signal from a video data stream

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP01127842.1 2001-11-22
EP01127842 2001-11-22

Publications (2)

Publication Number Publication Date
WO2003045066A2 WO2003045066A2 (en) 2003-05-30
WO2003045066A3 true WO2003045066A3 (en) 2003-11-27

Family

ID=8179319

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2002/012295 WO2003045066A2 (en) 2001-11-22 2002-11-04 Producing acoustic signals from a video data flow

Country Status (3)

Country Link
EP (1) EP1446956A2 (en)
JP (1) JP2005510907A (en)
WO (1) WO2003045066A2 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1507389A1 (en) * 2003-08-13 2005-02-16 Sony Ericsson Mobile Communications AB Mobile phone with means for switching off the alarm remotely
DE102022105681A1 (en) 2022-03-10 2023-09-14 Ebm-Papst Mulfingen Gmbh & Co. Kg Method for determining vibration of a ventilation system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0294960A2 (en) * 1987-06-09 1988-12-14 Sony Corporation Motion vector processing in television images
GB2350512A (en) * 1999-05-24 2000-11-29 Motorola Ltd Video encoder
WO2001006791A1 (en) * 1999-04-22 2001-01-25 Activesky Inc. Wireless video surveillance system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0294960A2 (en) * 1987-06-09 1988-12-14 Sony Corporation Motion vector processing in television images
WO2001006791A1 (en) * 1999-04-22 2001-01-25 Activesky Inc. Wireless video surveillance system
GB2350512A (en) * 1999-05-24 2000-11-29 Motorola Ltd Video encoder

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
ATSUSHI K ET AL: "MOVING OBJECT DETECTION METHOD USING H.263 VIDEO CODED DATA FOR REMOTE SURVEILLANCE SYSTEMS", PROCEEDINGS OF THE SPIE, SPIE, BELLINGHAM, VA, US, vol. 3641, January 1999 (1999-01-01), pages 247 - 258, XP000991237 *
BALDAUF K: "AURAL AIR", FLORIDA STATE UNIVERSITY BULLETIN, RESEARCH IN REVIEW, FLORIDA STATE UNIVERSITY, TALLAHASSEE, FL, US, vol. 8, no. 2/3, 1997, pages 6,2,1, XP001091400, ISSN: 0885-2073 *
BALDAUF, K.J.: "AirMusic Background Reports", FLORIDA STATE UNIVERSITY, 14 July 1997 (1997-07-14), Florida, US, pages 1 - 2, XP000926339, Retrieved from the Internet <URL:http://websrv.cs.fsu.edu/~baldauf/projects/airmusic/airreports.html> [retrieved on 20020516] *
BALDAUF, K.J.: "AirMusic: Interpreting Movement with Sound (Project Defense Summer 1997)", FLORIDA STATE UNIVERSITY, July 1997 (1997-07-01), Florida, US, XP000926348, Retrieved from the Internet <URL:http://websrv.cs.fsu.edu/~baldauf/projects/airmusic/AirMusi2.html> [retrieved on 20020516] *
COLLANDER P ET AL: "Mobile multimedia communication", ELECTRONIC MANUFACTURING TECHNOLOGY SYMPOSIUM, 1995, PROCEEDINGS OF 1995 JAPAN INTERNATIONAL, 18TH IEEE/CPMT INTERNATIONAL OMIYA, JAPAN 4-6 DEC. 1995, NEW YORK, NY, USA,IEEE, US, 4 December 1995 (1995-12-04), pages 20 - 22, XP010195637, ISBN: 0-7803-3622-4 *
FELS S ET AL: "Iamascope: a graphical musical instrument - new ways to play", COMPUTERS AND GRAPHICS, PERGAMON PRESS LTD. OXFORD, GB, vol. 23, no. 2, April 1999 (1999-04-01), pages 277 - 286, XP004165791, ISSN: 0097-8493 *
VLACHOS T: "Simple method for estimation of global motion parameters using sparse translational motion vector fields", ELECTRONICS LETTERS, IEE STEVENAGE, GB, vol. 34, no. 1, 8 January 1998 (1998-01-08), pages 60 - 62, XP006009128, ISSN: 0013-5194 *

Also Published As

Publication number Publication date
WO2003045066A2 (en) 2003-05-30
EP1446956A2 (en) 2004-08-18
JP2005510907A (en) 2005-04-21

Similar Documents

Publication Publication Date Title
US8169510B2 (en) Data processing device, data processing method, and storage medium
WO2002058385A3 (en) Method and device for converting video signals
WO2008045198A3 (en) Providing multiple video signals from single sensor
EP1422928A3 (en) Motion compensated interpolation of digital video signals
WO2005009022A3 (en) Method and apparatus for video on demand
CN103139446A (en) Received video stabilization
EP1471733A4 (en) Imaging apparatus and imaging method
TW200518600A (en) Method of compensating image signals and display device employing the same
TW200631422A (en) Video signal processing apparatus and video signal processing method
CA2499416A1 (en) Image pickup device
EP2093711A3 (en) Iimage processing apparatus and image processing method, and program
MY126470A (en) Video signal processing circuit and video signal processing method
KR950022977A (en) Time-base interpolation filter of video signal
WO2003045066A3 (en) Producing acoustic signals from a video data flow
KR101552070B1 (en) Method and apparatus for transmitting video signal
JP2005020606A (en) Digital camera
WO2003043314A1 (en) Image pickup apparatus
TW200729959A (en) Media playback system having a real-time displaying capability of displaying images generated from a camera and method thereof
GB2373946A (en) Method of synthesizing motion blur in a video sequence
JP4363199B2 (en) Information signal processing apparatus and information signal processing method
KR900005802A (en) Band compression transmission method of video signal by sub Nyquist sampling
EP1441535A3 (en) Video data stream processing
JPS58205377A (en) Adaptive type time spatial filter
JPH04246325A (en) Electronic endoscope device
US20100026891A1 (en) Image signal processing apparatus and method thereof

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2002790332

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2003546577

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 2002790332

Country of ref document: EP