JP2005526467A5

JP2005526467A5 -

Info

Publication number: JP2005526467A5
Application number: JP2004507241A
Authority: JP
Filing date: 2003-05-19
Publication date: 2006-06-08

Claims

A method for determining pan and scan pixel coordinates defining an image capture window useful for formatting an image having a first aspect ratio to yield an image having a second aspect ratio comprising:
Examining the image frame by examining video, audio and image data associated with the image frame to determine the location of the most relevant activity in the incoming image frame ;
Determining the pan and scan pixel coordinates according to the location of the most relevant activity in the incoming image frame according to a predetermined combination of the video, audio and image data. .

Before Sulfur butterfly Bell step comprises determining a location associated with said source of audio data in said image data The method of claim 1, wherein.

Before Sulfur butterfly Bell step comprises determining a location associated with the size of the maximum of sound in the image frame The method of claim 1, wherein.

Before Sulfur butterfly Bell step comprises determining a location associated with generation point of the surround sound in said image, the method of claim 1.

A method for determining pan and scan pixel coordinates defining an image capture window useful for formatting an image having a first aspect ratio to yield an image having a second aspect ratio comprising:
Examining the incoming image frame to ascertain where in the incoming image frame the closed caption information appears in the image ;
Determining pan and scan pixel coordinates according to the position in the incoming image frame at which closed caption information appears .

The pan and scan pixel coordinates (P) are:
P = X1 * F (V) + X2 * F (A) + X3 * F (D)
Determined from video, audio, and image data according to:
X1 = weighting factor assigned to video data (0 <X1 <1);
X2 = weighting factor assigned to audio data (0 <X2 <1);
X3 = weighting factor assigned to the image data (0 <X3 <1);
F (V) = coordinate predicted using video data;
F (A) = coordinate predicted using audio data;
F (D) = coordinate predicted using image data;
The method of claim 1, wherein X1 + X2 + X3 = 1.

An apparatus for determining pan and scan pixel coordinates defining an image capture window useful for formatting an image from a first aspect ratio to a second aspect ratio, comprising:
To confirm the most relevant activities location in the image frame, the video associated with the image frame, and means for examining the image frame by examining the audio and image data,
Means for determining the pan and scan pixel coordinates according to the location of the most relevant activity in the image according to a predetermined combination of the video, audio and image data .

The determining means determines the pan and scan pixel coordinates (P) as follows:
P = X1 * F (V) + X2 * F (A) + X3 * F (D)
According to the formula,
X1 = weighting factor assigned to video data (0 <X1 <1);
X2 = weighting factor assigned to audio data (0 <X2 <1);
X3 = weighting factor assigned to the image data (0 <X3 <1);
F (V) = coordinate predicted using video data;
F (A) = coordinate predicted using audio data;
F (D) = coordinate predicted using image data;
8. The apparatus of claim 7, wherein X1 + X2 + X3 = 1.

A method of formatting an incoming image frame having a first aspect ratio to yield a formatted image frame having a second aspect ratio, comprising:
By examining the video, audio and image data associated with the image frame, pan and scan pixel coordinates that substantially match the location associated with the most relevant activity in the image within the image frame. A finalizing stage;
In front of an image capture window centered on the pan and scan pixel location to format the incoming image frame according to a predetermined combination of video, audio and image data to produce a formatted image frame. Panning and scanning the incoming image frame.

The pan and scan pixel coordinates (P) are:
P = X1 * F (V) + X2 * F (A) + X3 * F (D)
Is determined according to the formula:
X1 = weighting factor assigned to video data (0 <X1 <1);
X2 = weighting factor assigned to audio data (0 <X2 <1);
X3 = weighting factor assigned to the image data (0 <X3 <1);
F (V) = coordinate predicted using video data;
F (A) = coordinate predicted using audio data;
F (D) = coordinate predicted using image data;
10. The method of claim 9, wherein X1 + X2 + X3 = 1.

An apparatus for formatting an incoming image frame having a first aspect ratio to yield a formatted image frame having a second aspect ratio,
Pan-and-scan pixel coordinates that substantially match the location associated with the most relevant activity in the image frame within the image frame by examining video, audio and image data associated with the image frame Means for determining
In front of an image capture window centered on the pan and scan pixel location to format the incoming image frame according to a predetermined combination of video, audio and image data to produce a formatted image frame. Means for panning and scanning the incoming image frame.

The means for determining determines the pan-and-scan pixel coordinates (P) as follows:
P = X1 * F (V) + X2 * F (A) + X3 * F (D)
According to the formula,
X1 = weighting factor assigned to video data (0 <X1 <1);
X2 = weighting factor assigned to audio data (0 <X2 <1);
X3 = weighting factor assigned to the image data (0 <X3 <1);
F (V) = coordinate predicted using video data;
F (A) = coordinate predicted using audio data;
F (D) = coordinate predicted using image data;
12. The method of claim 11, wherein X1 + X2 + X3 = 1.