JPH08237653A - Picture processor and picture transmitter - Google Patents

Abstract

PURPOSE: To display inputted picture information by an appropriate aspect ratio by displaying the inputted picture information by a selected aspect ratio when the picture information is not provided with aspect ratio information. CONSTITUTION: A system control part 1 transfers a JPEG file inputted from a video camera 15, an FDD 6 or a memory card drive 8 to a multiplexing/ demultiplexing device 24 and transmits it to an opposite device by a general purpose data channel. Also, simultaneously with transmission to the opposite device, display at a still picture monitor 22 is performed. Then, even when inputted pictures are not provided with the aspect ratio information, the aspect ratio corresponding to the inputted picture information is selected by an aspect ratio selection means and the inputted picture information is displayed by the selected aspect ratio. Thus, even when the inputted picture information is not provided with the aspect ratio information, the inputted picture information is displayed by the suitable aspect ratio.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention is provided with one or more image information input means for inputting image information which may include aspect ratio information, and the image information input by the image information input means is aspect ratio information. In the case of including the image information, the present invention relates to an image processing apparatus for displaying the input image information in its aspect ratio, and further comprises one or more image information input means for inputting image information which may include the aspect ratio information. The present invention relates to an image transmission device for directly transmitting the input image information to a partner device when the image information input from the image information input means includes aspect ratio information.

[0002]

2. Description of the Related Art As one of image processing, there is image information coding processing. A typical example thereof is JPEG (Joint Photograph) for color still image encoding.
phic Coding Experts Grou
p) algorithm, which is widely used in image processing devices or image transmission devices such as digital still cameras, color still image filing systems, and video conference systems.

In each of these devices, when input image information is encoded, image data of various image formats (image resolution, etc.) is generated for each device.

In order to enable the exchange of image data of various image formats for different devices as described above, information on the image format is provided.
It is taken in as header information in the interchange format of a JPEG file that stores encoded image data. By decoding based on this header information, it is possible to restore the image information that matches the image format at the time of encoding.

However, since the information about the conventional image format does not include the information about the aspect ratio of the encoded image information, the image data can be decoded based on the information, but the information is encoded. In some cases, the aspect ratio of an image could not be reproduced, and the displayed image was displayed with an incorrect aspect ratio and stretched vertically or horizontally.

[0006] Therefore, the JFIF (JPE) containing the aspect ratio of encoded image information while conforming to the interchange format of the conventional JPEG file.
GFile Interchange Format)
Has been proposed and adopted in some devices.

[0007]

However, since the conventional image processing apparatus or image transmission apparatus encodes the image information by the conventional interchange format before the JFIF is proposed, the conventional image processing apparatus or image transmission apparatus encodes the image information. Even if the encoded image data is decoded by a device conforming to JFIF, the aspect ratio of the image cannot be reproduced because the decoded image data does not contain the aspect ratio information.

This will be described with reference to FIG.

Now, it is assumed that the image shown in FIG. 1A is captured and encoded by a certain device that conforms to the conventional JPEG file interchange format but does not conform to JFIF. The aspect ratio expressed by horizontal (X): vertical (Y) of an image handled by this device is 1:
It is 1. This 1: 1 aspect ratio is an aspect ratio often used in personal computers and the like. The resolution is 352 pixels × 288 lines.

In this case, the JPEG file including the encoded image data includes information on its resolution according to the interchange format of the conventional JPEG file. However, the aspect ratio information is
Not included in F because it is not included.

On the other hand, suppose there is another device that also complies with JFIF. The aspect ratio represented by horizontal (X): vertical (Y) of the image handled by this device is 32:25. The aspect ratio of 32:25 is an aspect ratio often used in communication systems and the like.

[0012] If the image shown in Fig. 1A which is JPEG-filed by one device is decoded by another device, if the JPEG file to be decoded conforms to JFIF, the aspect ratio is If the ratio information is included, the aspect ratio can be reproduced, but as described above, the JPEG file encoded by the certain device does not include the aspect ratio information.

Therefore, the other device cannot reproduce the correct aspect ratio, and the displayed image is
As shown in FIG. 7B, the resolution is 352 pixels × 288 lines, which is the same as that shown in FIG. 4A, but the image becomes a laterally stretched image having a different aspect ratio.

The present invention has been made in view of such circumstances, and even if the input image information does not include the aspect ratio information, the input image information can be displayed with an appropriate aspect ratio. Provided is an image processing device, and an image transmission device capable of transmitting image information including proper aspect ratio information to a partner device even when input image information does not include aspect ratio information. The purpose is to do.

[0015]

To achieve the above object, the image processing apparatus according to claim 1 comprises one or more image information input means for inputting image information which may include aspect ratio information, When the image information input from the image information input means includes aspect ratio information, an image input from the image information input means in an image processing device displaying the input image information in the aspect ratio. When the information does not include aspect ratio information, an aspect ratio selecting means for selecting an aspect ratio according to the input image information is provided, and the input image information is displayed at the selected aspect ratio. It is a feature.

An image processing apparatus according to a second aspect is the image processing apparatus according to the first aspect.
In the image processing apparatus described above, the aspect ratio selecting means selects an aspect ratio according to a resolution of the input image information.

According to a third aspect of the present invention, in the image processing apparatus according to the first aspect, the aspect ratio selecting means includes the one or more image information input means in which the input image information is included. It is characterized in that the aspect ratio is selected according to the image information inputting means.

An image transmitting apparatus according to a fourth aspect is provided with one or more image information input means for inputting image information which may include aspect ratio information, and the image information input from the image information input means has an aspect ratio. If the image information input from the image information input means does not include aspect ratio information, the input information is transmitted to the other device as it is if the ratio information is included. Aspect ratio selecting means for selecting an aspect ratio according to the selected image information is added, and the selected aspect ratio information is added to the input image information and transmitted to the partner device. .

The image transmission device according to claim 5 is the image transmission device according to claim 4.
In the image transmission device described above, the aspect ratio selecting means selects an aspect ratio according to a resolution of the input image information.

An image transmission device according to a sixth aspect is the image transmission device according to the fourth aspect.
In the image transmission device described above, the aspect ratio selection means selects an aspect ratio according to which image information input means of the one or more image information input means has input the input image information. It is characterized by being a thing.

[0021]

According to the structure of claim 1, even when the input image information does not include the aspect ratio information, the aspect ratio selecting means selects the aspect ratio according to the input image information, The input image information is displayed in the selected aspect ratio. Thereby, even when the input image information does not include the aspect ratio information, the input image information can be displayed with an aspect ratio corresponding to the input image information.

According to the second aspect of the invention, the aspect ratio selection means selects the aspect ratio according to the resolution of the input image information. That is, the aspect ratio of the input image information is selected based on the fixed correlation between the resolution of the image information and the aspect ratio of the image information. Accordingly, even when the input image information does not include the aspect ratio information, the input image information can be displayed with an aspect ratio suitable for the resolution.

According to a third aspect of the present invention, the aspect ratio selecting means is responsive to which image information input means of the one or more image information input means inputs the input image information. To select the aspect ratio. That is, the aspect ratio of the input image information is selected based on a certain correlation between the input path of the image information and the aspect ratio of the image information. Accordingly, even if the input image information does not include the aspect ratio information, the input image information can be displayed with an aspect ratio suitable for the input path.

According to the configuration of claim 4, even when the input image information does not include aspect ratio information,
The aspect ratio selecting means selects an aspect ratio according to the input image information, and the selected aspect ratio information is added to the input image information and transmitted to the partner device. As a result, even when the image information that is input and transmitted to the partner device does not include aspect ratio information, when the partner device side displays the transmitted image information, it is added to the image information and transmitted. The transmitted image information can be displayed with the aspect ratio corresponding to the transmitted aspect ratio information.

According to the structure of claim 5, the aspect ratio selecting means selects the aspect ratio according to the resolution of the input image information. That is, the aspect ratio of the input image information is selected based on the fixed correlation between the resolution of the image information and the aspect ratio of the image information. As a result, even when the input image information does not include the aspect ratio information, when the transmitted image information is displayed on the partner device side, the aspect ratio information transmitted in addition to the image information is transmitted. Thus, the transmitted image information can be displayed with an aspect ratio suitable for the resolution.

According to a sixth aspect of the present invention, the aspect ratio selection means is responsive to which image information input means of the one or more image information input means inputs the input image information. To select the aspect ratio. That is, the aspect ratio of the input image information is selected based on a certain correlation between the input path of the image information and the aspect ratio of the image information. As a result, even when the input image information does not include the aspect ratio information, the aspect ratio information added and transmitted to the image information when displaying the transmitted image information on the partner device side, etc. Thus, the transmitted image information can be displayed with an aspect ratio suitable for the input path.

[0027]

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 shows a communication conference apparatus which is one of the image processing apparatus and one of the image transmitting apparatus according to one embodiment of the present invention. This teleconferencing device is an IS
The basic interface of DN is used as a transmission line, and has a communication function of voice information, a communication function of moving image information, a communication function of still image information, and a multiplexing communication function of these communication functions. Data communication using two information channels (B channel) is possible by connecting to.

In FIG. 1, the system control unit 1 controls the respective units of the communication conference device, processes of upper layers of the video conference communication, execution processes of various application programs included in the communication conference device, and a user. It executes various control processes such as help display process corresponding to the help request from.

The ROM (Read Only Memory) 2 is
It stores a part of the control processing program executed by the system control unit 1 and various kinds of data necessary for executing the control processing program. RAM (random
The access memory 3 constitutes a work area or the like of the system control unit 1.

The console 4 is for a user interface provided with a display section and a keypad. The console control unit 5 outputs display data to the console 4 and inputs key data from the console 4. Floppy disk drive (FD
D) 6 is for inputting JPEG format still image data created by another device such as a personal computer.

The FDD interface 7 drives the FDD 6 and transfers data read from the FDD 6 and data written to the FDD 6 with the system control unit 1. The memory card drive 8 is for inputting JPEG format still image data created by another device such as a digital still camera.

The audio CODEC 10 is for performing encoding / decoding of an audio signal and echo cancellation. The voice input processing unit 11 is for amplifying an input voice signal from the microphone 12, A / D converting it, and inputting it to the voice CODEC 10. The audio output processing unit 13 outputs the digital audio signal output from the audio CODEC 10 to D
It is for amplifying after A / A conversion and outputting to the speaker 14.

The video camera device 15 is for taking an image on the user side of the communication conference device. The video input processing unit 16 performs signal processing such as NTSC decoding and A / D conversion on the image signal output from the video camera device 15 to perform a moving image CODEC 17 and a still image COD described later.
It is for inputting into the EC 20.

The moving image CODEC 17 converts the moving image signal of the video camera device 15 into the TTC standard JT-H. In addition to encoding and compressing with the H.261 encoding system to form moving image information,
The moving picture information in the encoded and compressed state is converted into the original moving picture signal. The moving image output processing unit 18 uses the moving image CODE
The moving picture information output from C is subjected to D / A conversion, NTSC encoding, etc., and output to the moving picture monitor device 19.

The still image CODEC 20 is for encoding the still image signal of the video camera device 15 to convert it into an image file in the JPEG format, and conversely for decoding and outputting the image file in the JPEG format. The still image output processing unit 21 is for processing the still image information output from the still image CODEC 20, such as D / A conversion and NTSC encoding, and outputting it to the still image monitor device 22.

The ISDN interface circuit 23 uses the I
It is connected to SDN and has ISDN layer 1 signal processing function and integration / separation function of D channel signal and 2 B channel signals. D channel signal is exchanged via system bus 25. In addition, the signals of the two B channels are multiplexed / demultiplexed by the multiplexer / demultiplexer 24.
I am interacting with. Further, the ISDN interface circuit 23 has a signal processing function of the layer 2 of the D channel,
And a call control processing function for connecting / disconnecting one or two B channels.

The multiplexer / demultiplexer 27 multiplexes data of a plurality of media such as voice, moving images, and general-purpose data (other data such as still image data) exchanged using the B channel, and the TTC standard JT. -H. The frame data defined in 221 is formed and transmitted to the line side, and the data of a plurality of media multiplexed in the received frame data is separated. The multiplexer / demultiplexer 27 converts audio data into audio CODEC.
Video data is exchanged between 10 and video codec
17, and general-purpose data is also exchanged with the system control unit 1 via the system bus 25. This general-purpose data includes a JPEG image file generated by the still image CODEC 20.

These system control unit 1, ROM 2 and R
AM3, console control unit 5, FDD interface unit 7, memory card interface unit 9, voice COD
EC10, video CODEC17, still image CODEC2
0, the ISDN interface unit 23 and the multiplexer / demultiplexer 24 are connected to a system bus 25, and data exchange between these elements is mainly performed via the system bus 25.

FIG. 2 is a T that is applied as a transmission control procedure executed when the audiovisual terminal such as the communication conference apparatus shown in FIG. 1 transmits data using the B channel.
TC standard JT-H. 242 shows an example of a general procedure of 242. In this case, an example of a transmission procedure for exchanging audio data, general-purpose data (including still image data), and moving image data between terminals using two B channels is shown.

First, the calling terminal makes a call to the destination terminal and performs a call setting procedure on the D channel to secure one B channel (hereinafter referred to as the first channel) (Phase A), Frame synchronization is performed while exchanging frame data in which PCM audio data (A-law or μ-law, 64 Kbps) is set on one channel (frame mode). When frame synchronization is established, the capability BAS data and command BAS data are mutually exchanged. Exchanges (phase B1-1), decides a transmission mode to be used at that time, and starts an additional call setup request for securing the second B channel (phase B1-2).

Then, in principle, the modes having the highest functions common to each other are selected from the contents of the exchange of the transmission modes at that time (phase B1-3), and the call-in terminal receives the call in the selected operation mode. A BAS command designating a terminal function is transmitted to the terminal to operate the function, and parameters common to the device functions of the calling terminal and the called terminal are set (phase B2). Thereby, in the first channel, for example, data transmission of audio data (16 Kbps) corresponding to the transmission mode selected at that time, and
Data transmission of moving image data (46.4 Kbps) is performed (phase C).

When the first channel starts data transmission in the frame mode, the second B channel (hereinafter, referred to as the second channel).
When the second channel is established by performing the call setup procedure on the D channel (referred to as channel) and the second channel is established, the frame data including only the frame synchronization signal FAS and the bit allocation signal BAS is exchanged using the second channel. Synchronization and frame synchronization are established (Phase CB1-11), and then synchronization between the first channel and the second channel is established (Phase CB).
1-12).

When the synchronization of the two B channels is completed,
The BAS command is sent from the calling terminal side to set the transmission mode (phase CB1-2), the transmission mode is switched to the set contents (phase CB1-3), and the common parameter is set (phase CB2).

In this way, when the initialization of the second channel is completed, after that, the frame data exchanged on the first channel and the frame data exchanged on the second channel are synchronized with each other. Using the B channel, for example, audio data, general-purpose data (including still image data), and moving image data are 58 Kbps, 6.4 Kbps, and 62.4 Kb, respectively.
Data transmission is performed with a ps transmission rate assigned (see FIG. 3).

The general-purpose data channel is used for exchanging C & I mode (conference control function) data and still image data other than voice data.

When the communication conference device is activated in this manner, the system control unit 1 causes the audio CODEC 10 and the moving image C to be displayed.
The ODEC 17 and the still image CODEC 20 are activated, which enables bidirectional communication of voice, moving images, and still images with the partner device.

In order for the user to transmit the still image to the partner device, the user first operates the console 4 to select the input source of the still image information. In this embodiment, as the input source, the input from the video camera device 15, the FDD
Input from 6 and input from the memory card drive 8 can be selected from three.

When the selected input source is the video camera device 15, the system controller 1 determines that the still image C
The ODEC 20 is started, the image signal of the video camera device 15 is taken in through the video input processing unit 16, encoded by the JPEG algorithm, and the encoded data is stored in the RAM.
Temporarily store in 3. The system control unit 1 has its RAM 3
Various types of marker codes are added to the encoded data stored in the J
Convert to PEG file. The JPEG file is also compatible with JFIF and also contains predetermined aspect ratio information.

The data structure of the JPEG file will be briefly described with reference to FIG.

In the figure, the compressed image data in the JPEG file has three hierarchical structures of image / frame / scan. Compressed image data for one image includes marker code SOI (Start Of Im).
image) and EOI (End Of Image) form one image. One image contains only one frame, as the case shown is not hierarchical coding. At the beginning of the frame is a header for the frame, followed by one or more scans.

One frame is SOF (Start o
f Frame), which is followed by a plurality of parameters as a frame header. One scan starts with a marker code called SOS (Start of Scan) and is followed by a plurality of parameters as a scan header. The scan header is followed by data obtained by compression-encoding the image. An RSTm (Restart) marker code can be inserted into this compressed image data.

Next, the marker code inserted in the compressed image data will be described. The SOI is added to the head of the image as described above. EOI
Is attached to the end of the image.

The SOF is assigned to the beginning of the frame and specifies the encoding algorithm, entropy encoding method, and the like. The SOF also includes information on the resolution of the compressed image data. DHT (Define Huff
man Table) is for specifying what kind of code is put in the Huffman code table. D
QT (Define Quantization Ta)
ble) is for designating which table is to be inserted in which quantization table number with how many bits of precision.

DAC (Define Arithmet)
ic Coding Condition) is for setting a statistical model of arithmetic coding. DR
I (Define Restart Interva)
l) is for designating the interval for inserting the RST in 2 bytes by the number of MCUs. COM (Commem
t) is for inserting a character code.

APPn (Reserved for A)
Application use) is a marker code that an application can freely use. R
STm (Restart Interval Term)
(ination) is inserted in the compressed data at intervals specified by the DRI. DNL (Defin
e Number of Line) is normally added to the end of the compressed image data of the first frame and the first scan when the number of lines of the image specified in the frame header is unknown at the start of encoding.

DHT, DQT, DAC, DRI, CO
Marker codes of M and APPn are before SOF or S
You can insert only what you need before the OS.

Of the marker codes APPn, the one in which n is 0, that is, APP0 is used for JFIF, and this APP0 can include aspect ratio information together with other information if necessary.

When the selected input source is the FDD 6 or the memory card drive 8, the system control unit 1 controls the FDD interface unit 7 or the memory card interface unit 9,
Start FDD6 or Memory Cart Drive 8 and
D6 or memory cart drive 8 From the set recording media such as floppy disk or memory card to JP
Read a still image file encoded in EG format, and
It is temporarily stored in AM3. In addition, this read JPE
Since the G file is not created by the communication conference device according to the present embodiment, it does not necessarily correspond to JFIF.

The system control unit 1 transfers the JPEG file thus input from the video camera device 15, the FDD 6 or the memory card drive 8 to the multiplexing / demultiplexing device 24 and transmits it to the other device through the general-purpose data channel. To do. Further, it can be displayed on the still image monitor device 22 simultaneously with the transmission to the partner device.

When receiving the JPEG file, the system controller 1 reads the data on the general-purpose data channel from the multiplexer / demultiplexer 24 and stores it in the RAM 3. When the reception of the data for one image is completed, the system control unit 1 analyzes the received JPEG file and information necessary for decoding (various parameters such as the number of lines and line length).
Is extracted and set in the still image CODEC20.

The system control unit 1 uses the JPE in the RAM 3
Transfer G file to still image CODEC20
The ODEC 20 decodes the compressed image data in the JPEG file according to the set parameters. The decoded image is output to the still image output processing unit 21. When the received JPEG file includes the marker code APP0 and the aspect ratio information is obtained, the system control unit 1 controls the still image output processing unit 21 to scale the still image according to the aspect ratio information. The obtained image is displayed on the still image monitor device 22.

When the series of communication conferences as described above are finished and the data transmission is finished, first, the second channel is disconnected. At this time, the procedure for setting the common mode is performed for the audio data transmission performed only on the first channel (phase CD1), and the second channel is switched to the frame mode mode 0F (mode 0F). Phase CD2). At this time, the first channel and the second channel are asynchronous, and the second channel is in a state in which the call is held in the transmission state of only the frame synchronization signal FAS and the bit allocation signal BAS, and the call of the D channel is disconnected. The call of the second channel can be released by the release procedure.

In the first channel, the phase CD
During 1 and phase CD2, the audio data and the moving picture data are transmitted in the frame mode at the transmission speed of 62.4 KBAS in total, and further, when the operator of one terminal finishes the call, the transmission of the moving picture data is finished, In order to use all the transmission capacities of the first channel including the transmission capacity of the moving picture data for the audio transmission, the mode is switched to the mode 0F (phase D2), and thereafter, the call disconnection release procedure of the D channel is performed. The call is ready to be released.

As a result, the call disconnection release procedure is executed on the D channel for the first channel and the second channel (phase E), and the audiovisual transfer between the two terminals is completed.

When the conference communication is completed in this way, the system control unit 1 determines that the audio CODEC 10 and the moving image CODE.
C17 and still image CODEC 20 are stopped. In addition,
The user activates each of the above operations (calling, transmitting a still image, ending a communication conference) and registering various parameters on the console 4
Is operated by operating the keypad provided in the system, and the operation data is notified to the system control unit 1 via the console control unit 5. The system control unit 1 analyzes the operation data, activates an operation or registers parameters according to the operation content, notifies the console 4 of the display data of guidance to the user, and notifies the console 4 of the data. It is displayed on the display device arranged in 4.

Next, the procedure of transmitting a still image in the communication conference apparatus according to this embodiment will be described in detail with reference to the flowcharts of FIGS.

In the figure, the system control unit 1 monitors the notification from the console control unit 5 and monitors whether there is a still image transmission operation by the user (No loop of judgment 101). If there is a still image transmission operation (Yes in determination 101), the operation content is analyzed (process 102).

As a result of the analysis of the operation contents, when the input source of the still image information is the video camera device 15 (determination 1
03A) captures an image for one frame (Process 1
04), it is encoded by the JPEG algorithm and stored in the RAM 3 (process 105). The video camera device 15
The image format (resolution) input from is 704
Pixels × 480 lines.

For the encoded data stored in the RAM 3, the system control unit 1 refers to the table shown in FIG. The aspect ratio to be applied to is selected (process 106). The details of the table in FIG. 7 will be described later.

Then, the marker code APP0 in which the selected aspect ratio information is written is added to the encoded data stored in the RAM 3, and JPEG corresponding to JFIF is added.
A file is created (process 107). After the process 107, a process 117 described later is performed.

On the other hand, as a result of the analysis of the operation contents in the process 102, if the input source of the still image information is the FDD6 (B in decision 103), the FDD6 is activated (process 10).
8) Read the still image file of JPEG format from the floppy disk set in the FDD6 and RAM3
(Process 109).

When the input source of the still image information is the memory card drive 8 as a result of the analysis of the operation contents in the process 102 (C in decision 103), the memory card drive 8 is activated (process 110), The JPEG format still image file is read from the memory card set in the memory card drive 8 (process 111).

After step 109 or step 111, step 112 is performed. In process 112, the marker code is extracted from the JPEG file stored in the RAM 3 and analyzed. As a result, when the marker code APP0 including the aspect ratio information is included (Yes in judgment 113)
In s), the process 107 described later is performed.

When not included (No in judgment 113)
Extracts the image format information (resolution) from the marker code SOF (process 114) and refers to the table shown in FIG. 7 to select the aspect ratio information based on the resolution obtained from the image format (process 115). , RAM3
The selected aspect ratio information is added to the still image information of the JPEG file stored in
A PEG file is created (process 116).

According to the above procedure, the aspect ratio information is always added to the still image input from each input source.
It is converted into a JPEG file conforming to FIF.

Now, the table shown in FIG. 7 will be described. The table shown in the figure is composed of various combinations of still image input sources (still image input means), resolutions (image formats), and aspect ratios (X to Y). The table shown in the figure is created by paying attention to the fact that there is a fixed correlation between the image format and the aspect ratio, and the fixed correlation between the still image input means and the aspect ratio. .

That is, as an image format often handled by a personal computer or the like, 640 pixels × 4
There are 80 lines and 640 × 400 lines, and the aspect ratios applied in these cases are usually 1: 1, 5: 6, respectively. In other image formats, it is usually 1: 1. The image data created by a personal computer is usually transferred to another device by a floppy disk. That is, FD
It can be said that the image data input by D6 is highly likely created by a personal computer. Also,
If the image format of the input image data is 640 pixels × 480 lines or 640 × 400 lines,
It can be said that the image data is highly likely created by a personal computer.

The same applies to digital still cameras and the like.
The image data created by the digital still camera is
Usually, it is passed to another device by a memory card drive, and its image format and aspect ratio also correlate with that it was created by a digital still camera.

The same applies to the file received from the partner terminal device, and most of the images handled by the communication system have an aspect ratio of 32:25 or a ratio close to that regardless of the image format.

That is, when the input image information does not include the aspect ratio information, the aspect ratio can be selected based on the image format of the image information (process 114), and the image information is input. Route (F
It is also possible to select the aspect ratio based on whether it is from the DD 6, the memory card drive 8, or the partner terminal.

Now, with the aspect ratio information added, JF
The encoded data stored in the RAM 3 converted into the JPEG file conforming to the IF is transmitted to the partner device (process 11
7), various parameters are extracted from the encoded data (JPEG file) stored in the RAM 3 to the still image CODEC 20 and set in the still image CODEC 20 (Processing 11
8), the encoded data from the RAM3 is the still image CODEC2
0 for decoding (processing 119) and controlling the still image output processing unit 21 to perform scaling according to the aspect ratio information included in the encoded data and display it on the still image monitor device 22 (processing). 120).

Accordingly, if the partner terminal device is a device capable of handling a JPEG file conforming to JFIF, the partner terminal automatically adjusts and displays the aspect ratio, so the operability of the user of the partner terminal device is impaired. Never be Also, the image displayed on the terminal itself is FD
JFIF input from D6 or memory card drive 8
Even in the case of a JFIF file that does not comply with the above, since it is displayed with an aspect ratio that is almost suitable for the image, the operability of the user on the terminal side is not impaired.

Next, the procedure of receiving a still image in the communication conference apparatus according to this embodiment will be described in detail with reference to the flowchart of FIG.

In the figure, the system controller 1 monitors the reception of a still image file (No loop of decision 201). When a still image file is received (Y in judgment 201)
es) reads the data on the general-purpose data channel from the multiplexer / demultiplexer 24 and stores it in the RAM 3 (process 202). Then, the marker code is extracted and analyzed from the JPEG file which is a still image file stored in the RAM 3 (process 203). As a result, when the marker code APP0 including the aspect ratio information is included (Yes in determination 204), the process 207 described below is performed.
I do.

When not included (No in judgment 204)
Extracts the image format information (resolution) from the marker code SOF (process 205) and refers to the table shown in FIG. 7 to select the aspect ratio information based on the resolution obtained from the image format information (process 206). ) And R
The selected aspect ratio information is added to the still image information of the JPEG file stored in AM3 to create a JPEG file conforming to JFIF (process 207).

By the above procedure, aspect ratio information is always added to the received still image file, and the still image file is converted into a JPEG file conforming to JFIF.

Then, various parameters are extracted from the still image data (JPEG file) stored in the RAM 3 and set in the still image CODEC 20 (process 208), and RA
The encoded data is transferred from M3 to the still image CODEC 20 to be decoded (process 209), and the still image output processing unit 21 is controlled to scale the still image data according to the aspect ratio information included in the still image data. Monitor 22
Is displayed (step 210).

As a result, even if the received still image file does not include aspect ratio information because the other terminal device cannot handle a JPEG file conforming to JFIF, the image displayed on its own terminal is almost the same. Since the image is displayed in an aspect ratio suitable for the image, the operability of the user on the terminal side is not impaired.

In the embodiment of the communication conference apparatus according to the present invention described above, a still image, particularly a still image of JPEG system has been described as an example. However, the present invention is not limited to this, and compression is performed. It goes without saying that the same can be applied to image information and moving images that are handled without being processed.

The means for inputting image information is not limited to the monitor camera of its own terminal, FDD, memory card drive, partner terminal device, and the like.

[0092]

According to the first aspect of the present invention, even if the input image information does not include the aspect ratio information, the input image information can be displayed with an aspect ratio corresponding to it. The proper image display in which the display image does not stretch vertically or horizontally can be performed regardless of whether the input image information includes aspect ratio information.

According to the invention of claim 2, even when the inputted image information does not include the aspect ratio information,
Since the input image information can be displayed with an aspect ratio that matches the resolution, a proper image display that does not stretch the display image vertically or horizontally is displayed.
This can be done regardless of whether the input image information includes aspect ratio information. Therefore,
The operability for the user is not impaired.

According to the invention of claim 3, even when the input image information does not include the aspect ratio information,
Since the input image information can be displayed with an aspect ratio that matches the input path, the input image information can be displayed properly without displaying the image vertically or horizontally. This can be done with or without aspect ratio information. Therefore, the operability of the user is not impaired.

According to the invention of claim 4, even when the image information input and transmitted to the partner device does not include aspect ratio information, the partner device side displays the transmitted image information. In addition, since the transmitted image information can be displayed with an aspect ratio corresponding to it by the aspect ratio information added and transmitted to the image information, the display image may be stretched vertically or horizontally. It is possible to perform proper image display on the partner device side regardless of whether the input image information includes aspect ratio information.

According to the invention of claim 5, even when the input image information does not include the aspect ratio information,
When the transmitted image information is displayed on the other device side, the transmitted image information is displayed in an aspect ratio corresponding to the resolution by the aspect ratio information transmitted in addition to the image information. Therefore, it is possible to perform proper image display on the partner device side, regardless of whether the input image information includes aspect ratio information or not, so that the display image does not stretch vertically or horizontally. it can. Therefore, the operability of the user on the partner device side is not impaired.

According to the invention of claim 6, even when the inputted image information does not include the aspect ratio information,
When the transmitted image information is displayed on the partner device side, the transmitted image information is displayed in an aspect ratio suitable for the input path by the aspect ratio information transmitted by being added to the image information. Therefore, an appropriate image display in which the display image does not stretch vertically or horizontally is performed on the partner device side regardless of whether the input image information includes aspect ratio information. You can Therefore, the operability of the user on the partner device side is not impaired.

[Brief description of drawings]

FIG. 1 is a block configuration diagram of a communication conference device according to an embodiment of the present invention.

FIG. 2 is a TTC standard JT-H. It is a time chart which showed the example of the general procedure of 242.

FIG. 3 is a schematic diagram showing an example of transmission capacity allocation for audio data, general-purpose data, and moving image data in data transmission using two B channels.

FIG. 4 is a diagram showing an example of a data structure of a JPEG file.

FIG. 5 is a flowchart showing a processing procedure of a still image transmitting operation of the communication conference apparatus according to the embodiment of the present invention.

FIG. 6 is a flowchart showing a processing procedure of a still image transmitting operation of the communication conference apparatus according to the embodiment of the present invention together with FIG.

FIG. 7 is a diagram showing correspondence between still image input means, image format, and aspect ratio.

FIG. 8 is a flowchart showing a processing procedure of a still image receiving operation of the communication conference apparatus according to the embodiment of the present invention.

FIG. 9 is a diagram for explaining a conventional problem.

[Explanation of symbols]

 1 System Control Section 2 ROM 3 RAM 4 Console 5 Console Control Section 6 FDD 7 FDD Interface Section 8 Memory Card Drive 9 Memory Card Drive Interface Section 10 Audio CODEC 11 Audio Input Processing Section 12 Microphone 13 Audio Output Processing Section 14 Speaker 15 Video Camera Device 16 Video input processing unit 17 Video CODEC 18 Video output processing unit 19 Video monitor device 20 Still image CODEC 21 Still image output processing unit 22 Still image monitor device 23 ISDN interface unit 24 Multiplexing / separating device 25 System bus

Claims (6)

[Claims] 1. When one or more image information inputting means for inputting image information which may include aspect ratio information is provided, and when the image information input from the image information inputting means includes aspect ratio information, In the image processing device for displaying the input image information in the aspect ratio, when the image information input by the image information input means does not include aspect ratio information, the aspect ratio is changed according to the input image information. An image processing apparatus comprising: an aspect ratio selecting unit for selecting a ratio, and displaying the input image information at the selected aspect ratio. 2. The image processing apparatus according to claim 1, wherein the aspect ratio selecting means selects an aspect ratio according to a resolution of the input image information. 3. The aspect ratio selecting means selects an aspect ratio according to which image information input means of the one or more image information input means has input the input image information. The image processing apparatus according to claim 1, wherein the image processing apparatus is provided. 4. When one or more image information inputting means for inputting image information which may include aspect ratio information is provided, and when the image information input from the image information inputting means includes aspect ratio information, In an image transmission device that directly transmits the input image information to a partner device, if the image information input from the image information input means does not include aspect ratio information, the aspect ratio is changed according to the input image information. An image transmitting apparatus comprising: an aspect ratio selecting unit for selecting a ratio, wherein the selected aspect ratio information is added to the input image information and the image information is transmitted to a partner device. 5. The image transmission apparatus according to claim 4, wherein the aspect ratio selection means selects an aspect ratio according to the resolution of the input image information. 6. The aspect ratio selection means selects an aspect ratio according to which image information input means of the one or more image information input means input the input image information. The image transmission device according to claim 4, wherein the image transmission device is provided.