JP2005286445A - Image transmission terminal, system thereof and terminal image transmitting method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a simple device and a simple method for changing a transmission image range that does not use machine mechanisms in an imaging camera when photographing an object by the camera for transmission, and has improved readiness. <P>SOLUTION: A segmentation control unit 8 is provided which sets the imaging region of a camera to be larger than a transmission image in advance, creates and instructs the region of an image that is smaller than the region of a captured image as the transmission image, and specifies the prescribed position of the captured image as the start position of the transmission image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an apparatus for transmitting an image from a destination and displaying it on its own screen, and a device and method for changing the screen display easily and quickly in accordance with the intention of the receiving side by devising the transmitting side It is about.

In order to make a received image representing the intention of the receiving side, such as moving and expanding the screen display range of the videophone or videoconferencing system, which transmits the image of the other party and displays it on its own screen, As a representative technique, there is a technique disclosed in “Videophone device having a remote control function” in Patent Document 1. In order to perform remote control of the counterpart terminal camera, this technique is performed by transmitting a camera control signal to the counterpart terminal using the camera control means of the own terminal and controlling it. Specifically, camera control (tilt (vertical direction), pan (horizontal direction), zoom in / out) is mechanically performed.
Japanese Patent Application Laid-Open No. 11-112954

  The change of the image range in the conventional image communication is configured and operated as described above. Therefore, it relies on mechanical driving, and in the structure of a mobile phone with a camera equipped with a videophone function that requires a reduction in size, There is a problem that it is large, the follow-up speed is slow, and it is impossible to construct mechanical parts in terms of configuration.

  The present invention has been made to solve the above-described problems, and provides a simple transmission image range changing apparatus and method with improved responsiveness without using a mechanical mechanism.

  An image transmission terminal according to the present invention includes: a cutout control unit that instructs to create an image area smaller than a captured image area as a transmission image and designates a predetermined position of the captured image as a start position of the transmission image. .

  As described above, according to the present invention, the cut-out control unit that performs transmission control using an image smaller than the area of the captured image as the transmission image and an arbitrary position in the imaging area as the start position of the transmission image is provided. There is an effect that the range can be changed with high responsiveness including enlargement and reduction, and the range can be changed easily without mechanical parts.

Embodiment 1 FIG.
According to the present invention, in a communication terminal having an image transmission function, a memory in which an imaging area of a camera is set wider than a transmission image area in advance to capture an image and write an image, and a small image area from the image area written in the memory. A cutout control unit that cuts out and controls an image for transmission is provided, and a function of moving the cutout position in the horizontal, vertical, and diagonal directions by sending a camera control signal from the own terminal to the counterpart terminal is electrically provided. Can be controlled.
As a result, panning and tilting functions can be realized as remote control of the partner terminal camera without providing a large mechanism.

First, the configuration of the apparatus according to the present embodiment will be described with reference to the block diagram of the transmitting terminal in FIG.
In FIG. 1, a mobile communication terminal 1 includes a camera unit 2, a memory 3, an image encoding unit 4, an image decoding unit 5, a display control unit 6, a display unit 7, and an extraction control unit having an important function in this configuration. 8, DTMF signal detector 9, speech decoder 10, speaker 11, speech encoder 12, microphone 13, DTMF signal generator 14, dial (button) 15, demultiplexing controller 16, line I / F 17, communication It is comprised by the control part 18. The mobile communication terminal 1 performs communication including image transmission by connecting to the other mobile communication terminal 1 via a communication line 29 such as an analog telephone network, ISDN, or wireless telephone network.
What is important in this configuration is that the imaging area captured by the camera unit 2 is imaged in a wider range than the transmission image area, and the extraction control unit has a function of moving and enlarging / reducing the extraction start position as described in detail below. It is to have.

Next, the operation will be described.
As will be described later with reference to the explanatory diagram, a necessary portion of the image captured by the camera unit 2 is recorded in the memory 3 for each frame, and is encoded by the image encoding unit 4. Then, the voice signal encoded by the voice encoding unit 12 and the demultiplexing control unit 16 perform ITU-T recommendation H.264. The signals are multiplexed according to a media demultiplexing standard such as H.223 and output to the communication line 29 via the line I / F 17. In the communication control unit 18, the ITU-T recommendation H.264. Communication protocol processing is performed to negotiate a communication method and specify a communication mode with a partner terminal such as H.245.

On the other hand, on the receiving side, the received signal is transmitted to the ITU-T recommendation H.264 by the demultiplex control unit 16 via the line I / F 17. It is separated into an image signal and an audio signal in accordance with a media demultiplexing standard such as H.223. The separated image signal is decoded by the image decoding unit 5, synthesized with the image captured by the camera unit 2 read from the memory 3 by the display control unit, and displayed on the display unit 7. The separated audio signal is decoded by the audio decoding unit 10 and output from the speaker 11.
When the dial button 15 is pressed during communication, a DTMF signal corresponding to the pressed dial button is generated by the DTMF signal generating unit 14 and encoded by the voice encoding unit 12, and the demultiplexing control unit 16, line I / O F17, transmitted via the communication line 29.
On the other hand, the received DTMF signal is decoded by the voice decoding unit 10 via the line I / F 17 and the demultiplexing control unit 16, and the type of the dial button pressed by the partner terminal by the DTMF signal detection unit 9 is determined. To detect. The cutout control unit 8 designates the area and data amount to be written in the memory 3 from the image captured by the camera unit 2 in accordance with the type of dial button sent.

Next, the pan (horizontal direction) control operation of the counterpart terminal camera will be described with reference to FIGS.
In FIG. 2, first, it is shown that the transmission image area 20 currently transmitted to the counterpart terminal is in the upper left part in the imaging area 19 of the camera unit 2. Also, let A be the reference point of the transmission image area 20, the length of the transmission image area in the x direction be L, and the length in the y direction be M. Only the data of the transmission image area 20 is written in the memory 3. That is, the transmission image area 20 is necessarily an area smaller than the imaging area 19.
The new transmission image area 21 is an image area in which the original reference point A is shifted to the horizontal reference point B.

FIG. 7 specifically shows the dial button 15. As an example, the 6th dial button is assigned to the right control, and the 4th dial button is assigned to the left control.
When it is desired to view an image in the horizontal right direction from the image sent from the partner terminal during communication, when the sixth dial button of the dial button 15 of the own terminal in FIG. 1 is pressed, the DTMF signal corresponding to the sixth dial button is displayed. Is generated by the DTMF signal generation unit 14, encoded by the audio encoding unit 12, and transmitted to the partner terminal via the demultiplexing control unit 16, the line I / F 17, and the communication line 29.
The DTMF signal received by the partner terminal is decoded by the voice decoding unit 10 via the line I / F 17 and the demultiplexing control unit 16, and the DTMF signal detection unit 9 depresses the sixth dial button of the partner terminal. It is detected that

When the information indicating that the 6th dial button is pressed is transmitted to the extraction control unit 8, the extraction control unit 8 moves the extraction start position of the transmission image area 20 from the A direction to the B direction. If the position is moved at a constant speed, for example, by pressing the dial button once, the cutting start position A can be moved to B eventually if the number 6 dial button is kept pressed. Alternatively, if a certain amount of coordinate values are moved by pressing the button once, the cutting start position A is moved to B by pressing the button a plurality of times. At this time, since the data in the transmission image area 21 is written in the memory 3, the image transmitted from the counterpart terminal appears as if the camera unit 2 is rotated in the horizontal right direction.
Similarly, when the user wants to see an image in the horizontal left direction from the image sent from the partner terminal, the user presses the 4th dial button of the dial button 15 of the own terminal.
With the above operation, pan control of the partner terminal camera can be realized without providing a large mechanism.

Next, the tilt (vertical direction) control operation of the counterpart terminal camera will be described with reference to FIGS.
In FIG. 3, a new transmission image area 22 is obtained by shifting the reference point A of the original transmission image area 20 to the reference point C in the vertical direction.
In FIG. 7, as an example, the second dial button is assigned to the upward control of the counterpart terminal camera, and the eighth dial button is assigned to the downward control.
If you want to see an image below the image sent from the other terminal during communication, press the 8th dial button of the dial button 15 of your terminal, and the DTMF signal corresponding to the 8th dial button will generate a DTMF signal. In the same manner as in the case of the pan operation, the signal is transmitted to the partner terminal via the voice encoding unit 12, the demultiplexing control unit 16, the line I / F 17, and the communication line 29.

The DTMF signal received by the partner terminal is transmitted to the voice decoding unit 10 via the line I / F 17 and the demultiplexing control unit 16, where it is decoded, and the DTMF signal detection unit 9 selects the eighth dial button of the partner terminal. Detects pressing.
When information indicating that the 8th dial button has been pressed is transmitted to the cutout control unit 8, the cutout control unit 8 moves the cutout start position of the transmission image area 20 from the A direction to the C direction. That is, the cutting start position is moved from A to C by continuously pressing the dial button or pressing the dial button a plurality of times. At this time, since the data of the transmission image area 22 is written in the memory 3, the image transmitted from the counterpart terminal appears as if the camera unit 2 is rotated downward. Similarly, when the user wants to see an image upward from the image sent from the partner terminal, the user presses the second dial button of the dial button 15 of the own terminal.
In addition, by combining pan control and tilt control, as shown in the new transmission image area 25 in FIG. 4, it is possible to control the counterpart terminal camera in an oblique direction.

Embodiment 2. FIG.
In the above-described embodiment, the case has been described in which the cutout control unit 8 includes a position movement function for performing parallel movement of the cutout start position. In the present embodiment, a case will be described in which the cutout control unit 8 has zoom-out and zoom-in functions.
In the present embodiment, as a clipping control unit, a camera control signal is sent from the own terminal to the other terminal, and a zoom-out function for capturing a large image on the clipping screen or a zoom-in function for enlarging and displaying a certain part is electrically performed. To be able to control. That is, data is compressed when a large image is captured, and data is expanded when enlarged. Thus, zoom-out and zoom-in functions can be obtained without providing a large-scale mechanism for remote control of the partner terminal camera.
The configuration in this embodiment is the same as that in FIG. However, the function of the cutout control unit 8 is to compress and decompress the image data.

Next, the zoom-out control operation performed by the clipping control unit 8 of the counterpart terminal camera will be described with reference to FIGS.
In FIG. 5, the new transmission image area 23 is twice as long as the original image area.
In FIG. 7, as an example, a “*” dial button is assigned to zoom-out control.
If you want to see an image zoomed out from the image sent from the other terminal during communication, when you press the “*” dial button of the dial button 15 of your terminal, the DTMF signal that matches the “*” dial button is displayed. Obtained by the DTMF signal generation unit 14, encoded by the speech encoding unit 12, and transmitted to the partner terminal via the demultiplexing control unit 16, the line I / F 17, and the communication line 29.

The DTMF signal received by the partner terminal is sent from the line I / F 17 and the demultiplexing control unit 16 to the voice decoding unit 10, where it is decoded, and the DTMF signal detection unit 9 uses the “*” dial button of the partner terminal. It is detected that is pressed.
When the information indicating that the “*” dial button is pressed is transmitted to the extraction control unit 8, the extraction control unit 8 moves the extraction start position of the transmission image area 20 from A to D, and at the same time, sets the amount of data to be written in the memory 3. Control. Here, if the enlargement width of the transmission image area 20 by pressing the dial button once is N times vertically and horizontally, the relationship between A (x1, y1) and D (x4, y4) by pressing the dial button once is as follows ( 1) It becomes like a formula.
x4 = x1-NL / 2
y4 = y1-NM / 2 (1)

Although the above is zoom-in, conversely, by compressing the data to be written in the memory 3 to 1 / N, the image data of the area of NM × NL is written in the memory 3 as the transmission image area 23. For this reason, the image sent from the counterpart terminal appears as if the camera unit 2 was zoomed out.
The zoom-in control operation of the partner terminal camera will be described with reference to FIGS.
In FIG. 6, a new transmission image area 24 is an area that is half the length and width of the original transmission image area 20.
In FIG. 7, as an example, a “#” dial button is assigned to zoom-in control.
When it is desired to view an image zoomed in on an image sent from the partner terminal during communication, the “#” dial button of the dial button 15 of the own terminal is pressed. The DTMF signal in the DTMF signal generation unit 14 in accordance with the “#” dial button is transmitted to the partner terminal by the operation via the voice encoding unit 12, the demultiplexing control unit 16, the line I / F 17, and the communication line 29. .

The DTMF signal received by the partner terminal is a signal after decoding via the line I / F 17, the demultiplexing control unit 16, and the voice decoding unit 10, and the “#” dial button is pressed by the DTMF signal detection unit 9 Is detected.
When the information indicating that the “#” dial button is pressed is transmitted to the extraction control unit 8, the extraction control unit 8 moves the extraction start position of the transmission image area 20 from the A direction to the E direction, and at the same time, sets the amount of data to be written in the memory 3. Control. Assuming that the reduction width of the transmission image area 20 by pressing the dial button once is 1 / N times in the vertical and horizontal directions, A (x1, y1) and E (x5, y5) have the relationship of the following expression (2).
x5 = x1 + L (N-1) / 2N
y5 = y1 + M (N-1) / 2N (2)
Further, by expanding the data to be written in the memory 3 by N times, the image data in the M / N × L / N area is written in the memory 3 as the transmission image area 24. The coming image appears as if the camera unit 2 was zoomed in.
With the configuration of the above embodiment, zoom-in control of the partner terminal camera can be realized without providing a large mechanism.

  In the above embodiment, a method for transmitting and receiving a DTMF signal by superimposing it on an audio signal has been described. Transmission / reception may be performed using 245 User Input Indication message.

In the above embodiment, the camera remote control method by dial button operation is shown, but a touch panel as shown in FIG. 8 may be used. In the figure, the moving button 26 is pressed to control the moving direction. If both the up / down and left / right movement buttons are pressed, movement control in an oblique direction can be performed. Furthermore, buttons corresponding to # (zoom-in) and * (zoom-out) can be provided to control zoom-out for capturing a large image and zoom-in for displaying a magnified portion.
By using the touch panel, remote control of the counterpart terminal can be visually performed.

Embodiment 3 FIG.
As another embodiment, a case will be described in which an image in which a part of the imaging area 19 captured by the camera unit 2 is captured and the current transmission area 20 is transmitted.
The configuration of this system is also the same as the configuration shown in FIG. 1, but the contents that the camera unit 2 writes in the memory 3 are slightly different. FIG. 9 is a diagram for explaining this method.
That is, the camera unit 2 writes the image captured by the camera unit 2 as it is in the hatched portions shown in the upper and lower parts of FIG. In most other cases, the image in the transmission image area shown in FIG. As a result, the image shown in FIG. 9 is sent to the counterpart terminal.
Since the maximum area image is displayed at least at the top and bottom of the screen at the receiving terminal, there is a certain degree of insight to how far the transmission image can be moved.
Alternatively, as shown as the left and right dotted lines in FIG. 9, the left and right end portions may also send images captured by the camera unit 2. This makes it easier to determine how far the transmitted image can be moved.

Embodiment 4 FIG.
In each of the above embodiments, it has been described that all terminals are configured by hardware elements. However, the cut-out control unit 8 may be assembled not by hardware but by software operating on a processor and mounted in a memory to obtain an equivalent function.
FIG. 10 is a diagram illustrating an operation flow of the cutting start position control in the case where the cutting control unit 8b is configured by software incorporated so as to move the cutting start position at a constant speed.
The operation will be described.
The cutout controller 8b detects the DTMF signal in steps S41 and S42. When a movement or zoom-in / zoom-out signal is detected in these steps, the movement in S43 or the enlargement / reduction operation in S45 is performed according to the contents. If the button continues to be pressed, that is, if the signal continues, the operation is continued by a loop from S44 or S46.
If the cut-out control is configured by software, the function can be easily changed.

It is a figure which shows the structure of the terminal of the transmission side in Embodiment 1 of this invention. 6 is a diagram illustrating an imaging region and a transmission image region by the camera unit according to Embodiment 1. FIG. 6 is a diagram illustrating an imaging area and a transmission image area by another camera unit according to Embodiment 1. FIG. 6 is a diagram illustrating an imaging area and a transmission image area by another camera unit according to Embodiment 1. FIG. 6 is a diagram illustrating an imaging area and a transmission image area by a camera unit in Embodiment 2. FIG. FIG. 10 is a diagram illustrating an imaging region and a transmission image region by another camera unit in the second embodiment. It is a figure which shows the example of the dial button of a terminal. It is a figure which shows the example of the dial button by a touchscreen. FIG. 10 is a diagram showing a transmission image in the third embodiment. FIG. 10 is a flowchart showing the operation of the cutout control unit in the fourth embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Mobile communication terminal, 2 Camera part, 3 Memory, 4 Image encoding part, 5 Image decoding part, 6 Display control part, 7 Display part, 8 Clipping control part, 9 DTMF signal detection part, 10 Voice decoding part, 11 Speaker, 12 Voice encoding unit, 13 Microphone, 14 DTMF signal generation unit, 15 dial, 16 Demultiplexing control unit, 17 Line I / F, 18 Communication control unit, 29 Communication line, S41 Position movement signal detection step, S42 Enlargement / reduction signal detection step, S43 Step of moving the extraction start position in the designated direction, S45 Movement of the current image cutout position and designated enlargement / reduction processing.

Claims (7)

  An image transmission terminal comprising: a cutout control unit that instructs to create an image area smaller than a captured image area as a transmission image and that designates a predetermined position of the captured image as a start position of the transmission image.   2. The image according to claim 1, wherein upon receiving a movement signal for moving the start position, the clipping control unit maintains a predetermined small image area and moves the start position based on the received movement signal. Transmission terminal.   Upon receiving the transmission image enlargement / reduction instruction signal, the clipping control unit performs expansion / compression control of the captured image based on the received enlargement / reduction instruction signal while maintaining a predetermined small image area as the transmission image. The image transmission terminal according to claim 1, wherein the image transmission terminal is performed. A transmission-side image transmission terminal comprising: a cutout control unit that instructs to create a region of an image smaller than the region of the captured image as a transmission image, and that designates a predetermined position of the captured image as a start position of the transmission image;
An image transmission terminal system comprising: a reception-side image transmission terminal that transmits a signal designating a start position of a transmission image to the clipping control unit of the transmission-side image terminal. The receiving-side image transmission terminal sends either an instruction to move the start position of the transmission image, an instruction to enlarge the transmission image, or an instruction to reduce the transmission by pressing a specific button.
Upon receiving any instruction signal regarding the start position of the transmission image, the transmission-side image transmission terminal determines the start position based on the received movement signal corresponding to the clipping control unit while maintaining a predetermined small image area. 5. The image transmission terminal system according to claim 4, wherein the image transmission terminal system performs any one of movement, decompression processing of a captured image, and compression processing of a captured image.   6. The image transmission terminal system according to claim 5, wherein the reception-side image transmission terminal issues an instruction to move the start position of the transmission image by pressing an up / down / left / right button displayed on the touch panel. Instruct to create an image area smaller than the captured image area as a transmission image,
Detecting a signal for instructing movement of a predetermined position of the captured image from the counterpart terminal;
A terminal image transmission method comprising: shifting a start position of a transmission image in a predetermined direction based on the movement signal.

Images