JP2004072441A - Ip camera telephone device with image display function - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a calling party to confirm whether a called party is present or absent before the called party responds, at an IP camera telephone device with an image display function. <P>SOLUTION: An IP camera telephone device 1 is equipped with an image display function and connected to a network such as a LAN, and comprises a camera 17 and a display unit 15. When the device 1 exchanges a SETUP signal and an ALERT signal with an IP camera telephone device of a called party, the device 1 transmits or receives image data selected from an image by its camera 17, an image by a camera 3 connected to the network or an image from an image server 5 connected to the network, using RTP. The device 1 displays a received image on the display unit 15. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a communication device with an image display function connected to an IP network. That is, the present invention relates to an IP camera telephone with an image display function and an IP communication system using the IP camera telephone with an image display function. Further, the present invention relates to an IP camera telephone using Fast Connect connected to an IP network.
[0002]
[Prior art]
2. Description of the Related Art There is an IP communication system that transmits and displays images using an IP camera telephone, which is a communication device with an image display function, connected to an IP network. The configuration of a conventional IP camera telephone constituting such an IP communication system will be described with reference to FIG. The IP camera telephone 1 has a main control unit 10, a memory 11, a man-machine interface control unit 12, a handset 13, an image control unit 14, a display unit 15, a camera interface 16, a camera 17, a LAN control It has a unit 18, a LAN interface 19, and input means 20.
[0003]
The main control unit 10 is a unit that controls the entire apparatus.
[0004]
The memory 11 includes a flash ROM for storing a control program and an SDRAM for work.
[0005]
The man-machine interface control unit 12 is a unit that controls a man-machine interface such as a dial key, a hook, and a function key.
[0006]
The handset 13 has an audio input / output function.
[0007]
The image control unit 14 performs image input from the camera interface 16, image output to the display unit 15, and compression and expansion of images.
[0008]
The display unit 15 includes an LCD or the like, and has a color image display function.
[0009]
The camera interface 16 is a video input camera connection interface.
[0010]
The camera 17 is a video input camera.
[0011]
The LAN control unit 18 performs a network protocol.
[0012]
The LAN interface 19 is a network connection interface.
[0013]
The input unit 20 is a unit for inputting operation information such as numerical keys, operation keys, and hooks.
[0014]
The functional configuration of a conventional IP camera telephone will be described with reference to FIG. The IP camera telephone 1 with a display function includes a main control function 10F, a key input control function 12F1, a voice control function 12F2, a display control function 14F1, an image input function 14F2, a TCP / IP control function 18F1, and a call control function. Function 18F2; It comprises a H.323 control function 18F3 and a LAN control function 19F.
[0015]
The main control function 10F is a function for controlling the entire apparatus.
[0016]
The key input control 12F1 is a function for capturing a user operation using a numeric key, an operation key, a hook, etc., and monitors the state of the numeric key, the operation key, the hook, etc. When there is a change, this function notifies the call control function 18F2.
[0017]
The voice control 12F2 is a function for controlling a microphone input, a speaker output, and a vocoder / decoder. When a microphone activation request is received from the call control function 18F2, the microphone input is activated and the input voice is compressed by the vocoder. This function is a function of expanding the audio data from the H.323 control function 18F3 with a decoder and outputting the data to a speaker. Further, when a stop request is received from each of the call control functions 18F2, the function is to stop microphone input, speaker output, and vocoder / decoder control.
[0018]
The display control function 14F1 controls various kinds of display on the display unit and controls H.264. This function is for expanding image data from the H.323 and displaying the image data on the LCD.
[0019]
The image input function 14F2 is a function for capturing an image from the camera 17, compressing image data, and the like, and has a function for activating the camera, capturing an image, and compressing the image data.
[0020]
The TCP / IP control function 18F1 is a function for performing protocol control such as TCP / IP and UDP / IP. The TCP / IP control function 18F1 packetizes data to be transmitted according to a protocol such as TCP / IP and UDP / IP, and also receives received TCP / IP and UDP data. H./IP and other protocol packets are analyzed, This is a function for transferring data to the H.323 control function 18F3.
[0021]
The call control function 18F2 performs call management, H.264. The user interface block is managed by a function for giving an instruction to the H.323 or the like. H. 323 control function 18F3 or a H.323 control function. H.323 control function 18F3 and the like. This function has a role of bridging with the H.323 control function 18F3, and also bridges audio and image data.
[0022]
H. The H.323 control function 18F3 is a H.323 control function. H.323 protocol control and packetization of audio / video information. 225.0, H.R. This is a function that processes all H.245-related protocols and enables transmission of audio and images.
[0023]
The Ethernet control function 19F is a function of performing transmission / reception control with the Ethernet (registered trademark), an ARP function, and the like, and is a function of forming a packet received from the TCP / IP control function 18F1 into a frame and transmitting the frame to the Ethernet.
[0024]
As described above, the conventional IP camera telephone with an image display function is configured to transmit an image captured by the camera when a call is received from the calling side and the called side answers and enters a call state.
[0025]
When using such an IP camera phone with an image display function to communicate between IP camera phones with an image display function connected to each other via an IP network, the receiving side responds and the call state on the IP network is changed. After the image data is established, the image data is mutually transferred. Therefore, on the receiving side that has recognized that there is an incoming call, it was not possible to identify the caller by the image before answering when the call state was not established.
[0026]
In already provided number display services, etc., only the information of the calling terminal device is displayed on the display unit of the receiving terminal device, the user of the terminal device remains unknown, However, there is a problem that the caller cannot be visually recognized after answering the call and before responding.
[0027]
Further, even in the case of communication between IP camera telephones having an image display function connected to each other via an IP network, since the image information of the called side is obtained after the response of the called side, the caller cannot receive the image after receiving the call. During the period before answering, it was not possible to confirm whether the caller was present or out of the office. That is, when the called party does not answer, the sender cannot determine whether the other party is not present or not responding.
[0028]
[Problems to be solved by the invention]
SUMMARY OF THE INVENTION It is an object of the present invention to provide a communication device with an image display function that enables a caller to confirm whether a called party is present or absent before a called party answers.
[0029]
Another object of the present invention is to provide a communication device with an image display function so that the receiving side can visually recognize the caller before answering the incoming call.
[0030]
[Means for Solving the Problems]
In order to solve the above problems, the present invention provides an IP camera telephone with an image display function having a camera and a display unit, which exchanges image data and RTP at the stage of exchanging a SETUP signal and an ALERT signal with a partner IP camera telephone. The received image is transmitted and received, and the received image is displayed on the display unit.
[0031]
That is, the present invention relates to an IP camera telephone with an image display function, which is connected to a network such as a LAN or a WAN and has a camera and a display unit, when the SETUP signal and the ALERT signal are exchanged with the other party's IP camera telephone. Is transmitted and received using RTP, and the received image is displayed on the display unit.
[0032]
Furthermore, the present invention provides the above-described IP camera telephone with an image display function, which receives either an image of its own camera, an image of a camera connected to a network, or an image from an image server connected to the network when an incoming call is received. , Selected by the calling party's IP address or an image selection command from the calling party's IP camera telephone, and transmitted to the calling party.
[0033]
Further, according to the present invention, in the above-described IP camera telephone with an image display function, the image selected at the time of the incoming call is switched to the image of the own camera at the time of transition to the call state.
[0034]
According to the present invention, in the above-described IP camera telephone with an image display function, when an outgoing call is made, either the image of the other party's camera, the image of the camera connected to the other party's network, or the image from the image server connected to the other party's network. The image selection command to select the item is sent to the receiving side.
[0035]
According to the present invention, in an IP camera telephone with an image display function connected to a network and having a camera and a display unit, image data is transmitted and received by using RTP when a SETUP signal and an ALERT signal are exchanged with a partner IP camera telephone. A function of displaying a received image on a display unit, and a function of selecting either a camera image of the camera itself, a camera image connected to a network, or an image from an image server connected to the network.
[0036]
The present invention relates to the above-mentioned IP camera telephone with an image display function, comprising means for recognizing the IP address of the caller IP camera telephone, and using the recognized IP address to obtain its own camera image or a camera image or network connected to the network. To select one of the images from the image server connected to.
[0037]
The present invention relates to the above-described IP camera telephone with an image display function, which has a function of recognizing an image selection command from the calling IP camera telephone, and the camera connected to the own camera image or the network by the recognized image selection command. Either an image or an image from an image server connected to a network is selected.
[0038]
According to the present invention, in the above-described IP camera telephone with an image display function, when an outgoing call is made, either the image of the other party's camera, the image of the camera connected to the other party's network, or the image from the image server connected to the other party's network. It has a function to send an image selection command for selecting the item to the receiving side.
[0039]
In this way, by using a device that can transmit and receive image data before the call state, it is possible to display the image of the calling party on the screen of the receiving device before the receiving device responds, An image of the callee can be displayed on the screen of the calling device before the callee responds.
[0040]
As the image to be displayed on the calling side device, an image from another camera device on the same network can be selected in addition to the camera image attached to the receiving side device.
[0041]
BEST MODE FOR CARRYING OUT THE INVENTION
A configuration of an IP telephone communication system with an image display function configured using the IP camera telephone with an image display function according to the present invention will be described with reference to FIG.
[0042]
The IP telephone communication system with an image display function includes a plurality of IP camera telephones 1-1 to 1-8 with an image display function connected to a network (IP network) such as Ethernet (registered trademark) or a LAN (WAN). Camera 3.1.3-2 and an image server 5.
[0043]
For example, the IP camera telephones 1-1 to 1-4 with an image display function and the monitoring camera 3-1 are installed in the room A, and the IP camera telephones 1-5 to 1-8 with an image display function and the monitoring camera 3 -2 and the image server 5 are installed in the room B.
[0044]
The IP camera phone 1 with an image display function is an IP phone that can be directly connected to an IP network, and is configured to be connectable to 10/100 BASE Ethernet. The IP camera telephone 1 with an image display function has, for example, an MPEG4 compression / decompression function, a mail function, and a Web function. Further, the IP camera phone 1 with an image display function is a video phone equipped with a color camera and a color LCD, and has an integrated camera or an external general-purpose camera such as a digital video camera / CCD camera. .
[0045]
The surveillance camera 3 is a camera capable of photographing the whole room or the like, and includes a camera with an image distribution function or a general-purpose camera such as a digital video camera / CCD camera.
[0046]
The image server 5 is a PC-based image distribution server, and has a function of multicast distribution of an advertisement image and the like.
[0047]
The structure of the IP camera telephone with an image display function according to the present invention will be described with reference to FIG. The IP camera phone 1 with an image display function according to the present invention has the same structure as the above-described conventional IP camera phone 1. According to the present invention, the IP camera telephone 1 with an image display function does not require that the camera 17 be provided integrally with the telephone, but the camera interface unit 16 has a function of connecting to an external camera, as shown in FIG. The configuration may be such that the external camera 2 is connected via the camera interface 16 like the IP camera telephone 1-1 with an image display function described above.
[0048]
The functional configuration of the IP camera phone with a display function according to the present invention will be described with reference to FIG. The IP camera telephone 1 with a display function includes a main control function 10F, a key input control function 12F1, a voice control function 12F2, a display control function 14F1, an image input function 14F2, an image transmission control function 14F3, and TCP / IP. Control function 18F1, call control function 18F2, It comprises a H.323 control function 18F3 and a LAN control function 19F.
[0049]
The main control function 10F is a function for controlling the entire apparatus.
[0050]
The key input control function 12F1 is a function for capturing a user operation using a key, a hook, or the like. The key input control function 12F1 monitors the state of the key, the hook, and the like. This is the function to notify.
[0051]
The voice control function 12F2 controls the microphone input, the speaker output, and the vocoder / decoder. When a microphone activation request is received from the call control function 18F2, the microphone input is activated and the input voice is compressed by the vocoder. . This function is a function of expanding the audio data from the H.323 control function 18F3 with a decoder and outputting the data to a speaker. Further, when a stop request is received from each of the call control functions 18F2, the function is to stop microphone input, speaker output, and vocoder / decoder control.
[0052]
The display control function 14F1 controls various displays on the LCD and controls H.264. This function is for decompressing image data from the H.323, and in response to a start request from the image transmission control function 14F3, LCD display setting is performed and display is started. 323 control function 18F3 → image transmission control function 14F3 is a function of expanding image data and displaying the image data on the LCD. Further, when a stop request is received from the image transmission control function 14F3, the LCD display is stopped.
[0053]
The image input function 14F2 is a function for capturing an image from the camera 17, compressing image data, and the like. In response to a start request from the image transmission control function 14F3, the camera is activated to capture an image and compress the image data. , To the image transmission control function 14F3. Further, when a stop request is received from the image transmission control function 14F3, this function stops camera reception. Further, the image input function 14F2 has an external connection function, so that an image from a camera provided outside can be captured.
[0054]
The image transmission control function 14F3 transmits the call control function 18F2 / H. When the reception of the ALERT from the receiving side is notified by the H.323 control function 18F3, the activation request is notified to the image input function 14F2 and the display control function 14F1. Further, after the image transmission control function 14F3 is activated, the image data from the image input function 14F2 H.323 control function 18F3. The image data received from the H.323 control function 18F3 is transferred to the display control function 14F1.
[0055]
The image transmission control function 14F3 provides a call control function 18F2 · H. After the SET UP reception / ALERT reply is performed by the H.323 control unit 18F3, the display control function 14F1 is notified of a start request and the image data is transferred. The image transmission control function 14F3 is based on H.264. This function starts the transfer of image data to the H.323 control function 18F3. The image data at this time is variable depending on the setting, and when returning image data received from another terminal device / camera or transmitting an image of the own terminal device, a start request to the image input function 14F2 is notified, This is a function of transmitting image data from the image input function 14F2.
[0056]
Further, the image transmission control function 14F3 has a call control function 18F2 / H. When the communication state is notified from the H.323 control function 18F3, if the camera of the own terminal device is not activated, a trajectory request is notified to the image input function 14F2, and image data transfer from the image input function 14F2 is performed. Has the function of starting The call control function 18F2 / H.2 indicates that the call has ended due to off-hook or disconnection from the other party. When notified from the H.323 control function 18F3, it has a function of notifying the display control function 14F1 / image input function 14F2 of a stop request.
[0057]
The TCP / IP control function 18F1 is a function for performing protocol control such as TCP / IP and UDP / IP. The TCP / IP control function 18F1 packetizes data to be transmitted according to a protocol such as TCP / IP and UDP / IP, and also receives received TCP / IP and UDP data. H./IP and other protocol packets are analyzed, This is a function for transferring data to the H.323 control function 18F3.
[0058]
The call control function 18F2 performs call management, H.264. The user interface block is managed by a function for giving an instruction to the H.323 or the like. H. 323 control function 18F3 or a H.323 control function. H.323 control function 18F3 and the like. This function has a role of bridging with the H.323 control function 18F3, and also bridges audio and image data.
[0059]
H. The H.323 control function 18F3 is a H.323 control function. H.323 protocol control and packetization of audio / video information. 225.0, H.R. This function processes all H.245-related protocols and establishes an RTP channel with the partner device when a Fast Connect condition is satisfied or when a response is made, thereby enabling transmission of voice and image.
[0060]
The LAN control function 19F is a function of performing transmission / reception control with the LAN, an ARP function, and the like, and is a function of forming a packet received from the TCP / IP control function 18F1 into a frame and transmitting the frame to the LAN. The network to which the LAN control unit 19F faces is not limited to the LAN, but may be various networks using an IP address or command for call control, such as a WAN.
[0061]
This transmission image identification function is a function executed in the connection sequence shown in FIG. When the caller performs a calling operation on the calling side IP camera telephone 1-1, the calling side IP camera telephone 1-1 sends an image OLC (forward H.263: reverse H.263) to the called side IP camera telephone 1-5. A SETUP signal composed of a voice OLC (forward G.711: reverse G.711) is transmitted (S1). Upon receiving the SETUP signal, the receiving-side IP camera telephone 1-5 sends to the calling-side IP camera telephone 1-1 an image OLC (forward H.263: reverse H.263) and an audio OLC (forward G.711: reverse G). .711) is transmitted (S2), and the ringer is sounded to notify the incoming call (S3). Further, a ring back tone (RBT) sound source is connected (S4), and RTP (G.711) is transmitted to the calling side IP camera telephone 1-1 (S5). The calling side IP camera telephone 1-1 notifies the caller of the ring back tone (RBT) (S6). The receiving-side IP camera telephone 1-5 extracts a moving image at the time of incoming (S7), and transmits RTP (H.263) to the calling-side IP camera telephone 1-1 (S8). The calling side IP camera telephone 1-1 displays the received moving image on the display unit (S9). At the same time, the calling side IP camera phone 1-1 connects the camera and takes out a video at the time of calling (S10), and transmits RTP (H.263) to the called side IP camera phone 1-5 (S11). The receiving side IP camera telephone 1-5 displays the received moving image on the display unit (S12).
[0062]
In this sequence, the processing of transmitting and receiving the ringback tone, transmitting and receiving the moving image at the time of receiving, and transmitting and receiving the moving image at the time of the transmission proceed simultaneously. In this way, the calling side can know the situation of the called side before receiving a response by video, and the called side can know who the sender is by video when there is an incoming call.
[0063]
In such a situation, when the receiving side goes off-hook (S13), the ring-back tone (RBT) and the incoming moving image are stopped, and the microphone and the built-in camera are connected (S14). Thereafter, connection processing (CONNECT) is performed on the calling side IP camera telephone 1-1 (S15).
[0064]
The receiving side IP camera telephone 1-5 transmits the image of the built-in camera on the receiving side as RTP (H.263) to the calling side IP camera telephone 1-1 (S16). The calling side IP camera telephone 1-1 displays the called side camera image on the display unit (S17).
[0065]
The receiving side IP camera telephone 1-5 transmits the voice of the microphone as RTP (G.711) to the calling side IP camera telephone 1-1 (S18). The calling side IP camera telephone 1-1 outputs the sound of the called side from the speaker (S19).
[0066]
The calling side IP camera telephone 1-1 connects a microphone (S20), and transmits the RTP (G.711) to the called side IP camera telephone 1-5 (S21). The receiving side IP camera telephone 1-5 outputs the calling side voice from the speaker (S2). The transmission and reception of the calling side camera image (S10 to S12), the transmission and reception of the called side camera image (S16 and S17), the transmission and reception of the called side voice (S18 and S19), and the transmission and reception of the calling side voice (S20 to S22) are performed simultaneously. .
[0067]
Characteristic functions of the IP camera telephone 1 with an image display function having the above functions include a transmission image identification function, a transmission image selection function, an absence confirmation function, a caller confirmation function, a display image switching function, and an advertisement distribution function. There is.
[0068]
The transmitted image identification function is to capture the video that is connected by fast connect with the IP address of the other party at the time of the incoming call, (1) the video captured by the camera of the own telephone, and (2) the video captured by the surveillance camera connected to the system. This is a function to automatically select any one of the extracted video and the video taken out from the image server connected on the Ethernet and set it as the transmission image. The camera at the time of the transmission / reception processing of the receiving-side moving image (S7 to S9) Control at connection.
[0069]
The outgoing image selection function is a function for selecting an image to be transmitted to the other party by operating a number key or registering a telephone number when making an outgoing call. This is a function to automatically select any one of the video of the monitoring camera 3 and the video of the image server 5 connected on the Ethernet and set it as a transmission image. Control is performed when the camera is connected in steps S12 to S12).
[0070]
The absence confirmation function is that the receiving side IP camera telephone 1-5, which has received the SETUP from the calling side, starts capturing a monitoring camera image after transmitting an ALERT response, and transmits image data to the calling side. This function allows the camera phone 1-1 to display the image data on the display unit so as to know the state of the receiving side before the call state is established.
[0071]
The caller confirmation function is that the calling IP camera telephone 1-1 receives the ALERT from the receiving IP camera telephone 1-5, and thereafter, transfers the image data that has started capturing the camera image in S10 to S12 to the receiving IP camera telephone 1-1. 5 and the image received by the destination IP camera telephone 1-5 is displayed on the display unit, so that the caller can be confirmed by the video before the call state.
[0072]
The display image switching function is used when the destination IP camera telephone 1-5 relays an image from the monitoring camera 3-2 or the image server 5 on the same network to the originating IP camera telephone at the time of an incoming call. This is a function of stopping transmission of an image being relayed in response to an incoming call, and transmitting an image of a camera attached to the destination IP camera telephone 1-5 to the originating IP camera telephone 1-1.
[0073]
The remote control function allows the destination IP camera phone 1-5 to display the video connected by Fast Connect by command control from the calling side IP camera phone 1-1 to the camera provided on its own IP camera phone. The function is to select one of the image, (2) the image of the monitoring camera 3-2 connected to the system, and (3) the image of the image server 5 provided on the LAN. This function works in the moving image retrieval processing at the time of incoming call (S7).
[0074]
The advertisement distribution function is a function of transmitting and displaying an advertisement image from the image server 5 to the originating IP camera telephone 1-1 instead of or simultaneously with the RBT when waiting for a response. This function works in the moving image retrieval processing at the time of incoming call (S7).
[0075]
As described above, according to the present invention, when a call is made between IP camera phones with an image display function connected via a LAN, a calling operation is performed on the calling IP camera phone, and a SETUP signal is transmitted to the called IP camera phone. When the ALERT signal is transmitted from the receiving IP camera telephone to the calling IP camera telephone, image signals can be bidirectionally transmitted and received using RTP, and the image of the other party can be displayed on its own display unit.
[0076]
【The invention's effect】
According to the present invention, when an incoming call is received between IP camera telephones with an image display function connected via a LAN, the other party can be visually confirmed before answering.
[0077]
When the terminal information is displayed on the receiving side, the user and the terminal device do not always match, but since the image on the calling side is displayed, the user can be specified.
[0078]
On the receiving side, a response can be made after visually confirming the caller.
[0079]
By setting the sending side to send the indoor image, the caller can confirm the presence / absence of the calling party.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration of a communication system using an IP camera telephone with an image display function according to the present invention.
FIG. 2 is a conceptual diagram illustrating the structure of an IP camera telephone with an image display function.
FIG. 3 is a diagram illustrating a functional configuration of an IP camera telephone with an image display function according to the present invention.
FIG. 4 is a view for explaining connection processing using the IP camera telephone with an image display function according to the present invention.
FIG. 5 is a diagram illustrating a functional configuration of a conventional IP camera telephone with an image display function.
[Explanation of symbols]
1 IP camera telephone
2 External camera
10 Main control unit
11 memory
12 Man-machine interface
13 Handset
14 Image control unit
15 Display
16 Camera interface
17 Camera
18 LAN control unit
19 LAN interface
20 Input means
3 Surveillance camera
5 Image server
10F Main control function
12F1 key input control function
12F2 Voice control function
14F1 display control function
14F2 image input function
14F3 Image transmission control function
18F1 TCP / IP control function
18F2 call control function
18F3 H.P. 323 control function
19F LAN control function

Claims (3)

In an IP camera telephone with an image display function connected to a network and having a camera and a display unit,
A function of transmitting and receiving image data using RTP at a stage where the SETUP signal and the ALERT signal are exchanged with the other party's IP camera telephone;
A function of displaying the received image on the display unit,
An IP camera telephone with an image display function, which has a function of selecting one of its own camera image, a camera image connected to a network, and an image from an image server connected to the network. It has means for recognizing the IP address of the caller IP camera telephone or a function for recognizing an image selection command from the caller IP camera telephone. 2. The method according to claim 1, further comprising the step of selecting one of an image of the camera, an image of a camera connected to the network, and an image from an image server connected to the network, and transmitting the selected image to the caller. IP camera phone with image display function. At the time of outgoing call, send an image selection command to the called party to select either the image of the other party's camera, the image of the camera connected to the other party's network, or the image from the image server connected to the other party's network. The IP camera telephone with an image display function according to claim 1, wherein:

Images