KR20090028404A - Apparatus for video telephony - Google Patents

Abstract

A video call apparatus is provided to enable a user to perform the video communication with the other party as watching television by displaying an external image and an image of the other party in the PIP(Picture In Picture) mode at the same time. A DSP(Digital Signal Processor)(306) processes the digital signal received in the Ethernet(303) and a modem(304) or converts an internal signal into a digital signal which will be transmitted through the modem or an LAN(Local Area Network) connection unit. A CPU(308) receives the basic signal processed by the DSP, and then converts it into image and voice signals which are suitable for a TV. The CPU receives external images from an air wave/cable signal receiver directly or indirectly receives images from a camera(301), and then the received images to the DSP. A memory unit(310) is connected with the CPU and stores a program and protocol used for the signal processing of the CPU.

Description

Video calling device {apparatus for video telephony}

The present invention relates to a video call apparatus, and more particularly, to an apparatus capable of making a video call while watching a TV screen using a television (hereinafter, abbreviated as TV) as an image display apparatus.

As shown in Fig. 1, an IP videophone (Multimedia Over Internet Protocol) is an Ethernet 201 for making a video call using the Internet network, a modem 202 for using a general PSTN network, and an Internet network. Decode the incoming video signals (H.263, H.264) and audio signals (G.729, G.711) from the PSTN network, and process the incoming voice signals, DTMF signals, and ring back tones. Digital signature processor (204), video data (H.263, H.264) and audio signal (G.729, G.711) decoded raw data (raw date), voice signal, DTMF signal, CPU 203 capable of collecting ringback tones, various control data, and converting them into a signal that can be expressed on the display device 205, and a memory unit that stores execution programs and font data for such signal conversion and is controlled by the CPU. 207 constructs a user interface 206 that delivers user input to the CPU 203. By made.

In case of making IP video call using MOIP, MOIP uses WAN protocols such as PPPoE, DHCP, Static IP, etc. through the internet network, and handles authentication and charge using server protocol using SIP, H.323 protocol, etc. can do. After authenticating to the server, MOIP uses P2P video signal of H.263 and H.264 video signal and G.729 and G.711 audio signal to make video call from MOIP board to other MOIP board. 201) processes the physical part of the Internet, TCP and UDP to process video signals (H.263, H.264) and audio signals (G.729, G.711) or various control signals and information data to the MOIP board. Allows you to enter and exit. Thereafter, the DSP 204 converts the data entered into the MOIP board into the basic data format from the compressed video signals H.263 and H.264 and the audio signals G.729 and G.711.

Among the decompressed basic data, the video data is used to express the image on the display device 206 in the form of digital R.G.B, LVDS or DVI. Compressed audio signals (G.729 and G.711) are decompressed in the form of PCM (Pulse Code Modulation) data, and the PCM data is converted to an analog signal (DAC) that converts the digital signal into an analog signal for human hearing. It is output through speakers or handsets.

In addition, the MOIP compresses the basic data introduced through the user interface 205 to convert the video signals (H.263, H.264) and audio signals (G.729, G.711), and converts the compressed data to Ethernet ( It is also sent to another MOIP through 201). The signal coming into the modem 202 from the PSTN network is converted into PCM data through the modem 202, among which various control signals and information signals such as DTMF signals, ringback tones, and CID (caller ID indication) are detected. Various detected control signals and information signals are displayed so that the counterpart information can be known. The PCM data converted by the modem is output through the DAC, which converts the digital signal (PCM data) into an analog signal for human hearing, and then outputs it through a speaker or a handset.

In this case, the user may set the phone book and call log IP settings through the user interface 205, and view the input data on the display device 206.

The conventional MOIP may use a separate MOIP-only display device as the display device 206, but may use a TV, which is one of the representative display devices, for displaying a call image. However, in the case of using a TV, a call video and an external video input through an airwave or a cable of a cable TV may collide with each other. Thus, a method of displaying an image of the other party by cutting off an external video and an audio signal of an airwave or a cable TV is conventionally used. It became. However, this method is independent of the user's intentions and can interfere with important TV viewing.

On the other hand, when the call comes to the TV to inform the call of the incoming call, the user may choose to answer the call or continue watching TV. However, even in this case, you have to choose only one, so you cannot watch TV while receiving a call.

However, in order to receive a call and watch TV, an efficient video call device is required to arrange a collision between a video call and an audio signal of a telephone call and an external signal and to display all of them.

Preferably, an apparatus capable of arbitrarily switching the display specific gravity of TV and video call video according to its importance is desired.

Accordingly, an object of the present invention is to provide a video call apparatus that meets these needs.

In one aspect of the present invention for achieving the above object, a video call device includes a LAN connection unit connected to a local area network (LAN) for connection to the Internet, a modem for connecting to a public telephone network (PSTN), a LAN connection unit, and a modem. Digital signal processor (DSP) which processes digital signal or converts internal signal into digital signal to be transmitted through modem or LAN connection, receives basic signal obtained from DSP and makes it suitable for TV system or converts it into air wave or cable CPU or CPU that directly or indirectly receives a signal or camera signal from a signal receiver and is connected to the CPU, and a memory device that records programs and protocols that are the basis for processing the CPU. Receive the signal directly or indirectly, and receive the control command to edit the image. PIP processing device for emitting the edited signal for arranging, TV receiving and displaying the edited signal of the PIP processing device, and a user interface for command input to the CPU or for inputting a separate signal to the CPU .

In addition, the video call device of the present invention is preferably configured to record a video signal transmitted from another video call device to a memory device or a recording device connected to a user interface.

Method for using a video call device according to an aspect of the present invention for achieving the above object in using a video call device such as the configuration of the present invention,

An external image processing step of receiving an external image through an airwave or cable broadcasting network and maintaining or converting the signal into a signal type suitable for TV expression;

Call processing image processing step of receiving a video from the call counterpart over the Internet or PSTN and converting it into a signal form suitable for TV expression,

 A user image processing step of maintaining or converting a self (user side) image input through a user interface into a signal form suitable for TV representation,

And outputting the result signals of the external image processing step, the call target image processing step, and the user image processing step by the PIP processing apparatus and displaying them on the TV screen in a PIP manner.

Method for using a video call device according to an aspect of the present invention for achieving the above object, in using the video call device of the present invention, the step of confirming a call request (call signal) of a general phone or a mobile phone through the PSTN, Checking a predetermined signal setting value of a general telephone or a mobile phone included in the call request, and if the predetermined signal setting value is confirmed, making a call request to another video call device through the Internet. It can be made with.

Method for using a video call device according to an aspect of the present invention for achieving the above object, in using the video call device of the present invention, the step of confirming the call request via the Internet from another video call device, included in the call request Confirming the predetermined signal setting value, and when the predetermined signal setting value is confirmed, a step of calling a general telephone or a mobile phone through the PSTN.

Method for using a video call device according to an aspect of the present invention for achieving the above object, in using the video call device of the present invention, the user interface includes a sensor for detecting an intruder in the target space, the sensor is an intruder Detecting and informing the CPU, wherein the CPU transmits the image and the call signal of the camera to at least one of another video call device, a mobile phone, and a general telephone through a DSP.

Method for using a video call device according to an aspect of the present invention for achieving the above object, in using the video call device of the present invention, transmitting the external image of the airwave or cable broadcast to another video call device through a user interface And setting a transmission mode for the mobile communication device, calling and connecting the other video call device through the Internet, and converting the external video into a signal suitable for the Internet to the other video call device. .

Method for using a video call device according to an aspect of the present invention for achieving the above object, in using the video call device of the present invention, the step of connecting and confirming a call signal from another video call device, from the other video call device And maintaining or converting the transmitted signal into a signal suitable for a TV, and displaying it on a TV screen.

According to the present invention, while watching TV, a video call can be made with the other party by simultaneously displaying the external video and the other party's video on the TV by PIP method, and depending on the application, the TV screen being watched can be transmitted to the other party through the video phone. In addition, it is possible to make a low-cost call with the other party through a video call device located anywhere where the Internet is connected, regardless of country or region, by using external external telephones and mobile phones.

Hereinafter, the present invention will be described in detail.

Fig. 2 is a block diagram schematically showing the configuration of an embodiment of the video call apparatus of the present invention.

2, the present embodiment processes the digital signals received by the Ethernet 303 for the Internet connection, the modem 304 for connecting to the public switched telephone network (PSTN), the Ethernet 303, and the modem 304, or Digital signal processing device (DSP: 306) that converts the internal signal into a digital signal to be transmitted through a modem or LAN connection, and receives the basic signal obtained from the DSP 306 to make a video or audio signal suitable for TV, CPU 308, which is connected to CPU 308 and CPU 308, which directly or indirectly receives the external image 302 or the image from the camera 301 obtained from the cable signal receiver and sends them to the DSP 306, is connected to the CPU 308. A video room to which a program and a protocol which is a signal processing standard of the memory device 310 and the CPU 308 receive a video voice signal, an air wave or a cable signal indirectly or indirectly, and receive an adjustment command for editing an image to determine an image to be expressed. PIP processing unit 305 that emits the edited signal for arrangement, the TV 309 that receives and displays the edited signal of the PIP processing unit 305, is responsible for command input to the CPU 308 or CPU 308 ) Is provided with a user interface 311 used for separate signal input. The telephone 312 is connected to the modem 304.

At this time, the camera 301 or the phone 312 is connected to the PIP processing unit 305 and the modem 304 in the configuration of the embodiment of Figure 2, for example, may be configured to be directly connected to the CPU, in that sense It forms part of the user interface 311, and can be generally interchanged with the user interface 311.

In addition, in the present embodiment, the video signal input through the Internet network or the PSTN is input to the PIP processing apparatus while being processed through the CPU through the DSP, and the external image and the camera image are directly input to the PIP processing apparatus. Images may also be input once to the CPU and collectively input to the PIP processing apparatus from the CPU.

This example may be appropriate when a set-top box is needed to obtain an external video signal suitable for a TV. For example, if the TV 309 is a digital TV and the original signal for the external image has an analog signal or another type of digital signal that is compressed and modulated, the external image is processed into a form suitable for digital TV through a signal processor such as a three-top box. Should be. A typical three-top box includes a tuner for receiving a broadcast signal, a demodulator for converting an intermediate frequency signal (IF) filtered by the tuner into a digital baseband signal, and then converting the MPEG TS data into a MPEG TS data, and converting the MPEG TS data of the demodulator into a video. An MPEG decoder for decoding signals and audio signals, and a CPU for transmitting a signal of the MPEG decoder to a TV are provided. Therefore, if only the video and audio processing device parts such as a tuner, a demodulator, and a decoder are left, and the set-top box part is directly connected to the CPU of the video call device of the present invention, the CPU performs necessary processing and the result is transferred to the PIP processing device. Send it. In this case, the CPU directly receives the external image signal and the camera image signal, and the PIP processing apparatus indirectly receives the signals of the external image and the camera image through the CPU. In either case, the PIP processing unit can process the screen of which path through the CPU as a large screen, which path screen to take as the PIP screen, how to change the size and position of the PIP screen, and switch between the background screen and the PIP screen. It can be adjusted, and in a broader sense, through the user interface.

In a more simplified and integrated perspective, in this embodiment, the CPU 308, the PIP processing unit 305, the memory 310, and the DSP 306 have a separate form, but form a single microcomputer. It can be seen as part. In addition, these components may be composed of one chip (ONE CHIP) as a whole, or two or more components may be combined with each other to form an appropriate number of chips.

Meanwhile, in the present embodiment, Ethernet is used as a connection medium between the video call device and the Internet, and it can be seen that Ethernet is used as a means of authentication and fee processing. Therefore, Ethernet is used as a representative form of a general LAN, and can be replaced by other forms of Internet connection.

On the other hand, using the memory device or other storage device coupled to the user interface in the present application will be able to store the external image, the counterpart's image and the user's image, respectively. These images may be used as evidence to confirm whether or not the other party's consent or permission of the oral contract was in operation.

According to one embodiment in which a video call is made through this embodiment, the input of the external video to the TV through the PIP processing apparatus is performed at all times. This external image forms the background or main screen of the TV. When a call signal (call request) of a call counterpart is received using a PSTN or Ethernet, a CID or the like may be displayed on a screen of a TV through a video call apparatus using a PIP or an OSD. Therefore, the user can recognize the incoming state of the call even while watching TV, and the user of the video call device can select to answer the call.

When the other party's video call device is connected, video and audio signals transmitted from the other party are inputted to the user's video call device. Signals received using the Internet or PSTN are compressed data signals and analog signals for transmission, which are directly transmitted to the DSP and become basic data (LAW DATA) for video and audio display.

The basic data is transferred to the CPU, and the CPU converts the basic data into video and audio signals that can be easily implemented on a TV according to a predetermined program. The converted voice and video signals are represented in a PIP method to the TV through the PIP processing apparatus. At the same time, the user's image obtained by operating the camera forms one of the PIP screens of the TV through the PIP processing apparatus.

On the screen of the TV, the background screen and the PIP-type screen are displayed as predetermined by the path to which the video signal is input. Through the user interface, the CPU converts the converted signal to the PIP processing apparatus so that the surrounding background screen and the PIP screen are interchanged. In this case, the voice signal may be output through a receiver coupled to a user interface, a handset connected to a modem, and a TV speaker, and two or more may be heard together in one speaker. This path of sound can also be switched according to the user's operation.

On the other hand, video and audio signals from external airwaves and cable broadcasts, and signals generated from cameras and microphones formed by the user, are input to the PIP processing unit and then transmitted to the TV. It is converted into compressed signal in turn and sent to the other party through the Internet or PSTN network.

The conversion of data or signals (including compression and decompression) between the network and the respective components associated with the video call device of the present invention is well known as the concepts and protocols are already well known as exemplarily described in the prior art description. Is omitted.

In the present invention, the TV is not necessarily limited to a commercially available TV receiver, and includes a general display device that can serve as a TV receiver, such as a computer monitor, but excludes a display device dedicated to a video call device.

Hereinafter, various embodiments of a video call device using the video call device of the present invention and a network connected to the device will be described with reference to FIG. 3.

First, the video call device 417 according to the present invention checks a password or an arbitrary setting value when there is a call request through the PSTN 415 in the general phone 413 or the mobile phone 411, and then the Internet network 430. The other video call device 427 may be called through the call. On the other hand, when there is a call for a telephone call from the other video call device 427 through the Internet network 430, the general telephone 413 or the mobile phone 411 can be connected through the PSTN network 415.

By combining the above two functions, it is also possible to act as an intermediary between a general telephone or a mobile phone using a video call device. That is, the video call device 417 checks the password or any set value included in the call signal when there is a call request through the corresponding PSTN 415 of the general phone 413 or the mobile phone 411, and then checks the Internet network ( 430, another video calling device 427 is called, and the other video calling device 427 is connected to the video calling device 427 via the PSTN 425 to which the video calling device 427 belongs. 423 or the mobile phone 421 is connected. In this case, the PSTN 415 to which one video call device 417 is connected and the PSTN 425 to which another video call device 427 is connected may be the same network. Is suitable for.

Although not shown in detail, the video call device 417 is connected to another video call device through the Internet network 430 when a transmission mode for transmitting the TV program being watched to the other video call device 427 is set. 427) to connect and transmit the TV program being watched. Conversely, when a TV program is received from the other video call device 427 through the Internet network 430, the same may be expressed on the TV screen of the video call device 417.

Also in this case, as in the case of a video call, the video call device 417 can record a TV program transmitted from another video call device 427 to a memory device or a recording device connected to a user interface.

In addition, although not specifically illustrated, a sensor for detecting an intruder in a secure space such as an infrared sensor or a motion detection sensor is attached to a user interface of one video call device 417 and another video call predetermined according to the detection signal of the sensor. An automatic call can be made to the device 427, the regular telephone 413, and the mobile telephone 411. In this case, when the video call function of the video call device 417 is used, an image obtained by an image capturing means such as a camera coupled to a user interface or operated independently may be transmitted together with an intrusion warning message, which serves as a kind of security device. can do.

In the above embodiments, the video signal and the data have been mainly described. However, the audio signal and the data may be handled in the same manner as the video signal and the data. Alternatively, audio signals and data may be made in a simpler manner than video signals and data. For example, voice received and transmitted in a general telephone or a mobile telephone via the PSTN can be processed directly through the transceiver of the telephone via a modem.

Although the present invention has been described in detail only with respect to the specific embodiments described, it will be apparent to those skilled in the art that various changes and modifications are possible within the technical scope of the present invention, and such modifications and modifications belong to the appended claims. .

1 is a block diagram showing a conventional general video telephone (MOIP) configuration.

2 is a block diagram showing the configuration of a video call device using a PIP according to an embodiment of the present invention.

3 is a block diagram schematically showing the configuration of a video call system for explaining a video call device utilizing method using a video call device of the present invention and a network connected thereto.

Claims (1)

LAN connection to the local area network (LAN) for Internet connection, Installed in parallel with the LAN connection, a modem for connecting to a public telephone network (PSTN), A digital signal processing device (DSP) for processing digital signals received by the LAN connection unit and the modem or converting internal signals into digital signals to be transmitted through a modem or LAN connection unit; A CPU which receives a basic signal obtained by processing the DSP to make a signal suitable for a TV system, or receives a signal or a camera signal through an airwave or cable broadcasting signal receiver and sends the signal to the DSP; A memory device connected to the CPU and storing a program and a protocol serving as a signal processing standard of the CPU; A PIP processing device receiving the airwave or cable broadcast signal, receiving a signal sent from the CPU and an adjustment command for image editing, and emitting an edited signal to arrange the image to be expressed in a predetermined manner; A TV receiving and displaying the edited signal of the PIP processing apparatus; It is provided with a user interface that is responsible for command input to the CPU, or used for inputting a separate signal to the CPU, When the PIP processing apparatus receives the airwaves or cable broadcasting signal or camera signal directly, the CPU receives a signal or a camera signal through the PIP processing apparatus indirectly through the PIP processing apparatus and sends the signal to the DSP. When the CPU directly receives the airwaves or cable broadcast signal or camera signal, the PIP processing apparatus is configured to receive a signal or a camera signal through the CPU indirectly through the CPU. Call device.

Images