KR100850350B1 - Home Server having Multilateral Image Communication Using TV - Google Patents

Abstract

The present invention provides a set-top box unit for outputting the inputted video and audio on a TV; In the multi-way video call mode, video and audio of callers are input and synthesized into a single video and audio signal, and in the visitor mode, the visitor video and audio are input from the video phone and converted into digital video and audio and output to the set-top box unit. A video call matching unit; and checking the operation mode of the video call, and in the multi-party video call mode, the video voices of the callers are transferred to the video call matching unit, converted into a single video and audio signal, and then output to the set-top box, and the visitor If the mode is characterized in that it comprises a home server control unit for receiving the visitor video and audio from the following video call matching device to output to the set-top box function according to the user's absence setting or to the external mobile terminal set through an external network .

Home Server, Home Automation, MPEG4 Codec, Video Signal, Audio Signal, Video Call

Description

Home server having multilateral image communication using TV

1 is a block diagram showing the overall configuration of an embodiment of a home server system providing a video call function using a TV according to the present invention.

2 is a block diagram showing the configuration of an image processor in the video call matching device according to the present invention.

3 is a block diagram showing the configuration of an audio processing unit in the video call matching device according to the present invention.

Figure 4 is a block diagram showing the overall configuration showing another embodiment of a home server system according to the present invention.

5 (a) and 5 (b) are flowcharts illustrating a process of making a call by connecting to an external mobile terminal in the absence of a premises in a home server system having a multi-party video call function according to the present invention.

* Explanation of symbols for the main parts of the drawings *

100: home server system 120: video call matching unit

111: video phone 210: video codec unit

200: image processing unit 255: PCI interface unit

220: multi-channel MPEG4 codec unit 250: media interface unit

230: video quad unit 270: control unit

300: voice processing unit 310: audio separation unit

330: PCM codec unit 340: Audio mixer unit

350: multi-channel audio codec unit

The present invention relates to a system for providing a video call in a home server, and more particularly, to enable a user to make a video call with a visitor in real time through a TV, and also with an external caller received from an external telephone network. The present invention relates to a video call matching device and a home server system using a TV functioning as a video call server capable of a multi-party video call and making a video and audio of people who are calling together on a single screen.

In general, a home automation device transmits and receives an analog video signal and an analog audio signal to and from a video door phone installed outside the front door to check the visitor and control the front door. Implemented as a face, a two-wire interface is commonly implemented with the front door door lock device, and the home automation device is compatible with the video door phone and the door lock device.

On the other hand, a general video call system transmits a user's video and receives a counterpart's video, and only a call between the two is possible. In a multi-party video call, no video transmission is made or only a video of the first caller is transmitted.

In this regard, Korean Patent Application No. 10-2003-0071155, "Home Networking-based Video Telephone System," adds two-way video processing and voice functions to a gateway that builds a home networking system in conjunction with home automation (H / A). As a result, a technique for enabling video telephony at low cost is disclosed. However, the technology disclosed in the patent application proposes a technology for making only one-to-one video call, and recently, some service providers and home automation equipment companies have been provided with a service for checking a visitor and making a call. No service is available to enable this.

In order to provide such a multi-party video call service, it is necessary to quickly process video signals and audio signals of other people coming through an external network to make one screen and deliver them to users and other callers.

Therefore, the present invention has been made to solve the above-mentioned problems of the prior art, an object of the present invention is to receive the video and audio signal of the visitor coming from the video phone through the home server to deliver to the set-top box of the home server home users Its purpose is to allow people to watch TV screens and talk with visitors.

Still another object of the present invention is to receive the video and audio signals of external callers transmitted through the PCI interface of the home server through the PCI interface and combine them with the video and audio signals of the users in the home to make one screen and show them through the TV screen. At the same time, the purpose of the present invention is to provide an external caller who makes a call so that an external caller who has only one-to-one call function can view the same screen as a home user.

Another object of the present invention is to provide a service for automatically connecting an external telephone and a visitor call signal, which are called into a household, when the user is absent to an external mobile terminal which is set in advance by the user.

A construction means for achieving the above object, comprising: a set-top box unit for outputting the input image and audio to be reproduced on a TV; In the multi-way video call mode, video and audio of callers are input and synthesized into a single video and audio signal, and in the visitor mode, the visitor video and audio are input from the video phone and converted into digital video and audio and output to the set-top box unit. A video call matching unit; and checking the operation mode of the video call, and in the multi-party video call mode, the video voices of the callers are transferred to the video call matching unit, converted into a single video and audio signal, and then output to the set-top box, and the visitor If the mode is characterized in that it comprises a home server control unit for receiving the visitor video and audio from the following video call matching device to output to the set-top box function according to the user's absence setting or to the external mobile terminal set through an external network .

In addition, the present invention, a video call matching device for a home server having a set-top box function, PCI communication unit for transmitting and receiving control signals and video and audio data; In response to the control signal transmitted through the PCI interface unit, the visitor mode receives a visitor image from the video phone and converts the visitor image into a digital signal. An image processor to synthesize; According to the control signal transmitted through the PCI interface unit, the visitor mode receives a visitor voice signal from the video phone and converts it into a digital signal, and in the multi-way video call mode receives and mixes the voice signals of the callers from the PCI interface unit And a set-top box unit for synthesizing the visitor image and the voice or the multi-party caller and the image and the synthesized voice, which are converted by the image processing unit and the voice processing unit, to the TV.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings. It should be noted that the same elements among the drawings are denoted by the same reference numerals as much as possible even though they are shown in different drawings. In the following description of the present invention, detailed descriptions of related known functions or configurations will be omitted when it is determined that the present invention may unnecessarily obscure the subject matter.

1 is a block diagram illustrating an embodiment of a multi-party video call in a home server system having a multi-party video call function using a TV according to the present invention.
Referring to FIG. 1, a home server system includes a home server controller 270, a video call matching unit 120, and a set top box unit 260.
The home server controller 270 checks and notifies the operation mode of the video call set by the user, receives the video and audio of external callers transmitted from the external network 101, and transmits the video call to the video call matching unit 120. . When a video call operation is called by an external caller or visitor, the user determines whether the user is absent, and if the user is absent, the video and voice generated by the video call matching unit 120 are transmitted through the external network 101. Transmit to preset external mobile terminal. At this time, if the preset external mobile terminal can be implemented as any type of terminal that provides a communication function to a mobile phone, personal digital assistants (PDAs), computers, or the like, it can be arbitrarily set and changed by a user.
The video call matching unit 120 determines its operation mode under the control of the home server controller 270. Accordingly, the visitor mode obtains and outputs the visitor (or home user) video and audio through the video phone 102, and the video and audio of the external callers transmitted from the external network in the multi-way video call mode. And synthesized into a single screen and voice.
The set-top box unit 260 converts the video and audio output from the video call matching unit 120 into a signal form that can be reproduced by the TV 121 and provides the same to the TV 121.

delete

2 is a block diagram showing the configuration of the video call matching unit 120 according to the present invention, which may be included in the home server system or may be present as a separate device from the home server system.

Referring to FIG. 2, the video call matching unit 120 includes a PCI interface unit 260, an image processing unit 200, an audio processing unit 300, and a media interface unit 250.
The PCI interface unit 260 receives a control signal for notifying an operation mode and video and audio of external callers from the home server controller 270.
The image processing unit 200 determines the operation mode of the home server system by referring to the control signal transmitted through the PCI interface unit 260, and converts the visitor image from the video phone 111 into a digital signal in the visitor mode. In a multi-party video call mode, the visitor video and the video of external callers input through the PCI interface unit 260 are combined and output into one screen.
The voice processing unit 300 identifies the operation mode of the home server system by referring to the control signal transmitted through the PCI interface unit 260, and converts the visitor voice from the video phone 111 into a digital signal in the visitor mode. In the multi-party video call mode, the voice of the visitor and the voices of external callers input through the PCI interface unit 260 are synthesized and output into one voice.
The media interface 250 transmits the converted visitor image and audio or one screen and audio to the set-top box unit 260 through the image processing unit 200 and the audio processing unit 300.

3 is a block diagram showing the detailed configuration of the image processing unit 200 in the video call matching unit 120 according to the present invention.

Referring to FIG. 3, the image processor 200 includes a video codec unit 210, a multi-channel MPEG4 codec unit 220, and a video quad unit 230.
The video codec unit 210 decodes the visitor image obtained through the video phone 111 in the form of a digital signal.
The multi-channel MPEG4 codec unit 220 receives the decoded visitor image and the video of at least one external caller received through the home server controller 270, and each of them is CCIR656 type image of several channels through time division process. Convert to Each of CCIR656 video images of various channels is converted to an analog signal and then compressed using MPEG4 video.
The video quad unit 230 combines the compressed images into one screen and transmits the compressed images to the set top box unit 260.

Here, the CCIR656 method is a recommendation that defines coding parameters of a digital TV. A signal output by the CCIR656 standard has a frequency of 13.5 MHz, and a video signal having such a frequency has a resolution of 720 x 480. In the display, it is used as an international standard as a suitable signal applicable to various methods.

In addition, the signals of the CCIR standard can be displayed on a VGA computer monitor having a resolution of 640 × 480 as well as a TV monitor of about 400,000 pixels having a resolution of 720 × 480.

4 is a block diagram showing the detailed configuration of the audio processing unit 300 in the video call matching device 120 according to the present invention.

Referring to FIG. 4, the voice processor 300 includes an audio separator 310, a filter 320, a multi-channel audio codec 350, and an audio mixer 340.
The audio separation unit 310 separates the analog voice signal input and output from the speaker and the microphone of the video phone 111 into an input and an output by a half-duplex method.
The filter unit 320 removes noise by filtering the separated analog voice signal, and the multi-channel audio codec unit 350 decodes the analog voice signal from which the noise is removed into a digital voice signal, and then has a higher quality than the noise. Converts to PCM (Pulse Code Modulation) signal to transmit information.
The multi-channel audio codec unit 350 receives voice signals of at least one or more external callers received from the external network 101 through the home server controller 270 in the multi-way video call mode, and converts them to the standard of IS2. .
The audio mixer 340 mixes the visitor voice converted into the PCM signal and the voices of external callers converted into the IS2 standard into one voice.

Here, IS2 (Inter-IC Sound) is a serial bus design for digital audio devices and technologies such as CD players, DSPs, digital TV sounds, and the like. In I2S designs, audio data is processed separately from the clock signal.

In addition, the Pulse Code Modulation (PCM) codec unit 330 can be combined with other digital data in a common network in the same format, and has a strong advantage in noise and interference, thereby effectively reproducing a coded signal during transmission. Application of is appropriate.

The operation of the home server system having the multi-party video call function using the TV of the present invention configured as described above will be described.

First, in the visitor mode, the analog video signal received from the video phone 111 is decoded by the video codec unit 210 using the NTSC method and converted into a digital video signal.

Here, the NTSC (National Television System Committee) method is a standard standard of broadcast video media mainly used in North America, Canada, Mexico, and Japan.

Subsequently, the converted video signal is compressed in the multi-channel MPEG4 codec unit 220 and transmitted to the media interface unit 250.

In addition, the audio separating unit 310 separates the voice signal of the visitor from the analog voice signal input through the microphone of the video phone 111 into a half-duplex method and separates the analog voice signal into an input and an output to remove noise. To pass to the filter unit 320 for. The PCM codec unit 330 converts the noise-removed analog voice input signal into a PCM signal through the analog-to-digital conversion process, and transmits the analog voice input signal to the audio mixer unit 340, and the I2S interface of the audio mixer unit 340. Transfer to the media interface unit 250 through.

Thereafter, the converted and received video and audio signals of the visitor are transmitted to the set-top box unit 260 through the media interface 250 and output to the TV 121.

The visitor can make a video call with the visitor in real time with the video and audio signal of the visitor output through the TV screen and the speaker.

In addition, in the multi-party call mode, first, the video signal of the home caller input from the video phone 111 is decoded by the video codec unit 210 using NTSC and time-divided. Converts the compressed video signal of the external callers received from the home server controller 270 through the PCI interface 255 into a predetermined format in the multi-channel MPEG4 codec unit 220, and converts the compressed video signal into a predetermined format. The video signal of the external callers and the decoded video signal are input to each channel, summed into one screen by the video quad unit 230, transferred to the media interface unit 250, and simultaneously transferred to the media interface unit 250. After compressing using the MPEG4 method, the home server is transmitted to the external telephone network 101 through the home server control unit 270 and transmitted to other callers.

In addition, in the multi-way video call mode, the analog voice signal of the indoor caller transmitted through the video phone 111 is separated from the audio separation unit 310 by a half-duplex method, and the filter unit 320 is used. Removes the noise of the speech signal separated from and decodes it, converts it into a PCM signal, receives the speech signal of at least one external caller received from the external network 101, and converts it into a predetermined format. After mixing the voice signal and the voice signal of the external callers received from the external network 101 through the home server controller 270 in the audio mixer 340, and transmits the voice signal to the media interface 250.

The video and audio signals transmitted to the media interface unit 250 are transmitted to the set-top box unit 260 and output to the TV 121.

The video and audio signal of the indoor call is preferably a signal input through the camera of the indoor video phone and the microphone of the handset.

In addition, the home server system having a multi-party video call function using a TV according to the present invention, as described above, allows the user to automatically connect to an external mobile terminal when the user is absent.

Referring to the process of automatically connecting to an external mobile terminal in the absence of a home in more detail with reference to Figure 5 (a), (b), first, Figure 5 (a) is a visitor mode (S500), the home server control unit 270 ) Synthesizes the video and audio of the visitor received through the video phone 111 (S510).

The home server controller 270 checks the visitor user outing mode and determines whether there is a person in the home or not (S520).

The home server controller 270 synthesizes the video and audio of the visitor through the video call matching unit 120 and outputs it to the set-top box unit 260 (S550). The video call matching unit 120 transmits the synthesized video and audio signal to the set mobile terminal (S540).

In addition, FIG. 5 (b) shows that in the multi-party video call mode (S600), the home server controller 270 synthesizes video and audio of external callers received through the external network 101 (S610).

The home server controller 270 checks the user's outing mode and determines whether there is a person in the home or not (S620).

In this case, when the user makes a home call when the user goes out, the user may set the outing mode to automatically connect to an external mobile terminal.

The home server controller 270 synthesizes the video and audio of external callers through the video call matching unit 120 and outputs the set-top box unit 260 when there is a person in the home according to the user's setting. In operation S640, the video call matching unit 120 transmits the synthesized video and audio signal to the set mobile terminal at operation S650.

The detailed description and contents of the drawings described above are limited to the preferred embodiments of the present invention, and the present invention is not limited thereto. It will be possible to substitute, change or delete the components according to the present invention within the scope of the technical idea of the present invention.

Therefore, the scope of the present invention should be determined by the appended claims rather than by the foregoing description and drawings.

As described above, the home server system having the visitor identification function and the multi-party video call function according to the present invention converts the video and audio signals of the visitor of the videophone to the TV without affecting the home automation apparatus and transmits them to the TV. Allows the user to have a video call with the visitor in real time.

In addition, it is possible to have a multi-party video call with external callers received from an external telephone network, and it has the effect of acting as a video call server that delivers the video and audio of people who are talking together to one screen.

In addition, in the absence of a home, not only is it quickly connected to an external user mobile terminal, but also enables a multi-party video call in real time.

Claims (13)

In the visitor mode, a video call match is obtained by acquiring and outputting visitor video and audio through a video phone, and in the multi-way video call mode, the visitor video and audio and the video and audio of external callers are combined and output into one screen and voice. part; And It detects the operation mode of the video call and receives the video and voice of the external callers transmitted from the external network to provide to the video call matching unit, and in the absence of the user the video and audio output from the video call matching unit in the external network A home server control unit provided to an external terminal through a terminal; And And a set-top box unit configured to convert the video and audio output from the video call matching unit into a signal form reproducible by the TV. The method of claim 1, wherein the video call matching unit, A PCI interface unit for receiving a control signal for notifying an operation mode from the home server controller and video and audio of the external callers; The operation mode of the home server system is identified with reference to the control signal, and in the visitor mode, the visitor image is obtained and output through the video phone. In the multi-way video call mode, the video of the external callers and the visitor are displayed. An image processor configured to output an image summed into one screen; The operation mode of the home server system is identified with reference to the control signal, and the visitor voice is obtained through the video phone in the visitor mode and output. The voice of the external callers and the visitor in the multi-way video call mode. A voice processing unit for adding and outputting voices into the single voice; And And a media interface for transmitting the video and audio output from the video processing unit and the audio processing unit to the set-top box unit. The method of claim 2, wherein the image processing unit, A video codec unit which obtains the visitor image through the video phone and decodes the output image; A multi-channel MPEG4 codec unit configured to receive the decoded visitor image and the image of the external callers, separate them for each channel, and convert the compressed visitor image into a predetermined data format and output the converted data; And And a video quad unit configured to combine the converted and compressed images for each channel into the one screen and output the combined video to the set top box unit. The method of claim 3, wherein the multi-channel MPEG4 codec unit, The home server system having a video call function using a TV, characterized in that for converting each of the compressed video and the video of the external callers to a data format of CCIR656 standard. The method of claim 3, wherein the video codec unit, A home server system having a video call function using a TV, characterized in that decoding is performed by NTSC (National Television System Committee) method. The method of claim 2, wherein the voice processing unit, An audio separation unit for separating the visitor voice input and output through the video phone into an input and an output; A filter unit to remove noise of the separated visitor voice; A PCM codec unit for converting the noise canceled visitor's voice into a PCM signal; A multi-channel audio codec unit for converting voices of the external callers into a predetermined format; and And an audio mixer for adding the converted visitor's voice and the converted external caller's voices into the single voice. The method of claim 6, wherein the multi-channel audio codec unit, The home server system having a video call function using a TV, characterized in that for converting the voice of the external callers to the data format of the I2S (Inter-IC Sound) standard. A video call matching device for a home server having a set top box, A PCI interface unit for receiving a control signal for notifying an operation mode of a video call and video and audio of external callers; The operation mode is identified with reference to the control signal, and in the visitor mode, the visitor image is obtained and output through the video phone. In the multi-way video call mode, the video of the external callers and the visitor image are combined into one screen. An output image processor; The operation mode of the home server system is identified with reference to the control signal, and the visitor voice is obtained through the video phone in the visitor mode and output. The voice of the external callers and the visitor in the multi-way video call mode. A voice processor for adding the voices together into one voice and outputting the voices; And And a media interface for transmitting the video and audio output from the video processing unit and the audio processing unit to the set-top box. The method of claim 8, wherein the image processing unit, A video codec unit which obtains the visitor image through the video phone and decodes the output image; A multi-channel MPEG4 codec unit configured to receive the decoded visitor image and the image of the external callers, separate them for each channel, and convert the compressed visitor image into a predetermined data format and output the converted data; And And a video quad unit configured to combine the converted and compressed images for each channel into the single screen and output the set to the set top box unit. The method of claim 9, wherein the multi-channel MPEG4 codec unit, And a video call matching device for converting each of the compressed video and the video of the external callers into a data format of CCIR656 standard. 10. The method of claim 9, wherein the video codec unit, A video call matching device using a TV, characterized in that for performing decoding by the National Television System Committee (NTSC) method. The method of claim 8, wherein the voice processing unit, An audio separation unit for separating the visitor voice input and output through the video phone into an input and an output; A filter unit to remove noise of the separated visitor voice; A PCM codec unit for converting the noise canceled visitor's voice into a PCM signal; A multi-channel audio codec unit for converting voices of the external callers into a predetermined format; and And an audio mixer for adding the converted visitor voice and the converted external callers into one voice. The method of claim 12, wherein the multi-channel audio codec unit, And a video call matching device for converting the voices of the external callers into a data format of an I2S (Inter-IC Sound) standard.

Images