KR100984111B1 - apparatus and method of process image in home network system - Google Patents

Abstract

The present invention provides a video and audio of the first visitor, the door apparatus for outputting the voice of the home user, and at least one of the video and audio of at least one second visitor, and outputs the video and audio of the home user A home network system including the above-described external communication device and a generation device that outputs the video of the first visitor or the second visitor to each of the divided screens, and processes a video call with the visitor corresponding to the screen selected by the user. By starting the user, the user of the home network system can check the video of the visitor at the same time through the household device, the user checks the video of a plurality of counterparts through the screen of the household device, and optionally enable a video call with the visitor will be.

Description

Apparatus and method of process image in home network system

The present invention relates to an image processing method and a device of a home network system, and more particularly, a user of a home network system can simultaneously check a visitor's image through a household device, and the user can view a plurality of images through the screen of the household device. The present invention relates to a video processing method and apparatus for a home network system that can check a video of a counterpart of a user and selectively make a video call with a visitor.

In general, the home network is installed in the home various communication equipment and control / monitoring equipment, and these are connected to the network or digital devices or equipment in the home / outside.

The system for realizing such a home network applies information and communication technology to the electronic devices used in the home to easily manage and operate the electronic devices in the home and abroad, thereby providing functions such as home security, disaster prevention, and access control. Included by default.

In general, home network systems use any one of the following communication networks: telephone line communication, power line communication (PLC), LAN cable communication, coaxial cable communication, and wireless communication. By working in conjunction with the Internet, you can control and manage all the systems in your home from the outside.

The home network system includes a service device, a core device, and a human device.

The service device refers to a product that realizes real value as a product targeted for a home network. Products corresponding to such service devices include household appliances such as gas, heating, lighting, curtains, ventilation, and security appliances, and information appliances such as air conditioners, washing machines, purifiers, TVs, home theaters, refrigerators, and microwave ovens.

The core device is an infrastructure of a home network that interfaces a service device to a human device, and means an expensive essential device or a product having low user value. Products corresponding to these core devices include generation devices such as gateways, home servers, blocking filters, hubs, and public equipment such as web servers, mail servers, and DHCP servers (Dynamic Host Configuration Protocol Servers).

A human device is a product that helps a user easily use a home network. It refers to a dedicated device such as a web pad, a web video phone, a wall pad, a home auto, and the like, and a combined device such as a personal PC, a mobile phone, a personal digital [data] assistant, a notebook, and the like corresponding to the human device.

A user of such a home network system can make a video call with a visitor who visits a front porch or a common porch through a wall pad.

However, in a typical home network system, when a user makes a video call through a generation device, another call request, that is, a call, processes as follows.

1) The home network system notifies the household device that there is another call when the user is in a video call through the household device, or informs that there is a call through a device other than the household device.

The user recognizes that there is a call in the video call state, and determines whether to answer the other call.

2) The home network system notifies the visitor who is calling at the front door or the common door when the user is in the video call state through the household device, indicating that the call is busy, and allows the visitor to call again later.

That is, a general home network system allows a user to make only one video call through a generation device.

However, with the development of electronic technology, the size of the display unit (for example, LCD) of the generation device of the home network system is increasing in size, and since the devices of the home network system are digitized, video communication and Video call requests are increasing.

Therefore, a method capable of simultaneous video call through a generation device of a home network system should be developed.

The present invention has been proposed to meet the above-mentioned needs, and an object thereof is to provide an image processing method and apparatus for a home network system in which a user of a home network system can simultaneously check a visitor's image through a household device. .

Another object of the present invention is to provide an image processing method and apparatus for a home network system in which a user of a home network system can check images of a plurality of counterparts through a screen of a generation device and selectively make a video call with a visitor. There is this.

According to an aspect of the present invention, there is provided a home network system including an entrance device that provides an image and a voice of a first visitor, and outputs a voice of an indoor user, and provides an image and an audio of at least one or more second visitors. At least one external communication device that outputs a video and audio of the video, and outputs a video of the first visitor or the second visitor to each of divided screens, and processes a video call with a visitor corresponding to a screen selected by the user. Includes household appliances.

The generation device processes a video call with a visitor corresponding to an image output through a screen selected by the user, and outputs an image of a visitor other than the screen selected by the user.

A generation device of a home network system according to another aspect of the present invention includes a network interface unit for connecting to at least one or more types of external communication devices through a network, and a codec unit for codec processing image information of a first visitor received from an entrance apparatus. A first buffer for temporarily storing video or audio data exchanged with the external communication device through the network interface unit, a second buffer for temporarily storing video or audio data exchanged with the door apparatus, and a voice of an indoor user A voice input / output unit for converting the signal into an electrical signal and outputting voice information received from the external communication device or the entrance device, a camera unit for capturing an image of the indoor user, and the external communication device or the entrance device A display unit for outputting the video information of the visitor received from A driver unit for driving the display unit, a data communication interface unit for transmitting high-speed data to the driver unit, and splitting the display unit into at least one screen according to a user's selection, and the network interface unit or the codec unit And a central control unit for outputting video information of the visitor received through the divided screen and processing a video call with the visitor corresponding to the screen selected by the user.

The central control unit may include a call processing unit configured to exchange video or audio data with the door apparatus or an external communication device called by a visitor corresponding to a screen selected by the user and perform video call processing.

The central controller is connected to the first buffer or the second buffer by a memory bus.

The central controller exchanges video and audio data with the external communication device and the network interface unit in a real time protocol (RTP) manner.

The central control unit transmits at least one kind of device and video and audio information by NTSC (National Television System Committee method).

The codec unit converts analog data received from the door apparatus into digital data, codec processes the digitally converted image information, and passes the second buffer to the central control unit through a second buffer in a CCIR (Comite Consultatif International de Radio-communition) scheme. send.

The data communication interface unit transmits data to the display unit through the driver unit in a low voltage differential signaling (LVDS) manner.

The central control unit divides the screen of the display unit into any one of a checkerboard type and an asymmetric type.

The central controller outputs a selection field in which the user can select a visitor who wants to make a video call among the plurality of visitors and an end field in which the video call can be terminated.

According to another aspect of the present invention, there is provided a method of processing an image of a home network system, wherein the generation device divides the display unit into at least one screen according to a user's selection, and if a visitor calls from an external communication device or an entrance device. And outputting an image of the visitor through the divided screen, and processing a video call with the visitor corresponding to the image selected by the user among the visitor images output through the divided screen.

The image processing method of the home network system further includes the step of transmitting, by the generation device, video or audio data to at least one or more types of devices by a National Television System Committee method (NTSC) method.

In the processing of the video call, only video information of visitors other than the visitor selected by the user is output through the corresponding split screen.

According to the present invention as described above, the user of the home network system can check the image of the visitor at the same time through the generation device, the user checks the image of a plurality of counterparts through the screen of the generation device, and optionally the visitor and the image You can call.

DETAILED DESCRIPTION Hereinafter, an image processing method and a device of a home network system according to an exemplary embodiment of the present invention will be described in detail with reference to the accompanying drawings. .

1 is a block diagram illustrating a home network system according to a preferred embodiment of the present invention.

Referring to FIG. 1, the home network system according to the present invention includes a generation device 100 that is built in a house, various types of devices 321 to 32n, installed in a front door, and captures a visitor's video to generate a generation device. And a door apparatus 310 for exchanging a visitor's voice and a user's voice, wherein the household device 100 is a household home appliance 210 of another household, a common entrance through a network (for example, a LAN). It is connected to the device 220 and the guard terminal 330 of the guard room.

The devices 321 to 32n refer to service devices, core devices, and human devices.

The door apparatus 310 includes a camera for capturing an image of a visitor, a microphone for receiving an audio signal, converting the signal into an electrical signal, and transmitting the same to the generation device 100, and a speaker for outputting the user's voice received from the generation device 100. And a keypad having a card reader for reading the information of the RF card, a call button for the visitor to call the household device 100, an outing button for selecting an outing function, and a door opening / closing unit for opening and closing the front door. Can be configured.

The other generation device 210 allows other in-house users to call the target generation device 100 through the network, and the common entrance device 220 allows a visitor who visits the common entrance to call the generation device 100. And, the guard terminal 230 is installed in the guard room, so that the guard can call the household device 100.

That is, the other generation device 210, the common entrance device 220, and the security terminal 230 exchange video and audio information so that an external counterpart can make a video call with an indoor user provided with the generation device 100.

In the following detailed description of the present invention, for convenience of description, a device for allowing an external counterpart to make a video call with an in-house user will be collectively referred to as an "external communication device 200," and a visitor who calls a user through the door device 310. Is referred to as a "first visitor", and the other party calling a user through the external communication device 200 is referred to as a "second visitor".

If there is a call from the door apparatus 310 or the external communication device 200, the generation device 100 calls a user in the home, and exchanges video and audio information with the door apparatus 310 or the external communication device 200. Have an indoor user conduct a video call.

2 is a block diagram illustrating a generation device according to the present invention.

Referring to FIG. 2, the generation device 100 according to the present invention includes the network interface unit 111 connecting to the external communication device 200 through a network, and the video information of the first visitor received from the entrance device 310. A first buffer 121 for temporarily storing data (video and audio information) exchanged with the external communication device 200 through the network interface unit 111, and a door apparatus ( And a second buffer 122 that temporarily stores data exchanged with 310.

In addition, the generation device 100 receives a voice of a home user, converts the signal into an electrical signal, and provides the same to the central controller 150, and outputs voice information received from the external communication device 200 or the door apparatus 310. An input / output unit 190, a camera unit 180 for capturing an image of an indoor user, and a storage unit 170 storing operation information and the like of the generation device 100 are included.

In addition, the generation device 100 may include a display unit 140 for outputting image information received from the external communication device 200 or the entrance apparatus 310, a driver unit 131 for driving the display unit 140, and The central controller 150 includes a data communication interface 112 that enables the image data to be transmitted to the driver 131.

Then, the generation device 100 controls the operation of each component of the generation device 100, and if there is a call from the visitor, calls the indoor user through the display unit 140 or the voice input / output unit 190 And a central control unit 150 for communicating with and controlling the indoor devices 321 to 32n through a home network, and the central control unit 150 includes an external communication device 200 and an entrance device 310 and a generation device 100. Includes a call processor 151 for controlling a video call.

In the following detailed description of the present invention, since the description of the home network function, home automation function, and the like of the home network system is well known, the detailed description thereof will be omitted.

Meanwhile, the generation device 100 may further include a keypad unit (not shown) for allowing a user to select a function of the generation device 100 or implement the display unit 140 of the generation device 100 in a touch screen manner. To allow the user to select a function of the generation device 100.

The network interface unit 110 corresponds to an Ethernet controller because the generation device 100 is connected to the external communication device 200 through a network, for example, a LAN, and receives data received from the external communication device 200 first. The data is stored in the buffer 121 and the data stored in the first buffer 121 is transmitted to the external communication device 200 through the network.

In this case, the generation device 100 and the external communication device 200 exchange real-time video and audio data in a real time protocol (RTP) manner through a network.

The central control unit 150 is connected to the first buffer 121 by a memory bus, and stores voice and video data of the user in the first buffer 121 and reads data stored in the first buffer 121. .

The storage unit 170 may be implemented with, for example, a differential double data rate (DDR) and is connected to the central controller 150 by a memory bus.

The central control unit 150 is connected to the devices 321 to 32n through a home network. For example, the central control unit 150 transmits the video and audio information of the visitor to the devices 321 to 32n by the NTSC (National Television System Committee method) method.

In this case, the central control unit 150 is a device capable of outputting video and audio information among the devices 321 to 32n, for example, a TV, a personal PC, a mobile phone, a personal digital [data] assistant (PDA), a notebook, and the like. Send voice information.

The codec unit 130 converts analog data into digital data from the entrance device 310, codec processes the digitally converted image information, and stores the image information in a second buffer (CCIR) method using a Comite Consultatif International de Radio-communition (CCIR) method. Through the 122, to the central control unit 150.

The data communication interface unit 112 allows the central control unit 150 to transmit data at high speed to the driver unit 131 and to transmit data in a low voltage differential signaling (LVDS) manner.

The call processor 151 divides the screen of the display 140 according to a user's selection, and when a plurality of calls occur simultaneously from the external communication device 200 or the door apparatus 310, the call processor 151 visits each divided screen. Handles video calls for calls the user answers while outputting video information.

That is, when a plurality of calls occur simultaneously, the call processor 151 outputs the video of the visitor for each call on the divided screen, and enables the video call with the visitor selected by the user through the video.

3A to 3E are diagrams illustrating screens of a generation device according to the present invention.

3A illustrates an image output through a display unit 140 when a user makes a video call with a visitor. When the generation device 100 has only one call, the generation device 100 is displayed through the entire screen of the display unit 140. Output the visitor's video.

3B illustrates a menu screen in which a user divides and sets a screen of the display 140, and it can be seen that a screen division function is added among functions of various generation devices 100.

3C illustrates a screen division method of the display unit 140. The screen division method may divide one or more screens into various types, such as a checkerboard type or an asymmetric type.

FIG. 3D illustrates an image of a visitor output on each divided screen when the screen is divided into a checkerboard type, and FIG. 3E illustrates an image of a visitor output on each divided screen when an asymmetrical screen is divided.

3D and 3E, each split screen includes a selection field (a) that allows a user to select a visitor who wants to make a video call among a plurality of visitors, and an end field (b) that can end the video call. do.

That is, when the central control unit 150 is simultaneously called from the front door device 310 and the external communication device 200, the central control unit 150 displays image information received from the front door device 310 and the external communication device 200 through each split screen. It outputs and exchanges video and audio data with the door apparatus 310 or the external communication device 200 corresponding to the split screen selected by the user so that the user can make a video call with the visitor.

When the user selects the end field (b) of the split screen, the central control unit 150 ends the video call, and when the user selects the selection field (a) on a split screen other than the split screen currently in the video call, Video call with the visitor of the split screen is enabled. That is, the central control unit 150 outputs the video information of each visitor to each split screen, and the exchange of the video and audio information is processed so that only the visitor of the split screen selected by the user is processed.

Therefore, after checking the video of the visitor displayed on each split screen, the user may assign a priority to make a video call or monitor the call of another visitor during the video call with the visitor.

In this case, when a load occurs in a function of outputting each visitor image information on a split screen, the generation device 100 includes an external screen processing means (not shown) for outputting the image information in which the load is generated. It is preferable to connect with 100.

In addition, since the central controller 150 simultaneously receives image information from the entrance apparatus 310 or the external communication device 200, the central controller 150 processes each image information through different application ports to simultaneously display a plurality of image information. Output to each split screen.

4 is a flowchart illustrating an image processing method of a home network system according to the present invention.

Referring to FIG. 4, the generation device 100 divides the screen of the display unit 140 into one or more according to a user input (S100).

The generation device 100 checks whether there is a call from the visitor through the entrance device 310 or the external communication device 200 (S110).

When there is a call from the entrance device 310 or the external communication device 200, the generation device 100 calls the indoor user through the voice input / output unit 190 or the devices 321 to 32n (S 120).

At this time, the generation device 100 transmits the video and audio information of the visitor to the devices (321 to 32n) in the NTSC (National Television System Committee method) method.

In this case, when there is one call, the generation device 100 outputs the visitor's image on the entire screen as shown in FIG. 4A.

When at least one call is simultaneously made from the entrance device 310 or the external communication device 200, the new device 100 outputs an image of each visitor to the divided screen of the display unit 140 (S 130).

In this case, as illustrated in FIG. 4C, the screen division of the display 140 may divide one or more screens into various types, such as a checkerboard type or an asymmetric type.

The generation device 100 processes the video call with the visitor corresponding to the screen selected by the user on the split screen of the user (S 140).

In this case, the generation device 100 processes the video call with the visitor selected by the user while outputting the video of the plurality of visitors called through each divided screen.

Although the present invention has been described in detail only with respect to the described embodiments, it will be apparent to those skilled in the art that various modifications and changes are possible within the technical spirit of the present invention, and such modifications and modifications belong to the appended claims.

1 is a block diagram illustrating a home network system according to a preferred embodiment of the present invention.

2 is a block diagram illustrating a generation device according to the present invention;

3A to 3E are diagrams illustrating screens of a generation device according to the present invention.

4 is a flowchart for explaining an image processing method of a home network system according to the present invention;

<Description of the symbols for the main parts of the drawings>

100: generation unit 111: network interface unit

112: data communication interface section 121, 122: buffer

130: codec unit 131: driver unit

140: display unit 150: central control unit

151: call processing unit 170: storage unit

180: camera unit 190: voice input / output unit

200: external communication device 210: other generation device

220: common entrance device 230: guard terminal

310: entrance device 321 to 32n: device

Claims (14)

In a home network system, An entrance device that provides a video and audio of a first visitor and outputs a voice of an indoor user; At least one external communication device providing video and audio of at least one second visitor, and outputting video and audio of an in-house user; And a generation device for outputting the video of the first visitor or the second visitor to each of the divided screens, and processing a video call with the visitor corresponding to the screen selected by the user. The generation device is a home network system for transmitting video or audio data to the NTSC (National Television System Committee method) to at least one device connected to it. The method of claim 1, wherein the generation device, Processing a video call with a visitor corresponding to an image output through a screen selected by the user, and outputting a video of a visitor other than the screen selected by the user. In the household device of the home network system, A network interface unit for connecting to at least one type of external communication device through a network; A codec unit for codec processing the video information of the first visitor received from the entrance apparatus; A first buffer configured to temporarily store video or audio data exchanged with the external communication device through the network interface unit; A second buffer for temporarily storing video or audio data exchanged with the door apparatus; A voice input / output unit for receiving a voice of an indoor user and converting the voice signal into an electrical signal and outputting voice information received from the external communication device or the entrance apparatus; A camera unit for capturing an image of the indoor user; A display unit configured to output image information of the visitor received from the external communication device or the entrance apparatus; A driver unit for driving the display unit; A data communication interface for high speed data transmission to the driver; According to the user's selection, the display unit is divided into at least one or more, and the image information of the visitor received through the network interface unit or the codec unit is output to the divided screen, and the screen selected by the user A central control for handling video calls with corresponding visitors, The central control unit is a generation device of a home network system, characterized in that for transmitting at least one kind of device connected to the video and audio information by the NTSC (National Television System Committee method) method. The method of claim 3, wherein the central control unit, And a call processing unit for exchanging video or audio data with the door apparatus or the external communication device called by the visitor corresponding to the screen selected by the user to perform video call processing. The method of claim 3, wherein the central control unit, Generation device of a home network system, characterized in that connected to the first buffer or the second buffer and a memory bus. The method of claim 3, wherein the central control unit, And a real-time exchange of video and audio data with the external communication device and the network interface unit in a real time protocol (RTP) manner. delete The method of claim 3, wherein the codec unit, Converting the analog data received from the door apparatus into digital data, and performing codec processing on the digitally converted image information, and transmitting the same to the central control unit through a second buffer in a CCIR (Commercial Consultatif International de Radio-communition) scheme. Generation apparatus of home network system to assume. The method of claim 3, wherein the data communication interface unit, Generation device of a home network system, characterized in that for transmitting data to the display unit through the driver unit in a low voltage differential signaling (LVDS) method. The method of claim 3, wherein the central control unit, The generation device of the home network system, characterized in that to divide the screen of the display unit into any one of the board type or asymmetric type. The method of claim 3, wherein the central control unit, And a selection field in which the user selects a visitor who wants to make a video call among the plurality of visitors, and an end field for ending the video call, on each of the divided screens. In the image processing method of a home network system, Dividing the display unit into at least one screen according to a user's selection; Outputting the visitor's image through the divided screen when there is a visitor's call from an external communication device or an entrance device; Processing a video call with a visitor corresponding to an image selected by the user among the visitor images output through the divided screens; And transmitting the video or audio data to at least one or more types of devices connected to the household device by the National Television System Committee method (NTSC). delete The method of claim 12, The image processing method of the home network system, characterized in that for outputting the image information of the visitor is not selected by the user of the visitor image output to the divided screen through the corresponding split screen.

Images