KR101425428B1 - Display apparatus and control method thereof - Google Patents

Abstract

A display device for performing image communication is disclosed. The present display apparatus includes an image communication section that includes an image capturing section that captures an image and that performs image communication using an image captured through the image capturing section and a display section that displays at least one of the image capturing section and the image communication section And a controller for controlling one operation of the display device, thereby increasing the power efficiency of the display device.

Video communication, luminance, camera module

Description

[0001] The present invention relates to a display apparatus and a control method thereof,

1 is a block diagram showing a configuration of a display device according to an embodiment of the present invention.

2A and 2B are schematic diagrams of the display device shown in FIG.

3 is a block diagram showing a detailed configuration of the display device shown in FIG.

4 is a block diagram showing the configuration of a display device according to another embodiment of the present invention.

5 is a block diagram showing a configuration of a display device according to another embodiment of the present invention.

6 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.

FIG. 7 is a flowchart for explaining an embodiment of the method of controlling the display device shown in FIG. 6 in detail.

FIG. 8 is a flowchart for explaining another embodiment of the control method of the display device shown in FIG. 6 in detail.

[Description of Drawings]

100, 400, 500: display device 110, 410, 510:

120, 420, 520: Control unit 111, 511:

112, 512: power supply unit 113, 513: data input unit

114, 514: Data transmitting / receiving unit 530:

540: Display processor

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device and a control method thereof, and more particularly to a display device and a control method thereof for performing image communication.

The current and future communication environments are rapidly changing beyond the distinction between wireline and wireless areas and between regional countries. In particular, the future communication environment represented by IMT-2000 and the like is becoming an environment that provides various information required by the user in real time or in a comprehensive manner as well as video and audio. In addition, development of a personal mobile communication system is not limited to voice communication only in a cellular phone or a PCS, so that it is possible to transmit character information, access the Internet wirelessly using a personal portable communication terminal, To be transmitted and received.

In particular, video transmission technology is an indispensable element in a digital television system that processes moving pictures into digital data, transmits them in real time, receives and displays them, and personal portable terminals that process moving pictures in real time using IMT-2000 It is the fact that it is catching. This is due to the fact that the portable terminal is supposed to transmit and receive only human voice, but due to the development of multimedia and the development of digital information processing technology, various information such as voice and image can be transmitted. The development of such a communication technology and the development of a moving image compression technique enable a video communication in a multimedia environment in which not only a voice but also a voice of a communicator is transmitted and received.

Videoconferencing is a technology that allows video and audio to be transmitted simultaneously through a communication network to computers that are separated from each other, so that people who are away from each other can use video conferencing and video telephony. Video communication enables video communication using a PC camera, video chatting, video communication using a video phone (video phone) as well as video communication / video communication using a mobile communication terminal.

On the other hand, when image communication is performed using a display system capable of image communication, image capturing is performed irrespective of the state of the image captured by the image communication. That is, when the captured image is too bright or dark, or is an image that has been stopped for a predetermined time or longer, useless images continue to be picked up. In this case, there is a problem that power is continuously applied to the camera module related to the image scraping function.

In addition, when the image communication is not performed, that is, when the operation using the other functions of the display device is performed, power is applied to the camera module and the power efficiency of the display device is lowered.

It is an object of the present invention to provide a display device capable of increasing the power efficiency of a display device by controlling image pick-up or not in consideration of whether or not image communication is performed and the state of an image according to image communication, And a control method thereof.

According to one embodiment of the present invention for achieving the above object, there is provided a display apparatus including an image communication section that includes an image sensing section for sensing an image, and performs image communication using an image sensed through the sensing section; And controlling the operation of at least one of the imaging unit and the image communication unit when the status of the image is a preset condition.

Preferably, the image communication unit includes: a power supply unit that supplies power to the image sensing unit; a data input unit that receives communication data; and a control unit that transmits image communication data including the sensed image and the communication data to an external device, And a data transmission / reception unit for receiving the image communication data generated by the external device.

More preferably, the control unit controls the data transmission / reception unit to prevent the image communication data from being transmitted if the state of the sensed image is the predetermined condition.

Preferably, the control unit may cut off power supplied to the image sensing unit when the state of the sensed image is the predetermined condition.

Preferably, the predetermined condition is that the brightness of the sensed image is equal to or greater than a predetermined first threshold brightness or less than a predetermined second critical brightness.

Also, preferably, the predetermined condition is that the captured image is in a still image state for a predetermined threshold time.

Preferably, the image communication apparatus further comprises an input section for receiving an image communication execution command, wherein the image communication section is activated when the image communication execution command is input or when image communication data is received through the data transmission / reception section, Communication operation can be performed.

Still preferably, the control unit may interrupt power supply to the image sensing unit while the image communication unit is in an inactive state.

The display unit may further include a display unit for selectively providing one of the image communication result data performed by the image communication unit and the received data received from the external device under the control of the control unit .

According to an embodiment of the present invention, there is provided a method of controlling a display device for performing image communication, comprising the steps of: (a) capturing an image and performing image communication using the captured image; (b) Judging whether or not the state of the image satisfies a predetermined condition; and (c) stopping the imaging processing operation when the predetermined condition is satisfied.

More preferably, the step (a) includes the steps of: supplying power to an imaging unit for imaging an image; capturing an image; inputting communication data; and transmitting the captured image and the communication data And transmitting the image communication data to the external device and receiving the image communication data generated by the external device.

Further, preferably, in the step (c), the image communication data may not be transmitted if the state of the captured image is a predetermined condition.

Preferably, in the step (c), the power supplied to the image sensing unit may be cut off if the state of the sensed image is a predetermined condition.

Preferably, the predetermined condition is that the brightness of the sensed image is equal to or greater than a predetermined first threshold brightness or less than a predetermined second critical brightness.

Also, preferably, the predetermined condition may be that the captured image is in a still image state for a predetermined threshold time.

Preferably, the method further comprises the step of receiving a command for performing image communication, wherein the step (a) includes the step of, when the image communication execution command is input or when the image communication data is received, You can do the work.

Still preferably, in the step (c), power supply to the image sensing unit can be interrupted while the image communication operation is not performed.

Preferably, the method further comprises selectively displaying one of the image communication result data in accordance with the image communication and the received data received from the external device.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a display device according to an embodiment of the present invention. 1, the display device 100 includes an image communication unit 110 and a control unit 120. [

The display device 100 can be implemented as a video communication device and the video communication device can be connected to the video communication device 100 using a LAN (Local Area Network), a WAN (Wide Area Network), or a MAN (Metropolitan Area Network) It is possible to transmit and receive voice, image and the like necessary for communication.

The display device 100 may also provide selective video communication with a plurality of parties. That is, when a user receives a telephone call request message from another party during a video communication with a specific counterpart, the user can switch a call in the video conversation to a wait state first and make a received call later. At this time, it is preferable that the image and the voice of the other party are not received by the display device of the other party in the standby state.

In addition, the user may perform video communication with a plurality of other parties at the same time, and may conduct video communication with a plurality of other parties by selecting or removing a specific party from the list of the parties displayed on the screen.

2A and 2B are views showing a schematic view of the display device shown in FIG.

As shown in FIG. 2A, the display device 100 can be implemented as an image communication device including a PC function therein. When the external PC 10 is connected and used as shown in FIG. 2B, the display device 100 operates as a monitor May be possible.

2A, an application program by the control unit 120 in the display device 100 may be displayed on the screen when the display device 100 is implemented solely.

Alternatively, when an external PC is implemented as being connected to the display device 100 as shown in FIG. 2B, an application program input from the external PC may be displayed on the screen. However, this is merely an embodiment for explaining an embodiment of the display device 100, and may be implemented in various forms depending on the case.

The image communication unit 110 serves to capture an image according to image communication and perform image communication. That is, it is possible to transmit and receive image communication data in accordance with image communication, and to process the image communication data received from another display device so as to be displayable. In addition, a signal input through a camera (not shown) may be transmitted to another display device.

The image image picked up through the camera is transmitted to the display device main body 100 and transmitted to the external display device through a network interface unit (not shown). User display devices connected to each other via a network can exchange information with each other according to a defined communication protocol. That is, information including image information, audio information, and character information can be exchanged. The information is generally compressed and transmitted in order to improve the communication speed. In this case, the video communication program to be used is programmed according to a predefined protocol, so that only image data can be separated from the data transmitted to the network interface unit (not shown) and output on the screen.

The camera converts the captured image into an electrical signal, and the converted signal is transmitted to a display device of a desired communication network user through a network interface (not shown) and displayed on the screen. In addition, the camera can track, detect, magnify and transmit only the user's face or upper body, in order to protect the personal privacy of the user. Therefore, the tracking and detection function may not be applied depending on the setting of the user.

In addition, the display device 100 may include a microphone-array (not shown). The microphone array is composed of a plurality of microphones, each microphone receiving a user's voice signal, and the received voice signal is analyzed to ascertain an approximate user's location.

Accordingly, the display device 100 not only tracks and detects a user's face or an upper half of the user at an identified position using a camera and a microphone array, but also removes voice signals coming from different directions about the position It is possible to amplify only the voice signal coming from the direction of the user's position.

The control unit 120 stops the imaging operation for image communication when the state of the image captured by the image communication unit 110 satisfies predetermined conditions. Here, the state of the captured image can be used to include not only the state of the image captured by the camera but also the state of the camera for capturing the image, that is, whether or not the camera is being used. In addition, the stop condition may be used in a meaning including a condition related to the condition of the image being captured, as well as a condition related to whether or not to use the camera for capturing the image.

The control unit 120 may be any of various methods such as a method of shutting off the power supply to stop the imaging operation, a method of controlling the transmission of the captured image to the external device, a method of controlling the display of the image data generated by the external device The imaging operation can be stopped.

3 is a block diagram showing a detailed configuration of the display device according to FIG. 3, the display device 100 includes an image communication unit 110 and a control unit 120. The image communication unit 110 includes an image sensing unit 111, a power supply unit 112, a data input unit 113, And a data transmission / reception unit 114.

The image pickup section 111 serves to pick up an image according to image communication. Here, the imaging unit 111 may be implemented as a camera module that performs an operation related to an imaging operation. The camera, which is a component of the image pickup unit 111, may be implemented as a camera attached to the body of the display device 100 and may be implemented as an external camera requiring a separate connection with the display device 100 It is also possible. In addition, the camera may be implemented as a camera integrated with the viewfinder as the case may be.

On the other hand, when camera selection, recording, capturing, and other adjustments are required during image communication, a control switch (not shown) (for example, a still image shooting switch, a still image shooting switch, Recording switch or the like) can be operated so that a desired image communication / photographing / recording / capturing function can be performed.

The image pickup section 111 allows an image to be picked up in accordance with a function selected by a user's operation (such as a still image pickup, a still-picture continuous image pickup, a moving image pickup, etc.) To the main body of the display device 100. [ Further, when the camera is implemented by a viewfinder-integrated camera, it is also possible to display the captured image directly in a viewfinder (not shown).

The power supply unit 112 serves to supply power to the image pickup unit 111 and may also supply power necessary for the operation of the display device 100.

The power supply unit 112 may be located outside the image communication unit 110. The power supply unit 112 may be located outside the image communication unit 110 in some cases.

The control unit 120 can cut off the power supplied to the image pickup unit 111 by controlling the power supply unit 112 when the state of the image to be captured satisfies predetermined conditions. In addition, it is possible to control whether or not to transmit an image to an external device according to the state of the captured image, and to control whether or not to display image data generated by an external device.

Specifically, when the brightness of the image captured by the image capturing unit 111 is out of the predetermined brightness range, the control unit 120 determines that the preset condition for the image capturing operation is satisfied and can stop the image capturing operation. Here, the brightness is represented by a light intensity per unit area, and a unit called a stilb (symbol is sb) or a knit (nit. That is, if the brightness of the sensed image is equal to or higher than the predetermined first threshold brightness or equal to or lower than the predetermined second threshold brightness, it can be determined that the predetermined condition is satisfied.

The controller 120 separates a color signal and a luminance signal from a video signal input through a camera by a color / luminance separator (not shown), and the luminance level of the luminance signal separated by the luminance measuring unit (not shown) , It can be determined whether or not the measured luminance meets predetermined conditions. In this case, the reference luminance range may be preset, and the luminance range may be preset based on the first threshold luminance, which is the upper critical luminance, and the second critical luminance, which is the lower critical luminance. Here, the threshold luminance is preset by the manufacturer of the display device 100, or may be manually set / changed by the user as the case may be. Also, it may be possible to update internally according to the use state of the display apparatus 100. [ Since such a luminance determination method is well known, further explanation is omitted.

If the image captured by the imaging unit 111 is a still image for a predetermined threshold time, the control unit 120 may determine that the predetermined condition is satisfied and stop the imaging operation of the imaging unit 111 .

In order to determine whether a captured image is a still image, for example, in order to judge whether a captured image is a still image, a method of determining whether a captured image is a still image, (Summed Absolute Difference). Then, the absolute variation between the calculated SADs is calculated, and it is determined whether the input video signal is a still image based on the calculated SAD and the absolute variation. Since such a still image determination method is known, a further description will be omitted.

The data input unit 113 serves to receive communication data. The data input unit 113 can be realized by a microphone receiving a voice or an external input device such as a keyboard or a mouse provided in the display device 100 itself and receiving data for communication such as voice data and character data have.

The data transmission / reception unit 114 transmits the image captured by the image capture unit 111 and the image communication data including the communication data input by the data input unit 113 to the external device, and the image communication data As shown in FIG. Here, the external device can be implemented by an apparatus having the same configuration as that of the display apparatus 100, and can also be implemented by various apparatuses capable of image communication such as a portable terminal and a PC.

The control unit 120 may control the data transmission / reception unit 114 to prevent the image communication data from being transmitted when the state of the captured image satisfies a predetermined condition.

4, the display device 400 includes an image communication unit 410, a control unit 420, and an input unit 430. The detailed description of the elements shown in FIG. 4 will be omitted for the elements overlapping with the elements shown in FIG. 1 and FIG.

The input unit 430 receives an image communication execution command from the user. The input unit 430 may be implemented as an external input device such as a keyboard or a mouse or a remote control connected to the key panel or the display device 400 provided in the display device 400 itself or wirelessly, As shown in FIG. Here, the image communication execution command may be any user command that allows the display device 400 to perform an image communication function, that is, a predetermined menu selection, a specific key input, or the like.

In addition, the input unit 430 may receive a selection signal for size adjustment, area spacing, area concealment, etc. of an area where an image according to image communication is displayed.

The image communication unit 410 is activated when the image communication execution command is input through the input unit 430 or when the image communication data is received through the data transmission / reception unit 114, and performs the image communication operation.

In this case, the control unit 420 can cut off the power supply to the image pickup unit 111 while the image communication unit 410 is in the inactive state. That is, when an image communication execution command is input through the input unit 430 or image communication data is received through the data transmission / reception unit 114, the control unit 420 supplies power to the image pickup unit 111, . ≪ / RTI >

5 is a block diagram showing another example of the configuration of the present display device. 5, the display device 500 includes an image communication unit 510, a control unit 520, a display processing unit 530, and a display unit 540. 5, detailed description of the parts overlapping with the embodiments shown in Figs. 1, 3 and 4 will be omitted.

The display unit 540 serves to display an image according to image communication and a screen related to a general operation of the display apparatus 500. [ Here, the screen related to the general operation may be, for example, a window screen when a PC function is used. In this case, the display unit 540 may be implemented as a plasma display panel (PDP), a liquid crystal display (LCD), or a cathode ray tube (CRT) panel.

When a video call is made by a user or an opponent's video call attempt while a screen according to a user's general operation is displayed, the display unit 540 displays a video screen according to a video call Can be overlapped and displayed. In this case, the image screen according to the video call may be a screen on which the state of the calling party is displayed, or a screen on which the state of the calling party itself is displayed.

The display processing unit 530 can display an image according to the image communication on at least a part of the entire screen displayed on the display unit 540. [

That is, the display processor 530 may display an image according to a video call in a partial area of the screen as a sub-screen in a state where a screen according to a user's operation related to other functions of the display device 500 is displayed. In this case, the size of the area where the image according to the video call is displayed on the screen at the beginning of the video call may be pre-set by the user or may be pre-set by automatic adjustment of the display device 500. It can also be adjusted in real time by the user.

The display processor 530 may include a first receiver (not shown) for receiving an output signal of the external device 10 and a second receiver (not shown) for receiving an output signal of the controller 520 . In this case, the display processor 530 selects one of the first receiver (not shown) and the second receiver (not shown) under the control of the controller 520 and outputs the output signal received through the selected receiver to the display unit 540 ). Here, the external device 10 can be implemented by various devices such as a PC (Personal Computer), a TV, a DVD (Digital Versatile Disc), and a PVR (Personal Video Recorder).

6 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention. According to the display device control method of FIG. 6, when an image of the user is captured and an image processing operation is performed (S610), it is determined whether the state of the captured image satisfies predetermined conditions (S620).

As a result of the determination in step S620, if the state of the captured image satisfies the predetermined condition, the image capturing operation for the image communication is stopped (S630).

Further, according to the control method of the present display device, it is possible to selectively display one of the image communication result data according to the image communication and the received data received from the external device.

FIG. 7 is a flowchart for explaining an embodiment of the display device control method shown in FIG. 6 in detail. According to the control method of the display apparatus shown in FIG. 7, if an image of the user is captured and an image processing operation is performed (S710), whether or not the brightness of the captured image is included in a predetermined range is checked (S720)

If it is determined in step S720 that the brightness of the sensed image is not included in the predetermined range (Y in step S720), that is, if the brightness of the sensed image is equal to or greater than the predetermined first threshold brightness, State, the power supply to the camera module performing the scratching operation is interrupted to stop the imaging operation (S730).

If it is determined in step S720 that the brightness of the sensed image is included in the predetermined range (S720: N), that is, if the brightness of the sensed image is less than the predetermined first threshold brightness, In the case of the state, it is determined whether the captured image is a still image for a predetermined threshold time (S740).

If it is determined in step S740 that the captured image is a still image for a preset threshold time (S740: Y), the power supply to the image sensing unit for performing the scratching operation is interrupted to stop the image sensing operation (S730).

In this embodiment, the flowchart is configured to determine whether the luminance of the captured image is within a predetermined range, and to determine whether the captured image is a still image for a predetermined threshold time, but the determination order may be changed .

8 is a flowchart illustrating a method of controlling a display device according to another embodiment of the present invention. According to the control method of the display device shown in FIG. 8, it is checked whether an image communication execution command is input (S810).

As a result of the determination in step S810, if a video communication command has been input (S810: Y), power is supplied to the imaging unit that performs the imaging operation. Subsequently, an image is captured and communication data is input (S820). Then, the image communication data including the captured image and the input communication data is transmitted to the external device, and the image communication data generated by the external device is received (S830). Here, the image pickup section may be embodied as a camera module that performs an operation related to image pickup.

As a result of the determination in step S810, if no image communication command has been input (S810: N), whether or not image data is received from an external device is checked (S840).

If it is determined in step S840 that the image communication data has been received (S840: Y), power is supplied to the image capturing unit that performs the image capturing operation. Subsequently, an image is captured and communication data is input (S820). Then, the image communication data including the captured image and the input communication data is transmitted to the external device, and the image communication data generated by the external device is received (S830).

If it is determined in step S840 that the image communication data has not been received (S840: N), power supply to the image sensing unit for performing the image sensing operation is interrupted (S850).

In addition, it is possible to selectively display one of the image communication result data according to the image communication and the received data received from the external device.

In this embodiment, the flow chart is configured to determine whether or not to input the image communication execution command and to determine whether or not to receive the image data, but the judgment order may be changed depending on the case.

Accordingly, the power source efficiency of the display device can be increased by controlling the power source applied to the image sensing unit performing the image sensing operation.

As described above, according to the present invention, the power supply efficiency can be increased by controlling the power source applied to the image pickup unit in consideration of whether or not the image communication is performed and the state of the image according to the image communication. As a result, according to the present invention, the user's convenience is greatly improved.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

Claims (18)

An image communication unit that includes an image sensing unit that senses an image and performs image communication with an external device using the image sensed through the sensing unit; And And a control unit for controlling at least one of the image sensing unit and the image communication unit if the state of the sensed image is a predetermined condition, Wherein the predetermined condition is that the brightness of the sensed image is equal to or greater than a predetermined first threshold brightness or equal to or less than a predetermined second critical brightness. The method according to claim 1, Wherein the image communication unit comprises: A power supply unit for supplying power to the image pickup unit; A data input unit for receiving communication data; And And a data transmission / reception unit for transmitting the image communication data including the captured image and the communication data to the external device, and receiving the image communication data generated by the external device. 3. The method of claim 2, Wherein, And controls the data transmitting / receiving unit to prevent the image communication data from being transmitted if the state of the captured image is the predetermined condition. 3. The method of claim 2, Wherein, And disconnects the power supplied to the image sensing unit when the state of the sensed image is the predetermined condition. delete The method according to claim 3 or 4, Wherein, And controls the data transmitting / receiving unit to prevent the image communication data from being transmitted or cut off the power supplied to the image pickup unit when the captured image is in the still image state for a predetermined threshold time. 3. The method of claim 2, And an input unit for receiving an image communication execution command, Wherein the image communication section is activated when the image communication execution command is input or when the image communication data is received through the data transmission / reception section to perform the image communication operation. 8. The method of claim 7, Wherein the control unit interrupts power supply to the image sensing unit while the image communication unit is in an inactive state. 3. The method of claim 2, A display unit; And And a display processor for selectively providing one of the image communication result data performed by the image communication unit and the received data received from the external device to the display unit under the control of the control unit. A control method of a display device for performing image communication with an external device, (a) capturing an image and performing image communication with the external device using the captured image; (b) determining whether the state of the captured image satisfies a predetermined condition; And (c) stopping the imaging processing operation when the predetermined condition is satisfied, Wherein the predetermined condition is that the brightness of the captured image is equal to or higher than a predetermined first threshold brightness or lower than a predetermined second critical brightness. 11. The method of claim 10, The step (a) Supplying power to an image sensing unit for sensing an image; Capturing an image and receiving data for communication; And And transmitting the image communication data including the captured image and the input communication data to the external device and receiving the image communication data generated by the external device. 12. The method of claim 11, Wherein the step (c) prevents the image communication data from being transmitted if the state of the captured image is a predetermined condition. 12. The method of claim 11, Wherein, in the step (c), power supplied to the image sensing unit is cut off if the state of the sensed image is a predetermined condition. delete The method according to claim 12 or 13, The step (c) Wherein the controller controls the data transmitting and receiving unit to prevent the image communication data from being transmitted or cut off the power supplied to the image pickup unit when the captured image is in the still image state for a predetermined threshold time. 12. The method of claim 11, Receiving a command for performing video communication, Wherein the step (a) performs the image communication operation when the image communication execution command is input or when the image communication data is received. 17. The method of claim 16, Wherein the power supply to the image sensing unit is interrupted while the image communication operation is not performed. 11. The method of claim 10, And selectively displaying one of image communication result data according to image communication and received data received from an external device.

Images